LeaderRebalancerTest.AddTserver: /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:435: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 2
I20260812 19:25:40.771735 19018 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:40.727604 19759 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:40.771876  4084 tablet_server.cc:178] TabletServer@127.3.253.1:0 shutting down...
I20260812 19:25:40.772339  6178 leader_election.cc:398] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23.
I20260812 19:25:40.772676  6178 leader_election.cc:401] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260812 19:25:40.775166  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:40.775976  6344 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:40.781216 19093 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:40.782366 19600 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260812 19:25:40.783643 19422 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Stepping down as leader of term 23
I20260812 19:25:40.735196 19370 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260812 19:25:40.784055 19422 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:40.784924 19422 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.786319 19436 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 25 LEADER]: Stepping down as leader of term 25
I20260812 19:25:40.786799 19436 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:40.786506 19422 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:40.793345 19754 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260812 19:25:40.793759  7553 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260812 19:25:40.789203  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:40.796911 19667 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:40.798408  6344 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 23.
I20260812 19:25:40.805433  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:40.820116 19436 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.11, Last appended by leader: 11, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.807436 19667 consensus_queue.cc:1046] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260812 19:25:40.799787  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:40.802137  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:40.844499  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:40.838637  6055 catalog_manager.cc:5495] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:40.840853  6235 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 23.
I20260812 19:25:40.840433 19436 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:40.843703 19769 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260812 19:25:40.848564 19473 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23.
I20260812 19:25:40.843492  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:40.849812 19680 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:40.847729 19714 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260812 19:25:40.856029  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:40.866858 19714 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 24 LEADER]: Stepping down as leader of term 24
I20260812 19:25:40.867276 19714 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:40.868171 19714 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.869414 19714 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:40.857450 19701 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:40.885779  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:40.880201 19776 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Leader election won for term 27
I20260812 19:25:40.889304  6344 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:40.897373  6055 catalog_manager.cc:5495] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:40.897454 19311 raft_consensus.cc:3032] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:40.910509 19311 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:40.911473 19311 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.912957 19311 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:40.916307  6359 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260812 19:25:40.899423 19731 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:40.899518 19776 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 27 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:40.934612  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:40.938272  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 44179.4us
W20260812 19:25:40.939404  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 145673us
I20260812 19:25:40.935899 19731 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 23 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:25:40.979897  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 45378.8us
W20260812 19:25:40.980502  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 182475us
I20260812 19:25:40.949486  6482 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260812 19:25:40.983826 19667 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:40.984408 19785 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260812 19:25:40.984419 19667 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:40.991611 19776 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.982458 19452 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260812 19:25:40.999995  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 53738.8us
I20260812 19:25:41.038160  6359 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260812 19:25:41.010462 19531 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260812 19:25:41.049899 19153 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260812 19:25:41.085472 19531 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:41.085902 19531 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:41.017254 19731 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.091568 19531 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:41.089917 19646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60772 (request call id 832) took 2802 ms. Trace:
I20260812 19:25:41.097805 19646 rpcz_store.cc:276] 0812 19:25:38.311247 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:38.337671 (+ 26424us) service_pool.cc:227] Handling call
0812 19:25:39.239599 (+901928us) ts_tablet_manager.cc:928] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
0812 19:25:40.407323 (+1167724us) tablet_copy_client.cc:361] Tablet copy session begun
0812 19:25:40.788397 (+381074us) tablet_metadata.cc:641] Metadata flushed
0812 19:25:40.788707 (+   310us) tablet_copy_client.cc:490] Wrote new tablet metadata
0812 19:25:41.088755 (+300048us) tablet_copy_client.cc:411] Wrote new consensus metadata
0812 19:25:41.089117 (+   362us) tablet_replica.cc:205] Creating consensus instance
0812 19:25:41.089714 (+   597us) ts_tablet_manager.cc:983] Replica registered.
0812 19:25:41.089801 (+    87us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":39699,"tablet-copy.queue_time_us":830773,"thread_start_us":769829,"threads_started":2}
W20260812 19:25:41.166785  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 123657us
I20260812 19:25:41.172963 19764 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:41.186510  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 163151us
I20260812 19:25:41.191699  6353 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:25:41.192396 19818 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260812 19:25:41.200663  6354 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260812 19:25:41.202296 19755 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:25:41.204535  6344 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260812 19:25:41.204545  6481 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260812 19:25:41.190819 19799 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260812 19:25:41.216466 19759 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260812 19:25:41.219175 19788 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.323s	user 0.000s	sys 0.004s
I20260812 19:25:41.222441 19812 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260812 19:25:41.186787 19646 tablet_copy_client.cc:791] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:25:41.191121 19764 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.231213 19667 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:41.240442  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.224133  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.245072  6055 catalog_manager.cc:5495] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:41.210996 19612 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:41.265843  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 213418us
W20260812 19:25:41.242797 19792 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260812 19:25:41.270915  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.269443  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.271641  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.272168  6297 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:41.274739  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:41.274199  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.282635  6297 leader_election.cc:334] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:41.283262  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:41.294783 19646 tablet_copy_client.cc:655] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:25:41.300156  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:25:41.304432  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 117097us
W20260812 19:25:41.305029  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.314366  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 75563.1us
I20260812 19:25:41.308918  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:41.318992  6344 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:41.323751  6470 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260812 19:25:41.324170  6470 pending_rounds.cc:76] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 13
I20260812 19:25:41.324383  6470 pending_rounds.cc:97] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260812 19:25:41.324632  6470 raft_consensus.cc:2866] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:41.272089 19612 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.328744 19612 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.306284 19600 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:41.330279 19764 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.331703  6481 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:25:41.334061  6464 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260812 19:25:41.293157 19422 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:41.343601  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:41.289446 19755 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260812 19:25:41.359045 19531 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:41.302229 19701 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:41.372634  6055 catalog_manager.cc:5495] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260812 19:25:41.399549  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 80119.4us
I20260812 19:25:41.405423  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:41.406306  6474 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:41.408092  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:41.416832  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 55872.1us
I20260812 19:25:41.423547  6055 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:41.440106  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:41.443111  6055 catalog_manager.cc:5495] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 20 to 23, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 23 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:41.418596 19608 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260812 19:25:41.448447 19674 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:41.470481  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 169381us
I20260812 19:25:41.411590 19701 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.463903 19680 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:41.461169 19436 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
W20260812 19:25:41.511313  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.462862 19018 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
W20260812 19:25:41.518101  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 86183.9us
W20260812 19:25:41.521579  6060 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38512 (request call id 234) took 55125 ms (client timeout 15000 ms). Trace:
W20260812 19:25:41.515441  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.518231  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.487138 19674 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:41.543133  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.551891  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:41.553331  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 87798.4us
W20260812 19:25:41.522919  6060 rpcz_store.cc:269] 0812 19:24:46.396615 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:46.403011 (+  6396us) service_pool.cc:227] Handling call
0812 19:25:41.521462 (+55118451us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:39.583246 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:39.583929 (+   683us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:39.584000 (+    71us) write_op.cc:435] Acquired schema lock
0812 19:25:39.584018 (+    18us) tablet.cc:660] Decoding operations
0812 19:25:39.584545 (+   527us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:39.584648 (+   103us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:39.584698 (+    50us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:25:39.585162 (+   464us) tablet.cc:699] Row locks acquired
0812 19:25:39.585193 (+    31us) write_op.cc:260] PREPARE: finished
0812 19:25:39.585406 (+   213us) write_op.cc:270] Start()
0812 19:25:39.585568 (+   162us) write_op.cc:276] Timestamp: P: 1786562739585328 usec, L: 0
0812 19:25:39.585602 (+    34us) op_driver.cc:331] REPLICATION: starting
0812 19:25:39.586356 (+   754us) log.cc:842] Serialized 917 byte log entry
0812 19:25:40.179218 (+592862us) op_driver.cc:444] REPLICATION: finished
0812 19:25:40.392806 (+213588us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f483e5fe 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98fb188410
0812 19:25:40.669739 (+276933us) write_op.cc:301] APPLY: starting
0812 19:25:40.669895 (+   156us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:40.696850 (+ 26955us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:40.696893 (+    43us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:40.698220 (+  1327us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:40.698491 (+   271us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0812 19:25:40.698556 (+    65us) write_op.cc:312] APPLY: finished
0812 19:25:40.710317 (+ 11761us) log.cc:842] Serialized 33 byte log entry
0812 19:25:40.711322 (+  1005us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:40.711423 (+   101us) write_op.cc:454] Released schema lock
0812 19:25:40.711492 (+    69us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:40.725617 (+ 14125us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:40.728195 (+  2578us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10427,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":402621,"apply.run_cpu_time_us":5942,"apply.run_wall_time_us":97806,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12499,"num_ops":2,"prepare.queue_time_us":472778,"prepare.run_cpu_time_us":52989,"prepare.run_wall_time_us":270031,"raft.queue_time_us":91469,"raft.run_cpu_time_us":59266,"raft.run_wall_time_us":369489,"replication_time_us":572150,"spinlock_wait_cycles":6369024,"thread_start_us":636715,"threads_started":4,"wal-append.queue_time_us":348251}]]}
W20260812 19:25:41.562203  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 102507us
I20260812 19:25:41.561401 19608 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
W20260812 19:25:41.560160 19820 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260812 19:25:41.599476  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:41.586347 19754 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:41.590269 19093 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:41.599071 19764 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:41.604445 19018 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:41.605795 19370 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260812 19:25:41.629081  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.632881  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:41.621177 19608 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:41.649812  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:41.620568 19093 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:25:41.662352 19840 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260812 19:25:41.620878 19754 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.651376 19646 tablet_copy_client.cc:531] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:25:41.643554 19701 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.628159 19018 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.630466 19764 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.660701 19093 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:41.653169 19608 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:41.700560 19843 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.069s	user 0.000s	sys 0.003s
I20260812 19:25:41.691886 19612 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:41.692142 19674 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.705246 19680 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:41.725428 19667 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:41.729977 19667 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:41.690244  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.722162  6344 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260812 19:25:41.726788 19680 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:41.735626 19754 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.727460 19612 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.740494 19608 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:41.746723  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 61049.4us
W20260812 19:25:41.751784  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 189985us
W20260812 19:25:41.752822  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.757629  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.750224 19018 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.775523  6354 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260812 19:25:41.783004 19667 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:41.773562 19701 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:41.771581 19754 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:41.751097 19473 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:41.814709 19612 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:41.817026  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.817953  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.827771 19764 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.804965 19754 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:41.835374 19833 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.131s	user 0.003s	sys 0.000s
I20260812 19:25:41.851366 19754 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:41.801622 19701 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:41.852288 19856 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260812 19:25:41.853921 19701 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:41.858232  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.858705  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 90881.9us
W20260812 19:25:41.859320  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.860071  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.860769  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.861459  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.861994  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.806737 19473 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.864835 19473 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.873690  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:41.874482  7591 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:41.878378  6298 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:25:41.879631 19830 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.465s	user 0.000s	sys 0.005s
I20260812 19:25:41.882292 19837 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:41.882807 19837 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:41.883179 19837 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:41.898756  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:41.899645  6474 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:41.901006  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:41.901917  6482 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 23: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:41.903935 19680 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:41.899000  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.906872 19680 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:41.889810 19093 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:41.862509  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.910140  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 47666us
W20260812 19:25:41.907439  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.913884  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:25:41.914887  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.918495  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:41.919315  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.922389  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:25:41.922942  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.926331 19667 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:41.919205  6347 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 25.
I20260812 19:25:41.927016 19667 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.928872 19093 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.929642 19667 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:41.934768 19646 tablet_bootstrap.cc:492] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:25:41.934453 19837 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:41.937335 19837 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:41.938362  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:41.939260  7591 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Advancing to term 22
W20260812 19:25:41.942422  6297 leader_election.cc:334] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260812 19:25:41.949154  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.951828  6297 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:41.955152  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:25:41.959148  6297 leader_election.cc:334] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260812 19:25:41.961467  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 184344us
I20260812 19:25:41.950296 19473 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:41.954960 19452 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260812 19:25:41.958340 19680 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:41.979831  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:41.963135 19701 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:41.985102  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:41.980638  6353 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:41.958120 19311 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
I20260812 19:25:41.991644  6482 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:41.993535  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:41.991329  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:41.997198  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:41.996757  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:41.998714  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:41.999258  6474 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:42.000142  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:42.000236  6344 raft_consensus.cc:2379] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 22: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:41.997548  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:41.997927  6483 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:42.001680  6482 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:42.006539  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:42.007222  6482 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:42.005900  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:42.008685  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:42.024624  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 66790.3us
I20260812 19:25:42.030841  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:42.027007  7591 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:42.009298 19436 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260812 19:25:42.038218 19436 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:41.989490 19701 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.039274 19436 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:42.041013 19701 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:42.022814 19582 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:42.047919 19608 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:42.049882 19582 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:42.055311 19311 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:42.055516 19370 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.055827 19311 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.056339 19311 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:42.056244 19370 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.058491 19370 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.066093  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.050918 19436 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.070638  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:42.078181  6474 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:42.074074  6482 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:41.981933 19473 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.084123  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.084841  6344 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 24.
I20260812 19:25:42.086673  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.088498  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.089310  6475 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
I20260812 19:25:42.091991  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.094426  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:42.097033 19622 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:42.099995  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:42.100025  6298 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:42.103396  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.104277  6482 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:42.107501  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.127187  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.081362 19837 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:42.084842 19473 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:42.087949 19769 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:42.118971 19582 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:42.135643 19608 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:42.104918 19805 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:42.118415 19622 raft_consensus.cc:686] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:42.177472  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:42.128227 19436 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.119613 19862 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:42.157675 19837 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:42.136222 19531 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:42.184965  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:42.187623  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.105590 19828 consensus_queue.cc:1046] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.077s
I20260812 19:25:42.160174 19842 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:42.199566  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:42.151648 19311 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.208626 19311 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:42.209327  6482 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:42.182785 19608 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:42.192371 19755 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.190388 19837 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:42.197906 19582 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:42.203660 19627 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:42.200814 19452 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.217574 19608 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:42.195029 19531 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.274286 19452 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.196702 19769 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.274228 19018 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:25:42.278591  6297 leader_election.cc:334] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.303790 19452 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:42.239830 19755 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.276319 19473 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:25:42.308076  6297 leader_election.cc:334] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.283118 19627 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.310457  6482 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 26.
I20260812 19:25:42.189033 19805 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.325842  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:42.204849 19842 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.329423  6344 raft_consensus.cc:2354] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 25. Current term is 26.
I20260812 19:25:42.194105 19862 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:42.356743  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 179472us
I20260812 19:25:42.282251 19622 consensus_queue.cc:237] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.316147 19018 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.320657 19627 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.349212 19863 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:42.321075 19473 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.377983  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:42.377671  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 278568us
I20260812 19:25:42.352087 19889 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:42.357869 19841 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.320188 19582 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:42.400286  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 80516.8us
I20260812 19:25:42.401392  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:42.386776 19863 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.451537 19018 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:42.452502 19863 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.453166 19805 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:42.405076 19841 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.455708 19841 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:42.468353  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 66098.3us
I20260812 19:25:42.469581  6416 leader_election.cc:398] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 25. Current term is 26.
I20260812 19:25:42.470012  6416 leader_election.cc:401] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
W20260812 19:25:42.492091  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 90126.2us
I20260812 19:25:42.441088 19531 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.493726  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.435092 19759 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.494822 19759 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.495893 19862 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:42.501847  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 110962us
I20260812 19:25:42.511395  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.489446 19892 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.532267  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:42.509922 19769 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:42.506361 19900 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:42.536778  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.524974 19531 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.557231  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.397946 19889 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:42.565409  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 96053.2us
I20260812 19:25:42.568500  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.570906  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.572271  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:42.581682  6416 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260812 19:25:42.582799  6416 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.544864 19153 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 25. Current term is 26.
I20260812 19:25:42.552038 19755 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:42.584105  6297 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.552583 19900 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.588395  6359 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 26.
I20260812 19:25:42.563575 19849 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election won for term 26
W20260812 19:25:42.588070 19886 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260812 19:25:42.532687 19892 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.615924 19889 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.617336 19892 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.619634  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.620940  6482 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 25.
I20260812 19:25:42.626355 19772 raft_consensus.cc:3032] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:42.626907 19772 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:42.627869 19772 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.563828 19531 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.595230 19900 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:42.600128 19842 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:42.659286  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:42.669060  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.679332  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.671360  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:42.731007 19888 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.330s	user 0.004s	sys 0.000s
I20260812 19:25:42.731451 19769 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:42.732059 19769 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:42.734305 19769 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:42.734547 19370 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:42.736080 19370 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.738219 19370 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.654682 19849 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:42.741386 19849 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.696523 19896 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260812 19:25:42.747077 19896 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.747632 19896 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:42.694614 19754 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260812 19:25:42.751029 19754 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:42.751446 19754 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Advancing to term 27
I20260812 19:25:42.653292 19531 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:42.753913  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 171468us
I20260812 19:25:42.651556 19473 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:42.641652 19837 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.769275  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:42.770155  6482 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
W20260812 19:25:42.785929  6297 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.769009 19837 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.771626 19531 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.771157 19473 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.804211  6482 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:42.805801  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:42.789135 19769 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.808259 19769 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.809114 19627 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.807533 19927 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.810588 19769 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.811354 19927 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.814342 19927 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:42.820869  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 121774us
W20260812 19:25:42.821599  6416 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260812 19:25:42.822724  6416 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.785359 19608 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.824965 19608 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.826967 19804 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:42.827539 19804 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:42.829682 19804 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:42.800595 19473 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.833549 19612 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:42.834157 19473 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.834192 19612 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:42.846513 19612 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.800706 19531 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.851032 19531 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:42.838100 19917 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260812 19:25:42.855217  6055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 126) took 3774 ms. Trace:
I20260812 19:25:42.855743  6055 rpcz_store.cc:276] 0812 19:25:39.080659 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:39.080870 (+   211us) service_pool.cc:227] Handling call
0812 19:25:42.855112 (+3774242us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:41.627081 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:41.729688 (+102607us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:41.729728 (+    40us) write_op.cc:435] Acquired schema lock
0812 19:25:41.729763 (+    35us) tablet.cc:660] Decoding operations
0812 19:25:41.730696 (+   933us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:41.730756 (+    60us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:41.730786 (+    30us) tablet.cc:683] Acquiring locks for 6 operations
0812 19:25:41.811984 (+ 81198us) tablet.cc:699] Row locks acquired
0812 19:25:41.819554 (+  7570us) write_op.cc:260] PREPARE: finished
0812 19:25:41.837736 (+ 18182us) write_op.cc:270] Start()
0812 19:25:41.865455 (+ 27719us) write_op.cc:276] Timestamp: P: 1786562741837025 usec, L: 0
0812 19:25:41.865491 (+    36us) op_driver.cc:331] REPLICATION: starting
0812 19:25:41.866383 (+   892us) log.cc:842] Serialized 2416 byte log entry
0812 19:25:42.324752 (+458369us) op_driver.cc:444] REPLICATION: finished
0812 19:25:42.581232 (+256480us) write_op.cc:301] APPLY: starting
0812 19:25:42.584302 (+  3070us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:42.621745 (+ 37443us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:42.621898 (+   153us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:42.646848 (+ 24950us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:42.649357 (+  2509us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0812 19:25:42.649431 (+    74us) write_op.cc:312] APPLY: finished
0812 19:25:42.649778 (+   347us) log.cc:842] Serialized 65 byte log entry
0812 19:25:42.649973 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:42.650140 (+   167us) write_op.cc:454] Released schema lock
0812 19:25:42.650222 (+    82us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:42.651814 (+  1592us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:42.651850 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":558354,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":214742,"apply.run_cpu_time_us":12969,"apply.run_wall_time_us":86364,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29243,"num_ops":6,"prepare.queue_time_us":132602,"prepare.run_cpu_time_us":21404,"prepare.run_wall_time_us":360105,"raft.queue_time_us":308371,"raft.run_cpu_time_us":7890,"raft.run_wall_time_us":196580,"replication_time_us":459138,"thread_start_us":478654,"threads_started":4,"wal-append.queue_time_us":132431}]]}
I20260812 19:25:42.843204  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.870173  6347 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 21: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:42.794765 19759 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.859480 19896 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.860368 19900 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.863437 19754 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:42.864964  6416 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.866851 19531 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:42.838769  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:25:42.872731  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 103528us
I20260812 19:25:42.870535 19473 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:42.883010  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 44545.3us
I20260812 19:25:42.886595  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:42.893064  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:42.894882  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:42.896973  6483 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:42.889483 19759 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:42.909319  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:42.889559 19878 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:42.912441  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:42.908384 19018 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260812 19:25:42.931154  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:42.911885 19769 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:42.911059 19759 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.914680 19627 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:25:42.935197  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 100047us
I20260812 19:25:42.886739 19531 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.950810  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.892068 19473 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.923133 19370 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:25:42.950129  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.955852  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.954105  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.956884  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.959630  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:42.959652 19922 consensus_queue.cc:1159] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdfa5579d4534c618c00db6b4a841c81" responder_term: 19 status { last_received { term: 18 index: 15 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:25:42.961627  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.962379  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.964077  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:42.964928  6297 leader_election.cc:334] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.965359  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.966584 19473 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.967981 19531 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.968346  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.969641 19772 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:42.969815 19900 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:42.969918  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.971323  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.929455 19849 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:42.954013  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.954195  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.977922  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:42.985111 19754 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 27 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.936702 19608 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:42.986785  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.987929  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.992755  6349 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 24.
I20260812 19:25:42.946323 19759 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:42.996486  6473 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260812 19:25:42.955107 19918 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:42.998692 19918 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:43.001710 19918 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:43.001746 19759 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:43.003479 19929 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260812 19:25:43.023985 19841 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:43.024545  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.024552 19841 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.025964  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.026081  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:43.027052 19841 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.027745 19898 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election won for term 24
I20260812 19:25:43.004488  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.006124  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.007216  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.018555 19805 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:43.019783 19759 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.030146  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.031178  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.032655  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.032856  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.036765  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.037632  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:43.037858 19805 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.046116  6470 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:43.046234  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.047027  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.047631 19805 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.048594  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.048847  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:43.043141  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.049772  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.050151  6344 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:43.050400  6349 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 24.
I20260812 19:25:43.043448  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.053802  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:43.055856  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.059031  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:43.067746  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.067904  6465 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260812 19:25:43.070437  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:43.071044  6477 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Advancing to term 27
I20260812 19:25:43.072110  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:43.076901  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.077535  6470 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 24.
I20260812 19:25:43.034874 19898 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 24 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:43.063225 19842 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:43.078538 19370 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:43.091323  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.069921 19759 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:43.014452 19849 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:43.089496  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.097339  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.093983  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:43.102286  6475 raft_consensus.cc:2354] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23.
I20260812 19:25:43.102788  6481 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 26: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:43.101959  6477 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 27.
I20260812 19:25:43.076225 19903 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260812 19:25:43.104900  6359 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
W20260812 19:25:43.110426  6416 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:43.105515  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.096872 19370 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:25:43.116360  6477 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 27: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:43.116601  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:43.115993  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:43.121579 19805 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:43.125290  6344 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 24.
I20260812 19:25:43.129055 19849 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.126610  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:43.136435  6178 leader_election.cc:398] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23.
I20260812 19:25:43.136924  6178 leader_election.cc:401] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
W20260812 19:25:43.149155  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 76902.4us
I20260812 19:25:43.133356 19878 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:43.136200 19842 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader election won for term 24
W20260812 19:25:43.148845  6416 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:43.150390  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.155313  6483 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:43.158070  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.155669  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:43.160444  6352 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 27: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:43.162441 19370 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.168679  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:43.168104  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.150430 19825 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:43.155068 19899 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:43.172006  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.182184  6359 raft_consensus.cc:2354] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 26. Current term is 27.
I20260812 19:25:43.160799 19842 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 24 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:43.184087 19842 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.186414  6046 catalog_manager.cc:5495] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 13 to 17, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 17 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:25:43.191216 19940 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260812 19:25:43.193506  6046 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 15 to 18, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 18 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:43.196704  6046 catalog_manager.cc:5495] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:43.199375  6046 catalog_manager.cc:5495] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 14 to 18, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 18 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:43.202841 19370 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:43.131781 19898 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.173523  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:43.171689 19900 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:43.175779 19825 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.212374 19825 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:43.217394  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45054.4us
I20260812 19:25:43.218357  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:43.175799  6416 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260812 19:25:43.219558  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 43794.7us
I20260812 19:25:43.222150 19754 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:43.161408 19896 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:43.226884 19939 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260812 19:25:43.229293  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.230007  6483 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
W20260812 19:25:43.238150  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 64677.9us
I20260812 19:25:43.238878  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.239080  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.241036  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.243427  6416 leader_election.cc:398] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 26. Current term is 27.
I20260812 19:25:43.244216  6416 leader_election.cc:401] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260812 19:25:43.247511  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.261001  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.263458  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:43.245060 19909 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Leader election won for term 27
I20260812 19:25:43.267071 19913 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:43.251833 19370 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260812 19:25:43.270725  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:43.263200 19608 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:43.245285 19825 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:43.296656 19902 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 26. Current term is 27.
I20260812 19:25:43.298439 19909 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:43.299512 19909 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.11, Last appended by leader: 11, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.270218  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:43.260826 19805 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:43.258143 19841 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:43.305047  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.315351  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.269199 19899 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23.
I20260812 19:25:43.319620  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.321808  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.317548 19608 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260812 19:25:43.310109 19370 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260812 19:25:43.310110  6297 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:43.342515  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:43.344923 19913 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:43.345270 19910 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:43.345759 19910 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:43.346113 19910 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:43.323673 19841 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:43.323241 19825 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:43.357407  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.360910  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:43.364261  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.365860  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.368567 19608 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:43.373960  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.363174 19825 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:43.380795  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.366393 19842 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:43.366911 19841 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:43.389104 19841 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:43.389684 19841 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Advancing to term 25
W20260812 19:25:43.395161  6297 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:43.399609  7591 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260812 19:25:43.383849 19759 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:43.404014  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:43.398764 19842 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:43.410797  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.412359 19805 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:43.412489  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:43.413319  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:43.414119 19825 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:43.414557 19825 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:43.414939 19825 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:43.416354 19805 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Advancing to term 27
I20260812 19:25:43.420626  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.425911 19805 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260812 19:25:43.427759  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.412236 19849 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
W20260812 19:25:43.449453 19942 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.140s	user 0.004s	sys 0.000s
I20260812 19:25:43.461906  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.446177 19627 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:43.465298 19899 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:43.477854  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:43.472057 19944 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260812 19:25:43.483510 19701 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260812 19:25:43.488458  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:43.468466 19627 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.500412  6473 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260812 19:25:43.505517 19627 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.519204 19842 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:43.528707 19841 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.506166 19093 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260812 19:25:43.539377  6473 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260812 19:25:43.547423 19910 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:43.552884 19910 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.541488 19825 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:43.564028 19825 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:43.570925 19841 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:43.573287  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 66711.4us
I20260812 19:25:43.576380  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.580684  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.584882  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:43.585649  6344 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:43.588563  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:43.589481  6465 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:43.594841  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:43.595535  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:43.596483  6349 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 22: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:43.605835  6344 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 25.
I20260812 19:25:43.600282  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:43.617627  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.620800 19018 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:25:43.633721  6417 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:43.636380  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:43.637650 19825 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader election won for term 25
I20260812 19:25:43.638172 19825 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 25 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:43.638952  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.640020 19805 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:43.595722 19093 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
W20260812 19:25:43.640638  6297 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:43.660887 19825 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.662727  6465 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:43.665644 19018 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:43.666290 19018 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.668412 19018 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.681465 19646 tablet_bootstrap.cc:492] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:25:43.684746 19646 tablet_bootstrap.cc:492] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:25:43.685709 19646 ts_tablet_manager.cc:1397] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 1.751s	user 0.060s	sys 0.037s
I20260812 19:25:43.689747  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.696715  6349 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 24. Current term is 25. Ops: []
I20260812 19:25:43.701989  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.708155  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.710865 19018 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:43.712611  6473 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260812 19:25:43.724924  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:43.725950 19422 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:43.726675 19422 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:43.727531 19422 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:43.734953 19902 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.005s
I20260812 19:25:43.740867 19878 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 24 LEADER]: Stepping down as leader of term 24
I20260812 19:25:43.741339 19878 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:43.746043  6482 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 25 index: 11. Preceding OpId from leader: term: 27 index: 12. (index mismatch)
I20260812 19:25:43.745667 19878 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:43.742978  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:43.738065 19018 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260812 19:25:43.778491 19878 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:43.798904 19754 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:25:43.806638  6344 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260812 19:25:43.809638 19825 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
W20260812 19:25:43.857537  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:43.881908 19646 raft_consensus.cc:348] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:25:43.883096 19646 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:25:43.884068 19646 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:25:43.950990 19878 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:43.951743 19878 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:43.948342 19646 ts_tablet_manager.cc:1428] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.262s	user 0.007s	sys 0.004s
I20260812 19:25:43.966056 19878 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:43.972527  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.975919  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:43.976761  7591 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:43.979154  6417 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:43.989163 19898 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:43.989679 19898 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:43.990057 19898 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:43.999612  6049 catalog_manager.cc:5495] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.001241  6049 catalog_manager.cc:5495] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 16 to 22, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 22 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.012502  6049 catalog_manager.cc:5495] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.014954  6500 tablet_copy_service.cc:342] P bdfa5579d4534c618c00db6b4a841c81: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-2661573faf994c8f9bb837f55af974d9 received from {username='slave'} at 127.0.0.1:33386
I20260812 19:25:44.015465  6500 tablet_copy_service.cc:433] P bdfa5579d4534c618c00db6b4a841c81: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-2661573faf994c8f9bb837f55af974d9 on tablet 2661573faf994c8f9bb837f55af974d9 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:44.014504  6049 catalog_manager.cc:5495] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 16 to 20, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 20 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.019956  6049 catalog_manager.cc:5495] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.021626  6049 catalog_manager.cc:5495] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.031720  6049 catalog_manager.cc:5495] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 17 to 19, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 19 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.033784  6049 catalog_manager.cc:5495] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.035785  6049 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 22, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:25:44.048333  6046 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38512 (request call id 235) took 32980 ms (client timeout 15000 ms). Trace:
I20260812 19:25:44.049501  6049 catalog_manager.cc:5495] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 21 to 22, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.051338  6049 catalog_manager.cc:5495] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.053486  6049 catalog_manager.cc:5495] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 16 to 18, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 18 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.066947 19842 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:44.067582 19842 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:44.069813 19842 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:44.070245  6049 catalog_manager.cc:5495] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 11 to 20, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 20 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.072165  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:44.074191  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:44.079031  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:44.080189 19842 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:44.072844  6049 catalog_manager.cc:5495] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 17 to 21, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 21 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
W20260812 19:25:44.093222  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.094374 19898 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:44.099187 19898 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:44.099843  6049 catalog_manager.cc:5495] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 20, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 20 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.104882  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:44.121572  6049 catalog_manager.cc:5495] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.123281  6049 catalog_manager.cc:5495] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 19 to 21, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 21 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.117571  6347 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260812 19:25:44.126931  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.131090  6049 catalog_manager.cc:5495] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.129920  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:44.137234  7591 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Advancing to term 20
W20260812 19:25:44.055259  6046 rpcz_store.cc:269] 0812 19:25:11.067965 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:11.097664 (+ 29699us) service_pool.cc:227] Handling call
0812 19:25:44.048232 (+32950568us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:43.559477 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:43.560048 (+   571us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:43.560094 (+    46us) write_op.cc:435] Acquired schema lock
0812 19:25:43.560121 (+    27us) tablet.cc:660] Decoding operations
0812 19:25:43.563922 (+  3801us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:43.563999 (+    77us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:43.564023 (+    24us) tablet.cc:683] Acquiring locks for 4 operations
0812 19:25:43.564405 (+   382us) tablet.cc:699] Row locks acquired
0812 19:25:43.564424 (+    19us) write_op.cc:260] PREPARE: finished
0812 19:25:43.564574 (+   150us) write_op.cc:270] Start()
0812 19:25:43.564688 (+   114us) write_op.cc:276] Timestamp: P: 1786562743564527 usec, L: 0
0812 19:25:43.564717 (+    29us) op_driver.cc:331] REPLICATION: starting
0812 19:25:43.565866 (+  1149us) log.cc:842] Serialized 1682 byte log entry
0812 19:25:43.589442 (+ 23576us) op_driver.cc:444] REPLICATION: finished
0812 19:25:43.835704 (+246262us) write_op.cc:301] APPLY: starting
0812 19:25:43.841482 (+  5778us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:43.859663 (+ 18181us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:43.860942 (+  1279us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:43.927527 (+ 66585us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:43.927754 (+   227us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0812 19:25:43.927814 (+    60us) write_op.cc:312] APPLY: finished
0812 19:25:43.928082 (+   268us) log.cc:842] Serialized 49 byte log entry
0812 19:25:43.928280 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:43.928397 (+   117us) write_op.cc:454] Released schema lock
0812 19:25:43.928447 (+    50us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:43.947204 (+ 18757us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:43.947239 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3520,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":239701,"apply.run_cpu_time_us":8556,"apply.run_wall_time_us":115306,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20871,"num_ops":4,"prepare.queue_time_us":204514,"prepare.run_cpu_time_us":3389,"prepare.run_wall_time_us":21141,"replication_time_us":24606,"thread_start_us":255162,"threads_started":2}]]}
I20260812 19:25:44.137666 19825 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260812 19:25:44.143980  6482 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 17. (term mismatch)
I20260812 19:25:44.144394  6482 pending_rounds.cc:76] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 16
I20260812 19:25:44.144622  6482 pending_rounds.cc:97] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 24.17
I20260812 19:25:44.144866  6482 raft_consensus.cc:2866] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:44.146114  6049 catalog_manager.cc:5495] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.148051 19769 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260812 19:25:44.154232  4084 thread.cc:536] Waited for 1000ms trying to join with heartbeat (tid 6273)
I20260812 19:25:44.160871  6049 catalog_manager.cc:5495] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 20, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:25:44.175436  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.171303  6049 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 19 to 20, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.158982  7591 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:44.179212  6417 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:44.180033 19898 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:44.181003  6049 catalog_manager.cc:5495] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 19 to 20, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 20 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.182309 19898 raft_consensus.cc:686] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:44.184274 19898 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:44.205056  7591 raft_consensus.cc:1203] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 LEARNER]: Deduplicated request from leader. Original: 21.11->[21.12-21.12]   Dedup: 21.12->[]
I20260812 19:25:44.222294  6483 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260812 19:25:44.226286 19769 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:44.235044 19769 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:44.227967  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.241667 19769 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:44.243234  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:44.245810  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:44.248670  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:44.251185 19842 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:44.240859 19612 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
W20260812 19:25:44.276988  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.285665  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.324091  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.327490  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:44.387121  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.388264  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.409771  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.446977  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.471204  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.472584  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.500083 19841 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:44.500798 19841 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:44.505388 19841 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:44.505422  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:44.507037  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:44.508646  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:44.510596 19841 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:25:44.525833  6046 catalog_manager.cc:5495] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index -1 to 12, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 21 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:25:44.527841  6046 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:25:44.536022  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.549950  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.567405  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.579617  7591 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260812 19:25:44.581022 19878 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260812 19:25:44.586294 19825 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:44.587020 19825 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:44.592121 19898 raft_consensus.cc:1050] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:25:44.592262  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:44.595682 19825 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:44.595860  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:44.597198 19898 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 10, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:44.599730  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:44.604820 19825 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:44.608042 19825 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:44.608647 19825 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:44.629803  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:44.636898 19825 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:44.637938  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:44.639228  6349 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260812 19:25:44.639614  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.647286  7598 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 LEARNER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260812 19:25:44.647193  6179 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:44.654943 19825 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:44.647004 19918 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260812 19:25:44.678339 19878 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
W20260812 19:25:44.697014  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.707151  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.716781  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:44.720544  6060 catalog_manager.cc:5495] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.726557  6060 catalog_manager.cc:5495] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 20 to 21, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 21 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.729084  6060 catalog_manager.cc:5495] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 22, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 22 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.736353 19849 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:44.737185 19849 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:44.739459 19849 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:44.740497  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:44.743453  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:44.744299  6060 catalog_manager.cc:5495] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.746227  6060 catalog_manager.cc:5495] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 18 to 24, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 24 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:25:44.748322  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.748692  6347 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 20
I20260812 19:25:44.749135  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:44.753953  6060 catalog_manager.cc:5495] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 19 to 25, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 25 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.756330  6060 catalog_manager.cc:5495] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 21 to 24, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 24 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:44.757869  6060 catalog_manager.cc:5495] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.759470  6060 catalog_manager.cc:5495] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 19, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 19 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.761049  6060 catalog_manager.cc:5495] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 19 to 26. New cstate: current_term: 26 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.762224  6060 catalog_manager.cc:5495] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:25:44.783171  6049 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 244) took 16111 ms (client timeout 15000 ms). Trace:
I20260812 19:25:44.787220  6060 catalog_manager.cc:5495] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 20 to 24, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 24 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.790462  6060 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 22 to 23, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 23 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
W20260812 19:25:44.796183  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.797595  6060 catalog_manager.cc:5495] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.801185  6347 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260812 19:25:44.809466 19422 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:44.805500 19841 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:44.811925 19841 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:44.783658  6049 rpcz_store.cc:269] 0812 19:25:28.671890 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:28.680377 (+  8487us) service_pool.cc:227] Handling call
0812 19:25:44.783059 (+16102682us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:44.268515 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:44.269025 (+   510us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:44.269058 (+    33us) write_op.cc:435] Acquired schema lock
0812 19:25:44.269074 (+    16us) tablet.cc:660] Decoding operations
0812 19:25:44.321391 (+ 52317us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:44.321478 (+    87us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:44.321503 (+    25us) tablet.cc:683] Acquiring locks for 22 operations
0812 19:25:44.323068 (+  1565us) tablet.cc:699] Row locks acquired
0812 19:25:44.323089 (+    21us) write_op.cc:260] PREPARE: finished
0812 19:25:44.323243 (+   154us) write_op.cc:270] Start()
0812 19:25:44.323377 (+   134us) write_op.cc:276] Timestamp: P: 1786562744323193 usec, L: 0
0812 19:25:44.323402 (+    25us) op_driver.cc:331] REPLICATION: starting
0812 19:25:44.324019 (+   617us) log.cc:842] Serialized 8558 byte log entry
0812 19:25:44.390816 (+ 66797us) op_driver.cc:444] REPLICATION: finished
0812 19:25:44.391190 (+   374us) write_op.cc:301] APPLY: starting
0812 19:25:44.391290 (+   100us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:44.411328 (+ 20038us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:44.411425 (+    97us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:44.508775 (+ 97350us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:44.509103 (+   328us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0812 19:25:44.509145 (+    42us) write_op.cc:312] APPLY: finished
0812 19:25:44.511111 (+  1966us) log.cc:842] Serialized 196 byte log entry
0812 19:25:44.523153 (+ 12042us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:44.523376 (+   223us) write_op.cc:454] Released schema lock
0812 19:25:44.523434 (+    58us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:44.523768 (+   334us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:44.523795 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34971,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":93,"apply.run_cpu_time_us":28001,"apply.run_wall_time_us":133018,"cfile_cache_hit":88,"cfile_cache_hit_bytes":92092,"num_ops":22,"prepare.queue_time_us":59929,"prepare.run_cpu_time_us":6325,"prepare.run_wall_time_us":55836,"replication_time_us":67291,"thread_start_us":31825,"threads_started":1}]]}
I20260812 19:25:44.808496  6060 catalog_manager.cc:5495] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 20 to 22, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 22 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
W20260812 19:25:44.815857  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.815766  6060 catalog_manager.cc:5495] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 16 to 25. New cstate: current_term: 25 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.819087  6060 catalog_manager.cc:5495] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 20 to 23, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 23 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.818475 19878 raft_consensus.cc:2932] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index 12 to 13, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:44.820272  6060 catalog_manager.cc:5495] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 18, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 18 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.821419  6060 catalog_manager.cc:5495] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.823331 19898 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260812 19:25:44.822492  6060 catalog_manager.cc:5495] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 21 to 25, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 25 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.984978 19841 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:44.986620  6060 catalog_manager.cc:5495] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 25, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 25 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.984409  6349 raft_consensus.cc:2932] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:45.011183 19825 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:25:45.061582  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 67242.4us
I20260812 19:25:45.063741  7591 raft_consensus.cc:2932] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:45.051965 19825 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.079562 19825 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.092674 19998 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:45.121136  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 76029.9us
I20260812 19:25:45.121117  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.120105 19998 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.104996 19825 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:45.143913 19998 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.145474 19998 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:45.146035 19998 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.122313  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:45.158952  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44576.6us
W20260812 19:25:45.159780  4084 thread.cc:536] Waited for 2000ms trying to join with heartbeat (tid 6273)
W20260812 19:25:45.175200  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 52722us
I20260812 19:25:45.188633  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.194713  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.200410 19998 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.141463 19825 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.220152 19825 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.214815 19841 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:45.223610 19841 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.225884 19841 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.230834 19841 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:45.231411 19841 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:45.233582 19841 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:45.275558  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:45.278409  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:45.280313  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.285410  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.289059  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.285463  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.288113  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.293529  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.303182  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.303283  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.303313  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:45.309476  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 51495.2us
I20260812 19:25:45.282519 19842 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:45.295136 20001 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:45.321789 19842 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.309562 19769 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:45.303086 20024 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:45.339428  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:45.315186 19627 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:45.342533 19841 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:45.323576 20021 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:45.330981 19842 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.354312 19627 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:45.363281 19627 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:45.338798 19769 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.368695 19769 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:45.374099  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 56939us
W20260812 19:25:45.380129  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60562.2us
I20260812 19:25:45.342392 20001 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.384163 20001 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.359969 19841 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.388517 19841 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.370456 20021 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.391319 20021 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.345404 20024 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:45.393930 20024 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:45.412757  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:45.417891 20001 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:45.419490 20001 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.421573 20001 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.415125 19841 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:45.422376 19841 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.423674  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:45.424319  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:45.425061 19627 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:45.424523 19841 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.425617 19627 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.426841  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.429581 19627 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.432426 20025 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260812 19:25:45.434192  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.435070 20026 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:45.440120 20041 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:45.440662 20041 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:45.442858 20041 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:45.455847  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:45.456485  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:45.456874  6179 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:45.458747  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.460098 20024 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:45.477566 20041 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:45.486908 19627 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:45.487252  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:45.487396  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.488243 19627 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:45.488672  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.491377  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.494450  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.494536  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.495764  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.495838  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.495787  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.497073  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.498219 20041 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:45.501221  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.502099  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.503445  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.504961  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.497133  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.507464  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.510620 19627 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:45.510891 20041 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:45.511282 19627 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.511446 20041 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.513288  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.513603 20041 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.513568 19627 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.515021  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.517102  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.518447  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.514567  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.520884  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.522980  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.524052  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.524778  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:45.525574 20041 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:45.527143 19627 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:45.527655 19627 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:45.529677 19627 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:45.538239  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.538823  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:45.540515  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.551100 19627 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:45.551797 19627 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.554000 19627 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.554575  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:45.558493  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:45.562078  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:45.562767  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:45.563452  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.564330 19627 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:45.565075  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.566287 19627 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:45.593674  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.595510 20041 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:45.597373  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.598945 20041 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260812 19:25:45.593739  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:45.600720  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:25:45.600776  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:45.602351  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.609583  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.601667 20041 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:45.610853 20024 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:45.608207 19627 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:45.611595 20024 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:45.612844  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.613771 20024 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:45.612282 19627 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:45.615234  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.615963 19627 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:45.616098 20024 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:45.617115  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:45.618798 20024 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:45.623410  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.624635  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.624867 19627 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:45.628520 20026 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:45.630944  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:45.640846 20024 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:45.644681  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.647243  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.650940  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.655519  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.656508 20024 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:45.662803  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:45.666047  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:45.677022  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.677873 20026 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:45.734886  6046 catalog_manager.cc:5495] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:45.758443  6044 maintenance_manager.cc:419] P 4483e3a69e644cbea699c6f7c9c1da9e: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033360
I20260812 19:25:45.793167  6060 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 201) took 2097 ms. Trace:
I20260812 19:25:45.793699  6060 rpcz_store.cc:276] 0812 19:25:43.695558 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:43.697570 (+  2012us) service_pool.cc:227] Handling call
0812 19:25:43.737696 (+ 40126us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b5400002dd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fdaf0 00007f98f7780f2a 00007f98fd6d2d6c 00007f98fd7ccc3e 00007f98fbadefb4 00007f98fbadef42 00007f98fbadee71 00007f98fbadedec 00007f98fbade0a2 00007f98f5bae94c 00007f98f5badd86
0812 19:25:45.793071 (+2055375us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:45.205554 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:45.206193 (+   639us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:45.206228 (+    35us) write_op.cc:435] Acquired schema lock
0812 19:25:45.206239 (+    11us) tablet.cc:660] Decoding operations
0812 19:25:45.207923 (+  1684us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:45.207983 (+    60us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:45.208011 (+    28us) tablet.cc:683] Acquiring locks for 21 operations
0812 19:25:45.216520 (+  8509us) tablet.cc:699] Row locks acquired
0812 19:25:45.216542 (+    22us) write_op.cc:260] PREPARE: finished
0812 19:25:45.216695 (+   153us) write_op.cc:270] Start()
0812 19:25:45.216823 (+   128us) write_op.cc:276] Timestamp: P: 1786562745216644 usec, L: 0
0812 19:25:45.216845 (+    22us) op_driver.cc:331] REPLICATION: starting
0812 19:25:45.217586 (+   741us) log.cc:842] Serialized 8172 byte log entry
0812 19:25:45.327227 (+109641us) op_driver.cc:444] REPLICATION: finished
0812 19:25:45.467147 (+139920us) write_op.cc:301] APPLY: starting
0812 19:25:45.467234 (+    87us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:45.597414 (+130180us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:45.597540 (+   126us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:45.682523 (+ 84983us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:45.686296 (+  3773us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=0,mrs_lookups=0
0812 19:25:45.686347 (+    51us) write_op.cc:312] APPLY: finished
0812 19:25:45.689594 (+  3247us) log.cc:842] Serialized 188 byte log entry
0812 19:25:45.689786 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:45.689989 (+   203us) write_op.cc:454] Released schema lock
0812 19:25:45.690049 (+    60us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:45.751995 (+ 61946us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:45.752028 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":602,"reported_tablets":52,"spinlock_wait_cycles":5283712,"child_traces":[["op",{"apply.queue_time_us":139619,"apply.run_cpu_time_us":29851,"apply.run_wall_time_us":285357,"cfile_cache_hit":86,"cfile_cache_hit_bytes":92033,"num_ops":21,"prepare.queue_time_us":138250,"prepare.run_cpu_time_us":5580,"prepare.run_wall_time_us":15301,"replication_time_us":110274,"thread_start_us":196507,"threads_started":2}]]}
I20260812 19:25:45.804317  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:25:45.807901  4084 tablet_replica.cc:330] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:45.808897  4084 raft_consensus.cc:2229] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 25 LEADER]: Raft consensus shutting down.
I20260812 19:25:45.810017  4084 raft_consensus.cc:2258] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:45.813405  4084 tablet_replica.cc:330] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:45.814494  4084 raft_consensus.cc:2229] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:45.817116  4084 pending_rounds.cc:62] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Trying to abort 2 pending ops.
I20260812 19:25:45.817430  4084 pending_rounds.cc:68] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Aborting op as it isn't in flight: id { term: 23 index: 13 } timestamp: 7317760976692563968 op_type: NO_OP noop_request { }
I20260812 19:25:45.818102  4084 raft_consensus.cc:2866] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:25:45.819569  4084 pending_rounds.cc:68] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Aborting op as it isn't in flight: id { term: 21 index: 12 } timestamp: 7317760946661949440 op_type: NO_OP noop_request { }
I20260812 19:25:45.820278  4084 raft_consensus.cc:2866] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:25:45.820751  4084 raft_consensus.cc:2258] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:45.840524  6046 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 129) took 1137 ms. Trace:
W20260812 19:25:45.848145  7553 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 287 similar messages]
I20260812 19:25:45.863812  4084 tablet_replica.cc:330] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:45.864997  4084 raft_consensus.cc:2229] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:45.868646  6055 catalog_manager.cc:5495] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 16 to 23, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 23 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:45.870010  4084 raft_consensus.cc:2258] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:45.870434  6055 catalog_manager.cc:5495] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 21 to 23, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 23 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:45.873117  6055 catalog_manager.cc:5495] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 22 to 24, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 24 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:45.874907  6055 catalog_manager.cc:5495] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 19 to 23, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 23 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:45.877908  6055 catalog_manager.cc:5495] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:45.883891  6055 catalog_manager.cc:5495] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 27, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 27 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:45.888968  6055 catalog_manager.cc:5495] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 22 to 25. New cstate: current_term: 25 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:45.890175  6055 catalog_manager.cc:5495] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 20 to 23. New cstate: current_term: 23 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:45.841079  6046 rpcz_store.cc:276] 0812 19:25:44.703190 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:44.703399 (+   209us) service_pool.cc:227] Handling call
0812 19:25:45.840442 (+1137043us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:45.787749 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:45.788335 (+   586us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:45.788397 (+    62us) write_op.cc:435] Acquired schema lock
0812 19:25:45.788417 (+    20us) tablet.cc:660] Decoding operations
0812 19:25:45.788806 (+   389us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:45.788904 (+    98us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:45.788936 (+    32us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:25:45.789140 (+   204us) tablet.cc:699] Row locks acquired
0812 19:25:45.789161 (+    21us) write_op.cc:260] PREPARE: finished
0812 19:25:45.789353 (+   192us) write_op.cc:270] Start()
0812 19:25:45.789468 (+   115us) write_op.cc:276] Timestamp: P: 1786562745789292 usec, L: 0
0812 19:25:45.789491 (+    23us) op_driver.cc:331] REPLICATION: starting
0812 19:25:45.808938 (+ 19447us) log.cc:842] Serialized 530 byte log entry
0812 19:25:45.830720 (+ 21782us) op_driver.cc:444] REPLICATION: finished
0812 19:25:45.834618 (+  3898us) write_op.cc:301] APPLY: starting
0812 19:25:45.834782 (+   164us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:45.835659 (+   877us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:45.835762 (+   103us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:45.836797 (+  1035us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:45.836994 (+   197us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0812 19:25:45.837042 (+    48us) write_op.cc:312] APPLY: finished
0812 19:25:45.837245 (+   203us) log.cc:842] Serialized 25 byte log entry
0812 19:25:45.837412 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:45.837502 (+    90us) write_op.cc:454] Released schema lock
0812 19:25:45.837545 (+    43us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:45.837870 (+   325us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:45.837911 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8031,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":2513,"apply.run_cpu_time_us":3553,"apply.run_wall_time_us":3554,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":49711,"prepare.run_cpu_time_us":3024,"prepare.run_wall_time_us":39474,"replication_time_us":38409,"thread_start_us":49332,"threads_started":1}]]}
I20260812 19:25:45.891309  6055 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 20 to 24, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 24 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:45.923410  4084 tablet_replica.cc:330] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:45.924583  4084 raft_consensus.cc:2229] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:45.925206  4084 raft_consensus.cc:2258] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:45.944651 20041 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:45.950445 20041 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.965965 20041 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.968066  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.973577  4084 tablet_replica.cc:330] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:45.961120 19627 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:45.979565 19627 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.984362 19627 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.984699  6043 maintenance_manager.cc:643] P 4483e3a69e644cbea699c6f7c9c1da9e: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.225s	user 0.038s	sys 0.000s Metrics: {"bytes_written":6045,"delete_count":0,"lbm_write_time_us":1101,"lbm_writes_lt_1ms":6,"reinsert_count":0,"update_count":250}
I20260812 19:25:45.985934  4084 raft_consensus.cc:2229] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:45.987115  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 28 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.988909  4084 raft_consensus.cc:2258] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:45.995023  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 28 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.994596  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.996029  6044 maintenance_manager.cc:419] P 4483e3a69e644cbea699c6f7c9c1da9e: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.268047
I20260812 19:25:46.001477  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:46.012670  4084 tablet_replica.cc:330] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.013186 20043 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260812 19:25:46.025718  4084 raft_consensus.cc:2229] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.031311  4084 raft_consensus.cc:2258] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260812 19:25:46.033923  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:46.044296 19627 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:46.049229 19627 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:46.062887  4084 tablet_replica.cc:330] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.063994  4084 raft_consensus.cc:2229] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260812 19:25:46.065128  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 51699.3us
I20260812 19:25:46.066336  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:46.068365 20043 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:46.068778 19627 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:46.070595  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:46.074992  4084 raft_consensus.cc:2258] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.075050  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:46.078819  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:46.114871 20026 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260812 19:25:46.141983  4084 tablet_replica.cc:330] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.143409  4084 raft_consensus.cc:2229] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.144193  4084 raft_consensus.cc:2258] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.138857 20026 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:46.172009  6046 catalog_manager.cc:5495] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 12 to 13, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:46.150430 20026 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:25:46.177450  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:46.178604 20026 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:46.184710  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:46.186147  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:46.187394 20026 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:46.193601  4084 tablet_replica.cc:330] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.194535  4084 raft_consensus.cc:2229] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.207948  4084 raft_consensus.cc:2258] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.226915  4084 tablet_replica.cc:330] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.239595  4084 raft_consensus.cc:2229] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.240363  4084 raft_consensus.cc:2258] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.248486  4084 tablet_replica.cc:330] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.253520  4084 raft_consensus.cc:2229] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.254828  4084 raft_consensus.cc:2258] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.297049  4084 tablet_replica.cc:330] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.316642  4084 raft_consensus.cc:2229] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.316768  6055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 245) took 2503 ms. Trace:
I20260812 19:25:46.317236  6055 rpcz_store.cc:276] 0812 19:25:43.813867 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:43.988253 (+174386us) service_pool.cc:227] Handling call
0812 19:25:46.316704 (+2328451us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:45.982244 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:45.982771 (+   527us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:45.982810 (+    39us) write_op.cc:435] Acquired schema lock
0812 19:25:45.982822 (+    12us) tablet.cc:660] Decoding operations
0812 19:25:45.983815 (+   993us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:45.983875 (+    60us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:45.983901 (+    26us) tablet.cc:683] Acquiring locks for 9 operations
0812 19:25:45.984633 (+   732us) tablet.cc:699] Row locks acquired
0812 19:25:45.984656 (+    23us) write_op.cc:260] PREPARE: finished
0812 19:25:45.984800 (+   144us) write_op.cc:270] Start()
0812 19:25:45.984907 (+   107us) write_op.cc:276] Timestamp: P: 1786562745984746 usec, L: 0
0812 19:25:45.984927 (+    20us) op_driver.cc:331] REPLICATION: starting
0812 19:25:45.985568 (+   641us) log.cc:842] Serialized 3592 byte log entry
0812 19:25:46.022111 (+ 36543us) op_driver.cc:444] REPLICATION: finished
0812 19:25:46.027271 (+  5160us) write_op.cc:301] APPLY: starting
0812 19:25:46.027426 (+   155us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:46.062220 (+ 34794us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:46.062387 (+   167us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:46.149601 (+ 87214us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:46.163332 (+ 13731us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0812 19:25:46.163383 (+    51us) write_op.cc:312] APPLY: finished
0812 19:25:46.163764 (+   381us) log.cc:842] Serialized 89 byte log entry
0812 19:25:46.165770 (+  2006us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:46.165929 (+   159us) write_op.cc:454] Released schema lock
0812 19:25:46.165984 (+    55us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:46.183883 (+ 17899us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:46.183915 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38782,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":2260,"apply.run_cpu_time_us":16645,"apply.run_wall_time_us":157580,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37674,"cfile_init":1,"lbm_read_time_us":527,"lbm_reads_lt_1ms":4,"num_ops":9,"prepare.queue_time_us":11164,"prepare.run_cpu_time_us":3661,"prepare.run_wall_time_us":9420,"replication_time_us":36153}]]}
I20260812 19:25:46.328069  4084 raft_consensus.cc:2258] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.346554  4084 tablet_replica.cc:330] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.347448  4084 raft_consensus.cc:2229] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 25 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.348536  4084 raft_consensus.cc:2258] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.358613  4084 tablet_replica.cc:330] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.359503  4084 raft_consensus.cc:2229] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.369921  4084 raft_consensus.cc:2258] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.373055  4084 tablet_replica.cc:330] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.373854  4084 raft_consensus.cc:2229] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.374487  4084 raft_consensus.cc:2258] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.381850  6043 maintenance_manager.cc:643] P 4483e3a69e644cbea699c6f7c9c1da9e: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.384s	user 0.091s	sys 0.016s Metrics: {"cfile_cache_miss":7,"cfile_cache_miss_bytes":26039,"cfile_init":3,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":33885,"dirs.run_cpu_time_us":284,"dirs.run_wall_time_us":285,"lbm_read_time_us":2019,"lbm_reads_lt_1ms":19,"lbm_write_time_us":1630,"lbm_writes_lt_1ms":11,"reinsert_count":0,"thread_start_us":36342,"threads_started":1,"update_count":250}
I20260812 19:25:46.385924  4084 tablet_replica.cc:330] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.386952  4084 raft_consensus.cc:2229] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.388063  4084 raft_consensus.cc:2258] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.393899  4084 tablet_replica.cc:330] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.403542  4084 raft_consensus.cc:2229] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.406237  4084 raft_consensus.cc:2258] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.453258  4084 tablet_replica.cc:330] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.454177  4084 raft_consensus.cc:2229] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.454833  4084 raft_consensus.cc:2258] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260812 19:25:46.455763  6053 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 243) took 37893 ms (client timeout 15000 ms). Trace:
W20260812 19:25:46.461005  6053 rpcz_store.cc:269] 0812 19:25:08.566180 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:08.566606 (+   426us) service_pool.cc:227] Handling call
0812 19:25:46.455544 (+37888938us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":52}
I20260812 19:25:46.458102  4084 tablet_replica.cc:330] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.462806  4084 raft_consensus.cc:2229] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.463410  4084 pending_rounds.cc:62] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Trying to abort 1 pending ops.
I20260812 19:25:46.463675  4084 pending_rounds.cc:68] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Aborting op as it isn't in flight: id { term: 24 index: 14 } timestamp: 7317760976731385856 op_type: NO_OP noop_request { }
I20260812 19:25:46.464057  4084 raft_consensus.cc:2866] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:25:46.464447  4084 raft_consensus.cc:2258] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.467276  4084 tablet_replica.cc:330] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.468071  4084 raft_consensus.cc:2229] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.468688  4084 raft_consensus.cc:2258] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.480729  4084 tablet_replica.cc:330] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.481606  4084 raft_consensus.cc:2229] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.482327  4084 raft_consensus.cc:2258] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260812 19:25:46.502240  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:46.503713  4084 tablet_replica.cc:330] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.504684  4084 raft_consensus.cc:2229] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.505402  4084 pending_rounds.cc:62] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Trying to abort 1 pending ops.
I20260812 19:25:46.505687  4084 pending_rounds.cc:68] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Aborting op as it isn't in flight: id { term: 21 index: 13 } timestamp: 7317760975919271936 op_type: NO_OP noop_request { }
I20260812 19:25:46.506114  4084 raft_consensus.cc:2866] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:25:46.506620  4084 raft_consensus.cc:2258] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.514823  4084 tablet_replica.cc:330] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.515870  4084 raft_consensus.cc:2229] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.516830  4084 raft_consensus.cc:2258] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.521449  4084 tablet_replica.cc:330] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.522356  4084 raft_consensus.cc:2229] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.527872  4084 raft_consensus.cc:2258] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.531452 19627 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:46.547789 19627 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:46.552054 19627 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:46.558091  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:46.554766  4084 tablet_replica.cc:330] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.562214  4084 raft_consensus.cc:2229] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.562949  4084 raft_consensus.cc:2258] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260812 19:25:46.563414  6058 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 197) took 81343 ms (client timeout 15000 ms). Trace:
W20260812 19:25:46.566998  6058 rpcz_store.cc:269] 0812 19:24:25.220176 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:25.222854 (+  2678us) service_pool.cc:227] Handling call
0812 19:25:46.563169 (+81340315us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13070,"reported_tablets":52}
I20260812 19:25:46.564622  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:46.569141  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:46.569969 19627 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260812 19:25:46.572352  4084 tablet_replica.cc:330] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.573410  4084 raft_consensus.cc:2229] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.582072  4084 raft_consensus.cc:2258] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.592149  4084 tablet_replica.cc:330] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.593035  4084 raft_consensus.cc:2229] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.593811  4084 raft_consensus.cc:2258] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.597064  4084 tablet_replica.cc:330] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.597925  4084 raft_consensus.cc:2229] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.598724  4084 raft_consensus.cc:2258] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.602988  4084 tablet_replica.cc:330] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.603919  4084 raft_consensus.cc:2229] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.604542  4084 raft_consensus.cc:2258] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.607548  4084 tablet_replica.cc:330] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298: stopping tablet replica
W20260812 19:25:46.607910  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:46.608321  4084 raft_consensus.cc:2229] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.609520  4084 raft_consensus.cc:2258] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.612532  4084 tablet_replica.cc:330] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.613379  4084 raft_consensus.cc:2229] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.614140  4084 raft_consensus.cc:2258] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.617020  4084 tablet_replica.cc:330] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.617839  4084 raft_consensus.cc:2229] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.619056  4084 raft_consensus.cc:2258] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.624068  4084 tablet_replica.cc:330] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.624873  4084 raft_consensus.cc:2229] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.626817  6055 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 24 to 25, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 25 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:46.628422  4084 raft_consensus.cc:2258] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.628543  6055 catalog_manager.cc:5495] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 17 to 27, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 27 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:46.630026  6055 catalog_manager.cc:5495] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 22 to 26. New cstate: current_term: 26 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:46.631855  6055 catalog_manager.cc:5495] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 16 to 22, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } }
I20260812 19:25:46.647728  4084 tablet_replica.cc:330] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.649767  4084 raft_consensus.cc:2229] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.650379  4084 raft_consensus.cc:2258] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260812 19:25:46.664331  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:46.663717  4084 tablet_replica.cc:330] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: stopping tablet replica
W20260812 19:25:46.673537  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:46.673699  4084 raft_consensus.cc:2229] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.683060  4084 raft_consensus.cc:2258] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.686976  4084 tablet_replica.cc:330] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.688128  4084 raft_consensus.cc:2229] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.688899  4084 raft_consensus.cc:2258] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.691977  4084 tablet_replica.cc:330] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.692801  4084 raft_consensus.cc:2229] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.696501  4084 raft_consensus.cc:2258] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.708335  4084 tablet_replica.cc:330] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.711144  4084 raft_consensus.cc:2229] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.712491  4084 raft_consensus.cc:2258] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.715714  4084 tablet_replica.cc:330] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.716473  4084 raft_consensus.cc:2229] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.717089  4084 raft_consensus.cc:2258] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.719794  4084 tablet_replica.cc:330] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.720579  4084 raft_consensus.cc:2229] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.721653  4084 raft_consensus.cc:2258] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.724359  4084 tablet_replica.cc:330] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.725219  4084 raft_consensus.cc:2229] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.725976  4084 raft_consensus.cc:2258] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.728668  4084 tablet_replica.cc:330] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.729449  4084 raft_consensus.cc:2229] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.730515  4084 raft_consensus.cc:2258] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260812 19:25:46.731101  6054 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 240) took 100872 ms (client timeout 15000 ms). Trace:
W20260812 19:25:46.731572  6054 rpcz_store.cc:269] 0812 19:24:05.858488 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:05.858702 (+   214us) service_pool.cc:227] Handling call
0812 19:25:46.730849 (+100872147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17539,"reported_tablets":51}
I20260812 19:25:46.733472  4084 tablet_replica.cc:330] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.734588  4084 raft_consensus.cc:2229] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.735778  4084 raft_consensus.cc:2258] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.738628  4084 tablet_replica.cc:330] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.739499  4084 raft_consensus.cc:2229] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.740552  4084 raft_consensus.cc:2258] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.749202  4084 tablet_replica.cc:330] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.750170  4084 raft_consensus.cc:2229] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.751464  4084 raft_consensus.cc:2258] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.761526  4084 tablet_replica.cc:330] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.762401  4084 raft_consensus.cc:2229] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.763167  4084 raft_consensus.cc:2258] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.765937  4084 tablet_replica.cc:330] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.766636  4084 raft_consensus.cc:2229] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.767433  4084 raft_consensus.cc:2258] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.770527  4084 tablet_replica.cc:330] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.771308  4084 raft_consensus.cc:2229] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.771970  4084 raft_consensus.cc:2258] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.774544  4084 tablet_replica.cc:330] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.775283  4084 raft_consensus.cc:2229] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.775938  4084 raft_consensus.cc:2258] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.778599  4084 tablet_replica.cc:330] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.779304  4084 raft_consensus.cc:2229] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.780367  4084 raft_consensus.cc:2258] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.783288  4084 tablet_replica.cc:330] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.784212  4084 raft_consensus.cc:2229] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.785029  4084 raft_consensus.cc:2258] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.787750  4084 tablet_replica.cc:330] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.788412  4084 raft_consensus.cc:2229] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 25 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.789490  4084 raft_consensus.cc:2258] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260812 19:25:46.790297  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:46.820741  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:46.866941  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:46.921492  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:46.934784  6052 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 200) took 19071 ms (client timeout 15000 ms). Trace:
W20260812 19:25:46.935318  6052 rpcz_store.cc:269] 0812 19:25:27.863480 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:27.863798 (+   318us) service_pool.cc:227] Handling call
0812 19:25:46.934521 (+19070723us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6311,"reported_tablets":52}
W20260812 19:25:46.999662  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.011883  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.011955  6059 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38512 (request call id 233) took 89405 ms (client timeout 15000 ms). Trace:
W20260812 19:25:47.012534  6059 rpcz_store.cc:269] 0812 19:24:17.606791 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:17.608284 (+  1493us) service_pool.cc:227] Handling call
0812 19:25:47.011683 (+89403399us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39711,"reported_tablets":53}
W20260812 19:25:47.036747  6047 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38512 (request call id 236) took 14781 ms (client timeout 15000 ms). Trace:
W20260812 19:25:47.037334  6047 rpcz_store.cc:269] 0812 19:25:32.262307 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:37.890693 (+5628386us) service_pool.cc:227] Handling call
0812 19:25:47.036676 (+9145983us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1566,"reported_tablets":53}
W20260812 19:25:47.040465  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.056949  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.057452  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.066866  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.080241  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.104260  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.128834  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.185738  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.188187  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.203425  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.228873  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:47.267060 19878 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.267705 19878 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.269570 20048 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.270035 19878 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.270159 20048 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.272614 20048 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.273622  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:47.274830  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:47.281513  6416 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.281949  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:47.282862  6297 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.283311  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:47.284008 20048 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:47.285390 19878 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:47.303977 20048 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.304685 20048 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.306986 20048 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.309940  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:47.310542  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:47.315884  6464 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 25.
W20260812 19:25:47.318764  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.319641  6297 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.320459  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:47.321573 20048 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260812 19:25:47.321990 20048 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.322368 20048 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:47.345634 20048 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.349119 20048 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.354018  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:47.354780  6477 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Advancing to term 26
W20260812 19:25:47.358559  6297 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.363003  6477 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 26.
I20260812 19:25:47.364605  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:47.365477 20048 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election won for term 26
I20260812 19:25:47.366044 20048 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:47.366946 20048 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:47.381664  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.408996  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:47.453603  6059 catalog_manager.cc:5495] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 25 to 26, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 26 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:25:47.528882  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:47.573203 19878 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.573920 19878 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.579201 19878 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.573937 20049 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.583778 20049 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.586097 20049 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.582927  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:47.591434  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:47.593281  6416 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.594115  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:47.598591 19878 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260812 19:25:47.601315  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.606093  6416 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.607829  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:47.610858 19878 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:47.619941 19878 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.620537 19878 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.629642 19878 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.635412  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:47.635946 20069 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.636576 20069 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.638806 20069 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:47.649044  6416 leader_election.cc:334] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.649498  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:47.648859  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:47.650269  6477 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:47.650368 20049 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:47.658766  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:47.659580 20069 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:47.660004 20069 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.660382 20069 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
W20260812 19:25:47.675439  6297 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:47.705689  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 64428us
I20260812 19:25:47.711386 20069 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.713657 20069 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.722206  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:47.723037  6464 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:47.725899 20073 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.726485 20073 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.729467 20073 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.732049  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:47.734432  6416 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.735287  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:47.736392 20073 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:47.732306 19878 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.737425 19878 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.741289  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:47.741827  6297 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.742622 20073 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.743432 20073 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.741973  6342 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 25.
I20260812 19:25:47.739533 19878 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.744753 20048 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.745362 20048 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.746050 20073 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.747601 20048 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.749399  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:47.751367 20073 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260812 19:25:47.751838 20073 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.752194 20073 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:47.753338  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:47.753993  6482 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:47.754994  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:47.750846  6416 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.758968  6464 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
W20260812 19:25:47.759806  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.762409  6416 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.762853  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:47.763618 19878 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:47.770915 20073 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.771930  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:47.772730 20069 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:47.773111  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:47.773195 20069 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.773826 20069 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
W20260812 19:25:47.774192  6297 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.773888 20048 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:47.775254 20048 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:47.776145 20048 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.782356 20042 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.782212 20069 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.783010 20042 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:47.784885 20069 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.785171 20042 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:47.787323  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:47.787443  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:47.789592  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.792774  6416 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:47.794615  7553 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.795181  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:47.794960 20073 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.799783 20042 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:47.802260  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:47.802925  6477 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:47.807895  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:47.808691  6342 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Advancing to term 26
W20260812 19:25:47.856279  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 44060.4us
W20260812 19:25:47.859443  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:47.819741  6477 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:47.880005 20044 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.885933 20069 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.886848 20069 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.887880 20073 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.885268  6059 catalog_manager.cc:5495] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 21 to 22, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:47.888795 20073 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.890023 20069 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.892433 20073 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.892503 20067 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.894035 20067 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:47.896664  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:47.901296 20067 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:47.881384 20044 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:47.898664  6416 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.921300 20044 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.923724  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:47.926596 19878 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:47.933226  6342 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 26.
I20260812 19:25:47.938493  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:47.939983 20069 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.940276 20073 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader election won for term 26
I20260812 19:25:47.941109 20073 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 26 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:47.941066 20069 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.937552 20067 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.942930 20073 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.945271 20069 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.949798  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:47.953014  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:47.942955 20067 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.957170 20067 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.941890 20044 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.963538 20044 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:47.967021 20044 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.970276 19878 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.971128 19878 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:47.979842  6416 leader_election.cc:334] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.981711 19878 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:47.982874  4084 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 6269)
I20260812 19:25:47.998287  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:47.999348  6477 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:48.004726 20089 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.005728 20089 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.012082 20089 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:48.013767 19878 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.014541 19878 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.017107 19878 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:48.022442  6416 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.023449 20089 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.024235 20089 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.027139 20089 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:48.030200  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:48.034719  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:48.043850  7553 leader_election.cc:334] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.044283  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:48.035580 19878 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.046726 19878 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.050488 19878 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:48.039323  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:48.051506  6482 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:48.027391  6059 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 25 to 26, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 26 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:48.052668  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:48.056950 20090 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:25:48.062180  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:48.066139 20073 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:48.040362  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:48.083534 20073 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.085258 20073 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.087911  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:48.088646  6347 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
I20260812 19:25:48.090126  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:48.093520  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:48.088230 20073 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.094172  7591 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:48.100137  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:48.104046 20067 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.105058 20067 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.107035 20073 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.107878 20067 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.107755 20073 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.110042 20073 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.108968  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:48.111271 20042 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:48.111694 20042 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.112051 20042 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:48.117254  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:48.118003  7597 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:25:48.121075  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:48.121732  7597 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:48.124086  6298 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:48.124959 20067 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:48.125351 20067 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.125711 20067 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:48.131153 20042 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.135242 20089 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:48.143721  6417 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.144006 20089 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:48.144680 20073 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:25:48.145148 20073 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.145623 20073 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:25:48.145896 20089 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.147886  6417 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:48.148826 20049 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260812 19:25:48.135632  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 105570us
I20260812 19:25:48.142031  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:48.136296 20067 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.149933  6347 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 24.
I20260812 19:25:48.149263 20049 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.157953 20049 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:48.159345 20067 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:48.163254 20073 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:48.149715  6416 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.163255  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:48.168146 20042 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.171164 20091 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:48.171605 20091 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.171983 20091 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
W20260812 19:25:48.171990  6416 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.174629 20042 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.175710  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:48.175387 20042 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.180171 20042 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.174321  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:48.181027  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:48.181829  7597 raft_consensus.cc:2379] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 19: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:25:48.181879 19878 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:48.184965 20073 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:48.184460 20067 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:48.188858 20067 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.189357 20067 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:48.193087 20042 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.193884 20042 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.196058 20042 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.198211  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:48.199328  6416 leader_election.cc:334] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.201802 20091 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.203255  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:48.228152  6347 raft_consensus.cc:2379] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:25:48.203120  7553 leader_election.cc:334] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.204160  6059 catalog_manager.cc:5495] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 22 to 23, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 23 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:48.206602 20073 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:48.229631 20073 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.230144 20073 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:48.215204 20049 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.229823 20091 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.226987 20089 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:48.225519  6297 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.245067 20089 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.247404 20089 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:48.232064  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:48.248121  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:48.250674  6482 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260812 19:25:48.251717  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:48.252506  6347 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 23.
W20260812 19:25:48.217664  6416 leader_election.cc:334] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.238750 20049 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:48.256914  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:48.257530  7597 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:25:48.259029  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:48.259678  7591 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:48.261487 20073 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.263641 20073 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.266963  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:48.268225  6347 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Advancing to term 25
W20260812 19:25:48.275931  6416 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.279088  7591 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:48.280517  6347 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 25.
W20260812 19:25:48.282872  6416 leader_election.cc:334] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.309744  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.310849 20073 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader election won for term 25
I20260812 19:25:48.311312 20091 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.294404  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:48.312031 20091 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.312690 20042 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:48.313176 20042 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.313570 20042 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:48.314100 20091 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.314559  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:48.315235  6347 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 23.
I20260812 19:25:48.296124  7597 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:25:48.301213  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:48.296666 20067 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.317294  6473 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:48.311420 20073 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 25 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:48.318622 20073 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:48.322216  7553 leader_election.cc:334] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.322774  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:48.323663 20044 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:48.324973  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:48.325660  6470 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
W20260812 19:25:48.331562  6297 leader_election.cc:334] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.332561  6297 leader_election.cc:334] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.332485 20042 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.333199  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:48.334020 20089 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:25:48.334513  6297 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.335485  6297 leader_election.cc:334] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.335908  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:48.336169 20067 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.336848 20067 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260812 19:25:48.336887  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:48.343101 20042 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.345307 20089 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.345686  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:48.345780 20091 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:25:48.345971 20089 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.348354 20089 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.348940 20048 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260812 19:25:48.349148  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:48.349469 20048 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:48.349640  6297 leader_election.cc:334] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.349936 20048 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
W20260812 19:25:48.350556  6297 leader_election.cc:334] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.351016  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:48.351827 20069 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:25:48.352031  6297 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.354416  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:48.355268  6473 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:48.356199  6470 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
W20260812 19:25:48.358618  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:48.369437  6297 leader_election.cc:334] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.369959  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:48.370349  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:48.370702  6470 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260812 19:25:48.371161  6481 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 25.
I20260812 19:25:48.371208 20091 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:48.367343 20048 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:48.373090  6297 leader_election.cc:334] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.373646  6297 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.374120 20048 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.384093  6417 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.385715  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:48.386404  6359 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:48.388430  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:25:48.390053  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:48.390384  6470 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
W20260812 19:25:48.389081  7553 leader_election.cc:334] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.382630  6059 catalog_manager.cc:5495] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 24 to 25, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 25 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
W20260812 19:25:48.391160  6297 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.392071  6297 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.395107  7553 leader_election.cc:334] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.405678  6417 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.408078 20049 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:48.405864 20100 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:25:48.409384 20100 raft_consensus.cc:686] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:48.414000 20100 consensus_queue.cc:237] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.415794  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:48.408592 20049 raft_consensus.cc:686] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:48.416574  6482 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:48.417495  6359 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 24.
I20260812 19:25:48.417706 20049 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.418604  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.419507 20067 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:48.419999 20067 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.420501 20067 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:48.426131  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:48.427284  6481 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:48.432689  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.434813 20091 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:48.435009 20069 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260812 19:25:48.435400 20091 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:48.436359 20091 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.434113  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.444243  6481 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:48.446244 20088 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260812 19:25:48.447101  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:48.447237 20088 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.447732 20088 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:48.447268  6347 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260812 19:25:48.453002 20069 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:48.453418 20069 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.453776 20069 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:48.460714  6470 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:48.460196  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.467233 20090 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:48.467680 20090 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.468061 20090 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:48.474413  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:48.481693  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:48.482992  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.484342 20089 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:48.465592 20100 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.019s
I20260812 19:25:48.488279 20089 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:48.489392 20089 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:48.500384  6297 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.501490  6297 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.497515 20048 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election won for term 24
I20260812 19:25:48.499218 20042 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Leader election won for term 24
I20260812 19:25:48.508071 20048 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:48.508481 20042 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 24 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:48.509316 20048 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.544339  6047 catalog_manager.cc:5495] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 22 to 23, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 23 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:48.526005  6059 catalog_manager.cc:5495] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 17 to 18, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 18 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:48.549468  6059 catalog_manager.cc:5495] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 12 to 13, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 13 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:48.551072 20042 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.556627  6470 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260812 19:25:48.557928 20088 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:48.610071  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 128179us
I20260812 19:25:48.608399 20090 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.619445 20091 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260812 19:25:48.667281 20088 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.700280  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:48.701220  6477 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:48.654670 20067 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.662714 20069 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.717650 20069 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:48.730532  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 64742.5us
I20260812 19:25:48.743222  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:48.743889  6481 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:48.744231 20090 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.749006 20067 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.761096  6481 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:48.769155  6047 catalog_manager.cc:5495] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 23 to 24, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 24 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:48.779567  6059 catalog_manager.cc:5495] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 19 to 20, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:48.785082  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:25:48.785465  6297 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.785799  6475 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:48.785109  6059 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 23 to 24, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 24 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:25:48.791175  6297 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.800199  7553 leader_election.cc:334] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.809083  6477 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 26.
I20260812 19:25:48.812253  6475 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:48.816254  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:25:48.816368  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:48.834367  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:48.835081  6342 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:48.850479 19622 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:48.851176 19622 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:48.852264 19622 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.860563  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.864010 20048 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election won for term 26
I20260812 19:25:48.864760 20048 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:48.865831 20048 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.868034  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:48.870038  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:48.870644  6297 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.870769 20128 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:48.871557  6350 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260812 19:25:48.877169 20073 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260812 19:25:48.877724 20128 raft_consensus.cc:686] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:48.878777 20128 consensus_queue.cc:237] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.886626  6342 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 24.
I20260812 19:25:48.902767  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:48.906163 20116 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Leader election won for term 24
I20260812 19:25:48.906764 20116 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 24 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:48.907682 20116 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:48.930799  7553 leader_election.cc:334] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.958788  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:48.964568  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:48.984129  6482 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260812 19:25:48.984544  4084 thread.cc:536] Waited for 2000ms trying to join with diag-logger (tid 6269)
I20260812 19:25:48.990211  6477 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260812 19:25:48.996755  7597 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260812 19:25:49.011273  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:49.013717 20073 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260812 19:25:49.016172 20048 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:25:49.018786 20048 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260812 19:25:49.005373  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 19:25:49.019129  6473 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260812 19:25:49.023062  7597 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260812 19:25:49.026777 20048 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260812 19:25:49.029706 20073 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260812 19:25:49.041253  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:49.041688  6059 catalog_manager.cc:5495] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 23 to 24, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 24 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260812 19:25:49.044037  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:49.056607  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:49.060753  6047 catalog_manager.cc:5495] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 25 to 26, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 26 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:49.063036  6047 catalog_manager.cc:5495] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 21 to 22, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:49.073333  6047 catalog_manager.cc:5495] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 18 to 19, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 19 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:25:49.128453  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:49.156152  6347 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260812 19:25:49.161067 20133 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260812 19:25:49.270109  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:49.302248  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.307202  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 19:25:49.316375  6347 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260812 19:25:49.317281  6482 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260812 19:25:49.317943 20116 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260812 19:25:49.326244 20140 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260812 19:25:49.328528  6482 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260812 19:25:49.332156  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:49.350544 20128 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260812 19:25:49.369179  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:49.380081  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 19:25:49.394109  6481 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260812 19:25:49.394886  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:49.406082  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 19:25:49.413672 20091 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260812 19:25:49.425336  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:49.448560  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.449185  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.474587  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:49.483824  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.568804  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.629016  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.636107  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.670835  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.702525  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.705046  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.769160  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.783350  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.795656  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.822726  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.855966  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.893011  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.897222  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.957664  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:49.970000  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:49.981673  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.985018  4084 thread.cc:536] Waited for 3000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:50.024549  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 19:25:50.038372 20138 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:50.039000 20138 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:50.041544 20138 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:50.044378  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:50.046550  6347 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 19.
W20260812 19:25:50.049221  7553 leader_election.cc:334] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:50.050207  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:50.051704 20138 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:50.052212 20138 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:50.052788 20138 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:50.078154 20138 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:50.086772  7553 leader_election.cc:334] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:50.090299  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:50.090939  6342 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:50.105103 20138 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:50.116768  6342 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 20.
I20260812 19:25:50.118180  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:50.119057 20138 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:50.119625 20138 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:50.120609 20138 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:50.178696  6059 catalog_manager.cc:5495] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 18 to 20, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 20 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260812 19:25:50.227818  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.241930  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.328984  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.362480  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.382546  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.387842  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.420226  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.595522  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:50.687402  6347 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260812 19:25:50.694060 20126 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260812 19:25:50.703617  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:50.715389  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.854485  6297 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111) [suppressed 470 similar messages]
W20260812 19:25:50.954252  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.985555  4084 thread.cc:536] Waited for 4000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:51.067865  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.071556  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.132988  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.289944  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:51.363878  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:51.393401  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.451357  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.497570  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.532580  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.560920  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.635785  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:51.665938  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:51.712786  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.740505  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.801106  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:51.803274  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.828217  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.926422  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:51.927047  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:51.931339  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.932272  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:51.945034  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:51.972908  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:51.986173  4084 thread.cc:536] Waited for 5000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:52.044723  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.036689  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.081466  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.095572  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.134429  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.191217  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.198735  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.294314  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.300225  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.403007  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:52.416812  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.420171  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.496979  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:52.507154  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.526950  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.588922  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.606768  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.658731  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.660629  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.681682  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.757632  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.860340  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.875126  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.920980  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.986726  4084 thread.cc:536] Waited for 6000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:53.034273  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:53.076043  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:53.195709  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.267055  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:53.438993  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.591315  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:53.730734  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:53.865907  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.899070  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.905104  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.953429  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.967147  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.969244  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.987383  4084 thread.cc:536] Waited for 7000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:54.019325  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:54.198406  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:54.200730  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.202138  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:54.250334  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.292810  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:54.361589  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.377385  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.384182  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:54.408145  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:54.411538  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.540135  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.561748  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:54.562549  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:54.597925  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.617146  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.705116  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.778756  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.811527  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.854161  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.891987  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.897936  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:54.904855  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.952955  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.987905  4084 thread.cc:536] Waited for 8000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:55.034081  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.187769  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.214174  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:55.217347  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.226245  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.226949  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.228607  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.282634  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.309063  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.367935  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:55.426756  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.441784  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.453311  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.468423  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.490603  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:55.500321  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.592360  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.680516  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.793505  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:55.881035  7553 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111) [suppressed 510 similar messages]
W20260812 19:25:55.988812  4084 thread.cc:536] Waited for 9000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:56.007262  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.086722  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:56.155298  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.158993  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:56.295415  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.341192  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:56.354417  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.358034  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.372855  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.438920  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.571058  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:56.590190  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.695705  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:56.749380  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:56.809305  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.851243  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:56.858489  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:56.879989  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:56.939858  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:56.981887  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:56.989498  4084 thread.cc:536] Waited for 10000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:57.010519  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.015201  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:57.035411  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.109251  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.198860  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:57.214314  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.248129  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.262591  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:57.276523  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.308521  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.324285  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.347831  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.362855  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.416925  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:57.429292  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.442042  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:57.565785  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.653549  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.759744  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.852445  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.853473  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.865139  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.894891  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:57.903231  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.957147  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:58.002942  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:58.061003  4084 thread.cc:536] Waited for 11000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:58.153647  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:58.171039  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 95125.1us
W20260812 19:25:58.172495  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:58.198668  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:58.279803  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:58.306716  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:58.313923  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:58.312592  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:58.614383  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:58.667598  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:58.694882  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:25:58.738435  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:58.747507  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:58.799345  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:58.870819  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:58.901998  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:25:58.970892  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:25:59.062547  4084 thread.cc:536] Waited for 12000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:59.096787  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:59.226330  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:59.236202  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:59.445253  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:25:59.517297  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:25:59.571017  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:59.615759  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:25:59.667316  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.063115  4084 thread.cc:536] Waited for 13000ms trying to join with diag-logger (tid 6269)
I20260812 19:26:00.590152 20265 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:00.591150 20265 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:00.594368 20265 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:00.638708  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 52582.1us
I20260812 19:26:00.679926 20265 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:00.680668 20265 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:00.682947 20265 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:00.684204  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:26:00.707795  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 55535.2us
W20260812 19:26:00.715201  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.718763  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.719133  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:26:00.719727  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.719904  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:00.720309  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.720604  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:26:00.721043  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.721187  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.721766  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.722064  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.722394  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:26:00.722915  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.723515  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260812 19:26:00.725060  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:26:00.727824  6416 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:00.728391  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:00.729348 20252 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:26:00.729480  6416 leader_election.cc:334] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:00.734037  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:00.734941 20252 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:26:00.745378 20254 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:26:00.746117 20254 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:26:00.753670 20254 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:26:00.759217  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260812 19:26:00.786914  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:26:00.787815  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.788367  7553 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:00.811393  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:26:00.819260 20254 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260812 19:26:00.820179  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.892942  6416 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111) [suppressed 432 similar messages]
W20260812 19:26:00.973258  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:26:01.023767  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:01.031414  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:26:01.042538  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.049980  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:01.060189  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.064532  4084 thread.cc:536] Waited for 14000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:01.096171  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.202111  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:01.202914  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.219071  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.294358  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.366760  7643 debug-util.cc:398] Leaking SignalData structure 0x7b0800343fc0 after lost signal to thread 4090
W20260812 19:26:01.368086  7643 debug-util.cc:398] Leaking SignalData structure 0x7b080030fac0 after lost signal to thread 6116
W20260812 19:26:01.369690  7643 debug-util.cc:398] Leaking SignalData structure 0x7b08003223a0 after lost signal to thread 6399
W20260812 19:26:01.371052  7643 debug-util.cc:398] Leaking SignalData structure 0x7b0800332de0 after lost signal to thread 6521
W20260812 19:26:01.373272  7643 debug-util.cc:398] Leaking SignalData structure 0x7b08003c8800 after lost signal to thread 7647
W20260812 19:26:01.532817  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:01.590307  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:26:01.590935  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.634248  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.636132  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.694476  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.821578  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:01.977572  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:02.007380  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.043150  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:02.066051  4084 thread.cc:536] Waited for 15000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:02.069135  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:02.087718  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:02.144124  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.332577  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:02.334084  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.356303  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:02.486626  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.565752  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:02.575271  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.577035  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:02.593451  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.672190  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.730223  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:02.782701  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.790668  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:02.799799  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.809684  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:02.858064  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.881825  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.966823  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.988004  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.013918  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.066553  4084 thread.cc:536] Waited for 16000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:03.111701  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:03.132190  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.151692  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.153054  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:03.170447  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:03.177569  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.180787  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.201543  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.308066  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.429544  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:03.445439  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:03.480154  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:03.552699  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.580971  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.586932  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:03.598191  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:03.689728  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.731915  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 65347.1us
W20260812 19:26:03.743743  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.760434  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:03.799846  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.806025  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.978241  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:03.986465  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:04.067196  4084 thread.cc:536] Waited for 17000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:04.173635  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 58605.8us
W20260812 19:26:04.210276  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:04.225404  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:04.267854  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:04.272630  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:04.292490  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:04.312849  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:04.418223  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:04.475607  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:04.566665  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:04.739681  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:04.829460  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:04.896694  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.017861  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.031025  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.049572  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:05.053205  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.067772  4084 thread.cc:536] Waited for 18000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:05.071483  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.083180  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:05.254122  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:05.276594  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:05.282821  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.299837  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.325928  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.386921  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:05.396235  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.409044  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.532047  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.538295  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.531608  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:05.575506  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.618981  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:05.620565  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.660708  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.717715  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.722886  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:05.739809  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.759393  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:05.822105  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:05.862001  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.902866  6416 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111) [suppressed 525 similar messages]
W20260812 19:26:05.936132  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:05.959612  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:06.007150  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:06.045640  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:06.068409  4084 thread.cc:536] Waited for 19000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:06.075225  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:06.089906  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:06.205150  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:06.206668  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:06.287360  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:06.305492  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:06.354940  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:06.586336  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:06.631080  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44834.4us
W20260812 19:26:06.663811  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:06.725173  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:06.861253  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 420780us
W20260812 19:26:06.991812  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:07.000564  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:07.026119  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:07.034022  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:07.038153  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:07.058513  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:07.060420  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:07.068982  4084 thread.cc:536] Waited for 20000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:07.379734  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.380285  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.390182  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.390695  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 71571.3us
W20260812 19:26:07.395305  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:07.435989  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:07.474325  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.725994  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.777576  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.796599  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6c20 after lost signal to thread 4090
W20260812 19:26:07.797911  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08003523a0 after lost signal to thread 6116
W20260812 19:26:07.801661  6514 debug-util.cc:398] Leaking SignalData structure 0x7b0800398700 after lost signal to thread 6399
W20260812 19:26:07.803997  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08003f4d80 after lost signal to thread 6521
W20260812 19:26:07.807432  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08000f18c0 after lost signal to thread 7647
W20260812 19:26:07.849840  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.852428  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:07.865803  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.939826  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:07.962698  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:07.982000  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:08.016607  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.069463  4084 thread.cc:536] Waited for 21000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:08.071821  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:08.099328  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.101128  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:08.139289  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.271078  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.338835  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.340281  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.354776  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.367435  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.370411  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:08.373420  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:08.406598  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:08.415360  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.465173  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.470058  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:08.482592  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.632232  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:08.659559  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.905649  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.990682  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:08.994989  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:09.014613  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.016559  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.017140  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.019227  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:09.049548  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.071174  4084 thread.cc:536] Waited for 22000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:09.094726  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:09.111646  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:09.302752  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.350271  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:09.361352  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:09.440856  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:09.541832  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.559718  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:09.621618  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 49662.3us
W20260812 19:26:09.634158  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.707922  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.717355  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.760288  6396 debug-util.cc:398] Leaking SignalData structure 0x7b080031cda0 after lost signal to thread 4090
W20260812 19:26:09.761533  6396 debug-util.cc:398] Leaking SignalData structure 0x7b080033b540 after lost signal to thread 6116
W20260812 19:26:09.763131  6396 debug-util.cc:398] Leaking SignalData structure 0x7b0800338ce0 after lost signal to thread 6399
W20260812 19:26:09.764365  6396 debug-util.cc:398] Leaking SignalData structure 0x7b0800359080 after lost signal to thread 6521
W20260812 19:26:09.765692  6396 debug-util.cc:398] Leaking SignalData structure 0x7b080005dfe0 after lost signal to thread 7647
W20260812 19:26:09.779738  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.064005  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 124979us
W20260812 19:26:10.085685  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.162695  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:10.218613  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.218765  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:10.220394  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.223157  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:10.230816  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.240517  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.273480  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:10.396472  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.425495  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:10.430460  4084 tablet_server.cc:194] TabletServer@127.3.253.1:0 shutdown complete.
W20260812 19:26:10.458757  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.522151  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.579025  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:10.606051  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:10.613515  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:10.615072  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:10.671986  4084 tablet_server.cc:178] TabletServer@127.3.253.2:0 shutting down...
W20260812 19:26:10.712164  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.716342  7553 consensus_peers.cc:487] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.717975  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:10.720125  7553 consensus_peers.cc:487] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.728263  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.736706  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.740872  6416 consensus_peers.cc:487] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.751032  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.760141  7553 consensus_peers.cc:487] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.763677  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.764926  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.783804  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.799962  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.813570  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:26:10.815155  4084 tablet_replica.cc:330] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.827644  4084 raft_consensus.cc:2229] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Raft consensus shutting down.
W20260812 19:26:10.828804  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.830415  4084 raft_consensus.cc:2258] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:10.832006  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.836571  7553 consensus_peers.cc:487] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.839879  7553 consensus_peers.cc:487] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.842975  4084 tablet_replica.cc:330] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.844040  4084 raft_consensus.cc:2229] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.845340  4084 raft_consensus.cc:2258] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.848512  4084 tablet_replica.cc:330] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
W20260812 19:26:10.848428  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.849663  4084 raft_consensus.cc:2229] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.851184  4084 raft_consensus.cc:2258] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.855424  4084 tablet_replica.cc:330] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.858165  4084 raft_consensus.cc:2229] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.859056  4084 raft_consensus.cc:2258] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.861820  4084 tablet_replica.cc:330] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.862807  4084 raft_consensus.cc:2229] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.864045  4084 raft_consensus.cc:2258] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.866940  4084 tablet_replica.cc:330] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.867712  4084 raft_consensus.cc:2229] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.868309  4084 raft_consensus.cc:2258] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.872008  4084 tablet_replica.cc:330] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.873023  4084 raft_consensus.cc:2229] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Raft consensus shutting down.
W20260812 19:26:10.873410  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260812 19:26:10.874447  4084 raft_consensus.cc:2258] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.880050  4084 tablet_replica.cc:330] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.883337  4084 raft_consensus.cc:2229] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.884060  4084 raft_consensus.cc:2258] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:10.886629  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:10.887465  4084 tablet_replica.cc:330] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.888499  4084 raft_consensus.cc:2229] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.889722  4084 raft_consensus.cc:2258] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:10.891763  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.892912  4084 tablet_replica.cc:330] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.893697  4084 raft_consensus.cc:2229] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.894418  4084 raft_consensus.cc:2258] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.897532  4084 tablet_replica.cc:330] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.898177  4084 raft_consensus.cc:2229] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.899360  4084 raft_consensus.cc:2258] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.902119  4084 tablet_replica.cc:330] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.902850  4084 raft_consensus.cc:2229] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.903477  4084 raft_consensus.cc:2258] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.906226  4084 tablet_replica.cc:330] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.906996  4084 raft_consensus.cc:2229] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.907656  4084 raft_consensus.cc:2258] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.910887  4084 tablet_replica.cc:330] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.911815  4084 raft_consensus.cc:2229] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.913371  4084 raft_consensus.cc:2258] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.916531  4084 tablet_replica.cc:330] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.917346  4084 raft_consensus.cc:2229] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.918557  4084 raft_consensus.cc:2258] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.921288  4084 tablet_replica.cc:330] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.922108  4084 raft_consensus.cc:2229] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.924479  4084 raft_consensus.cc:2258] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:10.925665  6297 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111) [suppressed 513 similar messages]
I20260812 19:26:10.928154  4084 tablet_replica.cc:330] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.929201  4084 raft_consensus.cc:2229] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.930593  4084 raft_consensus.cc:2258] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.933856  4084 tablet_replica.cc:330] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
W20260812 19:26:10.934309  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.934979  4084 raft_consensus.cc:2229] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.935766  4084 raft_consensus.cc:2258] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.939342  4084 tablet_replica.cc:330] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
W20260812 19:26:10.940865  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.941998  4084 raft_consensus.cc:2229] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Raft consensus shutting down.
W20260812 19:26:10.942868  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:10.943533  4084 raft_consensus.cc:2258] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.946528  4084 tablet_replica.cc:330] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.947345  4084 raft_consensus.cc:2229] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Raft consensus shutting down.
W20260812 19:26:10.948028  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.948602  4084 raft_consensus.cc:2258] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.967831  4084 tablet_replica.cc:330] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.968914  4084 raft_consensus.cc:2229] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.972218  4084 raft_consensus.cc:2258] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:10.974345  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:10.975235  4084 tablet_replica.cc:330] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.982302  4084 raft_consensus.cc:2229] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.983284  4084 raft_consensus.cc:2258] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:10.982291  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.989895  4084 tablet_replica.cc:330] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.990942  4084 raft_consensus.cc:2229] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.992503  4084 raft_consensus.cc:2258] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.996869  4084 tablet_replica.cc:330] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.997828  4084 raft_consensus.cc:2229] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.999864  4084 raft_consensus.cc:2258] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:10.999936  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:11.005873  4084 tablet_replica.cc:330] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.006888  4084 raft_consensus.cc:2229] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260812 19:26:11.008216  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260812 19:26:11.009927  4084 raft_consensus.cc:2258] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.016250  4084 tablet_replica.cc:330] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.017302  4084 raft_consensus.cc:2229] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260812 19:26:11.018503  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260812 19:26:11.019186  4084 raft_consensus.cc:2258] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:11.020533  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:11.025033  4084 tablet_replica.cc:330] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.025980  4084 raft_consensus.cc:2229] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.030670  4084 raft_consensus.cc:2258] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:11.037894  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:11.044198  4084 tablet_replica.cc:330] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.046553  4084 raft_consensus.cc:2229] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.047855  4084 raft_consensus.cc:2258] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.053233  4084 tablet_replica.cc:330] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.054203  4084 raft_consensus.cc:2229] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.055502  4084 raft_consensus.cc:2258] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:11.058465  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:11.064327  4084 tablet_replica.cc:330] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.065466  4084 raft_consensus.cc:2229] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.069082  4084 raft_consensus.cc:2258] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:11.070611  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:11.072914  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:11.075399  4084 tablet_replica.cc:330] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.076540  4084 raft_consensus.cc:2229] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.078078  4084 raft_consensus.cc:2258] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.081851  4084 tablet_replica.cc:330] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.082801  4084 raft_consensus.cc:2229] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.083745  4084 raft_consensus.cc:2258] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.087018  4084 tablet_replica.cc:330] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.087915  4084 raft_consensus.cc:2229] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.089226  4084 raft_consensus.cc:2258] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.092299  4084 tablet_replica.cc:330] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
W20260812 19:26:11.096894  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:11.097839  4084 raft_consensus.cc:2229] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 25 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.099771  4084 raft_consensus.cc:2258] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.103062  4084 tablet_replica.cc:330] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.103977  4084 raft_consensus.cc:2229] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.104774  4084 raft_consensus.cc:2258] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.107954  4084 tablet_replica.cc:330] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.108912  4084 raft_consensus.cc:2229] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 25 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.110342  4084 raft_consensus.cc:2258] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.113883  4084 tablet_replica.cc:330] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.115371  4084 raft_consensus.cc:2229] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Raft consensus shutting down.
W20260812 19:26:11.127010  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:11.129031  4084 raft_consensus.cc:2258] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.132562  4084 tablet_replica.cc:330] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
W20260812 19:26:11.140240  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260812 19:26:11.141651  4084 raft_consensus.cc:2229] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.142831  4084 raft_consensus.cc:2258] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.146495  4084 tablet_replica.cc:330] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.147447  4084 raft_consensus.cc:2229] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.148756  4084 raft_consensus.cc:2258] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.152191  4084 tablet_replica.cc:330] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.159737  4084 raft_consensus.cc:2229] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.160652  4084 raft_consensus.cc:2258] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.164019  4084 tablet_replica.cc:330] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.165031  4084 raft_consensus.cc:2229] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.166175  4084 raft_consensus.cc:2258] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.169266  4084 tablet_replica.cc:330] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.170202  4084 raft_consensus.cc:2229] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.171725  4084 raft_consensus.cc:2258] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:11.176716  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:11.180286  4084 tablet_replica.cc:330] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.181167  4084 raft_consensus.cc:2229] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.182447  4084 raft_consensus.cc:2258] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.185478  4084 tablet_replica.cc:330] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.186311  4084 raft_consensus.cc:2229] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.187954  4084 raft_consensus.cc:2258] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.191493  4084 tablet_replica.cc:330] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.192391  4084 raft_consensus.cc:2229] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.193176  4084 raft_consensus.cc:2258] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.196305  4084 tablet_replica.cc:330] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.197501  4084 raft_consensus.cc:2229] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.198295  4084 raft_consensus.cc:2258] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.210908  4084 tablet_replica.cc:330] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.211812  4084 raft_consensus.cc:2229] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.212574  4084 raft_consensus.cc:2258] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.216223  4084 tablet_replica.cc:330] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.217095  4084 raft_consensus.cc:2229] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 LEADER]: Raft consensus shutting down.
W20260812 19:26:11.234474  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:11.258471  4084 raft_consensus.cc:2258] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.292523  4084 tablet_replica.cc:330] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.294412  4084 raft_consensus.cc:2229] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.299610  4084 raft_consensus.cc:2258] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.309121  4084 tablet_replica.cc:330] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
W20260812 19:26:11.333576  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260812 19:26:11.348362  4084 raft_consensus.cc:2229] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.351321  4084 raft_consensus.cc:2258] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.355666  4084 tablet_replica.cc:330] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
W20260812 19:26:11.349829  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:11.371975  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260812 19:26:11.373039  4084 raft_consensus.cc:2229] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.374963  4084 raft_consensus.cc:2258] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.390637  4084 tablet_replica.cc:330] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.393663  4084 raft_consensus.cc:2229] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.397320  4084 raft_consensus.cc:2258] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.402755  4084 tablet_replica.cc:330] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.403594  4084 raft_consensus.cc:2229] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.404488  4084 raft_consensus.cc:2258] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:11.532433  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:11.597402  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:11.703262  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:11.720494  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:11.737727  6296 connection.cc:441] server connection from 127.0.0.1:35822 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 2098) could send its response
W20260812 19:26:11.753931  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260812 19:26:11.831446 20372 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:11.832261 20372 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:11.835608 20372 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:11.842831  6416 leader_election.cc:334] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:11.845026  6416 leader_election.cc:334] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:11.845420  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:11.846553 20370 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:11.940263 20372 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:11.940834 20372 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:11.942981 20372 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:11.948148  6416 leader_election.cc:334] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:11.950412  6416 leader_election.cc:334] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:11.950919  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:11.951716 20372 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:26:11.979972  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260812 19:26:12.025442 20370 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.026165 20370 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.028966 20370 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.037894 20372 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.038472 20372 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:26:12.038683  6416 leader_election.cc:334] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.040655 20372 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.042326  6416 leader_election.cc:334] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.042835  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.043686 20372 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:26:12.046913  6416 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:12.047874  6416 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.048341  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.049160 20372 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:12.102562 20372 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.103155 20372 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.105244 20372 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.115406  6416 leader_election.cc:334] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:12.116348  6416 leader_election.cc:334] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.117064  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.120973 20372 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:12.132423 20370 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.133042 20370 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.135255 20370 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.150959  6416 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.153884  6416 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.154448  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.162947 20372 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:12.169452 20372 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.170166 20372 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.174054 20372 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.180965  6416 leader_election.cc:334] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.181778  6416 leader_election.cc:334] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.182260  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.187085 20370 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260812 19:26:12.209807  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:12.218072 20372 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.219774 20370 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.220417 20370 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:26:12.224169 20372 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.227603 20370 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.228399 20372 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.233858 20370 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:26:12.235551  6416 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.234433 20370 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:26:12.238370  6416 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.241156 20370 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.245532 20370 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.246170 20370 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:26:12.254441  6416 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.255156  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.262771 20372 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.265008 20372 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.266407 20375 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:26:12.267284 20372 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.264154 20370 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:26:12.269120  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:12.269785  6416 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.270279  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.273849  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:26:12.282747 20375 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:26:12.296212 20370 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.296810 20370 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.299018 20370 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.301488  6416 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:12.306535  6416 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.307143  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.307971 20370 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260812 19:26:12.314270  6416 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.316318  6416 leader_election.cc:334] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.316869  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:26:12.317850 20370 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260812 19:26:12.318957  6416 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.319413  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.320214 20370 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260812 19:26:12.324229  6416 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.325392 20370 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.325543 20362 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.326051 20370 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.326140 20362 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:26:12.328384 20362 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:26:12.328773  6416 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.329236  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.328384 20370 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.330026 20375 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260812 19:26:12.334013  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:26:12.334739  6464 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 22.
W20260812 19:26:12.340395  7553 leader_election.cc:334] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:12.340930  6416 leader_election.cc:334] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.341575  6416 leader_election.cc:334] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.342068  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.341477  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:26:12.343107 20362 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:26:12.343550 20362 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.343945 20362 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:26:12.348186 20375 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:26:12.358319 20375 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.358927 20375 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.361584 20375 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.362958 20375 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.363518 20375 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.365660 20375 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.366870 20362 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:26:12.377115 20362 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 23 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:26:12.378422  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:26:12.380045  7553 leader_election.cc:334] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.380822  6464 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
W20260812 19:26:12.388571  6416 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.389184  6464 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 23.
W20260812 19:26:12.389339  6416 leader_election.cc:334] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.390522  6416 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.391038  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:12.392066  6416 leader_election.cc:334] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.392403 20370 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.392603  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.393024 20370 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.394889 20372 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:26:12.395782 20372 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:26:12.396546 20372 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.397205 20372 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.400449  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:26:12.401544 20362 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:26:12.402164 20362 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 23 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:26:12.403198 20362 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:26:12.405495 20370 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.416087 20372 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.433583  6416 leader_election.cc:334] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.439430  6052 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 22 to 23, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 23 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:26:12.455062 20375 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.455766 20375 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.458029 20375 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.461854  6416 leader_election.cc:334] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.462483  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.464083 20370 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260812 19:26:12.464452  6416 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:12.472033  6416 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.472597  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.474490 20375 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260812 19:26:12.476468  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260812 19:26:12.477607 20370 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.479314 20370 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.481549 20370 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.486918  6416 leader_election.cc:334] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.489156 20375 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.489725 20375 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:26:12.491413  6416 leader_election.cc:334] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.491940 20375 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.491918  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.495929 20375 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260812 19:26:12.493960  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:12.504388  6416 leader_election.cc:334] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.505750 20372 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.506249 20372 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.508272 20372 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.520069  6416 leader_election.cc:334] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.521448  6416 leader_election.cc:334] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.522020  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.522894 20370 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260812 19:26:12.529408  6416 leader_election.cc:334] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.530432 20370 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.531031 20370 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.532908 20370 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.529958  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.534102 20370 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260812 19:26:12.540449  6416 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.546759 20370 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.547307 20370 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.549283 20370 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.563184 20370 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.563709 20370 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.565636 20370 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.566707  6416 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.568214  6416 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.568655  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.571080 20370 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260812 19:26:12.572067 20370 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.572615 20370 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.574776 20370 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.576408  6416 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.577330  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.579613 20370 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260812 19:26:12.587170  6416 leader_election.cc:334] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.588752  6416 leader_election.cc:334] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.589231  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.589975 20370 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260812 19:26:12.600569  6416 leader_election.cc:334] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.601177  6416 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.605006  6416 leader_election.cc:334] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.605495  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.606470 20370 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260812 19:26:12.607532  6416 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.607954  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.608691 20370 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260812 19:26:12.624192  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:12.628648  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:12.748673  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:12.763259  4084 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 6396)
W20260812 19:26:12.765542  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:12.814960  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260812 19:26:12.962555  6464 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260812 19:26:12.972020  7553 consensus_peers.cc:487] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:12.972075 20367 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260812 19:26:13.041931  7553 consensus_peers.cc:487] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:13.089495  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.097554  7553 consensus_peers.cc:487] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.121986  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.142493  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.163322  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.163870  7553 consensus_peers.cc:487] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.164786  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.184598  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.199913  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.205696  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.208979  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.221489  6416 consensus_peers.cc:487] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.234077  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.247728  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.263463  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.279105  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.280697  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.281148  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.322005  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.338491  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:13.361467  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.364898  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.389151  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.419287  7553 consensus_peers.cc:487] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.493050  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.500581  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.548353  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.556205  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.574261  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:13.585455  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.596796  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:13.665380 20406 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:13.666678 20406 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:13.668931 20406 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:13.682471  6416 leader_election.cc:334] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:13.685287  6416 leader_election.cc:334] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:13.687472  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:13.688269 20406 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:26:13.695338  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.712560  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.723101  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.736192  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.736760  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.740583  7553 consensus_peers.cc:487] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:13.818549 20406 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:13.819159 20406 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:13.820902 20406 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:13.827817  6416 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:13.828934  6416 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:13.829373  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:13.830731 20406 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260812 19:26:13.843958 20406 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:13.844514 20406 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:13.847113 20406 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:13.856000  6416 leader_election.cc:334] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:13.859776  6416 leader_election.cc:334] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:13.860195  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:13.860893 20406 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:13.918130 20408 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:13.918774 20408 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:13.920552 20408 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:13.928146  6416 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:13.928826  6416 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:13.929183  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:13.929803 20408 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:13.985255 20406 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:13.985878 20406 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:13.987847 20406 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:13.988926 20406 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:13.990161 20406 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:13.992129 20406 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.001449  6416 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:14.001952  6416 leader_election.cc:334] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:14.002526  6416 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.002924  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:14.003628 20406 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260812 19:26:14.003795  6416 leader_election.cc:334] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.004237  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:14.004948 20406 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:14.012790 20406 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.013229 20406 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.016952 20406 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.054344  6416 leader_election.cc:334] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:14.057863  6416 leader_election.cc:334] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.058389  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:14.060319 20406 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:14.111763 20408 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.112327 20408 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.114400 20408 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.116660 20408 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.117151 20408 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.123980 20408 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.128109  6416 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:14.134260  6416 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.134826  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:14.136454 20408 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260812 19:26:14.146456  6416 leader_election.cc:334] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:14.147318  6416 leader_election.cc:334] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:14.147773  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:14.150365 20408 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:26:14.165464 20406 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.166028 20406 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.168270 20406 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.168311  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:14.181988  6416 leader_election.cc:334] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.188845 20406 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.189383 20406 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.191107 20406 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.195497  6416 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:14.246919  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260812 19:26:14.247437 20406 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.248016 20406 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.250015 20406 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.252529 20408 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.253041 20408 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.254971 20408 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.258486  6416 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:14.264138  6416 leader_election.cc:334] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.285223  4084 tablet_server.cc:194] TabletServer@127.3.253.2:0 shutdown complete.
I20260812 19:26:14.289319 20406 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.289950 20406 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.291893 20406 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.303499  6416 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.321507 20406 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.322283 20406 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:26:14.324540 20406 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.328156  6416 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.328645 20406 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.334206 20408 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.335331 20408 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.337380 20408 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.339082 20406 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.339968 20408 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.340699 20408 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:26:14.341234  6416 leader_election.cc:334] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.343538 20406 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.343961 20408 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.346582 20408 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:26:14.347167  6416 leader_election.cc:334] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.347277 20408 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:26:14.347820  6416 leader_election.cc:334] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.349238 20408 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.352119  6416 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.451943  4084 tablet_server.cc:178] TabletServer@127.3.253.3:0 shutting down...
I20260812 19:26:14.469667 20406 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.470316 20406 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.473922 20406 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.474752 20406 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.475401 20406 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.477784 20406 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.495267  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:14.496879  7553 consensus_peers.cc:487] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:14.495769 20406 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.497732 20406 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.499773 20406 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.503818 20411 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.505897 20411 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:26:14.506855  6138 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260812 19:26:14.507290  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260812 19:26:14.508044  6416 leader_election.cc:334] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.508291 20411 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.514484  6416 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:14.515153  6416 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:14.518927  7553 consensus_peers.cc:487] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:14.519997 20411 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.520581 20411 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.522786 20411 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.523865  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:14.525424  6416 leader_election.cc:334] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:14.529412  6416 leader_election.cc:334] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:14.550477  7553 consensus_peers.cc:487] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:14.560803  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:26:14.561684  4084 tablet_replica.cc:330] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.562439  4084 raft_consensus.cc:2229] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.563028  4084 raft_consensus.cc:2258] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.565161  4084 tablet_replica.cc:330] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.566044  4084 raft_consensus.cc:2229] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.566599  4084 raft_consensus.cc:2258] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.568917  4084 tablet_replica.cc:330] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
W20260812 19:26:14.569290  7553 consensus_peers.cc:487] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:14.569592  4084 raft_consensus.cc:2229] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.570293  4084 raft_consensus.cc:2258] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.572216  4084 tablet_replica.cc:330] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.572839  4084 raft_consensus.cc:2229] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.573655  4084 raft_consensus.cc:2258] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.576048  4084 tablet_replica.cc:330] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.576926  4084 raft_consensus.cc:2229] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.577680  4084 raft_consensus.cc:2258] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.579595  4084 tablet_replica.cc:330] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.580183  4084 raft_consensus.cc:2229] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.581000  4084 raft_consensus.cc:2258] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.582824  4084 tablet_replica.cc:330] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.583365  4084 raft_consensus.cc:2229] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.583900  4084 raft_consensus.cc:2258] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.585695  4084 tablet_replica.cc:330] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.586436  4084 raft_consensus.cc:2229] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.587111  4084 raft_consensus.cc:2258] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.589607  4084 tablet_replica.cc:330] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.590396  4084 raft_consensus.cc:2229] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.591264  4084 raft_consensus.cc:2258] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.593113  4084 tablet_replica.cc:330] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.593710  4084 raft_consensus.cc:2229] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.594126  4084 raft_consensus.cc:2258] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.596051  4084 tablet_replica.cc:330] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.596570  4084 raft_consensus.cc:2229] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.597052  4084 raft_consensus.cc:2258] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.599030  4084 tablet_replica.cc:330] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.599537  4084 raft_consensus.cc:2229] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.600291  4084 raft_consensus.cc:2258] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.602305  4084 tablet_replica.cc:330] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.602912  4084 raft_consensus.cc:2229] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.603380  4084 raft_consensus.cc:2258] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.605576  4084 tablet_replica.cc:330] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.606302  4084 raft_consensus.cc:2229] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.606891  4084 raft_consensus.cc:2258] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.609190  4084 tablet_replica.cc:330] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.609771  4084 raft_consensus.cc:2229] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.610267  4084 raft_consensus.cc:2258] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.612841  4084 tablet_replica.cc:330] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.613436  4084 raft_consensus.cc:2229] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.614225  4084 raft_consensus.cc:2258] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.613905 20411 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.614971 20411 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.617288 20411 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.617411  4084 tablet_replica.cc:330] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.618921  4084 raft_consensus.cc:2229] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.619551  4084 raft_consensus.cc:2258] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:14.621433  6416 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.622151  4084 tablet_replica.cc:330] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.622884  4084 raft_consensus.cc:2229] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.623579  4084 raft_consensus.cc:2258] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.625448  4084 tablet_replica.cc:330] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.626014  4084 raft_consensus.cc:2229] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.626466  4084 raft_consensus.cc:2258] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:14.628407  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:14.628613  4084 tablet_replica.cc:330] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.629328  4084 raft_consensus.cc:2229] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 26 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.630076  4084 raft_consensus.cc:2258] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.632017  4084 tablet_replica.cc:330] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.632578  4084 raft_consensus.cc:2229] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.633068  4084 raft_consensus.cc:2258] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.634969  4084 tablet_replica.cc:330] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.635496  4084 raft_consensus.cc:2229] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.635918  4084 raft_consensus.cc:2258] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.637604  4084 tablet_replica.cc:330] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.638197  4084 raft_consensus.cc:2229] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.638634  4084 raft_consensus.cc:2258] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.640627  4084 tablet_replica.cc:330] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.641157  4084 raft_consensus.cc:2229] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.641856  4084 raft_consensus.cc:2258] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.643784  4084 tablet_replica.cc:330] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.644404  4084 raft_consensus.cc:2229] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.644866  4084 raft_consensus.cc:2258] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.646612  4084 tablet_replica.cc:330] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.647248  4084 raft_consensus.cc:2229] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.647850  4084 raft_consensus.cc:2258] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.650182  4084 tablet_replica.cc:330] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
W20260812 19:26:14.650146  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:14.651121  4084 raft_consensus.cc:2229] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.651597  4084 raft_consensus.cc:2258] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.653571  4084 tablet_replica.cc:330] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.654086  4084 raft_consensus.cc:2229] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.654520  4084 raft_consensus.cc:2258] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.656754  4084 tablet_replica.cc:330] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.657435  4084 raft_consensus.cc:2229] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.658136  4084 raft_consensus.cc:2258] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.660163  4084 tablet_replica.cc:330] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.660698  4084 raft_consensus.cc:2229] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 27 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.661535  4084 raft_consensus.cc:2258] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.663439  4084 tablet_replica.cc:330] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.663981  4084 raft_consensus.cc:2229] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.664412  4084 raft_consensus.cc:2258] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.666193  4084 tablet_replica.cc:330] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.666782  4084 raft_consensus.cc:2229] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.667268  4084 raft_consensus.cc:2258] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.669183  4084 tablet_replica.cc:330] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.669710  4084 raft_consensus.cc:2229] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.670461  4084 raft_consensus.cc:2258] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.672287  4084 tablet_replica.cc:330] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.672838  4084 raft_consensus.cc:2229] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 19 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.673521  4084 raft_consensus.cc:2258] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.675422  4084 tablet_replica.cc:330] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.675956  4084 raft_consensus.cc:2229] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 22 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.676808  4084 raft_consensus.cc:2258] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.678726  4084 tablet_replica.cc:330] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.679271  4084 raft_consensus.cc:2229] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.679730  4084 raft_consensus.cc:2258] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.681375  4084 tablet_replica.cc:330] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.681804  4084 raft_consensus.cc:2229] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.682180  4084 raft_consensus.cc:2258] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.683962  4084 tablet_replica.cc:330] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.684484  4084 raft_consensus.cc:2229] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.685396  4084 raft_consensus.cc:2258] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.687165  4084 tablet_replica.cc:330] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.687601  4084 raft_consensus.cc:2229] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.688052  4084 raft_consensus.cc:2258] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.689700  4084 tablet_replica.cc:330] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.690187  4084 raft_consensus.cc:2229] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.690903  4084 raft_consensus.cc:2258] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.692633  4084 tablet_replica.cc:330] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.693116  4084 raft_consensus.cc:2229] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.693491  4084 raft_consensus.cc:2258] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.695293  4084 tablet_replica.cc:330] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.695756  4084 raft_consensus.cc:2229] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.696226  4084 raft_consensus.cc:2258] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.697896  4084 tablet_replica.cc:330] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.698360  4084 raft_consensus.cc:2229] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.698772  4084 raft_consensus.cc:2258] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.700457  4084 tablet_replica.cc:330] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.700924  4084 raft_consensus.cc:2229] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 25 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.701617  4084 raft_consensus.cc:2258] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.703258  4084 tablet_replica.cc:330] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.703718  4084 raft_consensus.cc:2229] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.704406  4084 raft_consensus.cc:2258] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.706713  4084 tablet_replica.cc:330] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.707409  4084 raft_consensus.cc:2229] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.708135  4084 raft_consensus.cc:2258] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:14.708959  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260812 19:26:14.710152  4084 tablet_replica.cc:330] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.710942  4084 raft_consensus.cc:2229] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.711517  4084 raft_consensus.cc:2258] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.713924  4084 tablet_replica.cc:330] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
W20260812 19:26:14.713967  7553 consensus_peers.cc:487] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:14.714510  4084 raft_consensus.cc:2229] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.715252  4084 raft_consensus.cc:2258] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.717326  4084 tablet_replica.cc:330] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.718020  4084 raft_consensus.cc:2229] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 25 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.718885  4084 raft_consensus.cc:2258] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.721403  4084 tablet_replica.cc:330] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.721897  4084 raft_consensus.cc:2229] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.722501  4084 raft_consensus.cc:2258] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.724296  4084 tablet_replica.cc:330] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.724768  4084 raft_consensus.cc:2229] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.725441  4084 raft_consensus.cc:2258] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.727255  4084 tablet_replica.cc:330] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.727715  4084 raft_consensus.cc:2229] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.728196  4084 raft_consensus.cc:2258] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:14.736459  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:14.739945  7553 consensus_peers.cc:487] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:14.746635  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:14.760310  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:15.041633  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260812 19:26:15.171299 20415 leader_election.cc:334] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.171762 20415 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.172338 20415 raft_consensus.cc:2670] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260812 19:26:15.173960  4084 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Aborted: reactor is shutting down (error 108)
I20260812 19:26:15.174412  4084 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.174688 20415 leader_election.cc:334] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
W20260812 19:26:15.175043  4084 raft_consensus.cc:2670] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260812 19:26:15.175951 20415 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.177901 20415 raft_consensus.cc:2670] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260812 19:26:15.180688 20415 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.181139 20415 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.181775 20415 raft_consensus.cc:2670] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.183781 20415 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.184113 20415 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.184589 20415 raft_consensus.cc:2670] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.186079 20415 leader_election.cc:334] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.186430 20415 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.186969 20415 raft_consensus.cc:2670] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.188714 20415 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.189054 20415 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.189494 20415 raft_consensus.cc:2670] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.191011 20415 leader_election.cc:334] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.191723 20415 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.192731 20415 raft_consensus.cc:2670] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.194960 20415 leader_election.cc:334] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.195413 20415 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.195983 20415 raft_consensus.cc:2670] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.197500 20415 leader_election.cc:334] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.197835 20415 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.198303 20415 raft_consensus.cc:2670] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.200053 20415 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.200418 20415 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.200868 20415 raft_consensus.cc:2670] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.203533 20415 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.203876 20415 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.204324 20415 raft_consensus.cc:2670] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.205822 20415 leader_election.cc:334] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.206158 20415 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.206629 20415 raft_consensus.cc:2670] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.208277 20415 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.208633 20415 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.209182 20415 raft_consensus.cc:2670] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.211783 20415 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.212169 20415 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.212682 20415 raft_consensus.cc:2670] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.215992 20415 leader_election.cc:334] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.216487 20415 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.216965 20415 raft_consensus.cc:2670] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.271050  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260812 19:26:15.364024  7553 consensus_peers.cc:487] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:15.370203  6113 debug-util.cc:398] Leaking SignalData structure 0x7b080016ba40 after lost signal to thread 4090
W20260812 19:26:15.371330  6113 debug-util.cc:398] Leaking SignalData structure 0x7b0800327240 after lost signal to thread 6116
W20260812 19:26:15.372690  6113 debug-util.cc:398] Leaking SignalData structure 0x7b080037e560 after lost signal to thread 6521
W20260812 19:26:15.373991  6113 debug-util.cc:398] Leaking SignalData structure 0x7b08003a9ba0 after lost signal to thread 7647
W20260812 19:26:15.452916  7553 consensus_peers.cc:487] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.453604  7553 consensus_peers.cc:487] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.606698  6138 auto_rebalancer.cc:254] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.3.253.3:42599: connect: Connection refused (error 111)
W20260812 19:26:15.613917  6138 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.3.253.3:42599: connect: Connection refused (error 111)
W20260812 19:26:15.614271  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.3.253.3:42599: connect: Connection refused (error 111)
W20260812 19:26:15.619335  6138 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:15.619668  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:15.624780  6138 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:15.625093  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:15.632162  6138 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.3.253.3:42599: connect: Connection refused (error 111)
W20260812 19:26:15.632472  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.3.253.3:42599: connect: Connection refused (error 111)
W20260812 19:26:15.636116  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:15.638840  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.730592  7553 consensus_peers.cc:487] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.752182  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.803572  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260812 19:26:15.843850  4084 tablet_server.cc:194] TabletServer@127.3.253.3:0 shutdown complete.
W20260812 19:26:15.856714  7553 consensus_peers.cc:487] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.871548  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.926015  7553 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111) [suppressed 610 similar messages]
W20260812 19:26:15.928864  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.939970  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:26:15.940749  4084 tablet_server.cc:178] TabletServer@127.3.253.4:0 shutting down...
I20260812 19:26:15.979390 20414 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:26:15.980628 20414 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:26:15.984196 20414 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:26:15.984968 20414 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:26:15.985428 20414 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:26:15.988224 20414 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:26:15.991370  7553 leader_election.cc:334] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:15.992439  7553 leader_election.cc:334] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Network error: Client connection negotiation failed: client connection to 127.3.253.3:42599: connect: Connection refused (error 111)
I20260812 19:26:15.992889  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:26:15.993777 20414 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260812 19:26:15.998932  7553 leader_election.cc:334] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:15.999928  7553 leader_election.cc:334] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Network error: Client connection negotiation failed: client connection to 127.3.253.3:42599: connect: Connection refused (error 111)
I20260812 19:26:16.000270  7553 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:26:16.000960 20362 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260812 19:26:16.001058  7553 leader_election.cc:334] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:16.003633  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:26:16.004735  4084 tablet_replica.cc:330] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.006201  4084 raft_consensus.cc:2229] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Raft consensus shutting down.
W20260812 19:26:16.006852  7553 consensus_peers.cc:487] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:26:16.006973  4084 raft_consensus.cc:2258] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.009757  4084 tablet_replica.cc:330] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.010345  4084 raft_consensus.cc:2229] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.011266  4084 raft_consensus.cc:2258] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.013417  4084 tablet_replica.cc:330] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.014045  4084 raft_consensus.cc:2229] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:16.014524  4084 raft_consensus.cc:2258] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.016753  4084 tablet_replica.cc:330] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.017356  4084 raft_consensus.cc:2229] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.018183  4084 raft_consensus.cc:2258] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.020289  4084 tablet_replica.cc:330] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.020840  4084 raft_consensus.cc:2229] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.021723  4084 raft_consensus.cc:2258] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.023841  4084 tablet_replica.cc:330] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.024418  4084 raft_consensus.cc:2229] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 19 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.025390  4084 raft_consensus.cc:2258] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.027560  4084 tablet_replica.cc:330] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.028110  4084 raft_consensus.cc:2229] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.028923  4084 raft_consensus.cc:2258] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.031052  4084 tablet_replica.cc:330] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.031600  4084 raft_consensus.cc:2229] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.032502  4084 raft_consensus.cc:2258] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.034581  4084 tablet_replica.cc:330] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.035168  4084 raft_consensus.cc:2229] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a [term 3 LEARNER]: Raft consensus shutting down.
I20260812 19:26:16.035590  4084 pending_rounds.cc:62] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: Trying to abort 2 pending ops.
I20260812 19:26:16.035748  4084 pending_rounds.cc:68] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7317760215552921600 op_type: NO_OP noop_request { }
I20260812 19:26:16.036101  4084 raft_consensus.cc:2866] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a [term 3 LEARNER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:26:16.036334  4084 pending_rounds.cc:68] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7317760165250699264 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "6454eb944afe4306b52388febd0f82bb" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } } new_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } } }
I20260812 19:26:16.037030  4084 raft_consensus.cc:2894] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a [term 3 LEARNER]: Aborting config change with OpId 1.2: Aborted: Op aborted
I20260812 19:26:16.037374  4084 raft_consensus.cc:2866] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a [term 3 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260812 19:26:16.037624  4084 raft_consensus.cc:2258] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a [term 3 NON_PARTICIPANT]: Raft consensus is shut down!
I20260812 19:26:16.039930  4084 tablet_replica.cc:330] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.040585  4084 raft_consensus.cc:2229] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEARNER]: Raft consensus shutting down.
I20260812 19:26:16.041078  4084 pending_rounds.cc:62] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: Trying to abort 1 pending ops.
I20260812 19:26:16.041277  4084 pending_rounds.cc:68] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: Aborting op as it isn't in flight: id { term: 8 index: 7 } timestamp: 7317760428476964864 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "529ed979cd2842acb5bc24debb151b93" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } } new_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } } }
I20260812 19:26:16.042142  4084 raft_consensus.cc:2894] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEARNER]: Aborting config change with OpId 8.7: Aborted: Op aborted
I20260812 19:26:16.042546  4084 raft_consensus.cc:2866] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a [term 9 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260812 19:26:16.042902  4084 raft_consensus.cc:2258] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a [term 9 NON_PARTICIPANT]: Raft consensus is shut down!
I20260812 19:26:16.045552  4084 tablet_replica.cc:330] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.046213  4084 raft_consensus.cc:2229] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.047106  4084 raft_consensus.cc:2258] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.049152  4084 tablet_replica.cc:330] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.049746  4084 raft_consensus.cc:2229] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEARNER]: Raft consensus shutting down.
I20260812 19:26:16.050127  4084 pending_rounds.cc:62] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: Trying to abort 1 pending ops.
I20260812 19:26:16.050310  4084 pending_rounds.cc:68] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: Aborting op as it isn't in flight: id { term: 6 index: 4 } timestamp: 7317760333410623488 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } } new_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } } }
I20260812 19:26:16.051033  4084 raft_consensus.cc:2894] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEARNER]: Aborting config change with OpId 6.4: Aborted: Op aborted
I20260812 19:26:16.051319  4084 raft_consensus.cc:2866] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a [term 7 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260812 19:26:16.051560  4084 raft_consensus.cc:2258] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a [term 7 NON_PARTICIPANT]: Raft consensus is shut down!
I20260812 19:26:16.053759  4084 tablet_replica.cc:330] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.054306  4084 raft_consensus.cc:2229] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 21 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.055159  4084 raft_consensus.cc:2258] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.057164  4084 tablet_replica.cc:330] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.057703  4084 raft_consensus.cc:2229] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 21 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.058537  4084 raft_consensus.cc:2258] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.060715  4084 tablet_replica.cc:330] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.061276  4084 raft_consensus.cc:2229] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:16.061777  4084 raft_consensus.cc:2258] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.063789  4084 tablet_replica.cc:330] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.064312  4084 raft_consensus.cc:2229] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.065205  4084 raft_consensus.cc:2258] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.067301  4084 tablet_replica.cc:330] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.067823  4084 raft_consensus.cc:2229] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.068701  4084 raft_consensus.cc:2258] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.070585  4084 tablet_replica.cc:330] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.071127  4084 raft_consensus.cc:2229] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.072023  4084 raft_consensus.cc:2258] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.074199  4084 tablet_replica.cc:330] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.074705  4084 raft_consensus.cc:2229] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.075559  4084 raft_consensus.cc:2258] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.077625  4084 tablet_replica.cc:330] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.078131  4084 raft_consensus.cc:2229] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 20 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.079033  4084 raft_consensus.cc:2258] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.081125  4084 tablet_replica.cc:330] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.081686  4084 raft_consensus.cc:2229] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.082489  4084 raft_consensus.cc:2258] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.084411  4084 tablet_replica.cc:330] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.084910  4084 raft_consensus.cc:2229] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 19 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.085744  4084 raft_consensus.cc:2258] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.087795  4084 tablet_replica.cc:330] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.088253  4084 raft_consensus.cc:2229] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.089046  4084 raft_consensus.cc:2258] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.091120  4084 tablet_replica.cc:330] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.091543  4084 raft_consensus.cc:2229] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:16.092041  4084 raft_consensus.cc:2258] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.326083  4084 tablet_server.cc:194] TabletServer@127.3.253.4:0 shutdown complete.
I20260812 19:26:16.374172  4084 master.cc:537] Master@127.3.253.62:46555 shutting down...
I20260812 19:26:16.417908  4084 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.418713  4084 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.419175  4084 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: stopping tablet replica
I20260812 19:26:16.608448  4084 master.cc:552] Master@127.3.253.62:46555 shutdown complete.
I20260812 19:26:16.651647  4084 test_util.cc:175] -----------------------------------------------
I20260812 19:26:16.651877  4084 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0

[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 19:20:32.895303  4084 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.253.62:45767
I20260812 19:20:32.897197  4084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 19:20:32.898406  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:20:32.940105  4100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:20:32.940331  4097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:20:32.941424  4096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:20:34.222410  4098 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260812 19:20:34.222599  4084 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260812 19:20:34.227030  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:20:34.227303  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:20:34.227463  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562434227449 us; error 0 us; skew 500 ppm
I20260812 19:20:34.228332  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:20:34.238350  4084 webserver.cc:460] Webserver started at http://127.3.253.62:41395/ using document root <none> and password file <none>
I20260812 19:20:34.239539  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:20:34.239787  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:20:34.240262  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:20:34.247911  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/master-0-root/instance:
uuid: "641f3687454143feaa969040f2302440"
format_stamp: "Formatted at 2026-08-12 19:20:34 on dist-test-slave-3kk6"
I20260812 19:20:34.258514  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.010s	user 0.009s	sys 0.001s
I20260812 19:20:34.265930  4113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:20:34.267812  4084 fs_manager.cc:725] Time spent opening block manager: real 0.006s	user 0.006s	sys 0.000s
I20260812 19:20:34.268283  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/master-0-root
uuid: "641f3687454143feaa969040f2302440"
format_stamp: "Formatted at 2026-08-12 19:20:34 on dist-test-slave-3kk6"
I20260812 19:20:34.268745  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:20:34.329267  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:20:34.331476  4084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 19:20:34.332146  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:20:34.465418  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.62:45767
I20260812 19:20:34.465662  4204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.62:45767 every 8 connection(s)
I20260812 19:20:34.474628  4205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:34.509282  4205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440: Bootstrap starting.
I20260812 19:20:34.517712  4205 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:34.520320  4205 log.cc:824] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440: Log is configured to *not* fsync() on all Append() calls
I20260812 19:20:34.526901  4205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440: No bootstrap required, opened a new log
I20260812 19:20:34.556710  4205 raft_consensus.cc:348] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641f3687454143feaa969040f2302440" member_type: VOTER }
I20260812 19:20:34.557672  4205 raft_consensus.cc:374] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:34.558017  4205 raft_consensus.cc:729] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641f3687454143feaa969040f2302440, State: Initialized, Role: FOLLOWER
I20260812 19:20:34.559211  4205 consensus_queue.cc:260] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641f3687454143feaa969040f2302440" member_type: VOTER }
I20260812 19:20:34.559904  4205 raft_consensus.cc:388] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 19:20:34.560292  4205 raft_consensus.cc:482] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 19:20:34.560737  4205 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:34.566521  4205 raft_consensus.cc:504] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641f3687454143feaa969040f2302440" member_type: VOTER }
I20260812 19:20:34.567570  4205 leader_election.cc:302] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 641f3687454143feaa969040f2302440; no voters: 
I20260812 19:20:34.570204  4205 leader_election.cc:288] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 19:20:34.570772  4209 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:20:34.576069  4209 raft_consensus.cc:686] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [term 1 LEADER]: Becoming Leader. State: Replica: 641f3687454143feaa969040f2302440, State: Running, Role: LEADER
I20260812 19:20:34.577318  4209 consensus_queue.cc:237] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641f3687454143feaa969040f2302440" member_type: VOTER }
I20260812 19:20:34.579025  4205 sys_catalog.cc:564] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 19:20:34.590054  4126 tablet.cc:2369] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:20:34.594738  4210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 641f3687454143feaa969040f2302440. Latest consensus state: current_term: 1 leader_uuid: "641f3687454143feaa969040f2302440" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641f3687454143feaa969040f2302440" member_type: VOTER } }
I20260812 19:20:34.594501  4213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "641f3687454143feaa969040f2302440" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641f3687454143feaa969040f2302440" member_type: VOTER } }
I20260812 19:20:34.595547  4210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [sys.catalog]: This master's current role is: LEADER
I20260812 19:20:34.595561  4213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [sys.catalog]: This master's current role is: LEADER
I20260812 19:20:34.600874  4229 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 19:20:34.617558  4229 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 19:20:34.630811  4084 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 19:20:34.643507  4229 catalog_manager.cc:1347] Generated new cluster ID: c45a2f3559ee4bb3bb590b861e090597
I20260812 19:20:34.643937  4229 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:20:34.682040  4229 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 19:20:34.685933  4229 catalog_manager.cc:1504] Loading token signing keys...
I20260812 19:20:34.703382  4229 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440: Generated new TSK 0
I20260812 19:20:34.705293  4229 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:20:34.764077  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:20:34.776307  4260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:20:34.779778  4261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:20:34.788301  4266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:20:34.792796  4084 server_base.cc:1034] running on GCE node
I20260812 19:20:34.793761  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:20:34.793998  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:20:34.794188  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562434794170 us; error 0 us; skew 500 ppm
I20260812 19:20:34.794873  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:20:34.801496  4084 webserver.cc:460] Webserver started at http://127.3.253.1:46189/ using document root <none> and password file <none>
I20260812 19:20:34.802191  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:20:34.802438  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:20:34.802806  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:20:34.804121  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/ts-0-root/instance:
uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
format_stamp: "Formatted at 2026-08-12 19:20:34 on dist-test-slave-3kk6"
I20260812 19:20:34.811699  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.002s
I20260812 19:20:34.817157  4275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:20:34.818218  4084 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
I20260812 19:20:34.818691  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/ts-0-root
uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
format_stamp: "Formatted at 2026-08-12 19:20:34 on dist-test-slave-3kk6"
I20260812 19:20:34.819130  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:20:34.839751  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:20:34.842002  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:20:34.845631  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:20:34.852293  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:20:34.852648  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:20:34.852982  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:20:34.853214  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:20:35.000958  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.1:45593
I20260812 19:20:35.001003  4382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.1:45593 every 8 connection(s)
I20260812 19:20:35.010607  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:20:35.036113  4387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:20:35.040165  4388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:20:35.046005  4390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:20:35.057458  4084 server_base.cc:1034] running on GCE node
I20260812 19:20:35.058692  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:20:35.059010  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:20:35.059263  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562435059238 us; error 0 us; skew 500 ppm
I20260812 19:20:35.060048  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:20:35.064098  4383 heartbeater.cc:347] Connected to a master server at 127.3.253.62:45767
I20260812 19:20:35.064786  4383 heartbeater.cc:464] Registering TS with master...
I20260812 19:20:35.066519  4383 heartbeater.cc:511] Master 127.3.253.62:45767 requested a full tablet report, sending...
I20260812 19:20:35.067416  4084 webserver.cc:460] Webserver started at http://127.3.253.2:45865/ using document root <none> and password file <none>
I20260812 19:20:35.068166  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:20:35.068440  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:20:35.068796  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:20:35.070564  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/ts-1-root/instance:
uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
format_stamp: "Formatted at 2026-08-12 19:20:35 on dist-test-slave-3kk6"
I20260812 19:20:35.071226  4143 ts_manager.cc:194] Registered new tserver with Master: 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593)
I20260812 19:20:35.074824  4143 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58518
I20260812 19:20:35.078756  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.005s
I20260812 19:20:35.084110  4401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:20:35.085147  4084 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260812 19:20:35.085445  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/ts-1-root
uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
format_stamp: "Formatted at 2026-08-12 19:20:35 on dist-test-slave-3kk6"
I20260812 19:20:35.085731  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:20:35.121332  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:20:35.123215  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:20:35.125185  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:20:35.128443  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:20:35.128648  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:20:35.128961  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:20:35.129107  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:20:35.367919  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.2:45765
I20260812 19:20:35.368269  4501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.2:45765 every 8 connection(s)
I20260812 19:20:35.391191  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:20:35.407456  4512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:20:35.409672  4504 heartbeater.cc:347] Connected to a master server at 127.3.253.62:45767
I20260812 19:20:35.410108  4504 heartbeater.cc:464] Registering TS with master...
I20260812 19:20:35.411504  4504 heartbeater.cc:511] Master 127.3.253.62:45767 requested a full tablet report, sending...
I20260812 19:20:35.415179  4143 ts_manager.cc:194] Registered new tserver with Master: 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765)
I20260812 19:20:35.419615  4143 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58524
W20260812 19:20:35.423111  4515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:20:35.432570  4517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:20:35.435562  4084 server_base.cc:1034] running on GCE node
I20260812 19:20:35.436645  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:20:35.436895  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:20:35.437089  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562435437076 us; error 0 us; skew 500 ppm
I20260812 19:20:35.437672  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:20:35.440822  4084 webserver.cc:460] Webserver started at http://127.3.253.3:34761/ using document root <none> and password file <none>
I20260812 19:20:35.441352  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:20:35.441586  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:20:35.441882  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:20:35.443090  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/ts-2-root/instance:
uuid: "8123980701894dcd92e770f7b8b87bac"
format_stamp: "Formatted at 2026-08-12 19:20:35 on dist-test-slave-3kk6"
I20260812 19:20:35.448572  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.002s
I20260812 19:20:35.454015  4528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:20:35.455145  4084 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260812 19:20:35.455500  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/ts-2-root
uuid: "8123980701894dcd92e770f7b8b87bac"
format_stamp: "Formatted at 2026-08-12 19:20:35 on dist-test-slave-3kk6"
I20260812 19:20:35.455861  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786562432658360-4084-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:20:35.478766  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:20:35.480880  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:20:35.485201  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:20:35.490638  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:20:35.490957  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:20:35.491214  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:20:35.491391  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:20:35.762933  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.3:37975
I20260812 19:20:35.763850  4643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.3:37975 every 8 connection(s)
I20260812 19:20:35.800901  4644 heartbeater.cc:347] Connected to a master server at 127.3.253.62:45767
I20260812 19:20:35.801553  4644 heartbeater.cc:464] Registering TS with master...
I20260812 19:20:35.802892  4644 heartbeater.cc:511] Master 127.3.253.62:45767 requested a full tablet report, sending...
I20260812 19:20:35.806191  4143 ts_manager.cc:194] Registered new tserver with Master: 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:35.808601  4143 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58532
I20260812 19:20:35.809158  4084 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.031348131s
I20260812 19:20:35.817070  4084 test_util.cc:268] Using random seed: 2069569106
I20260812 19:20:35.917078  4143 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58534:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 19:20:35.924561  4143 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:20:36.080960  4383 heartbeater.cc:503] Master 127.3.253.62:45767 was elected leader, sending a full tablet report...
I20260812 19:20:36.110579  4575 tablet_service.cc:1467] Processing CreateTablet for tablet 9533c5aca216454db2e9cbe4e7abfde0 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260812 19:20:36.110603  4576 tablet_service.cc:1467] Processing CreateTablet for tablet 3d3287dd700842499e82be426018f0ba (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260812 19:20:36.116178  4571 tablet_service.cc:1467] Processing CreateTablet for tablet d8040d6a29794f9ca9cdaed5e1ea7026 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260812 19:20:36.116042  4572 tablet_service.cc:1467] Processing CreateTablet for tablet a9e58d3956004c2f9ad49d24e2e07f4b (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260812 19:20:36.118309  4575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9533c5aca216454db2e9cbe4e7abfde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.121896  4569 tablet_service.cc:1467] Processing CreateTablet for tablet 0629a1a838d347cd963068ac65351009 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260812 19:20:36.133358  4576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d3287dd700842499e82be426018f0ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.128496  4566 tablet_service.cc:1467] Processing CreateTablet for tablet 4489d7f9dfbd4ae39b26df513e5ac14d (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260812 19:20:36.142022  4444 tablet_service.cc:1467] Processing CreateTablet for tablet 9533c5aca216454db2e9cbe4e7abfde0 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260812 19:20:36.157634  4569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0629a1a838d347cd963068ac65351009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.171274  4565 tablet_service.cc:1467] Processing CreateTablet for tablet 4ee31345b54f4889a8908b6b3dc720c8 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260812 19:20:36.176488  4566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4489d7f9dfbd4ae39b26df513e5ac14d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.158910  4445 tablet_service.cc:1467] Processing CreateTablet for tablet 3d3287dd700842499e82be426018f0ba (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260812 19:20:36.158987  4319 tablet_service.cc:1467] Processing CreateTablet for tablet 3d3287dd700842499e82be426018f0ba (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260812 19:20:36.160053  4443 tablet_service.cc:1467] Processing CreateTablet for tablet a9e58d3956004c2f9ad49d24e2e07f4b (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260812 19:20:36.178768  4317 tablet_service.cc:1467] Processing CreateTablet for tablet a9e58d3956004c2f9ad49d24e2e07f4b (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260812 19:20:36.168550  4437 tablet_service.cc:1467] Processing CreateTablet for tablet 4ee31345b54f4889a8908b6b3dc720c8 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260812 19:20:36.190492  4444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9533c5aca216454db2e9cbe4e7abfde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.180958  4441 tablet_service.cc:1467] Processing CreateTablet for tablet 0629a1a838d347cd963068ac65351009 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260812 19:20:36.176657  4440 tablet_service.cc:1467] Processing CreateTablet for tablet 37ba65d1aef8455db82e3260a54bb255 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260812 19:20:36.192063  4438 tablet_service.cc:1467] Processing CreateTablet for tablet 4489d7f9dfbd4ae39b26df513e5ac14d (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260812 19:20:36.181941  4568 tablet_service.cc:1467] Processing CreateTablet for tablet 37ba65d1aef8455db82e3260a54bb255 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260812 19:20:36.202361  4572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9e58d3956004c2f9ad49d24e2e07f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.196825  4318 tablet_service.cc:1467] Processing CreateTablet for tablet 9533c5aca216454db2e9cbe4e7abfde0 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260812 19:20:36.190702  4563 tablet_service.cc:1467] Processing CreateTablet for tablet 95b3bd6c406642098c45291e34256638 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260812 19:20:36.207542  4317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9e58d3956004c2f9ad49d24e2e07f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.200459  4442 tablet_service.cc:1467] Processing CreateTablet for tablet d8040d6a29794f9ca9cdaed5e1ea7026 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260812 19:20:36.218495  4568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37ba65d1aef8455db82e3260a54bb255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.211700  4316 tablet_service.cc:1467] Processing CreateTablet for tablet d8040d6a29794f9ca9cdaed5e1ea7026 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260812 19:20:36.216588  4445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d3287dd700842499e82be426018f0ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.218940  4311 tablet_service.cc:1467] Processing CreateTablet for tablet 37ba65d1aef8455db82e3260a54bb255 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260812 19:20:36.225011  4310 tablet_service.cc:1467] Processing CreateTablet for tablet 4489d7f9dfbd4ae39b26df513e5ac14d (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260812 19:20:36.231552  4319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d3287dd700842499e82be426018f0ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.228765  4315 tablet_service.cc:1467] Processing CreateTablet for tablet 0629a1a838d347cd963068ac65351009 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260812 19:20:36.231586  4443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9e58d3956004c2f9ad49d24e2e07f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.229807  4571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8040d6a29794f9ca9cdaed5e1ea7026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.235565  4435 tablet_service.cc:1467] Processing CreateTablet for tablet 95b3bd6c406642098c45291e34256638 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260812 19:20:36.235766  4309 tablet_service.cc:1467] Processing CreateTablet for tablet 4ee31345b54f4889a8908b6b3dc720c8 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260812 19:20:36.244596  4318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9533c5aca216454db2e9cbe4e7abfde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.246877  4309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ee31345b54f4889a8908b6b3dc720c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.247304  4437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ee31345b54f4889a8908b6b3dc720c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.253293  4440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37ba65d1aef8455db82e3260a54bb255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.254703  4311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37ba65d1aef8455db82e3260a54bb255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.244982  4305 tablet_service.cc:1467] Processing CreateTablet for tablet 95b3bd6c406642098c45291e34256638 (DEFAULT_TABLE table=test-workload [id=acb1c505adf34c3e84b3272f951c987b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260812 19:20:36.258148  4442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8040d6a29794f9ca9cdaed5e1ea7026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.261350  4435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95b3bd6c406642098c45291e34256638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.257681  4563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95b3bd6c406642098c45291e34256638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.267581  4315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0629a1a838d347cd963068ac65351009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.270337  4441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0629a1a838d347cd963068ac65351009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.273154  4305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95b3bd6c406642098c45291e34256638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.273485  4438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4489d7f9dfbd4ae39b26df513e5ac14d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.277688  4565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ee31345b54f4889a8908b6b3dc720c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.277117  4310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4489d7f9dfbd4ae39b26df513e5ac14d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.337880  4316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8040d6a29794f9ca9cdaed5e1ea7026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:20:36.427562  4504 heartbeater.cc:503] Master 127.3.253.62:45767 was elected leader, sending a full tablet report...
W20260812 19:20:36.632898  4232 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:20:36.654551  4679 tablet_bootstrap.cc:492] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10: Bootstrap starting.
I20260812 19:20:36.686744  4682 tablet_bootstrap.cc:492] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac: Bootstrap starting.
I20260812 19:20:36.702948  4681 tablet_bootstrap.cc:492] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069: Bootstrap starting.
I20260812 19:20:36.712872  4679 tablet_bootstrap.cc:654] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:36.738042  4682 tablet_bootstrap.cc:654] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:36.740859  4681 tablet_bootstrap.cc:654] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:36.743702  4679 tablet_bootstrap.cc:492] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10: No bootstrap required, opened a new log
I20260812 19:20:36.744580  4679 ts_tablet_manager.cc:1397] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent bootstrapping tablet: real 0.116s	user 0.011s	sys 0.020s
I20260812 19:20:36.755295  4679 raft_consensus.cc:348] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.759570  4679 raft_consensus.cc:374] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:36.760135  4679 raft_consensus.cc:729] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Initialized, Role: FOLLOWER
I20260812 19:20:36.762483  4682 tablet_bootstrap.cc:492] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac: No bootstrap required, opened a new log
I20260812 19:20:36.761740  4679 consensus_queue.cc:260] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.763257  4682 ts_tablet_manager.cc:1397] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac: Time spent bootstrapping tablet: real 0.085s	user 0.004s	sys 0.034s
I20260812 19:20:36.766840  4681 tablet_bootstrap.cc:492] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069: No bootstrap required, opened a new log
I20260812 19:20:36.767988  4681 ts_tablet_manager.cc:1397] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent bootstrapping tablet: real 0.124s	user 0.012s	sys 0.020s
I20260812 19:20:36.773227  4682 raft_consensus.cc:348] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.774358  4682 raft_consensus.cc:374] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:36.774883  4682 raft_consensus.cc:729] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Initialized, Role: FOLLOWER
I20260812 19:20:36.776146  4682 consensus_queue.cc:260] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.782719  4679 ts_tablet_manager.cc:1428] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.027s
I20260812 19:20:36.774513  4681 raft_consensus.cc:348] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.785526  4679 tablet_bootstrap.cc:492] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10: Bootstrap starting.
I20260812 19:20:36.785707  4681 raft_consensus.cc:374] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:36.786077  4681 raft_consensus.cc:729] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Initialized, Role: FOLLOWER
I20260812 19:20:36.786993  4681 consensus_queue.cc:260] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.800931  4644 heartbeater.cc:503] Master 127.3.253.62:45767 was elected leader, sending a full tablet report...
I20260812 19:20:36.806416  4681 ts_tablet_manager.cc:1428] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent starting tablet: real 0.038s	user 0.017s	sys 0.004s
I20260812 19:20:36.808084  4681 tablet_bootstrap.cc:492] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069: Bootstrap starting.
I20260812 19:20:36.808048  4682 ts_tablet_manager.cc:1428] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.015s
I20260812 19:20:36.810109  4682 tablet_bootstrap.cc:492] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac: Bootstrap starting.
I20260812 19:20:36.828685  4679 tablet_bootstrap.cc:654] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:36.830183  4682 tablet_bootstrap.cc:654] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:36.833042  4681 tablet_bootstrap.cc:654] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:36.868974  4682 tablet_bootstrap.cc:492] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac: No bootstrap required, opened a new log
I20260812 19:20:36.869762  4682 ts_tablet_manager.cc:1397] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac: Time spent bootstrapping tablet: real 0.060s	user 0.004s	sys 0.026s
I20260812 19:20:36.873176  4679 tablet_bootstrap.cc:492] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10: No bootstrap required, opened a new log
I20260812 19:20:36.873992  4679 ts_tablet_manager.cc:1397] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent bootstrapping tablet: real 0.089s	user 0.024s	sys 0.004s
I20260812 19:20:36.876978  4681 tablet_bootstrap.cc:492] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069: No bootstrap required, opened a new log
I20260812 19:20:36.878031  4681 ts_tablet_manager.cc:1397] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.025s
I20260812 19:20:36.874780  4682 raft_consensus.cc:348] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.880846  4682 raft_consensus.cc:374] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:36.881673  4679 raft_consensus.cc:348] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.884986  4682 raft_consensus.cc:729] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Initialized, Role: FOLLOWER
I20260812 19:20:36.884835  4681 raft_consensus.cc:348] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.887111  4679 raft_consensus.cc:374] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:36.887245  4681 raft_consensus.cc:374] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:36.887802  4679 raft_consensus.cc:729] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Initialized, Role: FOLLOWER
I20260812 19:20:36.887560  4682 consensus_queue.cc:260] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.888204  4681 raft_consensus.cc:729] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Initialized, Role: FOLLOWER
I20260812 19:20:36.891155  4682 ts_tablet_manager.cc:1428] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac: Time spent starting tablet: real 0.021s	user 0.000s	sys 0.011s
I20260812 19:20:36.889950  4679 consensus_queue.cc:260] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.893339  4682 tablet_bootstrap.cc:492] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac: Bootstrap starting.
I20260812 19:20:36.893218  4696 raft_consensus.cc:482] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:20:36.893944  4696 raft_consensus.cc:504] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.892225  4681 consensus_queue.cc:260] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.901914  4699 raft_consensus.cc:482] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:20:36.908419  4679 ts_tablet_manager.cc:1428] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.006s
I20260812 19:20:36.903443  4699 raft_consensus.cc:504] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.903519  4696 leader_election.cc:288] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765)
I20260812 19:20:36.912796  4679 tablet_bootstrap.cc:492] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10: Bootstrap starting.
I20260812 19:20:36.932798  4682 tablet_bootstrap.cc:654] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:36.942894  4699 leader_election.cc:288] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:36.963452  4679 tablet_bootstrap.cc:654] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:36.982350  4696 raft_consensus.cc:482] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:20:36.982883  4699 raft_consensus.cc:482] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:20:36.985536  4696 raft_consensus.cc:504] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.985682  4699 raft_consensus.cc:504] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:36.990610  4696 leader_election.cc:288] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765)
I20260812 19:20:36.996183  4699 leader_election.cc:288] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:37.008322  4681 ts_tablet_manager.cc:1428] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent starting tablet: real 0.129s	user 0.006s	sys 0.027s
I20260812 19:20:37.015202  4681 tablet_bootstrap.cc:492] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069: Bootstrap starting.
I20260812 19:20:37.048389  4682 tablet_bootstrap.cc:492] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac: No bootstrap required, opened a new log
I20260812 19:20:37.050369  4682 ts_tablet_manager.cc:1397] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac: Time spent bootstrapping tablet: real 0.158s	user 0.001s	sys 0.042s
I20260812 19:20:37.052681  4695 raft_consensus.cc:482] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:20:37.053500  4695 raft_consensus.cc:504] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.063808  4679 tablet_bootstrap.cc:492] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10: No bootstrap required, opened a new log
I20260812 19:20:37.061267  4337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e58d3956004c2f9ad49d24e2e07f4b" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" is_pre_election: true
I20260812 19:20:37.063735  4336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ba65d1aef8455db82e3260a54bb255" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" is_pre_election: true
I20260812 19:20:37.065019  4679 ts_tablet_manager.cc:1397] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent bootstrapping tablet: real 0.153s	user 0.024s	sys 0.031s
I20260812 19:20:37.074828  4695 leader_election.cc:288] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
W20260812 19:20:37.076040  4536 leader_election.cc:341] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:20:37.072899  4679 raft_consensus.cc:348] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.080353  4679 raft_consensus.cc:374] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:37.081292  4679 raft_consensus.cc:729] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Initialized, Role: FOLLOWER
W20260812 19:20:37.082896  4536 leader_election.cc:341] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:20:37.082528  4681 tablet_bootstrap.cc:654] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.086170  4682 raft_consensus.cc:348] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.087131  4679 consensus_queue.cc:260] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.089362  4682 raft_consensus.cc:374] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:37.091495  4682 raft_consensus.cc:729] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Initialized, Role: FOLLOWER
I20260812 19:20:37.092831  4682 consensus_queue.cc:260] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.123242  4679 ts_tablet_manager.cc:1428] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.008s
I20260812 19:20:37.130079  4679 tablet_bootstrap.cc:492] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10: Bootstrap starting.
I20260812 19:20:37.136541  4601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac" is_pre_election: true
I20260812 19:20:37.139338  4682 ts_tablet_manager.cc:1428] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac: Time spent starting tablet: real 0.088s	user 0.010s	sys 0.004s
I20260812 19:20:37.139087  4597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4489d7f9dfbd4ae39b26df513e5ac14d" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac" is_pre_election: true
I20260812 19:20:37.142577  4682 tablet_bootstrap.cc:492] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac: Bootstrap starting.
W20260812 19:20:37.150730  4279 leader_election.cc:341] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:20:37.153307  4279 leader_election.cc:341] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:20:37.164675  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" is_pre_election: true
I20260812 19:20:37.169834  4462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4489d7f9dfbd4ae39b26df513e5ac14d" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" is_pre_election: true
I20260812 19:20:37.168159  4464 raft_consensus.cc:2454] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 0.
W20260812 19:20:37.175323  4280 leader_election.cc:341] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:20:37.176192  4280 leader_election.cc:302] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ea5c9f4c6b4bdd8fab381acd648069; no voters: 56e1de5b1f6c4e86bd161c3929a42a10, 8123980701894dcd92e770f7b8b87bac
I20260812 19:20:37.178782  4699 raft_consensus.cc:2726] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:20:37.183176  4280 leader_election.cc:302] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 70ea5c9f4c6b4bdd8fab381acd648069; no voters: 8123980701894dcd92e770f7b8b87bac
I20260812 19:20:37.184566  4699 raft_consensus.cc:2781] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:20:37.185233  4699 raft_consensus.cc:482] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:20:37.186054  4699 raft_consensus.cc:3037] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.198035  4679 tablet_bootstrap.cc:654] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.203372  4695 raft_consensus.cc:482] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:20:37.204085  4695 raft_consensus.cc:504] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.207239  4699 raft_consensus.cc:504] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.209103  4695 leader_election.cc:288] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:37.212517  4682 tablet_bootstrap.cc:654] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.212495  4336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" is_pre_election: true
I20260812 19:20:37.213045  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:37.213735  4464 raft_consensus.cc:3037] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.215744  4336 raft_consensus.cc:2379] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56e1de5b1f6c4e86bd161c3929a42a10 in current term 1: Already voted for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in this term.
I20260812 19:20:37.214710  4337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" is_pre_election: true
I20260812 19:20:37.219529  4699 leader_election.cc:288] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 election: Requested vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
W20260812 19:20:37.223878  4407 leader_election.cc:341] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:20:37.229609  4601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:37.221144  4681 tablet_bootstrap.cc:492] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069: No bootstrap required, opened a new log
I20260812 19:20:37.233844  4681 ts_tablet_manager.cc:1397] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent bootstrapping tablet: real 0.219s	user 0.026s	sys 0.023s
I20260812 19:20:37.234145  4459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ba65d1aef8455db82e3260a54bb255" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" is_pre_election: true
I20260812 19:20:37.237074  4462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e58d3956004c2f9ad49d24e2e07f4b" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" is_pre_election: true
I20260812 19:20:37.231808  4695 raft_consensus.cc:482] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:20:37.242275  4536 leader_election.cc:341] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:20:37.243264  4536 leader_election.cc:302] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8123980701894dcd92e770f7b8b87bac; no voters: 56e1de5b1f6c4e86bd161c3929a42a10, 70ea5c9f4c6b4bdd8fab381acd648069
W20260812 19:20:37.242741  4279 leader_election.cc:341] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:20:37.247123  4696 raft_consensus.cc:2726] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:20:37.247844  4536 leader_election.cc:341] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:20:37.248721  4536 leader_election.cc:302] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8123980701894dcd92e770f7b8b87bac; no voters: 56e1de5b1f6c4e86bd161c3929a42a10, 70ea5c9f4c6b4bdd8fab381acd648069
I20260812 19:20:37.250202  4696 raft_consensus.cc:2726] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:20:37.243425  4695 raft_consensus.cc:504] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.256083  4337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" is_pre_election: true
W20260812 19:20:37.257908  4407 leader_election.cc:341] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:20:37.258100  4695 leader_election.cc:288] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:37.263521  4681 raft_consensus.cc:348] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.264608  4681 raft_consensus.cc:374] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:37.264993  4681 raft_consensus.cc:729] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Initialized, Role: FOLLOWER
I20260812 19:20:37.265929  4681 consensus_queue.cc:260] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.273185  4682 tablet_bootstrap.cc:492] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac: No bootstrap required, opened a new log
I20260812 19:20:37.275945  4464 raft_consensus.cc:2454] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 1.
I20260812 19:20:37.276472  4682 ts_tablet_manager.cc:1397] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac: Time spent bootstrapping tablet: real 0.135s	user 0.027s	sys 0.044s
I20260812 19:20:37.277192  4601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac" is_pre_election: true
I20260812 19:20:37.277598  4280 leader_election.cc:302] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 70ea5c9f4c6b4bdd8fab381acd648069; no voters: 8123980701894dcd92e770f7b8b87bac
I20260812 19:20:37.282167  4679 tablet_bootstrap.cc:492] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10: No bootstrap required, opened a new log
I20260812 19:20:37.281929  4682 raft_consensus.cc:348] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.282811  4682 raft_consensus.cc:374] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:37.282859  4699 raft_consensus.cc:2781] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:20:37.283438  4682 raft_consensus.cc:729] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Initialized, Role: FOLLOWER
I20260812 19:20:37.283712  4699 raft_consensus.cc:686] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 LEADER]: Becoming Leader. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Running, Role: LEADER
I20260812 19:20:37.282859  4679 ts_tablet_manager.cc:1397] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent bootstrapping tablet: real 0.154s	user 0.023s	sys 0.029s
I20260812 19:20:37.284798  4699 consensus_queue.cc:237] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.278445  4597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac" is_pre_election: true
I20260812 19:20:37.287889  4595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac" is_pre_election: true
W20260812 19:20:37.288260  4406 leader_election.cc:341] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:20:37.289883  4597 raft_consensus.cc:2454] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 0.
I20260812 19:20:37.274431  4681 ts_tablet_manager.cc:1428] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.007s
I20260812 19:20:37.290488  4406 leader_election.cc:302] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10; no voters: 70ea5c9f4c6b4bdd8fab381acd648069, 8123980701894dcd92e770f7b8b87bac
I20260812 19:20:37.289001  4682 consensus_queue.cc:260] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.292302  4695 raft_consensus.cc:2726] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:20:37.294111  4406 leader_election.cc:302] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 8123980701894dcd92e770f7b8b87bac; no voters: 70ea5c9f4c6b4bdd8fab381acd648069
I20260812 19:20:37.294875  4595 raft_consensus.cc:2454] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 0.
I20260812 19:20:37.297561  4681 tablet_bootstrap.cc:492] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069: Bootstrap starting.
I20260812 19:20:37.299558  4695 raft_consensus.cc:2781] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:20:37.300194  4695 raft_consensus.cc:482] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:20:37.300825  4695 raft_consensus.cc:3037] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.310405  4406 leader_election.cc:302] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 8123980701894dcd92e770f7b8b87bac; no voters: 70ea5c9f4c6b4bdd8fab381acd648069
I20260812 19:20:37.313596  4679 raft_consensus.cc:348] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.314996  4695 raft_consensus.cc:504] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.317792  4682 ts_tablet_manager.cc:1428] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.014s
I20260812 19:20:37.321806  4682 tablet_bootstrap.cc:492] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac: Bootstrap starting.
I20260812 19:20:37.316636  4679 raft_consensus.cc:374] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:37.322510  4679 raft_consensus.cc:729] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Initialized, Role: FOLLOWER
I20260812 19:20:37.323839  4679 consensus_queue.cc:260] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.338383  4744 raft_consensus.cc:2781] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:20:37.337352  4141 catalog_manager.cc:5495] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:37.341825  4695 leader_election.cc:288] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:37.343210  4744 raft_consensus.cc:482] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:20:37.343146  4337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:37.344836  4744 raft_consensus.cc:3037] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.345053  4337 raft_consensus.cc:3037] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.351357  4595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:37.353727  4595 raft_consensus.cc:3037] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.364745  4682 tablet_bootstrap.cc:654] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.368937  4679 ts_tablet_manager.cc:1428] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent starting tablet: real 0.083s	user 0.016s	sys 0.016s
I20260812 19:20:37.370483  4679 tablet_bootstrap.cc:492] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10: Bootstrap starting.
I20260812 19:20:37.366715  4681 tablet_bootstrap.cc:654] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.366590  4337 raft_consensus.cc:2454] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 1.
I20260812 19:20:37.375941  4407 leader_election.cc:302] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 70ea5c9f4c6b4bdd8fab381acd648069; no voters: 
I20260812 19:20:37.378784  4745 raft_consensus.cc:2781] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:20:37.381212  4745 raft_consensus.cc:686] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Becoming Leader. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:37.382360  4745 consensus_queue.cc:237] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.388890  4595 raft_consensus.cc:2454] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 1.
I20260812 19:20:37.390586  4682 tablet_bootstrap.cc:492] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac: No bootstrap required, opened a new log
I20260812 19:20:37.391361  4682 ts_tablet_manager.cc:1397] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.020s
I20260812 19:20:37.407960  4744 raft_consensus.cc:504] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.415958  4681 tablet_bootstrap.cc:492] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069: No bootstrap required, opened a new log
I20260812 19:20:37.416301  4337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:37.416776  4681 ts_tablet_manager.cc:1397] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent bootstrapping tablet: real 0.120s	user 0.012s	sys 0.024s
W20260812 19:20:37.419278  4407 leader_election.cc:341] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:20:37.419615  4682 raft_consensus.cc:348] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.421478  4682 raft_consensus.cc:374] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:37.422016  4682 raft_consensus.cc:729] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Initialized, Role: FOLLOWER
I20260812 19:20:37.422606  4595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:37.421119  4744 leader_election.cc:288] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:37.426151  4595 raft_consensus.cc:3037] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.423323  4682 consensus_queue.cc:260] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.423185  4681 raft_consensus.cc:348] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.428592  4681 raft_consensus.cc:374] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:37.429069  4681 raft_consensus.cc:729] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Initialized, Role: FOLLOWER
I20260812 19:20:37.430189  4681 consensus_queue.cc:260] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.434378  4681 ts_tablet_manager.cc:1428] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.006s
I20260812 19:20:37.435994  4681 tablet_bootstrap.cc:492] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069: Bootstrap starting.
I20260812 19:20:37.431284  4679 tablet_bootstrap.cc:654] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.437139  4595 raft_consensus.cc:2454] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 1.
I20260812 19:20:37.438218  4682 ts_tablet_manager.cc:1428] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.010s
I20260812 19:20:37.439802  4406 leader_election.cc:302] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 8123980701894dcd92e770f7b8b87bac; no voters: 70ea5c9f4c6b4bdd8fab381acd648069
I20260812 19:20:37.440425  4682 tablet_bootstrap.cc:492] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac: Bootstrap starting.
I20260812 19:20:37.441540  4744 raft_consensus.cc:2781] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:20:37.442266  4744 raft_consensus.cc:686] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Becoming Leader. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:37.444336  4744 consensus_queue.cc:237] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.454033  4139 catalog_manager.cc:5495] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:37.460830  4681 tablet_bootstrap.cc:654] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.468974  4745 raft_consensus.cc:482] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:20:37.469769  4745 raft_consensus.cc:504] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.477571  4337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ba65d1aef8455db82e3260a54bb255" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" is_pre_election: true
I20260812 19:20:37.478456  4337 raft_consensus.cc:2454] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 0.
I20260812 19:20:37.479230  4595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ba65d1aef8455db82e3260a54bb255" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac" is_pre_election: true
I20260812 19:20:37.476089  4745 leader_election.cc:288] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:37.480219  4595 raft_consensus.cc:2454] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 0.
I20260812 19:20:37.481012  4407 leader_election.cc:302] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 70ea5c9f4c6b4bdd8fab381acd648069; no voters: 
I20260812 19:20:37.482501  4745 raft_consensus.cc:2781] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:20:37.483275  4745 raft_consensus.cc:482] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:20:37.484054  4745 raft_consensus.cc:3037] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.493600  4682 tablet_bootstrap.cc:654] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.498462  4679 tablet_bootstrap.cc:492] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10: No bootstrap required, opened a new log
I20260812 19:20:37.511824  4679 ts_tablet_manager.cc:1397] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent bootstrapping tablet: real 0.142s	user 0.015s	sys 0.022s
I20260812 19:20:37.529458  4679 raft_consensus.cc:348] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.530544  4679 raft_consensus.cc:374] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:37.530980  4679 raft_consensus.cc:729] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Initialized, Role: FOLLOWER
I20260812 19:20:37.532136  4679 consensus_queue.cc:260] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.536162  4679 ts_tablet_manager.cc:1428] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.006s
I20260812 19:20:37.537559  4679 tablet_bootstrap.cc:492] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10: Bootstrap starting.
I20260812 19:20:37.537926  4745 raft_consensus.cc:504] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.542923  4337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ba65d1aef8455db82e3260a54bb255" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:37.544157  4337 raft_consensus.cc:3037] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.551115  4679 tablet_bootstrap.cc:654] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.551635  4682 tablet_bootstrap.cc:492] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac: No bootstrap required, opened a new log
I20260812 19:20:37.553184  4682 ts_tablet_manager.cc:1397] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac: Time spent bootstrapping tablet: real 0.113s	user 0.023s	sys 0.017s
I20260812 19:20:37.551945  4139 catalog_manager.cc:5495] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:37.555850  4681 tablet_bootstrap.cc:492] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069: No bootstrap required, opened a new log
I20260812 19:20:37.556818  4681 ts_tablet_manager.cc:1397] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent bootstrapping tablet: real 0.121s	user 0.006s	sys 0.025s
I20260812 19:20:37.568030  4681 raft_consensus.cc:348] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.569213  4681 raft_consensus.cc:374] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:37.569303  4595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ba65d1aef8455db82e3260a54bb255" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:37.569839  4681 raft_consensus.cc:729] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Initialized, Role: FOLLOWER
I20260812 19:20:37.570508  4595 raft_consensus.cc:3037] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.571421  4681 consensus_queue.cc:260] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.575325  4745 leader_election.cc:288] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:37.575682  4681 ts_tablet_manager.cc:1428] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.009s
I20260812 19:20:37.582365  4681 tablet_bootstrap.cc:492] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069: Bootstrap starting.
I20260812 19:20:37.585237  4337 raft_consensus.cc:2454] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 1.
I20260812 19:20:37.587114  4407 leader_election.cc:302] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 70ea5c9f4c6b4bdd8fab381acd648069; no voters: 
I20260812 19:20:37.587325  4595 raft_consensus.cc:2454] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 1.
I20260812 19:20:37.592402  4745 raft_consensus.cc:2781] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:20:37.601480  4679 tablet_bootstrap.cc:492] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10: No bootstrap required, opened a new log
I20260812 19:20:37.599964  4745 raft_consensus.cc:686] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Becoming Leader. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:37.602054  4679 ts_tablet_manager.cc:1397] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.013s
I20260812 19:20:37.603557  4681 tablet_bootstrap.cc:654] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.602947  4682 raft_consensus.cc:348] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.604118  4682 raft_consensus.cc:374] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:37.604601  4682 raft_consensus.cc:729] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Initialized, Role: FOLLOWER
I20260812 19:20:37.605857  4745 consensus_queue.cc:237] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.606379  4679 raft_consensus.cc:348] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.607606  4679 raft_consensus.cc:374] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:37.608062  4679 raft_consensus.cc:729] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Initialized, Role: FOLLOWER
I20260812 19:20:37.609064  4679 consensus_queue.cc:260] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.609810  4682 consensus_queue.cc:260] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.612891  4679 ts_tablet_manager.cc:1428] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260812 19:20:37.614470  4679 tablet_bootstrap.cc:492] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10: Bootstrap starting.
I20260812 19:20:37.619642  4699 raft_consensus.cc:482] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:20:37.620415  4681 tablet_bootstrap.cc:492] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069: No bootstrap required, opened a new log
I20260812 19:20:37.620365  4699 raft_consensus.cc:504] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.621105  4681 ts_tablet_manager.cc:1397] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.005s
I20260812 19:20:37.622134  4696 raft_consensus.cc:482] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:20:37.622849  4696 raft_consensus.cc:504] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.628608  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95b3bd6c406642098c45291e34256638" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" is_pre_election: true
I20260812 19:20:37.629060  4595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95b3bd6c406642098c45291e34256638" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac" is_pre_election: true
I20260812 19:20:37.629447  4464 raft_consensus.cc:2454] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 0.
I20260812 19:20:37.631359  4280 leader_election.cc:302] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 70ea5c9f4c6b4bdd8fab381acd648069; no voters: 
W20260812 19:20:37.632109  4279 leader_election.cc:341] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:20:37.632416  4682 ts_tablet_manager.cc:1428] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac: Time spent starting tablet: real 0.079s	user 0.003s	sys 0.011s
I20260812 19:20:37.630290  4699 leader_election.cc:288] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:37.634473  4713 raft_consensus.cc:2781] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:20:37.633173  4681 raft_consensus.cc:348] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.640026  4681 raft_consensus.cc:374] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:37.639528  4713 raft_consensus.cc:482] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:20:37.643478  4696 leader_election.cc:288] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765)
I20260812 19:20:37.645936  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0629a1a838d347cd963068ac65351009" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" is_pre_election: true
I20260812 19:20:37.648320  4682 tablet_bootstrap.cc:492] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac: Bootstrap starting.
I20260812 19:20:37.648339  4337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0629a1a838d347cd963068ac65351009" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" is_pre_election: true
I20260812 19:20:37.647078  4713 raft_consensus.cc:3037] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:20:37.652101  4232 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260812 19:20:37.651978  4536 leader_election.cc:341] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:20:37.646894  4681 raft_consensus.cc:729] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Initialized, Role: FOLLOWER
I20260812 19:20:37.664418  4679 tablet_bootstrap.cc:654] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.663547  4141 catalog_manager.cc:5495] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:37.666054  4681 consensus_queue.cc:260] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.667742  4337 raft_consensus.cc:2454] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8123980701894dcd92e770f7b8b87bac in term 0.
I20260812 19:20:37.670611  4681 ts_tablet_manager.cc:1428] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.003s
I20260812 19:20:37.672873  4681 tablet_bootstrap.cc:492] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069: Bootstrap starting.
I20260812 19:20:37.680425  4536 leader_election.cc:302] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ea5c9f4c6b4bdd8fab381acd648069, 8123980701894dcd92e770f7b8b87bac; no voters: 56e1de5b1f6c4e86bd161c3929a42a10
I20260812 19:20:37.683430  4696 raft_consensus.cc:2781] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:20:37.683979  4696 raft_consensus.cc:482] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:20:37.684487  4696 raft_consensus.cc:3037] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.689826  4682 tablet_bootstrap.cc:654] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.682844  4713 raft_consensus.cc:504] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.693712  4699 consensus_queue.cc:1035] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:20:37.696370  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95b3bd6c406642098c45291e34256638" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:37.697184  4464 raft_consensus.cc:3037] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.726188  4595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95b3bd6c406642098c45291e34256638" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:37.727857  4464 raft_consensus.cc:2454] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 1.
I20260812 19:20:37.729393  4280 leader_election.cc:302] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 70ea5c9f4c6b4bdd8fab381acd648069; no voters: 
I20260812 19:20:37.723658  4713 leader_election.cc:288] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 election: Requested vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:37.730583  4699 raft_consensus.cc:2781] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:20:37.731281  4699 raft_consensus.cc:686] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 LEADER]: Becoming Leader. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Running, Role: LEADER
W20260812 19:20:37.731572  4279 leader_election.cc:341] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:20:37.733851  4279 consensus_peers.cc:487] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 -> Peer 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975): Couldn't send request to peer 8123980701894dcd92e770f7b8b87bac. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:20:37.733475  4699 consensus_queue.cc:237] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.705076  4696 raft_consensus.cc:504] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.740669  4681 tablet_bootstrap.cc:654] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.742970  4774 raft_consensus.cc:482] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:20:37.744242  4774 raft_consensus.cc:504] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.747875  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d3287dd700842499e82be426018f0ba" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" is_pre_election: true
I20260812 19:20:37.748951  4464 raft_consensus.cc:2454] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8123980701894dcd92e770f7b8b87bac in term 0.
I20260812 19:20:37.750588  4536 leader_election.cc:302] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:37.755064  4774 leader_election.cc:288] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593)
I20260812 19:20:37.755774  4774 raft_consensus.cc:2781] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:20:37.756313  4679 tablet_bootstrap.cc:492] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10: No bootstrap required, opened a new log
I20260812 19:20:37.756240  4774 raft_consensus.cc:482] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:20:37.763515  4679 ts_tablet_manager.cc:1397] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent bootstrapping tablet: real 0.149s	user 0.005s	sys 0.021s
I20260812 19:20:37.763377  4774 raft_consensus.cc:3037] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.760296  4696 leader_election.cc:288] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765)
I20260812 19:20:37.776048  4337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d3287dd700842499e82be426018f0ba" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" is_pre_election: true
I20260812 19:20:37.783268  4141 catalog_manager.cc:5495] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:37.789296  4337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0629a1a838d347cd963068ac65351009" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:37.790199  4337 raft_consensus.cc:3037] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.807839  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0629a1a838d347cd963068ac65351009" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:37.817844  4337 raft_consensus.cc:2454] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8123980701894dcd92e770f7b8b87bac in term 1.
W20260812 19:20:37.818672  4536 leader_election.cc:341] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:20:37.826144  4536 leader_election.cc:341] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:20:37.826457  4682 tablet_bootstrap.cc:492] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac: No bootstrap required, opened a new log
I20260812 19:20:37.827370  4682 ts_tablet_manager.cc:1397] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac: Time spent bootstrapping tablet: real 0.186s	user 0.036s	sys 0.020s
I20260812 19:20:37.828269  4536 leader_election.cc:302] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ea5c9f4c6b4bdd8fab381acd648069, 8123980701894dcd92e770f7b8b87bac; no voters: 56e1de5b1f6c4e86bd161c3929a42a10
I20260812 19:20:37.824358  4679 raft_consensus.cc:348] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.830363  4679 raft_consensus.cc:374] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:37.830811  4679 raft_consensus.cc:729] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Initialized, Role: FOLLOWER
I20260812 19:20:37.831836  4679 consensus_queue.cc:260] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.839681  4781 raft_consensus.cc:2781] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:20:37.845404  4781 raft_consensus.cc:686] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 1 LEADER]: Becoming Leader. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Running, Role: LEADER
I20260812 19:20:37.844411  4774 raft_consensus.cc:504] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.848488  4781 consensus_queue.cc:237] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.851270  4774 leader_election.cc:288] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 election: Requested vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593)
W20260812 19:20:37.852285  4407 consensus_peers.cc:487] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 -> Peer 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593): Couldn't send request to peer 70ea5c9f4c6b4bdd8fab381acd648069. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:20:37.852823  4681 tablet_bootstrap.cc:492] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069: No bootstrap required, opened a new log
I20260812 19:20:37.854576  4679 ts_tablet_manager.cc:1428] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.006s
I20260812 19:20:37.855893  4745 consensus_queue.cc:1035] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:20:37.861166  4681 ts_tablet_manager.cc:1397] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent bootstrapping tablet: real 0.189s	user 0.002s	sys 0.023s
I20260812 19:20:37.860489  4682 raft_consensus.cc:348] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.861894  4682 raft_consensus.cc:374] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:37.862393  4682 raft_consensus.cc:729] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Initialized, Role: FOLLOWER
I20260812 19:20:37.863853  4682 consensus_queue.cc:260] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.866714  4681 raft_consensus.cc:348] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.867833  4681 raft_consensus.cc:374] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:37.868188  4681 raft_consensus.cc:729] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Initialized, Role: FOLLOWER
I20260812 19:20:37.869287  4682 ts_tablet_manager.cc:1428] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac: Time spent starting tablet: real 0.041s	user 0.011s	sys 0.001s
I20260812 19:20:37.874217  4682 tablet_bootstrap.cc:492] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac: Bootstrap starting.
I20260812 19:20:37.877287  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d3287dd700842499e82be426018f0ba" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:37.878371  4464 raft_consensus.cc:3037] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.880505  4679 tablet_bootstrap.cc:492] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10: Bootstrap starting.
I20260812 19:20:37.869230  4681 consensus_queue.cc:260] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.885350  4337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d3287dd700842499e82be426018f0ba" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:37.886574  4337 raft_consensus.cc:3037] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:37.899889  4681 ts_tablet_manager.cc:1428] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.004s
I20260812 19:20:37.907990  4681 tablet_bootstrap.cc:492] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069: Bootstrap starting.
I20260812 19:20:37.908644  4337 raft_consensus.cc:2454] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8123980701894dcd92e770f7b8b87bac in term 1.
I20260812 19:20:37.910058  4536 leader_election.cc:302] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ea5c9f4c6b4bdd8fab381acd648069, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:37.911166  4781 raft_consensus.cc:2781] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:20:37.911926  4781 raft_consensus.cc:686] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 1 LEADER]: Becoming Leader. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Running, Role: LEADER
I20260812 19:20:37.913393  4781 consensus_queue.cc:237] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:37.918447  4745 consensus_queue.cc:1035] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:20:37.923146  4464 raft_consensus.cc:2454] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8123980701894dcd92e770f7b8b87bac in term 1.
I20260812 19:20:37.926234  4682 tablet_bootstrap.cc:654] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.927037  4142 catalog_manager.cc:5495] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac reported cstate change: term changed from 0 to 1, leader changed from <none> to 8123980701894dcd92e770f7b8b87bac (127.3.253.3). New cstate: current_term: 1 leader_uuid: "8123980701894dcd92e770f7b8b87bac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: HEALTHY } } }
I20260812 19:20:37.957055  4679 tablet_bootstrap.cc:654] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.967080  4681 tablet_bootstrap.cc:654] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:37.976259  4745 consensus_queue.cc:1035] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:20:38.010142  4141 catalog_manager.cc:5495] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac reported cstate change: term changed from 0 to 1, leader changed from <none> to 8123980701894dcd92e770f7b8b87bac (127.3.253.3). New cstate: current_term: 1 leader_uuid: "8123980701894dcd92e770f7b8b87bac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: HEALTHY } } }
I20260812 19:20:38.031985  4679 tablet_bootstrap.cc:492] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10: No bootstrap required, opened a new log
I20260812 19:20:38.032756  4679 ts_tablet_manager.cc:1397] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent bootstrapping tablet: real 0.153s	user 0.004s	sys 0.022s
I20260812 19:20:38.033309  4682 tablet_bootstrap.cc:492] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac: No bootstrap required, opened a new log
I20260812 19:20:38.034210  4682 ts_tablet_manager.cc:1397] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac: Time spent bootstrapping tablet: real 0.164s	user 0.026s	sys 0.019s
I20260812 19:20:38.046361  4682 raft_consensus.cc:348] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.048604  4682 raft_consensus.cc:374] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:38.048954  4682 raft_consensus.cc:729] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Initialized, Role: FOLLOWER
I20260812 19:20:38.049845  4682 consensus_queue.cc:260] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.052485  4682 ts_tablet_manager.cc:1428] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.002s
I20260812 19:20:38.053344  4682 tablet_bootstrap.cc:492] T 4489d7f9dfbd4ae39b26df513e5ac14d P 8123980701894dcd92e770f7b8b87bac: Bootstrap starting.
I20260812 19:20:38.060647  4681 tablet_bootstrap.cc:492] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069: No bootstrap required, opened a new log
I20260812 19:20:38.063436  4679 raft_consensus.cc:348] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.065944  4679 raft_consensus.cc:374] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:38.066291  4679 raft_consensus.cc:729] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Initialized, Role: FOLLOWER
I20260812 19:20:38.064743  4681 ts_tablet_manager.cc:1397] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent bootstrapping tablet: real 0.155s	user 0.006s	sys 0.025s
I20260812 19:20:38.067796  4679 consensus_queue.cc:260] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.075661  4798 consensus_queue.cc:1035] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260812 19:20:38.085296  4679 ts_tablet_manager.cc:1428] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.003s
I20260812 19:20:38.082151  4681 raft_consensus.cc:348] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.087378  4681 raft_consensus.cc:374] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:38.087649  4681 raft_consensus.cc:729] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Initialized, Role: FOLLOWER
I20260812 19:20:38.088385  4681 consensus_queue.cc:260] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.089012  4679 tablet_bootstrap.cc:492] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10: Bootstrap starting.
I20260812 19:20:38.091014  4681 ts_tablet_manager.cc:1428] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260812 19:20:38.092319  4681 tablet_bootstrap.cc:492] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069: Bootstrap starting.
I20260812 19:20:38.112748  4679 tablet_bootstrap.cc:654] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:38.119717  4682 tablet_bootstrap.cc:654] T 4489d7f9dfbd4ae39b26df513e5ac14d P 8123980701894dcd92e770f7b8b87bac: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:38.119844  4681 tablet_bootstrap.cc:654] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069: Neither blocks nor log segments found. Creating new log.
I20260812 19:20:38.131837  4798 consensus_queue.cc:1035] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:20:38.142103  4597 raft_consensus.cc:3037] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:38.160063  4679 tablet_bootstrap.cc:492] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10: No bootstrap required, opened a new log
I20260812 19:20:38.160543  4679 ts_tablet_manager.cc:1397] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.011s
I20260812 19:20:38.165184  4679 raft_consensus.cc:348] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.165892  4679 raft_consensus.cc:374] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:38.166167  4679 raft_consensus.cc:729] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Initialized, Role: FOLLOWER
I20260812 19:20:38.166860  4679 consensus_queue.cc:260] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.171034  4681 tablet_bootstrap.cc:492] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069: No bootstrap required, opened a new log
I20260812 19:20:38.171595  4681 ts_tablet_manager.cc:1397] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.010s
I20260812 19:20:38.179363  4682 tablet_bootstrap.cc:492] T 4489d7f9dfbd4ae39b26df513e5ac14d P 8123980701894dcd92e770f7b8b87bac: No bootstrap required, opened a new log
I20260812 19:20:38.180068  4682 ts_tablet_manager.cc:1397] T 4489d7f9dfbd4ae39b26df513e5ac14d P 8123980701894dcd92e770f7b8b87bac: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.005s
I20260812 19:20:38.179373  4679 ts_tablet_manager.cc:1428] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260812 19:20:38.180256  4681 raft_consensus.cc:348] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.181326  4681 raft_consensus.cc:374] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:38.186347  4682 raft_consensus.cc:348] T 4489d7f9dfbd4ae39b26df513e5ac14d P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.187412  4682 raft_consensus.cc:374] T 4489d7f9dfbd4ae39b26df513e5ac14d P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:20:38.187860  4682 raft_consensus.cc:729] T 4489d7f9dfbd4ae39b26df513e5ac14d P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Initialized, Role: FOLLOWER
I20260812 19:20:38.183943  4681 raft_consensus.cc:729] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Initialized, Role: FOLLOWER
I20260812 19:20:38.188944  4682 consensus_queue.cc:260] T 4489d7f9dfbd4ae39b26df513e5ac14d P 8123980701894dcd92e770f7b8b87bac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.191114  4681 consensus_queue.cc:260] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.192595  4682 ts_tablet_manager.cc:1428] T 4489d7f9dfbd4ae39b26df513e5ac14d P 8123980701894dcd92e770f7b8b87bac: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260812 19:20:38.204663  4681 ts_tablet_manager.cc:1428] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260812 19:20:38.218948  4699 consensus_queue.cc:1035] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:20:38.236303  4798 raft_consensus.cc:482] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:20:38.236930  4798 raft_consensus.cc:504] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.237439  4597 raft_consensus.cc:3037] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:38.245188  4336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0629a1a838d347cd963068ac65351009" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" is_pre_election: true
I20260812 19:20:38.246426  4336 raft_consensus.cc:2379] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56e1de5b1f6c4e86bd161c3929a42a10 in current term 1: Already voted for candidate 8123980701894dcd92e770f7b8b87bac in this term.
I20260812 19:20:38.249715  4798 leader_election.cc:288] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:38.251602  4595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0629a1a838d347cd963068ac65351009" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac" is_pre_election: true
I20260812 19:20:38.252631  4699 consensus_queue.cc:1035] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:20:38.253979  4406 leader_election.cc:302] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10; no voters: 70ea5c9f4c6b4bdd8fab381acd648069, 8123980701894dcd92e770f7b8b87bac
I20260812 19:20:38.255265  4798 raft_consensus.cc:3037] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:38.271826  4798 raft_consensus.cc:2726] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:20:38.293972  4699 raft_consensus.cc:482] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:20:38.294571  4699 raft_consensus.cc:504] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.297850  4699 leader_election.cc:288] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:38.298455  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" is_pre_election: true
I20260812 19:20:38.301534  4595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac" is_pre_election: true
I20260812 19:20:38.303748  4279 leader_election.cc:302] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ea5c9f4c6b4bdd8fab381acd648069; no voters: 56e1de5b1f6c4e86bd161c3929a42a10, 8123980701894dcd92e770f7b8b87bac
I20260812 19:20:38.304855  4699 raft_consensus.cc:2726] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:20:38.304764  4781 consensus_queue.cc:1035] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:20:38.313691  4798 raft_consensus.cc:482] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:20:38.314389  4798 raft_consensus.cc:504] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.317112  4798 leader_election.cc:288] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:38.318256  4337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4489d7f9dfbd4ae39b26df513e5ac14d" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" is_pre_election: true
I20260812 19:20:38.319219  4337 raft_consensus.cc:2454] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 0.
I20260812 19:20:38.319240  4595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4489d7f9dfbd4ae39b26df513e5ac14d" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac" is_pre_election: true
I20260812 19:20:38.320070  4595 raft_consensus.cc:2454] T 4489d7f9dfbd4ae39b26df513e5ac14d P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 0.
I20260812 19:20:38.320712  4407 leader_election.cc:302] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 70ea5c9f4c6b4bdd8fab381acd648069; no voters: 
I20260812 19:20:38.322396  4798 raft_consensus.cc:2781] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:20:38.322901  4798 raft_consensus.cc:482] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:20:38.323374  4798 raft_consensus.cc:3037] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:38.328954  4774 consensus_queue.cc:1035] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:20:38.332657  4798 raft_consensus.cc:504] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.336788  4337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4489d7f9dfbd4ae39b26df513e5ac14d" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:38.340837  4337 raft_consensus.cc:3037] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:38.340929  4799 raft_consensus.cc:482] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:20:38.341800  4799 raft_consensus.cc:504] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.347038  4799 leader_election.cc:288] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:38.352069  4336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e58d3956004c2f9ad49d24e2e07f4b" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" is_pre_election: true
I20260812 19:20:38.353266  4336 raft_consensus.cc:2454] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 0.
I20260812 19:20:38.354099  4334 raft_consensus.cc:3037] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:38.355196  4407 leader_election.cc:302] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 70ea5c9f4c6b4bdd8fab381acd648069; no voters: 
I20260812 19:20:38.356426  4799 raft_consensus.cc:2781] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:20:38.358114  4799 raft_consensus.cc:482] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:20:38.358814  4799 raft_consensus.cc:3037] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:38.363097  4798 leader_election.cc:288] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:38.368647  4595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e58d3956004c2f9ad49d24e2e07f4b" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac" is_pre_election: true
I20260812 19:20:38.369257  4597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4489d7f9dfbd4ae39b26df513e5ac14d" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:38.369613  4595 raft_consensus.cc:2454] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 0.
I20260812 19:20:38.370579  4597 raft_consensus.cc:3037] T 4489d7f9dfbd4ae39b26df513e5ac14d P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:38.365885  4774 consensus_queue.cc:1035] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:20:38.391821  4597 raft_consensus.cc:2454] T 4489d7f9dfbd4ae39b26df513e5ac14d P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 1.
I20260812 19:20:38.393822  4799 raft_consensus.cc:504] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.396854  4406 leader_election.cc:302] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:38.398280  4798 raft_consensus.cc:2781] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:20:38.398927  4798 raft_consensus.cc:686] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Becoming Leader. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:38.400481  4798 consensus_queue.cc:237] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.394371  4337 raft_consensus.cc:2454] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 1.
I20260812 19:20:38.412674  4333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e58d3956004c2f9ad49d24e2e07f4b" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:38.413337  4799 leader_election.cc:288] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:38.413755  4333 raft_consensus.cc:3037] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:38.420642  4597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e58d3956004c2f9ad49d24e2e07f4b" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:38.422115  4597 raft_consensus.cc:3037] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:20:38.441918  4597 raft_consensus.cc:2454] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 1.
I20260812 19:20:38.443681  4406 leader_election.cc:302] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:38.444941  4798 raft_consensus.cc:2781] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:20:38.445523  4798 raft_consensus.cc:686] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Becoming Leader. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:38.446756  4798 consensus_queue.cc:237] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:38.448348  4139 catalog_manager.cc:5495] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:38.466027  4333 raft_consensus.cc:2454] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 1.
I20260812 19:20:38.486133  4781 consensus_queue.cc:1035] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:20:38.503082  4139 catalog_manager.cc:5495] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:38.790841  4798 consensus_queue.cc:1035] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:20:38.809943  4745 consensus_queue.cc:1035] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:20:38.906387  4597 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3d3287dd700842499e82be426018f0ba"
dest_uuid: "8123980701894dcd92e770f7b8b87bac"
mode: GRACEFUL
new_leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
 from {username='slave'} at 127.0.0.1:54710
I20260812 19:20:38.907552  4597 raft_consensus.cc:595] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 1 LEADER]: Received request to transfer leadership to TS 70ea5c9f4c6b4bdd8fab381acd648069
I20260812 19:20:38.910226  4745 consensus_queue.cc:1035] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:20:38.938545  4745 consensus_queue.cc:1035] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:20:38.941736  4464 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
mode: GRACEFUL
new_leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
 from {username='slave'} at 127.0.0.1:40392
I20260812 19:20:38.942617  4464 raft_consensus.cc:595] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Received request to transfer leadership to TS 70ea5c9f4c6b4bdd8fab381acd648069
I20260812 19:20:38.954077  4464 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a9e58d3956004c2f9ad49d24e2e07f4b"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
mode: GRACEFUL
new_leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
 from {username='slave'} at 127.0.0.1:40392
I20260812 19:20:38.954679  4464 raft_consensus.cc:595] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Received request to transfer leadership to TS 70ea5c9f4c6b4bdd8fab381acd648069
I20260812 19:20:38.962576  4464 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
mode: GRACEFUL
new_leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
 from {username='slave'} at 127.0.0.1:40392
I20260812 19:20:38.963497  4464 raft_consensus.cc:595] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Received request to transfer leadership to TS 70ea5c9f4c6b4bdd8fab381acd648069
I20260812 19:20:38.970883  4597 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0629a1a838d347cd963068ac65351009"
dest_uuid: "8123980701894dcd92e770f7b8b87bac"
mode: GRACEFUL
new_leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
 from {username='slave'} at 127.0.0.1:54710
I20260812 19:20:38.971611  4597 raft_consensus.cc:595] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 1 LEADER]: Received request to transfer leadership to TS 56e1de5b1f6c4e86bd161c3929a42a10
I20260812 19:20:38.999788  4333 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8"
dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
mode: GRACEFUL
new_leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
 from {username='slave'} at 127.0.0.1:34738
I20260812 19:20:39.000449  4333 raft_consensus.cc:595] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 LEADER]: Received request to transfer leadership to TS 56e1de5b1f6c4e86bd161c3929a42a10
I20260812 19:20:39.007045  4333 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "95b3bd6c406642098c45291e34256638"
dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
mode: GRACEFUL
new_leader_uuid: "8123980701894dcd92e770f7b8b87bac"
 from {username='slave'} at 127.0.0.1:34738
I20260812 19:20:39.007721  4333 raft_consensus.cc:595] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 LEADER]: Received request to transfer leadership to TS 8123980701894dcd92e770f7b8b87bac
I20260812 19:20:39.041224  4696 raft_consensus.cc:979] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac: : Instructing follower 70ea5c9f4c6b4bdd8fab381acd648069 to start an election
I20260812 19:20:39.041821  4781 raft_consensus.cc:1067] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 1 LEADER]: Signalling peer 70ea5c9f4c6b4bdd8fab381acd648069 to start an election
I20260812 19:20:39.044167  4333 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3d3287dd700842499e82be426018f0ba"
dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
 from {username='slave'} at 127.0.0.1:40194
I20260812 19:20:39.045276  4333 raft_consensus.cc:482] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:39.045984  4333 raft_consensus.cc:3037] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.048058  4798 raft_consensus.cc:979] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10: : Instructing follower 70ea5c9f4c6b4bdd8fab381acd648069 to start an election
I20260812 19:20:39.048710  4745 raft_consensus.cc:1067] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Signalling peer 70ea5c9f4c6b4bdd8fab381acd648069 to start an election
I20260812 19:20:39.050876  4336 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0"
dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
 from {username='slave'} at 127.0.0.1:40198
I20260812 19:20:39.051668  4336 raft_consensus.cc:482] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:39.052204  4336 raft_consensus.cc:3037] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.054958  4333 raft_consensus.cc:504] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.057675  4333 leader_election.cc:288] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 2 election: Requested vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:39.059446  4597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d3287dd700842499e82be426018f0ba" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:39.060454  4597 raft_consensus.cc:3032] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:20:39.060724  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d3287dd700842499e82be426018f0ba" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:39.061120  4597 raft_consensus.cc:729] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Running, Role: LEADER
I20260812 19:20:39.061700  4464 raft_consensus.cc:3037] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.062191  4597 consensus_queue.cc:260] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.064270  4597 raft_consensus.cc:3037] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.069880  4464 raft_consensus.cc:2454] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 2.
I20260812 19:20:39.062299  4336 raft_consensus.cc:504] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.071705  4280 leader_election.cc:302] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 70ea5c9f4c6b4bdd8fab381acd648069; no voters: 
I20260812 19:20:39.072919  4699 raft_consensus.cc:2781] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:20:39.072962  4336 leader_election.cc:288] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 2 election: Requested vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:39.073719  4699 raft_consensus.cc:686] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Becoming Leader. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Running, Role: LEADER
I20260812 19:20:39.074848  4595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:39.075670  4595 raft_consensus.cc:3037] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.075088  4699 consensus_queue.cc:237] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.075968  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:39.077065  4464 raft_consensus.cc:3032] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:20:39.077652  4464 raft_consensus.cc:729] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:39.078014  4597 raft_consensus.cc:2454] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 2.
I20260812 19:20:39.079363  4464 consensus_queue.cc:260] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.081301  4464 raft_consensus.cc:3037] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.084390  4595 raft_consensus.cc:2454] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 2.
I20260812 19:20:39.085422  4279 leader_election.cc:302] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ea5c9f4c6b4bdd8fab381acd648069, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:39.086198  4699 raft_consensus.cc:2781] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:20:39.086764  4699 raft_consensus.cc:686] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Becoming Leader. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Running, Role: LEADER
I20260812 19:20:39.087567  4699 consensus_queue.cc:237] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.087946  4141 catalog_manager.cc:5495] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 reported cstate change: term changed from 1 to 2, leader changed from 8123980701894dcd92e770f7b8b87bac (127.3.253.3) to 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:39.089030  4464 raft_consensus.cc:2454] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 2.
I20260812 19:20:39.108558  4141 catalog_manager.cc:5495] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 reported cstate change: term changed from 1 to 2, leader changed from 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2) to 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:39.255512  4713 raft_consensus.cc:979] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069: : Instructing follower 56e1de5b1f6c4e86bd161c3929a42a10 to start an election
I20260812 19:20:39.255980  4699 raft_consensus.cc:1067] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 LEADER]: Signalling peer 56e1de5b1f6c4e86bd161c3929a42a10 to start an election
I20260812 19:20:39.257417  4464 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
 from {username='slave'} at 127.0.0.1:36018
I20260812 19:20:39.257941  4464 raft_consensus.cc:482] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:39.258262  4464 raft_consensus.cc:3037] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.262931  4464 raft_consensus.cc:504] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.264642  4464 leader_election.cc:288] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 2 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:39.265573  4336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:39.265815  4595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:39.266173  4336 raft_consensus.cc:3032] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:20:39.266439  4595 raft_consensus.cc:3037] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.266567  4336 raft_consensus.cc:729] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Running, Role: LEADER
I20260812 19:20:39.267472  4336 consensus_queue.cc:260] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.268581  4336 raft_consensus.cc:3037] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.271504  4595 raft_consensus.cc:2454] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 2.
I20260812 19:20:39.272662  4406 leader_election.cc:302] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:39.273393  4745 raft_consensus.cc:2781] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:20:39.273625  4336 raft_consensus.cc:2454] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 2.
I20260812 19:20:39.273934  4745 raft_consensus.cc:686] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 LEADER]: Becoming Leader. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:39.274920  4745 consensus_queue.cc:237] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.282632  4141 catalog_manager.cc:5495] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 reported cstate change: term changed from 1 to 2, leader changed from 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1) to 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:39.287585  4696 raft_consensus.cc:979] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac: : Instructing follower 56e1de5b1f6c4e86bd161c3929a42a10 to start an election
I20260812 19:20:39.288125  4781 raft_consensus.cc:1067] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 1 LEADER]: Signalling peer 56e1de5b1f6c4e86bd161c3929a42a10 to start an election
I20260812 19:20:39.289759  4464 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0629a1a838d347cd963068ac65351009"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
 from {username='slave'} at 127.0.0.1:36020
I20260812 19:20:39.290352  4464 raft_consensus.cc:482] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:39.290804  4464 raft_consensus.cc:3037] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.296239  4464 raft_consensus.cc:504] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.298190  4464 leader_election.cc:288] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 2 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:39.299176  4336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0629a1a838d347cd963068ac65351009" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:39.299435  4595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0629a1a838d347cd963068ac65351009" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:39.299844  4336 raft_consensus.cc:3037] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.299983  4595 raft_consensus.cc:3032] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:20:39.300354  4595 raft_consensus.cc:729] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Running, Role: LEADER
I20260812 19:20:39.301174  4595 consensus_queue.cc:260] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.302507  4595 raft_consensus.cc:3037] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.306917  4336 raft_consensus.cc:2454] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 2.
I20260812 19:20:39.308190  4407 leader_election.cc:302] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 70ea5c9f4c6b4bdd8fab381acd648069; no voters: 
I20260812 19:20:39.308849  4595 raft_consensus.cc:2454] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 2.
I20260812 19:20:39.308995  4745 raft_consensus.cc:2781] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:20:39.309687  4745 raft_consensus.cc:686] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 LEADER]: Becoming Leader. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:39.310530  4745 consensus_queue.cc:237] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.316164  4713 raft_consensus.cc:979] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069: : Instructing follower 8123980701894dcd92e770f7b8b87bac to start an election
I20260812 19:20:39.316394  4745 raft_consensus.cc:979] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10: : Instructing follower 70ea5c9f4c6b4bdd8fab381acd648069 to start an election
I20260812 19:20:39.316697  4699 raft_consensus.cc:1067] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 LEADER]: Signalling peer 8123980701894dcd92e770f7b8b87bac to start an election
I20260812 19:20:39.316797  4798 raft_consensus.cc:1067] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Signalling peer 70ea5c9f4c6b4bdd8fab381acd648069 to start an election
I20260812 19:20:39.318375  4595 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "95b3bd6c406642098c45291e34256638"
dest_uuid: "8123980701894dcd92e770f7b8b87bac"
 from {username='slave'} at 127.0.0.1:45674
I20260812 19:20:39.318980  4595 raft_consensus.cc:482] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:39.318790  4336 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026"
dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
 from {username='slave'} at 127.0.0.1:40198
I20260812 19:20:39.319443  4595 raft_consensus.cc:3037] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.318773  4141 catalog_manager.cc:5495] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 reported cstate change: term changed from 1 to 2, leader changed from 8123980701894dcd92e770f7b8b87bac (127.3.253.3) to 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:39.319582  4336 raft_consensus.cc:482] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:39.320079  4336 raft_consensus.cc:3037] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.326555  4595 raft_consensus.cc:504] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.326570  4336 raft_consensus.cc:504] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.329907  4597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:39.328737  4595 leader_election.cc:288] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 2 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765)
I20260812 19:20:39.330011  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:39.330572  4597 raft_consensus.cc:3037] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.330513  4333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95b3bd6c406642098c45291e34256638" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:39.330753  4464 raft_consensus.cc:3032] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:20:39.331333  4333 raft_consensus.cc:3032] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:20:39.331284  4464 raft_consensus.cc:729] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:39.331780  4333 raft_consensus.cc:729] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Running, Role: LEADER
I20260812 19:20:39.332300  4464 consensus_queue.cc:260] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.332600  4333 consensus_queue.cc:260] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.333453  4464 raft_consensus.cc:3037] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.333649  4333 raft_consensus.cc:3037] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.338608  4597 raft_consensus.cc:2454] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 2.
I20260812 19:20:39.339898  4279 leader_election.cc:302] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ea5c9f4c6b4bdd8fab381acd648069, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:39.340008  4462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95b3bd6c406642098c45291e34256638" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:39.340180  4464 raft_consensus.cc:2454] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 2.
I20260812 19:20:39.340749  4462 raft_consensus.cc:3037] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.341542  4745 raft_consensus.cc:979] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10: : Instructing follower 70ea5c9f4c6b4bdd8fab381acd648069 to start an election
I20260812 19:20:39.338564  4333 raft_consensus.cc:2454] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8123980701894dcd92e770f7b8b87bac in term 2.
I20260812 19:20:39.342031  4798 raft_consensus.cc:1067] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Signalling peer 70ea5c9f4c6b4bdd8fab381acd648069 to start an election
I20260812 19:20:39.342001  4336 leader_election.cc:288] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 2 election: Requested vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:39.342859  4699 raft_consensus.cc:2781] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:20:39.343400  4699 raft_consensus.cc:686] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Becoming Leader. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Running, Role: LEADER
I20260812 19:20:39.344282  4336 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a9e58d3956004c2f9ad49d24e2e07f4b"
dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
 from {username='slave'} at 127.0.0.1:40198
I20260812 19:20:39.344846  4336 raft_consensus.cc:482] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:39.344310  4699 consensus_queue.cc:237] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.345156  4336 raft_consensus.cc:3037] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.347427  4536 leader_election.cc:302] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ea5c9f4c6b4bdd8fab381acd648069, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:39.348338  4781 raft_consensus.cc:2781] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:20:39.348899  4781 raft_consensus.cc:686] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [term 2 LEADER]: Becoming Leader. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Running, Role: LEADER
I20260812 19:20:39.350275  4462 raft_consensus.cc:2454] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8123980701894dcd92e770f7b8b87bac in term 2.
I20260812 19:20:39.349835  4781 consensus_queue.cc:237] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.351532  4336 raft_consensus.cc:504] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.355579  4336 leader_election.cc:288] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 2 election: Requested vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:39.356523  4462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e58d3956004c2f9ad49d24e2e07f4b" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:39.357208  4462 raft_consensus.cc:3032] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:20:39.357592  4462 raft_consensus.cc:729] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:39.356938  4141 catalog_manager.cc:5495] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 reported cstate change: term changed from 1 to 2, leader changed from 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2) to 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:39.358886  4597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e58d3956004c2f9ad49d24e2e07f4b" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:39.358443  4462 consensus_queue.cc:260] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.359557  4597 raft_consensus.cc:3037] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.360136  4462 raft_consensus.cc:3037] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:39.359433  4139 catalog_manager.cc:5495] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac reported cstate change: term changed from 1 to 2, leader changed from 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1) to 8123980701894dcd92e770f7b8b87bac (127.3.253.3). New cstate: current_term: 2 leader_uuid: "8123980701894dcd92e770f7b8b87bac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: HEALTHY } } }
I20260812 19:20:39.367067  4597 raft_consensus.cc:2454] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 2.
I20260812 19:20:39.367067  4462 raft_consensus.cc:2454] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 2.
I20260812 19:20:39.368470  4279 leader_election.cc:302] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ea5c9f4c6b4bdd8fab381acd648069, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:39.369364  4699 raft_consensus.cc:2781] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:20:39.369904  4699 raft_consensus.cc:686] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Becoming Leader. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Running, Role: LEADER
I20260812 19:20:39.370862  4699 consensus_queue.cc:237] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:39.377303  4139 catalog_manager.cc:5495] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 reported cstate change: term changed from 1 to 2, leader changed from 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2) to 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:39.457545  4597 raft_consensus.cc:1261] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Refusing update from remote peer 70ea5c9f4c6b4bdd8fab381acd648069: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:39.458966  4699 consensus_queue.cc:1035] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:20:39.468937  4462 raft_consensus.cc:1261] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Refusing update from remote peer 70ea5c9f4c6b4bdd8fab381acd648069: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:39.470541  4699 consensus_queue.cc:1035] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:20:39.526937  4464 raft_consensus.cc:1261] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Refusing update from remote peer 70ea5c9f4c6b4bdd8fab381acd648069: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:39.528385  4699 consensus_queue.cc:1035] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:20:39.538908  4597 raft_consensus.cc:1261] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Refusing update from remote peer 70ea5c9f4c6b4bdd8fab381acd648069: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:39.540274  4699 consensus_queue.cc:1035] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:20:39.736771  4464 raft_consensus.cc:1261] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Refusing update from remote peer 8123980701894dcd92e770f7b8b87bac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:39.738149  4781 consensus_queue.cc:1035] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:20:39.744571  4597 raft_consensus.cc:1261] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Refusing update from remote peer 56e1de5b1f6c4e86bd161c3929a42a10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:39.746381  4799 consensus_queue.cc:1035] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:20:39.746968  4336 raft_consensus.cc:1261] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Refusing update from remote peer 8123980701894dcd92e770f7b8b87bac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:39.750679  4336 raft_consensus.cc:1261] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Refusing update from remote peer 56e1de5b1f6c4e86bd161c3929a42a10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:39.750890  4696 consensus_queue.cc:1035] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:20:39.752468  4799 consensus_queue.cc:1035] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:20:39.768997  4597 raft_consensus.cc:1261] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Refusing update from remote peer 70ea5c9f4c6b4bdd8fab381acd648069: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:39.770933  4713 consensus_queue.cc:1035] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:20:39.779860  4464 raft_consensus.cc:1261] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Refusing update from remote peer 70ea5c9f4c6b4bdd8fab381acd648069: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:39.781952  4713 consensus_queue.cc:1035] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:20:39.783586  4333 raft_consensus.cc:1261] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Refusing update from remote peer 56e1de5b1f6c4e86bd161c3929a42a10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:39.786772  4799 consensus_queue.cc:1035] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:20:39.798298  4597 raft_consensus.cc:1261] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Refusing update from remote peer 56e1de5b1f6c4e86bd161c3929a42a10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:39.800331  4799 consensus_queue.cc:1035] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:20:39.838186  4597 raft_consensus.cc:1261] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Refusing update from remote peer 70ea5c9f4c6b4bdd8fab381acd648069: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:39.839622  4871 consensus_queue.cc:1035] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:20:39.848232  4464 raft_consensus.cc:1261] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Refusing update from remote peer 70ea5c9f4c6b4bdd8fab381acd648069: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:39.849783  4699 consensus_queue.cc:1035] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:20:42.036329  4084 auto_leader_rebalancer-test.cc:269] The leader distribution is 
I20260812 19:20:42.037258  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:20:42.065609  4464 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
mode: GRACEFUL
new_leader_uuid: "8123980701894dcd92e770f7b8b87bac"
 from {username='slave'} at 127.0.0.1:40396
I20260812 19:20:42.066368  4464 raft_consensus.cc:595] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 LEADER]: Received request to transfer leadership to TS 8123980701894dcd92e770f7b8b87bac
I20260812 19:20:42.084834  4336 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0"
dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
mode: GRACEFUL
new_leader_uuid: "8123980701894dcd92e770f7b8b87bac"
 from {username='slave'} at 127.0.0.1:34742
I20260812 19:20:42.085561  4336 raft_consensus.cc:595] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Received request to transfer leadership to TS 8123980701894dcd92e770f7b8b87bac
I20260812 19:20:42.087066  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260812 19:20:42.087664  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:20:42.101224  4905 raft_consensus.cc:979] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069: : Instructing follower 8123980701894dcd92e770f7b8b87bac to start an election
I20260812 19:20:42.101907  4871 raft_consensus.cc:1067] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Signalling peer 8123980701894dcd92e770f7b8b87bac to start an election
I20260812 19:20:42.104182  4595 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0"
dest_uuid: "8123980701894dcd92e770f7b8b87bac"
 from {username='slave'} at 127.0.0.1:45674
I20260812 19:20:42.105024  4595 raft_consensus.cc:482] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:42.105552  4595 raft_consensus.cc:3037] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:20:42.112766  4595 raft_consensus.cc:504] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:42.114923  4595 leader_election.cc:288] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 3 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765)
I20260812 19:20:42.116393  4336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:42.116380  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:42.117246  4336 raft_consensus.cc:3032] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:20:42.117372  4464 raft_consensus.cc:3037] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:20:42.117691  4336 raft_consensus.cc:729] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Running, Role: LEADER
I20260812 19:20:42.118889  4336 consensus_queue.cc:260] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:42.120301  4336 raft_consensus.cc:3037] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:20:42.125195  4464 raft_consensus.cc:2454] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8123980701894dcd92e770f7b8b87bac in term 3.
I20260812 19:20:42.126627  4536 leader_election.cc:302] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:42.127256  4336 raft_consensus.cc:2454] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8123980701894dcd92e770f7b8b87bac in term 3.
I20260812 19:20:42.127584  4900 raft_consensus.cc:2781] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:20:42.130712  4900 raft_consensus.cc:686] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 3 LEADER]: Becoming Leader. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Running, Role: LEADER
I20260812 19:20:42.132210  4900 consensus_queue.cc:237] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:42.144384  4139 catalog_manager.cc:5495] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac reported cstate change: term changed from 2 to 3, leader changed from 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1) to 8123980701894dcd92e770f7b8b87bac (127.3.253.3). New cstate: current_term: 3 leader_uuid: "8123980701894dcd92e770f7b8b87bac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: HEALTHY } } }
I20260812 19:20:42.481376  4914 raft_consensus.cc:979] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10: : Instructing follower 8123980701894dcd92e770f7b8b87bac to start an election
I20260812 19:20:42.481979  4799 raft_consensus.cc:1067] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 LEADER]: Signalling peer 8123980701894dcd92e770f7b8b87bac to start an election
I20260812 19:20:42.483793  4595 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8"
dest_uuid: "8123980701894dcd92e770f7b8b87bac"
 from {username='slave'} at 127.0.0.1:45682
I20260812 19:20:42.484378  4595 raft_consensus.cc:482] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:42.484704  4595 raft_consensus.cc:3037] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:20:42.491776  4595 raft_consensus.cc:504] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:42.494165  4595 leader_election.cc:288] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 3 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765)
I20260812 19:20:42.496428  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:42.496801  4336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:42.497414  4464 raft_consensus.cc:3032] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:20:42.497753  4336 raft_consensus.cc:3037] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:20:42.497927  4464 raft_consensus.cc:729] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:42.499251  4464 consensus_queue.cc:260] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:42.501461  4464 raft_consensus.cc:3037] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:20:42.507592  4336 raft_consensus.cc:2454] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8123980701894dcd92e770f7b8b87bac in term 3.
I20260812 19:20:42.509135  4536 leader_election.cc:302] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ea5c9f4c6b4bdd8fab381acd648069, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:42.510010  4900 raft_consensus.cc:2781] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:20:42.510025  4464 raft_consensus.cc:2454] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8123980701894dcd92e770f7b8b87bac in term 3.
I20260812 19:20:42.510913  4900 raft_consensus.cc:686] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 3 LEADER]: Becoming Leader. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Running, Role: LEADER
I20260812 19:20:42.512347  4900 consensus_queue.cc:237] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:42.522538  4139 catalog_manager.cc:5495] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac reported cstate change: term changed from 2 to 3, leader changed from 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2) to 8123980701894dcd92e770f7b8b87bac (127.3.253.3). New cstate: current_term: 3 leader_uuid: "8123980701894dcd92e770f7b8b87bac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: HEALTHY } } }
I20260812 19:20:42.550253  4464 raft_consensus.cc:1261] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Refusing update from remote peer 8123980701894dcd92e770f7b8b87bac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:20:42.551630  4900 consensus_queue.cc:1035] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:20:42.566531  4336 raft_consensus.cc:1261] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Refusing update from remote peer 8123980701894dcd92e770f7b8b87bac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:20:42.568347  4907 consensus_queue.cc:1035] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:20:42.980309  4336 raft_consensus.cc:1261] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Refusing update from remote peer 8123980701894dcd92e770f7b8b87bac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:20:42.982036  4900 consensus_queue.cc:1035] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:20:42.995743  4464 raft_consensus.cc:1261] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Refusing update from remote peer 8123980701894dcd92e770f7b8b87bac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:20:42.998248  4906 consensus_queue.cc:1035] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:20:43.088779  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:20:43.095211  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:20:43.095713  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:20:44.096907  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:20:44.103777  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:20:44.104218  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:20:45.105113  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:20:45.110016  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:20:45.110456  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:20:46.111317  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:20:46.116029  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:20:46.116475  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:20:47.117508  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:20:47.123026  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:20:47.123452  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:20:48.124389  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:20:48.130700  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:20:48.131229  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:20:49.132131  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:20:49.136739  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:20:49.137181  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:20:50.138015  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:20:50.142630  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:20:50.143108  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:20:51.143990  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:20:51.148957  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:20:51.149415  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:20:52.178115  4084 auto_leader_rebalancer-test.cc:288] The leader distribution is 
I20260812 19:20:52.182624  4333 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3d3287dd700842499e82be426018f0ba"
dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
mode: GRACEFUL
new_leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
 from {username='slave'} at 127.0.0.1:34738
I20260812 19:20:52.183327  4333 raft_consensus.cc:595] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Received request to transfer leadership to TS 56e1de5b1f6c4e86bd161c3929a42a10
I20260812 19:20:52.188452  4595 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0"
dest_uuid: "8123980701894dcd92e770f7b8b87bac"
mode: GRACEFUL
new_leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
 from {username='slave'} at 127.0.0.1:54710
I20260812 19:20:52.188948  4595 raft_consensus.cc:595] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 3 LEADER]: Received request to transfer leadership to TS 56e1de5b1f6c4e86bd161c3929a42a10
I20260812 19:20:52.193717  4333 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a9e58d3956004c2f9ad49d24e2e07f4b"
dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
mode: GRACEFUL
new_leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
 from {username='slave'} at 127.0.0.1:34738
I20260812 19:20:52.194300  4333 raft_consensus.cc:595] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Received request to transfer leadership to TS 56e1de5b1f6c4e86bd161c3929a42a10
I20260812 19:20:52.199012  4333 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026"
dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
mode: GRACEFUL
new_leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
 from {username='slave'} at 127.0.0.1:34738
I20260812 19:20:52.199536  4333 raft_consensus.cc:595] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Received request to transfer leadership to TS 56e1de5b1f6c4e86bd161c3929a42a10
I20260812 19:20:52.211756  4595 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8"
dest_uuid: "8123980701894dcd92e770f7b8b87bac"
mode: GRACEFUL
new_leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
 from {username='slave'} at 127.0.0.1:54710
I20260812 19:20:52.212313  4595 raft_consensus.cc:595] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 3 LEADER]: Received request to transfer leadership to TS 56e1de5b1f6c4e86bd161c3929a42a10
I20260812 19:20:52.255481  4940 raft_consensus.cc:979] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac: : Instructing follower 56e1de5b1f6c4e86bd161c3929a42a10 to start an election
I20260812 19:20:52.256088  4946 raft_consensus.cc:1067] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 3 LEADER]: Signalling peer 56e1de5b1f6c4e86bd161c3929a42a10 to start an election
I20260812 19:20:52.257625  4464 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
 from {username='slave'} at 127.0.0.1:36020
I20260812 19:20:52.258036  4464 raft_consensus.cc:482] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:52.258284  4464 raft_consensus.cc:3037] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:20:52.263401  4464 raft_consensus.cc:504] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:52.265982  4464 leader_election.cc:288] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 4 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:52.266913  4333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:52.266877  4595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:52.267679  4333 raft_consensus.cc:3037] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:20:52.267702  4595 raft_consensus.cc:3032] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:20:52.267844  4942 raft_consensus.cc:979] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069: : Instructing follower 56e1de5b1f6c4e86bd161c3929a42a10 to start an election
I20260812 19:20:52.268234  4595 raft_consensus.cc:729] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Running, Role: LEADER
I20260812 19:20:52.268745  4942 raft_consensus.cc:1067] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Signalling peer 56e1de5b1f6c4e86bd161c3929a42a10 to start an election
I20260812 19:20:52.269078  4595 consensus_queue.cc:260] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:52.270243  4464 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
 from {username='slave'} at 127.0.0.1:36018
I20260812 19:20:52.270365  4595 raft_consensus.cc:3037] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:20:52.270759  4464 raft_consensus.cc:482] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:52.271080  4464 raft_consensus.cc:3037] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:20:52.275128  4333 raft_consensus.cc:2454] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 4.
I20260812 19:20:52.275091  4464 raft_consensus.cc:504] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:52.276726  4464 leader_election.cc:288] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 3 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:52.276615  4407 leader_election.cc:302] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 70ea5c9f4c6b4bdd8fab381acd648069; no voters: 
I20260812 19:20:52.277140  4595 raft_consensus.cc:2454] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 4.
I20260812 19:20:52.277753  4945 raft_consensus.cc:2781] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:20:52.277899  4597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:52.278564  4597 raft_consensus.cc:3037] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:20:52.278677  4945 raft_consensus.cc:686] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 LEADER]: Becoming Leader. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:52.278644  4333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:52.279405  4333 raft_consensus.cc:3032] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:20:52.279795  4333 raft_consensus.cc:729] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Running, Role: LEADER
I20260812 19:20:52.279836  4945 consensus_queue.cc:237] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:52.280846  4333 consensus_queue.cc:260] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:52.282155  4333 raft_consensus.cc:3037] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:20:52.285537  4597 raft_consensus.cc:2454] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 3.
I20260812 19:20:52.287035  4406 leader_election.cc:302] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:52.287882  4943 raft_consensus.cc:2781] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:20:52.288353  4943 raft_consensus.cc:686] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 LEADER]: Becoming Leader. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:52.289057  4333 raft_consensus.cc:2454] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 3.
I20260812 19:20:52.289367  4943 consensus_queue.cc:237] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:52.290503  4139 catalog_manager.cc:5495] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 reported cstate change: term changed from 3 to 4, leader changed from 8123980701894dcd92e770f7b8b87bac (127.3.253.3) to 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2). New cstate: current_term: 4 leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:52.308269  4139 catalog_manager.cc:5495] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 reported cstate change: term changed from 2 to 3, leader changed from 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1) to 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2). New cstate: current_term: 3 leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:52.316031  4940 raft_consensus.cc:979] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac: : Instructing follower 56e1de5b1f6c4e86bd161c3929a42a10 to start an election
I20260812 19:20:52.316581  4946 raft_consensus.cc:1067] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 3 LEADER]: Signalling peer 56e1de5b1f6c4e86bd161c3929a42a10 to start an election
I20260812 19:20:52.317929  4464 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
 from {username='slave'} at 127.0.0.1:36020
I20260812 19:20:52.318425  4464 raft_consensus.cc:482] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:52.318717  4464 raft_consensus.cc:3037] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:20:52.323323  4464 raft_consensus.cc:504] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:52.324891  4464 leader_election.cc:288] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 4 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:52.325680  4333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:52.326215  4333 raft_consensus.cc:3037] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:20:52.326236  4597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:52.326812  4597 raft_consensus.cc:3032] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:20:52.327016  4597 raft_consensus.cc:729] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Running, Role: LEADER
I20260812 19:20:52.327574  4597 consensus_queue.cc:260] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:52.328462  4597 raft_consensus.cc:3037] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:20:52.325845  4942 raft_consensus.cc:979] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069: : Instructing follower 56e1de5b1f6c4e86bd161c3929a42a10 to start an election
I20260812 19:20:52.331092  4333 raft_consensus.cc:2454] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 4.
I20260812 19:20:52.331162  4947 raft_consensus.cc:1067] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Signalling peer 56e1de5b1f6c4e86bd161c3929a42a10 to start an election
I20260812 19:20:52.332172  4407 leader_election.cc:302] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 70ea5c9f4c6b4bdd8fab381acd648069; no voters: 
I20260812 19:20:52.332937  4943 raft_consensus.cc:2781] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:20:52.332994  4464 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3d3287dd700842499e82be426018f0ba"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
 from {username='slave'} at 127.0.0.1:36018
I20260812 19:20:52.333381  4597 raft_consensus.cc:2454] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 4.
I20260812 19:20:52.333551  4943 raft_consensus.cc:686] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 LEADER]: Becoming Leader. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:52.333648  4464 raft_consensus.cc:482] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:52.334036  4464 raft_consensus.cc:3037] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:20:52.334457  4943 consensus_queue.cc:237] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:52.339074  4464 raft_consensus.cc:504] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:52.340735  4464 leader_election.cc:288] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 3 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:52.341480  4333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d3287dd700842499e82be426018f0ba" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:52.341607  4597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d3287dd700842499e82be426018f0ba" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:52.341979  4333 raft_consensus.cc:3032] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:20:52.342146  4597 raft_consensus.cc:3037] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:20:52.342308  4333 raft_consensus.cc:729] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Running, Role: LEADER
I20260812 19:20:52.342249  4139 catalog_manager.cc:5495] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 reported cstate change: term changed from 3 to 4, leader changed from 8123980701894dcd92e770f7b8b87bac (127.3.253.3) to 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2). New cstate: current_term: 4 leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:52.343163  4333 consensus_queue.cc:260] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:52.344046  4333 raft_consensus.cc:3037] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:20:52.349386  4597 raft_consensus.cc:2454] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 3.
I20260812 19:20:52.349391  4333 raft_consensus.cc:2454] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 3.
I20260812 19:20:52.350579  4406 leader_election.cc:302] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:52.351428  4943 raft_consensus.cc:2781] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:20:52.351888  4943 raft_consensus.cc:686] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 LEADER]: Becoming Leader. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:52.352636  4943 consensus_queue.cc:237] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:52.359366  4139 catalog_manager.cc:5495] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 reported cstate change: term changed from 2 to 3, leader changed from 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1) to 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2). New cstate: current_term: 3 leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:52.585644  4942 raft_consensus.cc:979] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069: : Instructing follower 56e1de5b1f6c4e86bd161c3929a42a10 to start an election
I20260812 19:20:52.586124  4947 raft_consensus.cc:1067] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Signalling peer 56e1de5b1f6c4e86bd161c3929a42a10 to start an election
I20260812 19:20:52.587459  4464 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a9e58d3956004c2f9ad49d24e2e07f4b"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
 from {username='slave'} at 127.0.0.1:36018
I20260812 19:20:52.587862  4464 raft_consensus.cc:482] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:52.588109  4464 raft_consensus.cc:3037] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:20:52.592552  4464 raft_consensus.cc:504] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:52.594074  4464 leader_election.cc:288] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 3 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:52.595000  4333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e58d3956004c2f9ad49d24e2e07f4b" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:52.595242  4597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e58d3956004c2f9ad49d24e2e07f4b" candidate_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:52.595715  4333 raft_consensus.cc:3032] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:20:52.595782  4597 raft_consensus.cc:3037] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:20:52.596159  4333 raft_consensus.cc:729] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Running, Role: LEADER
I20260812 19:20:52.596943  4333 consensus_queue.cc:260] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:52.598124  4333 raft_consensus.cc:3037] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:20:52.602370  4597 raft_consensus.cc:2454] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 3.
I20260812 19:20:52.603451  4406 leader_election.cc:302] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:52.604254  4943 raft_consensus.cc:2781] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:20:52.604426  4333 raft_consensus.cc:2454] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e1de5b1f6c4e86bd161c3929a42a10 in term 3.
I20260812 19:20:52.604837  4943 raft_consensus.cc:686] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 LEADER]: Becoming Leader. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:52.605729  4943 consensus_queue.cc:237] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:52.613055  4139 catalog_manager.cc:5495] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 reported cstate change: term changed from 2 to 3, leader changed from 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1) to 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2). New cstate: current_term: 3 leader_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:52.682627  4333 raft_consensus.cc:1261] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Refusing update from remote peer 56e1de5b1f6c4e86bd161c3929a42a10: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 19:20:52.684038  4943 consensus_queue.cc:1035] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:20:52.694751  4597 raft_consensus.cc:1261] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 4 FOLLOWER]: Refusing update from remote peer 56e1de5b1f6c4e86bd161c3929a42a10: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 19:20:52.696259  4967 consensus_queue.cc:1035] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:20:52.770107  4333 raft_consensus.cc:1261] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Refusing update from remote peer 56e1de5b1f6c4e86bd161c3929a42a10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:20:52.771231  4597 raft_consensus.cc:1261] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 4 FOLLOWER]: Refusing update from remote peer 56e1de5b1f6c4e86bd161c3929a42a10: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 19:20:52.771484  4967 consensus_queue.cc:1035] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:20:52.772439  4945 consensus_queue.cc:1035] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:20:52.787932  4336 raft_consensus.cc:1261] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Refusing update from remote peer 56e1de5b1f6c4e86bd161c3929a42a10: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 19:20:52.790000  4967 consensus_queue.cc:1035] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:20:52.790331  4597 raft_consensus.cc:1261] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Refusing update from remote peer 56e1de5b1f6c4e86bd161c3929a42a10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:20:52.792526  4967 consensus_queue.cc:1035] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:20:52.861984  4333 raft_consensus.cc:1261] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Refusing update from remote peer 56e1de5b1f6c4e86bd161c3929a42a10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:20:52.863905  4967 consensus_queue.cc:1035] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:20:52.871497  4597 raft_consensus.cc:1261] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Refusing update from remote peer 56e1de5b1f6c4e86bd161c3929a42a10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:20:52.873126  4943 consensus_queue.cc:1035] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:20:53.024353  4597 raft_consensus.cc:1261] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Refusing update from remote peer 56e1de5b1f6c4e86bd161c3929a42a10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:20:53.026611  4943 consensus_queue.cc:1035] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:20:53.041805  4333 raft_consensus.cc:1261] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Refusing update from remote peer 56e1de5b1f6c4e86bd161c3929a42a10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:20:53.043879  4967 consensus_queue.cc:1035] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260812 19:20:54.640085  4374 debug-util.cc:398] Leaking SignalData structure 0x7b08000ea060 after lost signal to thread 4090
W20260812 19:20:54.640910  4374 debug-util.cc:398] Leaking SignalData structure 0x7b08000ea740 after lost signal to thread 4204
W20260812 19:20:54.641839  4374 debug-util.cc:398] Leaking SignalData structure 0x7b0800203c40 after lost signal to thread 4382
W20260812 19:20:54.642620  4374 debug-util.cc:398] Leaking SignalData structure 0x7b08000d2a60 after lost signal to thread 4501
W20260812 19:20:54.643385  4374 debug-util.cc:398] Leaking SignalData structure 0x7b080009c7e0 after lost signal to thread 4643
I20260812 19:20:55.330902  4084 auto_leader_rebalancer-test.cc:303] The leader distribution is 
I20260812 19:20:55.331730  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:20:55.339128  4464 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "37ba65d1aef8455db82e3260a54bb255"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
mode: GRACEFUL
new_leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
 from {username='slave'} at 127.0.0.1:40396
I20260812 19:20:55.339851  4464 raft_consensus.cc:595] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Received request to transfer leadership to TS 70ea5c9f4c6b4bdd8fab381acd648069
I20260812 19:20:55.342554  5010 raft_consensus.cc:979] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10: : Instructing follower 70ea5c9f4c6b4bdd8fab381acd648069 to start an election
I20260812 19:20:55.342531  4464 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3d3287dd700842499e82be426018f0ba"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
mode: GRACEFUL
new_leader_uuid: "8123980701894dcd92e770f7b8b87bac"
 from {username='slave'} at 127.0.0.1:40396
I20260812 19:20:55.343312  4464 raft_consensus.cc:595] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 LEADER]: Received request to transfer leadership to TS 8123980701894dcd92e770f7b8b87bac
I20260812 19:20:55.343406  5001 raft_consensus.cc:1067] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Signalling peer 70ea5c9f4c6b4bdd8fab381acd648069 to start an election
I20260812 19:20:55.345500  4336 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "37ba65d1aef8455db82e3260a54bb255"
dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
 from {username='slave'} at 127.0.0.1:40198
I20260812 19:20:55.346127  4336 raft_consensus.cc:482] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:55.346428  4336 raft_consensus.cc:3037] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:55.351473  4336 raft_consensus.cc:504] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:55.345467  4464 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
mode: GRACEFUL
new_leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
 from {username='slave'} at 127.0.0.1:40396
I20260812 19:20:55.352298  4464 raft_consensus.cc:595] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 LEADER]: Received request to transfer leadership to TS 70ea5c9f4c6b4bdd8fab381acd648069
I20260812 19:20:55.354322  4336 leader_election.cc:288] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 2 election: Requested vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:55.355018  4597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ba65d1aef8455db82e3260a54bb255" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:55.355762  4597 raft_consensus.cc:3037] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:55.355934  4462 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
mode: GRACEFUL
new_leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
 from {username='slave'} at 127.0.0.1:40396
I20260812 19:20:55.354694  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ba65d1aef8455db82e3260a54bb255" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:55.356680  4464 raft_consensus.cc:3032] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:20:55.356663  4462 raft_consensus.cc:595] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 LEADER]: Received request to transfer leadership to TS 70ea5c9f4c6b4bdd8fab381acd648069
I20260812 19:20:55.357139  4464 raft_consensus.cc:729] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:55.359107  4462 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026"
dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
mode: GRACEFUL
new_leader_uuid: "8123980701894dcd92e770f7b8b87bac"
 from {username='slave'} at 127.0.0.1:40396
I20260812 19:20:55.358349  4464 consensus_queue.cc:260] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:55.359687  4462 raft_consensus.cc:595] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 LEADER]: Received request to transfer leadership to TS 8123980701894dcd92e770f7b8b87bac
I20260812 19:20:55.360705  4464 raft_consensus.cc:3037] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:20:55.360826  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:20:55.361493  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:20:55.363776  4597 raft_consensus.cc:2454] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 2.
I20260812 19:20:55.365257  4279 leader_election.cc:302] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ea5c9f4c6b4bdd8fab381acd648069, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:55.365547  4464 raft_consensus.cc:2454] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 2.
I20260812 19:20:55.367396  5011 raft_consensus.cc:2781] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:20:55.368389  5011 raft_consensus.cc:686] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Becoming Leader. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Running, Role: LEADER
I20260812 19:20:55.369266  5011 consensus_queue.cc:237] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:55.377980  4139 catalog_manager.cc:5495] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 reported cstate change: term changed from 1 to 2, leader changed from 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2) to 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:55.459625  5010 raft_consensus.cc:979] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10: : Instructing follower 8123980701894dcd92e770f7b8b87bac to start an election
I20260812 19:20:55.460119  5001 raft_consensus.cc:1067] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 LEADER]: Signalling peer 8123980701894dcd92e770f7b8b87bac to start an election
I20260812 19:20:55.461570  4597 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3d3287dd700842499e82be426018f0ba"
dest_uuid: "8123980701894dcd92e770f7b8b87bac"
 from {username='slave'} at 127.0.0.1:45682
I20260812 19:20:55.462065  4597 raft_consensus.cc:482] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:55.462343  4597 raft_consensus.cc:3037] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:20:55.468171  4597 raft_consensus.cc:504] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:55.470323  4597 leader_election.cc:288] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 4 election: Requested vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593)
I20260812 19:20:55.471122  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d3287dd700842499e82be426018f0ba" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:55.471397  4336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d3287dd700842499e82be426018f0ba" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:55.471717  4464 raft_consensus.cc:3032] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:20:55.471897  4336 raft_consensus.cc:3037] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:20:55.472019  4464 raft_consensus.cc:729] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:55.472860  4464 consensus_queue.cc:260] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:55.474021  4464 raft_consensus.cc:3037] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:20:55.478117  4336 raft_consensus.cc:2454] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8123980701894dcd92e770f7b8b87bac in term 4.
I20260812 19:20:55.479642  4536 leader_election.cc:302] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ea5c9f4c6b4bdd8fab381acd648069, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:55.480219  4464 raft_consensus.cc:2454] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8123980701894dcd92e770f7b8b87bac in term 4.
I20260812 19:20:55.480737  5004 raft_consensus.cc:2781] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:20:55.482084  5004 raft_consensus.cc:686] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 4 LEADER]: Becoming Leader. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Running, Role: LEADER
I20260812 19:20:55.483095  5004 consensus_queue.cc:237] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:55.491986  4139 catalog_manager.cc:5495] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac reported cstate change: term changed from 3 to 4, leader changed from 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2) to 8123980701894dcd92e770f7b8b87bac (127.3.253.3). New cstate: current_term: 4 leader_uuid: "8123980701894dcd92e770f7b8b87bac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: HEALTHY } } }
I20260812 19:20:55.693540  5001 raft_consensus.cc:979] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10: : Instructing follower 8123980701894dcd92e770f7b8b87bac to start an election
I20260812 19:20:55.694106  5010 raft_consensus.cc:1067] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 LEADER]: Signalling peer 8123980701894dcd92e770f7b8b87bac to start an election
I20260812 19:20:55.695935  4597 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026"
dest_uuid: "8123980701894dcd92e770f7b8b87bac"
 from {username='slave'} at 127.0.0.1:45682
I20260812 19:20:55.696421  4597 raft_consensus.cc:482] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:55.696753  4597 raft_consensus.cc:3037] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:20:55.701226  4597 raft_consensus.cc:504] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:55.702764  4597 leader_election.cc:288] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 4 election: Requested vote from peers 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593), 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765)
I20260812 19:20:55.703624  4336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
I20260812 19:20:55.703778  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8040d6a29794f9ca9cdaed5e1ea7026" candidate_uuid: "8123980701894dcd92e770f7b8b87bac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:55.704306  4336 raft_consensus.cc:3037] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:20:55.704355  4464 raft_consensus.cc:3032] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:20:55.704975  4464 raft_consensus.cc:729] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:55.705667  4464 consensus_queue.cc:260] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:55.706638  4464 raft_consensus.cc:3037] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:20:55.711560  4464 raft_consensus.cc:2454] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8123980701894dcd92e770f7b8b87bac in term 4.
I20260812 19:20:55.711778  4336 raft_consensus.cc:2454] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8123980701894dcd92e770f7b8b87bac in term 4.
I20260812 19:20:55.712886  4536 leader_election.cc:302] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e1de5b1f6c4e86bd161c3929a42a10, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:55.713670  5004 raft_consensus.cc:2781] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:20:55.714304  5004 raft_consensus.cc:686] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 4 LEADER]: Becoming Leader. State: Replica: 8123980701894dcd92e770f7b8b87bac, State: Running, Role: LEADER
I20260812 19:20:55.715474  5004 consensus_queue.cc:237] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:55.724135  4139 catalog_manager.cc:5495] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac reported cstate change: term changed from 3 to 4, leader changed from 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2) to 8123980701894dcd92e770f7b8b87bac (127.3.253.3). New cstate: current_term: 4 leader_uuid: "8123980701894dcd92e770f7b8b87bac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: HEALTHY } } }
I20260812 19:20:55.790644  5001 raft_consensus.cc:979] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10: : Instructing follower 70ea5c9f4c6b4bdd8fab381acd648069 to start an election
I20260812 19:20:55.791244  5010 raft_consensus.cc:1067] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 LEADER]: Signalling peer 70ea5c9f4c6b4bdd8fab381acd648069 to start an election
I20260812 19:20:55.793244  4336 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0"
dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
 from {username='slave'} at 127.0.0.1:40198
I20260812 19:20:55.793759  4336 raft_consensus.cc:482] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:55.794051  4336 raft_consensus.cc:3037] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:20:55.799085  4336 raft_consensus.cc:504] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:55.800588  4336 leader_election.cc:288] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 5 election: Requested vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:55.801405  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:55.801962  4464 raft_consensus.cc:3032] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:20:55.802265  4464 raft_consensus.cc:729] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:55.802176  4597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9533c5aca216454db2e9cbe4e7abfde0" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:55.802779  4597 raft_consensus.cc:3037] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:20:55.803092  4464 consensus_queue.cc:260] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:55.804370  4464 raft_consensus.cc:3037] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:20:55.809705  4597 raft_consensus.cc:2454] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 5.
I20260812 19:20:55.810988  4464 raft_consensus.cc:2454] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 5.
I20260812 19:20:55.810873  4279 leader_election.cc:302] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ea5c9f4c6b4bdd8fab381acd648069, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:55.811985  5011 raft_consensus.cc:2781] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:20:55.812523  5011 raft_consensus.cc:686] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 5 LEADER]: Becoming Leader. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Running, Role: LEADER
I20260812 19:20:55.813596  5011 consensus_queue.cc:237] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:55.823757  4139 catalog_manager.cc:5495] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 reported cstate change: term changed from 4 to 5, leader changed from 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2) to 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1). New cstate: current_term: 5 leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:55.853865  5001 raft_consensus.cc:979] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10: : Instructing follower 70ea5c9f4c6b4bdd8fab381acd648069 to start an election
I20260812 19:20:55.854453  5010 raft_consensus.cc:1067] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 LEADER]: Signalling peer 70ea5c9f4c6b4bdd8fab381acd648069 to start an election
I20260812 19:20:55.856343  4336 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8"
dest_uuid: "70ea5c9f4c6b4bdd8fab381acd648069"
 from {username='slave'} at 127.0.0.1:40198
I20260812 19:20:55.856824  4336 raft_consensus.cc:482] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:20:55.857167  4336 raft_consensus.cc:3037] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:20:55.862295  4336 raft_consensus.cc:504] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:55.863926  4336 leader_election.cc:288] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 5 election: Requested vote from peers 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765), 8123980701894dcd92e770f7b8b87bac (127.3.253.3:37975)
I20260812 19:20:55.864884  4464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "56e1de5b1f6c4e86bd161c3929a42a10"
I20260812 19:20:55.865465  4464 raft_consensus.cc:3032] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:20:55.865468  4597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee31345b54f4889a8908b6b3dc720c8" candidate_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8123980701894dcd92e770f7b8b87bac"
I20260812 19:20:55.865851  4464 raft_consensus.cc:729] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56e1de5b1f6c4e86bd161c3929a42a10, State: Running, Role: LEADER
I20260812 19:20:55.866114  4597 raft_consensus.cc:3037] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:20:55.866551  4464 consensus_queue.cc:260] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:55.867826  4464 raft_consensus.cc:3037] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:20:55.873036  4597 raft_consensus.cc:2454] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 5.
I20260812 19:20:55.874339  4464 raft_consensus.cc:2454] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ea5c9f4c6b4bdd8fab381acd648069 in term 5.
I20260812 19:20:55.875439  4279 leader_election.cc:302] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ea5c9f4c6b4bdd8fab381acd648069, 8123980701894dcd92e770f7b8b87bac; no voters: 
I20260812 19:20:55.876504  5011 raft_consensus.cc:2781] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:20:55.877171  5011 raft_consensus.cc:686] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 5 LEADER]: Becoming Leader. State: Replica: 70ea5c9f4c6b4bdd8fab381acd648069, State: Running, Role: LEADER
I20260812 19:20:55.878196  5011 consensus_queue.cc:237] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } }
I20260812 19:20:55.889441  4139 catalog_manager.cc:5495] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 reported cstate change: term changed from 4 to 5, leader changed from 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2) to 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1). New cstate: current_term: 5 leader_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 } health_report { overall_health: UNKNOWN } } }
I20260812 19:20:55.920902  4336 raft_consensus.cc:1261] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Refusing update from remote peer 8123980701894dcd92e770f7b8b87bac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 19:20:55.922179  5004 consensus_queue.cc:1035] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:20:55.940721  4597 raft_consensus.cc:1261] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Refusing update from remote peer 70ea5c9f4c6b4bdd8fab381acd648069: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:55.943022  4464 raft_consensus.cc:1261] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 FOLLOWER]: Refusing update from remote peer 8123980701894dcd92e770f7b8b87bac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 19:20:55.943022  5011 consensus_queue.cc:1035] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:20:55.955226  4464 raft_consensus.cc:1261] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Refusing update from remote peer 70ea5c9f4c6b4bdd8fab381acd648069: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:20:55.955323  5019 consensus_queue.cc:1035] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260812 19:20:55.957969  5013 consensus_queue.cc:1035] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:20:56.156077  4462 raft_consensus.cc:1261] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 FOLLOWER]: Refusing update from remote peer 8123980701894dcd92e770f7b8b87bac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 19:20:56.158721  5019 consensus_queue.cc:1035] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:20:56.174429  4336 raft_consensus.cc:1261] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Refusing update from remote peer 8123980701894dcd92e770f7b8b87bac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 19:20:56.176406  5028 consensus_queue.cc:1035] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ea5c9f4c6b4bdd8fab381acd648069" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260812 19:20:56.249517  4462 raft_consensus.cc:1261] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 5 FOLLOWER]: Refusing update from remote peer 70ea5c9f4c6b4bdd8fab381acd648069: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260812 19:20:56.251667  5037 consensus_queue.cc:1035] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:20:56.260571  4597 raft_consensus.cc:1261] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 5 FOLLOWER]: Refusing update from remote peer 70ea5c9f4c6b4bdd8fab381acd648069: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260812 19:20:56.262473  5037 consensus_queue.cc:1035] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:20:56.269475  4464 raft_consensus.cc:1261] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 5 FOLLOWER]: Refusing update from remote peer 70ea5c9f4c6b4bdd8fab381acd648069: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260812 19:20:56.270200  4597 raft_consensus.cc:1261] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 5 FOLLOWER]: Refusing update from remote peer 70ea5c9f4c6b4bdd8fab381acd648069: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260812 19:20:56.273716  5013 consensus_queue.cc:1035] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8123980701894dcd92e770f7b8b87bac" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:20:56.275765  5043 consensus_queue.cc:1035] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e1de5b1f6c4e86bd161c3929a42a10" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:20:56.362459  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:20:56.367333  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:20:56.367751  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:20:57.368605  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:20:57.373558  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:20:57.374037  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:20:58.374974  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:20:58.379995  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:20:58.380463  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:20:59.493590  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:20:59.500305  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:20:59.501067  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260812 19:21:00.479681  4639 debug-util.cc:398] Leaking SignalData structure 0x7b080016bee0 after lost signal to thread 4090
W20260812 19:21:00.480873  4639 debug-util.cc:398] Leaking SignalData structure 0x7b080016c5c0 after lost signal to thread 4204
W20260812 19:21:00.481851  4639 debug-util.cc:398] Leaking SignalData structure 0x7b0800115ae0 after lost signal to thread 4382
W20260812 19:21:00.483238  4639 debug-util.cc:398] Leaking SignalData structure 0x7b08001dc900 after lost signal to thread 4501
W20260812 19:21:00.484414  4639 debug-util.cc:398] Leaking SignalData structure 0x7b0800077920 after lost signal to thread 4643
I20260812 19:21:00.502231  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:00.508260  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:00.508754  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:01.509601  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:01.515019  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:01.515442  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:02.516350  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:02.522500  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:02.523036  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:03.524085  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:03.529765  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:03.530267  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:04.531038  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:04.535976  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:04.536499  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:05.566709  4084 auto_leader_rebalancer-test.cc:314] The leader distribution is 
I20260812 19:21:05.567376  4084 tablet_server.cc:178] TabletServer@127.3.253.1:0 shutting down...
I20260812 19:21:05.604642  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:21:05.605489  4084 tablet_replica.cc:330] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069: stopping tablet replica
I20260812 19:21:05.606432  4084 raft_consensus.cc:2229] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.607205  4084 raft_consensus.cc:2258] T a9e58d3956004c2f9ad49d24e2e07f4b P 70ea5c9f4c6b4bdd8fab381acd648069 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.609707  4084 tablet_replica.cc:330] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069: stopping tablet replica
I20260812 19:21:05.610217  4084 raft_consensus.cc:2229] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.610721  4084 raft_consensus.cc:2258] T 0629a1a838d347cd963068ac65351009 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.612484  4084 tablet_replica.cc:330] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069: stopping tablet replica
I20260812 19:21:05.612948  4084 raft_consensus.cc:2229] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:21:05.613801  4084 raft_consensus.cc:2258] T 37ba65d1aef8455db82e3260a54bb255 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.615585  4084 tablet_replica.cc:330] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069: stopping tablet replica
I20260812 19:21:05.616060  4084 raft_consensus.cc:2229] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.616492  4084 raft_consensus.cc:2258] T d8040d6a29794f9ca9cdaed5e1ea7026 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.618178  4084 tablet_replica.cc:330] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069: stopping tablet replica
I20260812 19:21:05.618785  4084 raft_consensus.cc:2229] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 5 LEADER]: Raft consensus shutting down.
I20260812 19:21:05.619608  4084 raft_consensus.cc:2258] T 4ee31345b54f4889a8908b6b3dc720c8 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.621598  4084 tablet_replica.cc:330] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069: stopping tablet replica
I20260812 19:21:05.622031  4084 raft_consensus.cc:2229] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.622400  4084 raft_consensus.cc:2258] T 95b3bd6c406642098c45291e34256638 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.624001  4084 tablet_replica.cc:330] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069: stopping tablet replica
I20260812 19:21:05.624429  4084 raft_consensus.cc:2229] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 5 LEADER]: Raft consensus shutting down.
I20260812 19:21:05.625213  4084 raft_consensus.cc:2258] T 9533c5aca216454db2e9cbe4e7abfde0 P 70ea5c9f4c6b4bdd8fab381acd648069 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.626955  4084 tablet_replica.cc:330] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069: stopping tablet replica
I20260812 19:21:05.627372  4084 raft_consensus.cc:2229] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.627774  4084 raft_consensus.cc:2258] T 3d3287dd700842499e82be426018f0ba P 70ea5c9f4c6b4bdd8fab381acd648069 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.629266  4084 tablet_replica.cc:330] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069: stopping tablet replica
I20260812 19:21:05.629673  4084 raft_consensus.cc:2229] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.630005  4084 raft_consensus.cc:2258] T 4489d7f9dfbd4ae39b26df513e5ac14d P 70ea5c9f4c6b4bdd8fab381acd648069 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.747220  4084 tablet_server.cc:194] TabletServer@127.3.253.1:0 shutdown complete.
I20260812 19:21:05.766140  4084 tablet_server.cc:178] TabletServer@127.3.253.2:0 shutting down...
I20260812 19:21:05.800086  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:21:05.800917  4084 tablet_replica.cc:330] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10: stopping tablet replica
W20260812 19:21:05.801330  4536 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:21:05.801764  4084 raft_consensus.cc:2229] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:21:05.802820  4084 raft_consensus.cc:2258] T a9e58d3956004c2f9ad49d24e2e07f4b P 56e1de5b1f6c4e86bd161c3929a42a10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.804826  4084 tablet_replica.cc:330] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10: stopping tablet replica
W20260812 19:21:05.804765  4536 consensus_peers.cc:487] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac -> Peer 56e1de5b1f6c4e86bd161c3929a42a10 (127.3.253.2:45765): Couldn't send request to peer 56e1de5b1f6c4e86bd161c3929a42a10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:05.805775  4084 raft_consensus.cc:2229] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:21:05.806829  4084 raft_consensus.cc:2258] T 0629a1a838d347cd963068ac65351009 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.808722  4084 tablet_replica.cc:330] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10: stopping tablet replica
I20260812 19:21:05.809252  4084 raft_consensus.cc:2229] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:21:05.810201  4084 raft_consensus.cc:2258] T 4489d7f9dfbd4ae39b26df513e5ac14d P 56e1de5b1f6c4e86bd161c3929a42a10 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:21:05.811564  4536 consensus_peers.cc:487] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac -> Peer 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593): Couldn't send request to peer 70ea5c9f4c6b4bdd8fab381acd648069. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:45593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:05.812309  4084 tablet_replica.cc:330] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10: stopping tablet replica
I20260812 19:21:05.812784  4084 raft_consensus.cc:2229] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.813154  4084 raft_consensus.cc:2258] T 3d3287dd700842499e82be426018f0ba P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.814857  4084 tablet_replica.cc:330] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10: stopping tablet replica
I20260812 19:21:05.815369  4084 raft_consensus.cc:2229] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.815763  4084 raft_consensus.cc:2258] T 37ba65d1aef8455db82e3260a54bb255 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.817520  4084 tablet_replica.cc:330] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10: stopping tablet replica
I20260812 19:21:05.818099  4084 raft_consensus.cc:2229] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.818459  4084 raft_consensus.cc:2258] T 4ee31345b54f4889a8908b6b3dc720c8 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.820204  4084 tablet_replica.cc:330] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10: stopping tablet replica
I20260812 19:21:05.820696  4084 raft_consensus.cc:2229] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.821079  4084 raft_consensus.cc:2258] T d8040d6a29794f9ca9cdaed5e1ea7026 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.822810  4084 tablet_replica.cc:330] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10: stopping tablet replica
I20260812 19:21:05.823236  4084 raft_consensus.cc:2229] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.823599  4084 raft_consensus.cc:2258] T 95b3bd6c406642098c45291e34256638 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.825062  4084 tablet_replica.cc:330] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10: stopping tablet replica
I20260812 19:21:05.825453  4084 raft_consensus.cc:2229] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.825796  4084 raft_consensus.cc:2258] T 9533c5aca216454db2e9cbe4e7abfde0 P 56e1de5b1f6c4e86bd161c3929a42a10 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.856395  4084 tablet_server.cc:194] TabletServer@127.3.253.2:0 shutdown complete.
I20260812 19:21:05.874974  4084 tablet_server.cc:178] TabletServer@127.3.253.3:0 shutting down...
I20260812 19:21:05.903250  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:21:05.903942  4084 tablet_replica.cc:330] T 4489d7f9dfbd4ae39b26df513e5ac14d P 8123980701894dcd92e770f7b8b87bac: stopping tablet replica
I20260812 19:21:05.904670  4084 raft_consensus.cc:2229] T 4489d7f9dfbd4ae39b26df513e5ac14d P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.905123  4084 raft_consensus.cc:2258] T 4489d7f9dfbd4ae39b26df513e5ac14d P 8123980701894dcd92e770f7b8b87bac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.907429  4084 tablet_replica.cc:330] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac: stopping tablet replica
W20260812 19:21:05.907734  4536 consensus_peers.cc:487] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac -> Peer 70ea5c9f4c6b4bdd8fab381acd648069 (127.3.253.1:45593): Couldn't send request to peer 70ea5c9f4c6b4bdd8fab381acd648069. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:45593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:05.907949  4084 raft_consensus.cc:2229] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 4 LEADER]: Raft consensus shutting down.
I20260812 19:21:05.908921  4084 raft_consensus.cc:2258] T 3d3287dd700842499e82be426018f0ba P 8123980701894dcd92e770f7b8b87bac [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.911203  4084 tablet_replica.cc:330] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac: stopping tablet replica
I20260812 19:21:05.912005  4084 raft_consensus.cc:2229] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.912590  4084 raft_consensus.cc:2258] T a9e58d3956004c2f9ad49d24e2e07f4b P 8123980701894dcd92e770f7b8b87bac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.914523  4084 tablet_replica.cc:330] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac: stopping tablet replica
I20260812 19:21:05.915094  4084 raft_consensus.cc:2229] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.915512  4084 raft_consensus.cc:2258] T 0629a1a838d347cd963068ac65351009 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.917057  4084 tablet_replica.cc:330] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac: stopping tablet replica
I20260812 19:21:05.917538  4084 raft_consensus.cc:2229] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:21:05.918459  4084 raft_consensus.cc:2258] T 95b3bd6c406642098c45291e34256638 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.920300  4084 tablet_replica.cc:330] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac: stopping tablet replica
I20260812 19:21:05.920809  4084 raft_consensus.cc:2229] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 5 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.921233  4084 raft_consensus.cc:2258] T 4ee31345b54f4889a8908b6b3dc720c8 P 8123980701894dcd92e770f7b8b87bac [term 5 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.922885  4084 tablet_replica.cc:330] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac: stopping tablet replica
I20260812 19:21:05.923362  4084 raft_consensus.cc:2229] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 4 LEADER]: Raft consensus shutting down.
I20260812 19:21:05.924113  4084 raft_consensus.cc:2258] T d8040d6a29794f9ca9cdaed5e1ea7026 P 8123980701894dcd92e770f7b8b87bac [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.925622  4084 tablet_replica.cc:330] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac: stopping tablet replica
I20260812 19:21:05.926070  4084 raft_consensus.cc:2229] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 5 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.926496  4084 raft_consensus.cc:2258] T 9533c5aca216454db2e9cbe4e7abfde0 P 8123980701894dcd92e770f7b8b87bac [term 5 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.928090  4084 tablet_replica.cc:330] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac: stopping tablet replica
I20260812 19:21:05.928547  4084 raft_consensus.cc:2229] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:05.928952  4084 raft_consensus.cc:2258] T 37ba65d1aef8455db82e3260a54bb255 P 8123980701894dcd92e770f7b8b87bac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:05.963393  4084 tablet_server.cc:194] TabletServer@127.3.253.3:0 shutdown complete.
I20260812 19:21:05.982040  4084 master.cc:537] Master@127.3.253.62:45767 shutting down...
I20260812 19:21:06.132562  4084 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:21:06.133265  4084 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:06.133713  4084 tablet_replica.cc:330] T 00000000000000000000000000000000 P 641f3687454143feaa969040f2302440: stopping tablet replica
I20260812 19:21:06.154065  4084 master.cc:552] Master@127.3.253.62:45767 shutdown complete.
56e1de5b1f6c4e86bd161c3929a42a10  4
70ea5c9f4c6b4bdd8fab381acd648069  4
8123980701894dcd92e770f7b8b87bac  1
56e1de5b1f6c4e86bd161c3929a42a10  3
70ea5c9f4c6b4bdd8fab381acd648069  3
8123980701894dcd92e770f7b8b87bac  3
56e1de5b1f6c4e86bd161c3929a42a10  8
70ea5c9f4c6b4bdd8fab381acd648069  0
8123980701894dcd92e770f7b8b87bac  1
56e1de5b1f6c4e86bd161c3929a42a10  3
70ea5c9f4c6b4bdd8fab381acd648069  3
8123980701894dcd92e770f7b8b87bac  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (33308 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260812 19:21:06.198163  4084 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.253.62:41975
I20260812 19:21:06.199407  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:21:06.206245  5067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:06.206893  5072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:06.206602  5070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:21:06.207935  4084 server_base.cc:1034] running on GCE node
I20260812 19:21:06.209039  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:21:06.209225  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:21:06.209344  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562466209328 us; error 0 us; skew 500 ppm
I20260812 19:21:06.209789  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:21:06.216171  4084 webserver.cc:460] Webserver started at http://127.3.253.62:45847/ using document root <none> and password file <none>
I20260812 19:21:06.216655  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:21:06.216823  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:21:06.217060  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:21:06.218321  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/master-0-root/instance:
uuid: "fb341fdbc9f44ea28e2e1688407d3264"
format_stamp: "Formatted at 2026-08-12 19:21:06 on dist-test-slave-3kk6"
I20260812 19:21:06.223091  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260812 19:21:06.226419  5079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:06.227248  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260812 19:21:06.227551  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/master-0-root
uuid: "fb341fdbc9f44ea28e2e1688407d3264"
format_stamp: "Formatted at 2026-08-12 19:21:06 on dist-test-slave-3kk6"
I20260812 19:21:06.227855  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:21:06.238083  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:21:06.239480  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:21:06.280418  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.62:41975
I20260812 19:21:06.280522  5172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.62:41975 every 8 connection(s)
I20260812 19:21:06.284693  5174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.295743  5174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264: Bootstrap starting.
I20260812 19:21:06.300881  5174 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:06.305714  5174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264: No bootstrap required, opened a new log
I20260812 19:21:06.307895  5174 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb341fdbc9f44ea28e2e1688407d3264" member_type: VOTER }
I20260812 19:21:06.308396  5174 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:06.308648  5174 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb341fdbc9f44ea28e2e1688407d3264, State: Initialized, Role: FOLLOWER
I20260812 19:21:06.309281  5174 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb341fdbc9f44ea28e2e1688407d3264" member_type: VOTER }
I20260812 19:21:06.309746  5174 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 19:21:06.309979  5174 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 19:21:06.310287  5174 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:06.314332  5174 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb341fdbc9f44ea28e2e1688407d3264" member_type: VOTER }
I20260812 19:21:06.315092  5174 leader_election.cc:302] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb341fdbc9f44ea28e2e1688407d3264; no voters: 
I20260812 19:21:06.316404  5174 leader_election.cc:288] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 19:21:06.316779  5177 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:06.318166  5177 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [term 1 LEADER]: Becoming Leader. State: Replica: fb341fdbc9f44ea28e2e1688407d3264, State: Running, Role: LEADER
I20260812 19:21:06.318964  5177 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb341fdbc9f44ea28e2e1688407d3264" member_type: VOTER }
I20260812 19:21:06.319834  5174 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 19:21:06.324434  5179 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb341fdbc9f44ea28e2e1688407d3264" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb341fdbc9f44ea28e2e1688407d3264" member_type: VOTER } }
I20260812 19:21:06.324470  5182 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb341fdbc9f44ea28e2e1688407d3264. Latest consensus state: current_term: 1 leader_uuid: "fb341fdbc9f44ea28e2e1688407d3264" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb341fdbc9f44ea28e2e1688407d3264" member_type: VOTER } }
I20260812 19:21:06.325115  5179 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [sys.catalog]: This master's current role is: LEADER
I20260812 19:21:06.325129  5182 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [sys.catalog]: This master's current role is: LEADER
I20260812 19:21:06.329978  5190 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 19:21:06.334952  5190 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 19:21:06.338225  4084 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 19:21:06.344169  5190 catalog_manager.cc:1347] Generated new cluster ID: 6e182376426642e8ae8fd41fc835acf0
I20260812 19:21:06.344480  5190 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:21:06.370414  5190 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 19:21:06.372282  5190 catalog_manager.cc:1504] Loading token signing keys...
I20260812 19:21:06.387923  5190 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264: Generated new TSK 0
I20260812 19:21:06.388718  5190 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:21:06.405488  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:21:06.412158  5204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:06.413852  5205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:06.415374  5207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:21:06.415767  4084 server_base.cc:1034] running on GCE node
I20260812 19:21:06.417037  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:21:06.417268  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:21:06.417469  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562466417433 us; error 0 us; skew 500 ppm
I20260812 19:21:06.418061  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:21:06.420833  4084 webserver.cc:460] Webserver started at http://127.3.253.1:36157/ using document root <none> and password file <none>
I20260812 19:21:06.421397  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:21:06.421625  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:21:06.421927  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:21:06.423338  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/ts-0-root/instance:
uuid: "c4b010d4147f4b438ec1b520f84d9d93"
format_stamp: "Formatted at 2026-08-12 19:21:06 on dist-test-slave-3kk6"
I20260812 19:21:06.428421  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260812 19:21:06.432235  5216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:06.432943  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260812 19:21:06.433267  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/ts-0-root
uuid: "c4b010d4147f4b438ec1b520f84d9d93"
format_stamp: "Formatted at 2026-08-12 19:21:06 on dist-test-slave-3kk6"
I20260812 19:21:06.433549  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:21:06.461927  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:21:06.463296  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:21:06.464829  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:21:06.467180  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:21:06.467374  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:06.467681  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:21:06.467837  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:06.509012  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.1:46149
I20260812 19:21:06.509114  5333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.1:46149 every 8 connection(s)
I20260812 19:21:06.513749  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:21:06.521864  5342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:06.523248  5347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:06.527566  5351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:21:06.527614  4084 server_base.cc:1034] running on GCE node
I20260812 19:21:06.529817  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:21:06.530107  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:21:06.530313  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562466530292 us; error 0 us; skew 500 ppm
I20260812 19:21:06.531040  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:21:06.531491  5334 heartbeater.cc:347] Connected to a master server at 127.3.253.62:41975
I20260812 19:21:06.531889  5334 heartbeater.cc:464] Registering TS with master...
I20260812 19:21:06.532820  5334 heartbeater.cc:511] Master 127.3.253.62:41975 requested a full tablet report, sending...
I20260812 19:21:06.533869  4084 webserver.cc:460] Webserver started at http://127.3.253.2:36705/ using document root <none> and password file <none>
I20260812 19:21:06.534479  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:21:06.534795  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:21:06.535127  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:21:06.535156  5110 ts_manager.cc:194] Registered new tserver with Master: c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149)
I20260812 19:21:06.536463  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/ts-1-root/instance:
uuid: "356ae6f7ee30414e97fdef8340814baf"
format_stamp: "Formatted at 2026-08-12 19:21:06 on dist-test-slave-3kk6"
I20260812 19:21:06.537320  5110 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49986
I20260812 19:21:06.541379  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260812 19:21:06.545037  5357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:06.545855  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 19:21:06.546164  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/ts-1-root
uuid: "356ae6f7ee30414e97fdef8340814baf"
format_stamp: "Formatted at 2026-08-12 19:21:06 on dist-test-slave-3kk6"
I20260812 19:21:06.546432  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:21:06.562354  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:21:06.563614  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:21:06.565167  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:21:06.567519  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:21:06.567746  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:06.568009  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:21:06.568176  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:06.612541  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.2:34217
I20260812 19:21:06.612660  5470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.2:34217 every 8 connection(s)
I20260812 19:21:06.617308  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:21:06.625020  5481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:06.625732  5484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:06.627561  5486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:21:06.629333  4084 server_base.cc:1034] running on GCE node
I20260812 19:21:06.630487  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:21:06.630744  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:21:06.630947  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562466630931 us; error 0 us; skew 500 ppm
I20260812 19:21:06.631609  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:21:06.633522  5472 heartbeater.cc:347] Connected to a master server at 127.3.253.62:41975
I20260812 19:21:06.633914  5472 heartbeater.cc:464] Registering TS with master...
I20260812 19:21:06.634723  5472 heartbeater.cc:511] Master 127.3.253.62:41975 requested a full tablet report, sending...
I20260812 19:21:06.634975  4084 webserver.cc:460] Webserver started at http://127.3.253.3:32935/ using document root <none> and password file <none>
I20260812 19:21:06.635535  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:21:06.635747  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:21:06.636101  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:21:06.636845  5110 ts_manager.cc:194] Registered new tserver with Master: 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:06.637383  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/ts-2-root/instance:
uuid: "7a40385c10c04a1eba3767425715efb1"
format_stamp: "Formatted at 2026-08-12 19:21:06 on dist-test-slave-3kk6"
I20260812 19:21:06.638585  5110 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49998
I20260812 19:21:06.642452  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260812 19:21:06.645813  5492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:06.646570  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 19:21:06.646937  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/ts-2-root
uuid: "7a40385c10c04a1eba3767425715efb1"
format_stamp: "Formatted at 2026-08-12 19:21:06 on dist-test-slave-3kk6"
I20260812 19:21:06.647254  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786562432658360-4084-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:21:06.675911  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:21:06.677222  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:21:06.678797  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:21:06.681198  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:21:06.681423  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:06.681663  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:21:06.681830  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:06.724061  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.3:37579
I20260812 19:21:06.724169  5591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.3:37579 every 8 connection(s)
I20260812 19:21:06.739872  5592 heartbeater.cc:347] Connected to a master server at 127.3.253.62:41975
I20260812 19:21:06.740281  5592 heartbeater.cc:464] Registering TS with master...
I20260812 19:21:06.740983  5592 heartbeater.cc:511] Master 127.3.253.62:41975 requested a full tablet report, sending...
I20260812 19:21:06.742988  5110 ts_manager.cc:194] Registered new tserver with Master: 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:06.743093  4084 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016048873s
I20260812 19:21:06.744863  5110 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50002
I20260812 19:21:06.745812  4084 test_util.cc:268] Using random seed: 2100497845
I20260812 19:21:06.775776  5110 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50018:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 19:21:06.778882  5110 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:21:06.864153  5526 tablet_service.cc:1467] Processing CreateTablet for tablet 2d34a1970c2b4eb2b9ad047662a2f45b (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260812 19:21:06.865702  5526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d34a1970c2b4eb2b9ad047662a2f45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.866937  5528 tablet_service.cc:1467] Processing CreateTablet for tablet 7ae788179bfc4e028fe0471ae6858a27 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260812 19:21:06.868350  5528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ae788179bfc4e028fe0471ae6858a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.871687  5266 tablet_service.cc:1467] Processing CreateTablet for tablet 2d34a1970c2b4eb2b9ad047662a2f45b (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260812 19:21:06.873107  5266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d34a1970c2b4eb2b9ad047662a2f45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.875926  5404 tablet_service.cc:1467] Processing CreateTablet for tablet 7ae788179bfc4e028fe0471ae6858a27 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260812 19:21:06.877405  5404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ae788179bfc4e028fe0471ae6858a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.877219  5263 tablet_service.cc:1467] Processing CreateTablet for tablet 89608281e35945d88c5fbd969a02135a (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260812 19:21:06.878619  5263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89608281e35945d88c5fbd969a02135a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.884198  5398 tablet_service.cc:1467] Processing CreateTablet for tablet 31d33a4ba5664054b80766af27c2e7a7 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260812 19:21:06.885049  5257 tablet_service.cc:1467] Processing CreateTablet for tablet 3e800a4938b1453eb019bccef7a713e8 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260812 19:21:06.886480  5257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e800a4938b1453eb019bccef7a713e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.887898  5395 tablet_service.cc:1467] Processing CreateTablet for tablet db8e6b83637e4d049b4e905e64fe128a (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260812 19:21:06.889489  5396 tablet_service.cc:1467] Processing CreateTablet for tablet 3b940c5579654cb4bfa011d2fb201021 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260812 19:21:06.870078  5267 tablet_service.cc:1467] Processing CreateTablet for tablet 7ae788179bfc4e028fe0471ae6858a27 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260812 19:21:06.875967  5264 tablet_service.cc:1467] Processing CreateTablet for tablet 4a3fb5889a5d45ab890a37efa5dc6e07 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260812 19:21:06.892192  5267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ae788179bfc4e028fe0471ae6858a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.879992  5403 tablet_service.cc:1467] Processing CreateTablet for tablet 2d34a1970c2b4eb2b9ad047662a2f45b (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260812 19:21:06.893671  5614 tablet_bootstrap.cc:492] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1: Bootstrap starting.
I20260812 19:21:06.881253  5401 tablet_service.cc:1467] Processing CreateTablet for tablet 4a3fb5889a5d45ab890a37efa5dc6e07 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260812 19:21:06.881261  5261 tablet_service.cc:1467] Processing CreateTablet for tablet 3b940c5579654cb4bfa011d2fb201021 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260812 19:21:06.879979  5262 tablet_service.cc:1467] Processing CreateTablet for tablet 31d33a4ba5664054b80766af27c2e7a7 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260812 19:21:06.896014  5261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b940c5579654cb4bfa011d2fb201021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.882522  5399 tablet_service.cc:1467] Processing CreateTablet for tablet 89608281e35945d88c5fbd969a02135a (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260812 19:21:06.897728  5262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31d33a4ba5664054b80766af27c2e7a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.882477  5258 tablet_service.cc:1467] Processing CreateTablet for tablet db8e6b83637e4d049b4e905e64fe128a (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260812 19:21:06.900175  5258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db8e6b83637e4d049b4e905e64fe128a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.900275  5614 tablet_bootstrap.cc:654] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:06.900662  5256 tablet_service.cc:1467] Processing CreateTablet for tablet 8e7c4f90fea34a52aa0b66da6ddb052e (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260812 19:21:06.901949  5264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a3fb5889a5d45ab890a37efa5dc6e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.902631  5256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e7c4f90fea34a52aa0b66da6ddb052e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.903586  5392 tablet_service.cc:1467] Processing CreateTablet for tablet 3e800a4938b1453eb019bccef7a713e8 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260812 19:21:06.907152  5391 tablet_service.cc:1467] Processing CreateTablet for tablet 8e7c4f90fea34a52aa0b66da6ddb052e (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260812 19:21:06.907721  5526 tablet_service.cc:1467] Processing CreateTablet for tablet 4a3fb5889a5d45ab890a37efa5dc6e07 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260812 19:21:06.908245  5253 tablet_service.cc:1467] Processing CreateTablet for tablet dced490192de4aaca7dccacdfded1596 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260812 19:21:06.909098  5526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a3fb5889a5d45ab890a37efa5dc6e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.909204  5398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31d33a4ba5664054b80766af27c2e7a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.909586  5253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dced490192de4aaca7dccacdfded1596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.910295  5401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a3fb5889a5d45ab890a37efa5dc6e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.910480  5528 tablet_service.cc:1467] Processing CreateTablet for tablet 89608281e35945d88c5fbd969a02135a (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260812 19:21:06.911585  5395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db8e6b83637e4d049b4e905e64fe128a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.911823  5528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89608281e35945d88c5fbd969a02135a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.911643  5390 tablet_service.cc:1467] Processing CreateTablet for tablet dced490192de4aaca7dccacdfded1596 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260812 19:21:06.913123  5390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dced490192de4aaca7dccacdfded1596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.918004  5391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e7c4f90fea34a52aa0b66da6ddb052e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.915932  5524 tablet_service.cc:1467] Processing CreateTablet for tablet 31d33a4ba5664054b80766af27c2e7a7 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260812 19:21:06.919450  5392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e800a4938b1453eb019bccef7a713e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.920133  5524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31d33a4ba5664054b80766af27c2e7a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.920894  5403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d34a1970c2b4eb2b9ad047662a2f45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.921808  5399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89608281e35945d88c5fbd969a02135a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.922610  5396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b940c5579654cb4bfa011d2fb201021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.969568  5523 tablet_service.cc:1467] Processing CreateTablet for tablet 3b940c5579654cb4bfa011d2fb201021 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260812 19:21:06.971103  5523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b940c5579654cb4bfa011d2fb201021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.979589  5522 tablet_service.cc:1467] Processing CreateTablet for tablet db8e6b83637e4d049b4e905e64fe128a (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260812 19:21:06.981083  5522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db8e6b83637e4d049b4e905e64fe128a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.984344  5520 tablet_service.cc:1467] Processing CreateTablet for tablet 3e800a4938b1453eb019bccef7a713e8 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260812 19:21:06.986138  5520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e800a4938b1453eb019bccef7a713e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:06.991961  5519 tablet_service.cc:1467] Processing CreateTablet for tablet 8e7c4f90fea34a52aa0b66da6ddb052e (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260812 19:21:06.993505  5519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e7c4f90fea34a52aa0b66da6ddb052e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:07.007916  5518 tablet_service.cc:1467] Processing CreateTablet for tablet dced490192de4aaca7dccacdfded1596 (DEFAULT_TABLE table=test-workload [id=147e1c51009d44409aa57783e3d4beae]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260812 19:21:07.008782  5618 tablet_bootstrap.cc:492] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93: Bootstrap starting.
I20260812 19:21:07.009449  5518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dced490192de4aaca7dccacdfded1596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:07.022676  5618 tablet_bootstrap.cc:654] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:07.072918  5614 tablet_bootstrap.cc:492] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1: No bootstrap required, opened a new log
I20260812 19:21:07.073464  5614 ts_tablet_manager.cc:1397] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1: Time spent bootstrapping tablet: real 0.180s	user 0.008s	sys 0.009s
I20260812 19:21:07.077234  5614 raft_consensus.cc:348] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.078001  5614 raft_consensus.cc:374] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.078269  5614 raft_consensus.cc:729] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.094866  5614 consensus_queue.cc:260] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.105454  5618 tablet_bootstrap.cc:492] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93: No bootstrap required, opened a new log
I20260812 19:21:07.106144  5618 ts_tablet_manager.cc:1397] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.012s
I20260812 19:21:07.109362  5618 raft_consensus.cc:348] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:07.110361  5618 raft_consensus.cc:374] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.110852  5618 raft_consensus.cc:729] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.111879  5618 consensus_queue.cc:260] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:07.119017  5623 tablet_bootstrap.cc:492] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf: Bootstrap starting.
I20260812 19:21:07.120817  5614 ts_tablet_manager.cc:1428] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.004s
I20260812 19:21:07.121618  5592 heartbeater.cc:503] Master 127.3.253.62:41975 was elected leader, sending a full tablet report...
I20260812 19:21:07.121869  5614 tablet_bootstrap.cc:492] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1: Bootstrap starting.
I20260812 19:21:07.128479  5614 tablet_bootstrap.cc:654] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:07.130295  5623 tablet_bootstrap.cc:654] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:07.139577  5623 tablet_bootstrap.cc:492] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf: No bootstrap required, opened a new log
I20260812 19:21:07.140100  5623 ts_tablet_manager.cc:1397] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.007s
I20260812 19:21:07.142956  5623 raft_consensus.cc:348] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.143968  5623 raft_consensus.cc:374] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.144330  5623 raft_consensus.cc:729] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.146836  5618 ts_tablet_manager.cc:1428] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93: Time spent starting tablet: real 0.040s	user 0.001s	sys 0.009s
I20260812 19:21:07.145802  5623 consensus_queue.cc:260] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.147364  5334 heartbeater.cc:503] Master 127.3.253.62:41975 was elected leader, sending a full tablet report...
I20260812 19:21:07.148149  5618 tablet_bootstrap.cc:492] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93: Bootstrap starting.
I20260812 19:21:07.150111  5614 tablet_bootstrap.cc:492] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1: No bootstrap required, opened a new log
I20260812 19:21:07.150758  5614 ts_tablet_manager.cc:1397] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.007s
I20260812 19:21:07.154583  5618 tablet_bootstrap.cc:654] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:07.159858  5618 tablet_bootstrap.cc:492] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93: No bootstrap required, opened a new log
I20260812 19:21:07.160442  5618 ts_tablet_manager.cc:1397] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260812 19:21:07.162743  5618 raft_consensus.cc:348] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.163527  5618 raft_consensus.cc:374] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.163836  5618 raft_consensus.cc:729] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.164722  5618 consensus_queue.cc:260] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.164947  5614 raft_consensus.cc:348] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:07.166260  5614 raft_consensus.cc:374] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.166641  5614 raft_consensus.cc:729] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.167142  5618 ts_tablet_manager.cc:1428] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260812 19:21:07.168118  5618 tablet_bootstrap.cc:492] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93: Bootstrap starting.
I20260812 19:21:07.167630  5614 consensus_queue.cc:260] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:07.170280  5614 ts_tablet_manager.cc:1428] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260812 19:21:07.171339  5614 tablet_bootstrap.cc:492] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1: Bootstrap starting.
I20260812 19:21:07.174998  5618 tablet_bootstrap.cc:654] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:07.176534  5472 heartbeater.cc:503] Master 127.3.253.62:41975 was elected leader, sending a full tablet report...
I20260812 19:21:07.176906  5623 ts_tablet_manager.cc:1428] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.022s
I20260812 19:21:07.177896  5623 tablet_bootstrap.cc:492] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf: Bootstrap starting.
I20260812 19:21:07.181941  5624 raft_consensus.cc:482] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:07.182452  5624 raft_consensus.cc:504] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.184247  5623 tablet_bootstrap.cc:654] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:07.190986  5614 tablet_bootstrap.cc:654] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:07.202483  5624 leader_election.cc:288] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:07.205242  5614 tablet_bootstrap.cc:492] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1: No bootstrap required, opened a new log
I20260812 19:21:07.206125  5614 ts_tablet_manager.cc:1397] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.013s
I20260812 19:21:07.210049  5614 raft_consensus.cc:348] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.211448  5614 raft_consensus.cc:374] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.211953  5614 raft_consensus.cc:729] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.213127  5614 consensus_queue.cc:260] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.216842  5614 ts_tablet_manager.cc:1428] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260812 19:21:07.218237  5614 tablet_bootstrap.cc:492] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1: Bootstrap starting.
I20260812 19:21:07.227114  5614 tablet_bootstrap.cc:654] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1: Neither blocks nor log segments found. Creating new log.
W20260812 19:21:07.228287  5593 tablet.cc:2369] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:21:07.234683  5288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d34a1970c2b4eb2b9ad047662a2f45b" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
W20260812 19:21:07.237915  5495 leader_election.cc:341] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.242026  5614 tablet_bootstrap.cc:492] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1: No bootstrap required, opened a new log
I20260812 19:21:07.242954  5614 ts_tablet_manager.cc:1397] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.011s
I20260812 19:21:07.247190  5614 raft_consensus.cc:348] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.248600  5614 raft_consensus.cc:374] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.249161  5614 raft_consensus.cc:729] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.250336  5614 consensus_queue.cc:260] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.254300  5614 ts_tablet_manager.cc:1428] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260812 19:21:07.255527  5624 raft_consensus.cc:482] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:07.256158  5624 raft_consensus.cc:504] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.258849  5624 leader_election.cc:288] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:07.261160  5288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
W20260812 19:21:07.263186  5495 leader_election.cc:341] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.264572  5614 tablet_bootstrap.cc:492] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1: Bootstrap starting.
I20260812 19:21:07.273576  5614 tablet_bootstrap.cc:654] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:07.299278  5421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
W20260812 19:21:07.301482  5497 leader_election.cc:341] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.302000  5497 leader_election.cc:302] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1; no voters: 356ae6f7ee30414e97fdef8340814baf, c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:07.298615  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d34a1970c2b4eb2b9ad047662a2f45b" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
I20260812 19:21:07.302973  5624 raft_consensus.cc:2726] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:21:07.303746  5497 leader_election.cc:341] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.304186  5497 leader_election.cc:302] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1; no voters: 356ae6f7ee30414e97fdef8340814baf, c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:07.304630  5623 tablet_bootstrap.cc:492] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf: No bootstrap required, opened a new log
I20260812 19:21:07.304877  5614 tablet_bootstrap.cc:492] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1: No bootstrap required, opened a new log
I20260812 19:21:07.304956  5624 raft_consensus.cc:2726] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:07.305130  5623 ts_tablet_manager.cc:1397] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf: Time spent bootstrapping tablet: real 0.127s	user 0.055s	sys 0.062s
I20260812 19:21:07.305382  5614 ts_tablet_manager.cc:1397] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.022s
I20260812 19:21:07.307663  5623 raft_consensus.cc:348] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.307904  5618 tablet_bootstrap.cc:492] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93: No bootstrap required, opened a new log
I20260812 19:21:07.308257  5623 raft_consensus.cc:374] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.308032  5614 raft_consensus.cc:348] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.308585  5618 ts_tablet_manager.cc:1397] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93: Time spent bootstrapping tablet: real 0.141s	user 0.070s	sys 0.059s
I20260812 19:21:07.308614  5623 raft_consensus.cc:729] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.308823  5614 raft_consensus.cc:374] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.309301  5614 raft_consensus.cc:729] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.309610  5623 consensus_queue.cc:260] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.310148  5614 consensus_queue.cc:260] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.311241  5618 raft_consensus.cc:348] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.311991  5618 raft_consensus.cc:374] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.312093  5623 ts_tablet_manager.cc:1428] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260812 19:21:07.312287  5618 raft_consensus.cc:729] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.313030  5623 tablet_bootstrap.cc:492] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf: Bootstrap starting.
I20260812 19:21:07.315186  5614 ts_tablet_manager.cc:1428] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260812 19:21:07.313134  5618 consensus_queue.cc:260] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.316418  5614 tablet_bootstrap.cc:492] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1: Bootstrap starting.
I20260812 19:21:07.317608  5618 ts_tablet_manager.cc:1428] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260812 19:21:07.317855  5634 raft_consensus.cc:482] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:07.318631  5618 tablet_bootstrap.cc:492] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93: Bootstrap starting.
I20260812 19:21:07.318297  5634 raft_consensus.cc:504] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.323172  5614 tablet_bootstrap.cc:654] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:07.325184  5618 tablet_bootstrap.cc:654] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93: Neither blocks nor log segments found. Creating new log.
W20260812 19:21:07.332437  5194 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:21:07.334102  5634 leader_election.cc:288] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:07.338474  5618 tablet_bootstrap.cc:492] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93: No bootstrap required, opened a new log
I20260812 19:21:07.339123  5618 ts_tablet_manager.cc:1397] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260812 19:21:07.342505  5623 tablet_bootstrap.cc:654] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:07.342054  5618 raft_consensus.cc:348] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.343058  5618 raft_consensus.cc:374] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.343503  5618 raft_consensus.cc:729] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.344674  5618 consensus_queue.cc:260] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.350473  5618 ts_tablet_manager.cc:1428] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260812 19:21:07.351732  5618 tablet_bootstrap.cc:492] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93: Bootstrap starting.
I20260812 19:21:07.358621  5618 tablet_bootstrap.cc:654] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:07.371047  5618 tablet_bootstrap.cc:492] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93: No bootstrap required, opened a new log
I20260812 19:21:07.371847  5618 ts_tablet_manager.cc:1397] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260812 19:21:07.375258  5618 raft_consensus.cc:348] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.376032  5618 raft_consensus.cc:374] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.376338  5618 raft_consensus.cc:729] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.377542  5618 consensus_queue.cc:260] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.383159  5618 ts_tablet_manager.cc:1428] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260812 19:21:07.384608  5618 tablet_bootstrap.cc:492] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93: Bootstrap starting.
I20260812 19:21:07.404462  5618 tablet_bootstrap.cc:654] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:07.426867  5627 raft_consensus.cc:482] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:07.430680  5614 tablet_bootstrap.cc:492] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1: No bootstrap required, opened a new log
I20260812 19:21:07.432389  5614 ts_tablet_manager.cc:1397] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1: Time spent bootstrapping tablet: real 0.116s	user 0.051s	sys 0.050s
I20260812 19:21:07.430718  5627 raft_consensus.cc:504] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.436918  5623 tablet_bootstrap.cc:492] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf: No bootstrap required, opened a new log
I20260812 19:21:07.438367  5623 ts_tablet_manager.cc:1397] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf: Time spent bootstrapping tablet: real 0.126s	user 0.023s	sys 0.035s
I20260812 19:21:07.449359  5624 raft_consensus.cc:482] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:07.451143  5624 raft_consensus.cc:504] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:07.460608  5627 leader_election.cc:288] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:07.460951  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
I20260812 19:21:07.470796  5550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dced490192de4aaca7dccacdfded1596" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1" is_pre_election: true
I20260812 19:21:07.465461  5288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
I20260812 19:21:07.473205  5288 raft_consensus.cc:2454] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 0.
W20260812 19:21:07.476292  5362 leader_election.cc:341] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:07.477306  5497 leader_election.cc:341] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.478950  5495 leader_election.cc:302] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf
I20260812 19:21:07.451103  5618 tablet_bootstrap.cc:492] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93: No bootstrap required, opened a new log
I20260812 19:21:07.464879  5623 raft_consensus.cc:348] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.467062  5624 leader_election.cc:288] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149)
I20260812 19:21:07.468974  5634 raft_consensus.cc:482] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:07.469985  5614 raft_consensus.cc:348] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.483924  5623 raft_consensus.cc:374] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.484298  5614 raft_consensus.cc:374] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.484917  5623 raft_consensus.cc:729] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.485657  5614 raft_consensus.cc:729] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.484304  5634 raft_consensus.cc:504] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.482425  5288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dced490192de4aaca7dccacdfded1596" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
W20260812 19:21:07.489064  5361 leader_election.cc:341] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.488571  5614 consensus_queue.cc:260] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.490851  5361 leader_election.cc:302] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf; no voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:07.494753  5634 leader_election.cc:288] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:07.499435  5618 ts_tablet_manager.cc:1397] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93: Time spent bootstrapping tablet: real 0.115s	user 0.030s	sys 0.016s
I20260812 19:21:07.500334  5550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1" is_pre_election: true
I20260812 19:21:07.487154  5623 consensus_queue.cc:260] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.494343  5624 raft_consensus.cc:2781] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:07.497722  5634 raft_consensus.cc:2726] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:21:07.507133  5362 leader_election.cc:341] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.508395  5624 raft_consensus.cc:482] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:07.514606  5624 raft_consensus.cc:3037] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:07.532449  5495 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46149, user_credentials={real_user=slave}} blocked reactor thread for 53694.2us
I20260812 19:21:07.562041  5627 raft_consensus.cc:482] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:07.561298  5618 raft_consensus.cc:348] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.565348  5618 raft_consensus.cc:374] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.566990  5618 raft_consensus.cc:729] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.564626  5627 raft_consensus.cc:504] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.581157  5634 raft_consensus.cc:482] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:07.592907  5623 ts_tablet_manager.cc:1428] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf: Time spent starting tablet: real 0.153s	user 0.021s	sys 0.005s
I20260812 19:21:07.585530  5634 raft_consensus.cc:504] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
W20260812 19:21:07.607277  5361 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46149, user_credentials={real_user=slave}} blocked reactor thread for 118508us
I20260812 19:21:07.613850  5614 ts_tablet_manager.cc:1428] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1: Time spent starting tablet: real 0.180s	user 0.031s	sys 0.027s
I20260812 19:21:07.587929  5672 raft_consensus.cc:482] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:07.594573  5623 tablet_bootstrap.cc:492] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf: Bootstrap starting.
I20260812 19:21:07.576227  5618 consensus_queue.cc:260] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.631377  5677 raft_consensus.cc:482] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:07.631551  5627 leader_election.cc:288] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:07.627991  5288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
I20260812 19:21:07.636837  5550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d34a1970c2b4eb2b9ad047662a2f45b" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1" is_pre_election: true
I20260812 19:21:07.640564  5614 tablet_bootstrap.cc:492] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1: Bootstrap starting.
I20260812 19:21:07.640199  5550 raft_consensus.cc:2454] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 0.
I20260812 19:21:07.646431  5362 leader_election.cc:302] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1; no voters: 
I20260812 19:21:07.653303  5673 raft_consensus.cc:2781] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:07.655735  5673 raft_consensus.cc:482] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:07.618249  5672 raft_consensus.cc:504] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.657019  5673 raft_consensus.cc:3037] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:07.634951  5677 raft_consensus.cc:504] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.671113  5288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db8e6b83637e4d049b4e905e64fe128a" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
I20260812 19:21:07.682029  5288 raft_consensus.cc:2454] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 0.
I20260812 19:21:07.631364  5634 leader_election.cc:288] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
W20260812 19:21:07.675614  5361 leader_election.cc:341] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.683856  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db8e6b83637e4d049b4e905e64fe128a" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
I20260812 19:21:07.684824  5361 leader_election.cc:302] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf; no voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:07.686476  5421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
I20260812 19:21:07.687037  5634 raft_consensus.cc:2726] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:07.688473  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
I20260812 19:21:07.686476  5677 leader_election.cc:288] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
W20260812 19:21:07.691298  5497 leader_election.cc:341] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.692896  5284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
I20260812 19:21:07.694423  5284 raft_consensus.cc:2454] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 0.
I20260812 19:21:07.694209  5495 leader_election.cc:302] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:07.676770  5618 ts_tablet_manager.cc:1428] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93: Time spent starting tablet: real 0.176s	user 0.024s	sys 0.020s
I20260812 19:21:07.678032  5287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d34a1970c2b4eb2b9ad047662a2f45b" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
I20260812 19:21:07.697216  5495 leader_election.cc:302] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf
I20260812 19:21:07.699227  5677 raft_consensus.cc:2781] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:07.696434  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db8e6b83637e4d049b4e905e64fe128a" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
I20260812 19:21:07.700016  5677 raft_consensus.cc:482] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:07.697728  5678 raft_consensus.cc:482] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:07.700590  5676 raft_consensus.cc:2781] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:07.700932  5677 raft_consensus.cc:3037] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:07.701614  5676 raft_consensus.cc:482] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:07.702416  5676 raft_consensus.cc:3037] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:07.703274  5497 leader_election.cc:341] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:07.703903  5223 leader_election.cc:341] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.704914  5678 raft_consensus.cc:504] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
W20260812 19:21:07.707294  5361 leader_election.cc:341] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.707547  5672 leader_election.cc:288] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
W20260812 19:21:07.705745  5223 leader_election.cc:341] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.698144  5618 tablet_bootstrap.cc:492] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93: Bootstrap starting.
I20260812 19:21:07.718745  5550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db8e6b83637e4d049b4e905e64fe128a" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1" is_pre_election: true
I20260812 19:21:07.723804  5678 leader_election.cc:288] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:07.726198  5676 raft_consensus.cc:504] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.727738  5549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1" is_pre_election: true
I20260812 19:21:07.719022  5623 tablet_bootstrap.cc:654] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:07.730755  5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1" is_pre_election: true
I20260812 19:21:07.733165  5549 raft_consensus.cc:2379] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4b010d4147f4b438ec1b520f84d9d93 in current term 1: Already voted for candidate 7a40385c10c04a1eba3767425715efb1 in this term.
I20260812 19:21:07.728802  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
I20260812 19:21:07.735942  5614 tablet_bootstrap.cc:654] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:07.737929  5676 leader_election.cc:288] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:07.739503  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:07.729118  5627 raft_consensus.cc:482] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:07.741734  5287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
W20260812 19:21:07.743325  5223 leader_election.cc:341] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.744365  5627 raft_consensus.cc:504] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.745802  5287 raft_consensus.cc:3037] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:07.749727  5497 leader_election.cc:341] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.750334  5676 raft_consensus.cc:482] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:07.753419  5676 raft_consensus.cc:504] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.756357  5618 tablet_bootstrap.cc:654] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93: Neither blocks nor log segments found. Creating new log.
W20260812 19:21:07.751040  5223 leader_election.cc:341] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.757308  5223 leader_election.cc:302] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1
I20260812 19:21:07.759686  5678 raft_consensus.cc:2726] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:07.762018  5627 leader_election.cc:288] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:07.772094  5284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89608281e35945d88c5fbd969a02135a" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
I20260812 19:21:07.773954  5284 raft_consensus.cc:2454] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 0.
I20260812 19:21:07.774403  5677 raft_consensus.cc:504] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.783474  5495 leader_election.cc:302] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:07.785254  5627 raft_consensus.cc:482] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:07.776217  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e7c4f90fea34a52aa0b66da6ddb052e" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
I20260812 19:21:07.793514  5672 raft_consensus.cc:2781] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:07.795454  5550 raft_consensus.cc:2379] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4b010d4147f4b438ec1b520f84d9d93 in current term 1: Already voted for candidate 7a40385c10c04a1eba3767425715efb1 in this term.
I20260812 19:21:07.787763  5624 raft_consensus.cc:504] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:07.798810  5284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db8e6b83637e4d049b4e905e64fe128a" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:07.794384  5672 raft_consensus.cc:482] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:07.807806  5672 raft_consensus.cc:3037] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:07.801625  5627 raft_consensus.cc:504] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.812393  5550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e7c4f90fea34a52aa0b66da6ddb052e" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1" is_pre_election: true
I20260812 19:21:07.806557  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db8e6b83637e4d049b4e905e64fe128a" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:07.799379  5677 leader_election.cc:288] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:07.806792  5284 raft_consensus.cc:3037] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:07.819664  5223 leader_election.cc:341] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:07.829332  5497 leader_election.cc:341] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.842088  5623 tablet_bootstrap.cc:492] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf: No bootstrap required, opened a new log
I20260812 19:21:07.843158  5624 leader_election.cc:288] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Requested vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149)
I20260812 19:21:07.846714  5223 leader_election.cc:302] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1
I20260812 19:21:07.847365  5623 ts_tablet_manager.cc:1397] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf: Time spent bootstrapping tablet: real 0.253s	user 0.038s	sys 0.018s
I20260812 19:21:07.849727  5288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:07.852306  5288 raft_consensus.cc:3037] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:07.836905  5627 leader_election.cc:288] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:07.855291  5421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:07.854509  5673 raft_consensus.cc:504] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.859246  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89608281e35945d88c5fbd969a02135a" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
I20260812 19:21:07.863322  5673 leader_election.cc:288] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
W20260812 19:21:07.863587  5497 leader_election.cc:341] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:07.880381  5497 leader_election.cc:341] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.866525  5287 raft_consensus.cc:2454] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 1.
I20260812 19:21:07.869238  5550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d34a1970c2b4eb2b9ad047662a2f45b" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:07.882814  5550 raft_consensus.cc:3037] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:07.883656  5678 raft_consensus.cc:2726] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:07.889112  5495 leader_election.cc:302] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf
I20260812 19:21:07.892846  5624 raft_consensus.cc:2781] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:07.894440  5624 raft_consensus.cc:686] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Becoming Leader. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:07.898219  5624 consensus_queue.cc:237] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.869952  5614 tablet_bootstrap.cc:492] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1: No bootstrap required, opened a new log
I20260812 19:21:07.837659  5676 leader_election.cc:288] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:07.872476  5672 raft_consensus.cc:504] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.901118  5614 ts_tablet_manager.cc:1397] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1: Time spent bootstrapping tablet: real 0.271s	user 0.048s	sys 0.035s
I20260812 19:21:07.876627  5223 leader_election.cc:302] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1
I20260812 19:21:07.906026  5672 leader_election.cc:288] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
W20260812 19:21:07.906332  5223 leader_election.cc:341] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.907371  5223 leader_election.cc:302] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1
I20260812 19:21:07.908049  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89608281e35945d88c5fbd969a02135a" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:07.908285  5627 raft_consensus.cc:2726] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:07.908389  5284 raft_consensus.cc:2454] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 1.
I20260812 19:21:07.909766  5678 raft_consensus.cc:2726] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:07.912724  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89608281e35945d88c5fbd969a02135a" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
W20260812 19:21:07.910324  5497 leader_election.cc:341] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.914557  5549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89608281e35945d88c5fbd969a02135a" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1" is_pre_election: true
I20260812 19:21:07.917454  5618 tablet_bootstrap.cc:492] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93: No bootstrap required, opened a new log
I20260812 19:21:07.918424  5618 ts_tablet_manager.cc:1397] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93: Time spent bootstrapping tablet: real 0.221s	user 0.034s	sys 0.017s
I20260812 19:21:07.919376  5284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d34a1970c2b4eb2b9ad047662a2f45b" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:07.919799  5614 raft_consensus.cc:348] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.920303  5287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89608281e35945d88c5fbd969a02135a" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:07.916625  5549 raft_consensus.cc:2379] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4b010d4147f4b438ec1b520f84d9d93 in current term 1: Already voted for candidate 7a40385c10c04a1eba3767425715efb1 in this term.
I20260812 19:21:07.923220  5614 raft_consensus.cc:374] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260812 19:21:07.925222  5223 leader_election.cc:341] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:07.903208  5623 raft_consensus.cc:348] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.932828  5623 raft_consensus.cc:374] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.924937  5614 raft_consensus.cc:729] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.925418  5495 leader_election.cc:302] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf
I20260812 19:21:07.933661  5223 leader_election.cc:302] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1
I20260812 19:21:07.934479  5624 raft_consensus.cc:2781] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:07.936220  5624 raft_consensus.cc:686] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Becoming Leader. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:07.936170  5614 consensus_queue.cc:260] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.937320  5624 consensus_queue.cc:237] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.926558  5618 raft_consensus.cc:348] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.926235  5287 raft_consensus.cc:3037] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:07.916759  5288 raft_consensus.cc:2454] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 1.
I20260812 19:21:07.939745  5109 catalog_manager.cc:5495] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a40385c10c04a1eba3767425715efb1 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "7a40385c10c04a1eba3767425715efb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:07.941738  5614 ts_tablet_manager.cc:1428] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.005s
I20260812 19:21:07.941601  5495 leader_election.cc:302] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf
I20260812 19:21:07.943195  5614 tablet_bootstrap.cc:492] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1: Bootstrap starting.
I20260812 19:21:07.943379  5672 raft_consensus.cc:2781] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:07.944145  5672 raft_consensus.cc:686] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Becoming Leader. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:07.945438  5672 consensus_queue.cc:237] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:07.932001  5550 raft_consensus.cc:2454] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 1.
I20260812 19:21:07.933451  5623 raft_consensus.cc:729] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.952666  5618 raft_consensus.cc:374] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:07.953886  5362 leader_election.cc:302] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1; no voters: 
I20260812 19:21:07.954062  5287 raft_consensus.cc:2454] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 1.
I20260812 19:21:07.953306  5623 consensus_queue.cc:260] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.955516  5678 raft_consensus.cc:2726] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:07.955581  5673 raft_consensus.cc:2781] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:07.958819  5614 tablet_bootstrap.cc:654] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:07.959328  5623 ts_tablet_manager.cc:1428] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf: Time spent starting tablet: real 0.088s	user 0.010s	sys 0.006s
I20260812 19:21:07.953357  5618 raft_consensus.cc:729] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Initialized, Role: FOLLOWER
I20260812 19:21:07.964401  5673 raft_consensus.cc:686] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 1 LEADER]: Becoming Leader. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Running, Role: LEADER
I20260812 19:21:07.967003  5618 consensus_queue.cc:260] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.965862  5495 leader_election.cc:302] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf
I20260812 19:21:07.970412  5284 raft_consensus.cc:3037] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:07.971822  5673 consensus_queue.cc:237] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:07.968814  5623 tablet_bootstrap.cc:492] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf: Bootstrap starting.
I20260812 19:21:07.994343  5672 raft_consensus.cc:2781] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:08.000407  5672 raft_consensus.cc:686] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Becoming Leader. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:08.009411  5672 consensus_queue.cc:237] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.015895  5614 tablet_bootstrap.cc:492] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1: No bootstrap required, opened a new log
I20260812 19:21:08.010823  5623 tablet_bootstrap.cc:654] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:08.016928  5614 ts_tablet_manager.cc:1397] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1: Time spent bootstrapping tablet: real 0.074s	user 0.022s	sys 0.012s
I20260812 19:21:08.020124  5673 raft_consensus.cc:482] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:08.024401  5673 raft_consensus.cc:504] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.039456  5284 raft_consensus.cc:2454] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 1.
I20260812 19:21:08.048583  5287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
I20260812 19:21:08.054294  5614 raft_consensus.cc:348] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.057994  5614 raft_consensus.cc:374] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:08.059574  5614 raft_consensus.cc:729] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Initialized, Role: FOLLOWER
W20260812 19:21:08.068508  5361 leader_election.cc:341] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:08.067806  5550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1" is_pre_election: true
I20260812 19:21:08.062588  5614 consensus_queue.cc:260] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.065857  5673 leader_election.cc:288] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:08.078238  5614 ts_tablet_manager.cc:1428] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1: Time spent starting tablet: real 0.055s	user 0.029s	sys 0.001s
I20260812 19:21:08.092453  5624 raft_consensus.cc:482] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:08.074774  5550 raft_consensus.cc:2454] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 0.
I20260812 19:21:08.096113  5624 raft_consensus.cc:504] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.093773  5614 tablet_bootstrap.cc:492] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1: Bootstrap starting.
I20260812 19:21:08.110728  5362 leader_election.cc:302] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1; no voters: c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:08.116166  5672 raft_consensus.cc:482] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:08.120798  5673 raft_consensus.cc:2781] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:08.103860  5623 tablet_bootstrap.cc:492] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf: No bootstrap required, opened a new log
I20260812 19:21:08.122016  5673 raft_consensus.cc:482] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:08.124017  5623 ts_tablet_manager.cc:1397] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf: Time spent bootstrapping tablet: real 0.159s	user 0.034s	sys 0.010s
I20260812 19:21:08.118585  5672 raft_consensus.cc:504] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.124176  5673 raft_consensus.cc:3037] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:08.139312  5284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
I20260812 19:21:08.140973  5614 tablet_bootstrap.cc:654] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1: Neither blocks nor log segments found. Creating new log.
W20260812 19:21:08.151538  5495 leader_election.cc:341] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:08.154430  5672 leader_election.cc:288] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:08.160429  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
W20260812 19:21:08.168031  5497 leader_election.cc:341] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:08.170727  5284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
I20260812 19:21:08.105957  5110 catalog_manager.cc:5495] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf reported cstate change: term changed from 0 to 1, leader changed from <none> to 356ae6f7ee30414e97fdef8340814baf (127.3.253.2). New cstate: current_term: 1 leader_uuid: "356ae6f7ee30414e97fdef8340814baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:08.179852  5284 raft_consensus.cc:2454] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 0.
I20260812 19:21:08.177953  5673 raft_consensus.cc:504] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.190446  5673 leader_election.cc:288] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:08.200026  5550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:08.202901  5550 raft_consensus.cc:3037] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:08.198016  5287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:08.206039  5624 leader_election.cc:288] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:08.206310  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
W20260812 19:21:08.208387  5361 leader_election.cc:341] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:08.209021  5422 raft_consensus.cc:2454] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 0.
I20260812 19:21:08.210824  5618 ts_tablet_manager.cc:1428] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93: Time spent starting tablet: real 0.292s	user 0.028s	sys 0.004s
I20260812 19:21:08.211169  5495 leader_election.cc:302] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf
I20260812 19:21:08.212404  5497 leader_election.cc:302] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1; no voters: c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:08.218583  5618 tablet_bootstrap.cc:492] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93: Bootstrap starting.
I20260812 19:21:08.224141  5623 raft_consensus.cc:348] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.226768  5623 raft_consensus.cc:374] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:08.228333  5623 raft_consensus.cc:729] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Initialized, Role: FOLLOWER
I20260812 19:21:08.230079  5624 raft_consensus.cc:2781] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:08.231269  5624 raft_consensus.cc:482] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:08.233300  5624 raft_consensus.cc:3037] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:08.243316  5672 raft_consensus.cc:2781] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:08.232560  5623 consensus_queue.cc:260] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.250907  5614 tablet_bootstrap.cc:492] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1: No bootstrap required, opened a new log
I20260812 19:21:08.253867  5614 ts_tablet_manager.cc:1397] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1: Time spent bootstrapping tablet: real 0.163s	user 0.051s	sys 0.007s
I20260812 19:21:08.271468  5550 raft_consensus.cc:2454] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 1.
I20260812 19:21:08.245710  5672 raft_consensus.cc:482] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:08.278558  5362 leader_election.cc:302] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1; no voters: c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:08.279652  5672 raft_consensus.cc:3037] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:08.282280  5673 raft_consensus.cc:2781] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:08.283807  5673 raft_consensus.cc:686] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 1 LEADER]: Becoming Leader. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Running, Role: LEADER
I20260812 19:21:08.284565  5623 ts_tablet_manager.cc:1428] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf: Time spent starting tablet: real 0.158s	user 0.034s	sys 0.000s
I20260812 19:21:08.300194  5618 tablet_bootstrap.cc:654] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:08.291194  5673 consensus_queue.cc:237] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.316910  5623 tablet_bootstrap.cc:492] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf: Bootstrap starting.
W20260812 19:21:08.333812  5497 consensus_peers.cc:487] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 -> Peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Couldn't send request to peer 356ae6f7ee30414e97fdef8340814baf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:08.356061  5676 consensus_queue.cc:1035] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260812 19:21:08.351408  5194 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:21:08.307411  5614 raft_consensus.cc:348] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.364038  5614 raft_consensus.cc:374] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:08.391280  5614 raft_consensus.cc:729] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Initialized, Role: FOLLOWER
W20260812 19:21:08.381316  5497 consensus_peers.cc:487] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 -> Peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Couldn't send request to peer 356ae6f7ee30414e97fdef8340814baf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:08.396548  5672 raft_consensus.cc:504] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.394584  5614 consensus_queue.cc:260] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.417963  5614 ts_tablet_manager.cc:1428] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1: Time spent starting tablet: real 0.144s	user 0.024s	sys 0.001s
I20260812 19:21:08.421872  5695 raft_consensus.cc:482] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:08.426781  5614 tablet_bootstrap.cc:492] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1: Bootstrap starting.
I20260812 19:21:08.401252  5109 catalog_manager.cc:5495] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a40385c10c04a1eba3767425715efb1 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "7a40385c10c04a1eba3767425715efb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:08.438097  5624 raft_consensus.cc:504] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.427788  5695 raft_consensus.cc:504] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.463343  5618 tablet_bootstrap.cc:492] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93: No bootstrap required, opened a new log
I20260812 19:21:08.476617  5618 ts_tablet_manager.cc:1397] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93: Time spent bootstrapping tablet: real 0.259s	user 0.025s	sys 0.035s
I20260812 19:21:08.480312  5695 leader_election.cc:288] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:08.463739  5673 consensus_queue.cc:1035] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:08.454844  5109 catalog_manager.cc:5495] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a40385c10c04a1eba3767425715efb1 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "7a40385c10c04a1eba3767425715efb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:08.486835  5672 leader_election.cc:288] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:08.488790  5614 tablet_bootstrap.cc:654] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:08.495950  5624 leader_election.cc:288] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:08.503592  5623 tablet_bootstrap.cc:654] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:08.507661  5284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:08.491822  5550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89608281e35945d88c5fbd969a02135a" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1" is_pre_election: true
W20260812 19:21:08.536307  5495 leader_election.cc:341] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:08.498281  5109 catalog_manager.cc:5495] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a40385c10c04a1eba3767425715efb1 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "7a40385c10c04a1eba3767425715efb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:08.518626  5287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89608281e35945d88c5fbd969a02135a" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
I20260812 19:21:08.546465  5623 tablet_bootstrap.cc:492] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf: No bootstrap required, opened a new log
I20260812 19:21:08.548583  5287 raft_consensus.cc:2379] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 356ae6f7ee30414e97fdef8340814baf in current term 1: Already voted for candidate 7a40385c10c04a1eba3767425715efb1 in this term.
I20260812 19:21:08.553604  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:08.553532  5361 leader_election.cc:302] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf; no voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:08.556537  5421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:08.554831  5422 raft_consensus.cc:3037] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:08.560444  5673 raft_consensus.cc:3037] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:08.525135  5284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:08.567624  5284 raft_consensus.cc:3037] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:08.518332  5618 raft_consensus.cc:348] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.548630  5623 ts_tablet_manager.cc:1397] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf: Time spent bootstrapping tablet: real 0.233s	user 0.066s	sys 0.008s
I20260812 19:21:08.574477  5618 raft_consensus.cc:374] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:08.575659  5618 raft_consensus.cc:729] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Initialized, Role: FOLLOWER
I20260812 19:21:08.578405  5618 consensus_queue.cc:260] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
W20260812 19:21:08.587829  5497 consensus_peers.cc:487] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 -> Peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Couldn't send request to peer 356ae6f7ee30414e97fdef8340814baf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:08.599618  5695 consensus_queue.cc:1035] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260812 19:21:08.602725  5497 leader_election.cc:341] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:08.610190  5618 ts_tablet_manager.cc:1428] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93: Time spent starting tablet: real 0.133s	user 0.021s	sys 0.000s
I20260812 19:21:08.639324  5618 tablet_bootstrap.cc:492] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93: Bootstrap starting.
I20260812 19:21:08.537613  5624 consensus_queue.cc:1035] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.100s
I20260812 19:21:08.700455  5720 raft_consensus.cc:482] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:08.703857  5720 raft_consensus.cc:504] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.729262  5618 tablet_bootstrap.cc:654] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:08.741725  5623 raft_consensus.cc:348] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.764735  5720 leader_election.cc:288] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:08.775375  5419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dced490192de4aaca7dccacdfded1596" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
I20260812 19:21:08.748612  5623 raft_consensus.cc:374] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:08.782335  5419 raft_consensus.cc:2454] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 0.
I20260812 19:21:08.796376  5720 consensus_queue.cc:1035] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:08.796881  5281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dced490192de4aaca7dccacdfded1596" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
W20260812 19:21:08.799031  5495 leader_election.cc:341] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:08.799289  5614 tablet_bootstrap.cc:492] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1: No bootstrap required, opened a new log
I20260812 19:21:08.799800  5614 ts_tablet_manager.cc:1397] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1: Time spent bootstrapping tablet: real 0.376s	user 0.050s	sys 0.102s
I20260812 19:21:08.804565  5614 raft_consensus.cc:348] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.805141  5614 raft_consensus.cc:374] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:08.805380  5614 raft_consensus.cc:729] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Initialized, Role: FOLLOWER
I20260812 19:21:08.805930  5614 consensus_queue.cc:260] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.790699  5623 raft_consensus.cc:729] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Initialized, Role: FOLLOWER
I20260812 19:21:08.782335  5624 consensus_queue.cc:1035] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260812 19:21:08.808338  5673 raft_consensus.cc:2726] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:08.808614  5497 leader_election.cc:302] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1; no voters: c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:08.815860  5720 raft_consensus.cc:2781] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:08.816358  5720 raft_consensus.cc:482] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:08.811533  5614 ts_tablet_manager.cc:1428] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260812 19:21:08.811846  5695 consensus_queue.cc:1035] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:08.812126  5110 catalog_manager.cc:5495] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf reported cstate change: term changed from 0 to 1, leader changed from <none> to 356ae6f7ee30414e97fdef8340814baf (127.3.253.2). New cstate: current_term: 1 leader_uuid: "356ae6f7ee30414e97fdef8340814baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:08.813079  5284 raft_consensus.cc:2454] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 1.
I20260812 19:21:08.826551  5495 leader_election.cc:302] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf
I20260812 19:21:08.819280  5720 raft_consensus.cc:3037] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:08.828585  5713 raft_consensus.cc:2781] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:08.829257  5713 raft_consensus.cc:686] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Becoming Leader. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:08.830544  5713 consensus_queue.cc:237] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.832829  5676 consensus_queue.cc:1035] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:08.834169  5618 tablet_bootstrap.cc:492] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93: No bootstrap required, opened a new log
I20260812 19:21:08.835469  5618 ts_tablet_manager.cc:1397] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93: Time spent bootstrapping tablet: real 0.197s	user 0.051s	sys 0.005s
I20260812 19:21:08.825582  5623 consensus_queue.cc:260] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.841473  5695 raft_consensus.cc:482] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:08.850273  5695 raft_consensus.cc:504] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.857686  5422 raft_consensus.cc:2454] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 1.
I20260812 19:21:08.864624  5695 leader_election.cc:288] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:08.867295  5284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
I20260812 19:21:08.868242  5284 raft_consensus.cc:2379] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 356ae6f7ee30414e97fdef8340814baf in current term 1: Already voted for candidate 7a40385c10c04a1eba3767425715efb1 in this term.
I20260812 19:21:08.870138  5497 leader_election.cc:302] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1; no voters: c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:08.871546  5717 raft_consensus.cc:2781] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:08.875444  5731 raft_consensus.cc:482] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:08.875510  5717 raft_consensus.cc:686] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Becoming Leader. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:08.881347  5731 raft_consensus.cc:504] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.878958  5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1" is_pre_election: true
I20260812 19:21:08.883291  5281 raft_consensus.cc:3037] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:08.884158  5731 leader_election.cc:288] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:08.884259  5720 raft_consensus.cc:504] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.885488  5623 ts_tablet_manager.cc:1428] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf: Time spent starting tablet: real 0.314s	user 0.022s	sys 0.014s
I20260812 19:21:08.885347  5717 consensus_queue.cc:237] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.886803  5623 tablet_bootstrap.cc:492] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf: Bootstrap starting.
I20260812 19:21:08.887091  5720 leader_election.cc:288] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:08.888279  5421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
I20260812 19:21:08.889600  5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1" is_pre_election: true
I20260812 19:21:08.890923  5284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dced490192de4aaca7dccacdfded1596" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:08.891218  5223 leader_election.cc:302] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1
W20260812 19:21:08.893162  5495 leader_election.cc:341] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:08.900655  5421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dced490192de4aaca7dccacdfded1596" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:08.901440  5421 raft_consensus.cc:3037] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:08.902078  5723 log.cc:924] Time spent T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260812 19:21:08.906103  5623 tablet_bootstrap.cc:654] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:08.911164  5110 catalog_manager.cc:5495] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a40385c10c04a1eba3767425715efb1 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "7a40385c10c04a1eba3767425715efb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:08.912843  5421 raft_consensus.cc:2454] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 1.
I20260812 19:21:08.900691  5362 leader_election.cc:302] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf; no voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:08.923043  5744 raft_consensus.cc:3037] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:08.936513  5731 raft_consensus.cc:2726] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:08.937314  5744 raft_consensus.cc:2726] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:08.939306  5497 leader_election.cc:302] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1; no voters: c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:08.940991  5720 raft_consensus.cc:2781] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:08.941473  5720 raft_consensus.cc:686] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Becoming Leader. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:08.942996  5618 raft_consensus.cc:348] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.943769  5618 raft_consensus.cc:374] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:08.943460  5634 consensus_queue.cc:1035] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:08.944074  5618 raft_consensus.cc:729] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Initialized, Role: FOLLOWER
I20260812 19:21:08.944808  5618 consensus_queue.cc:260] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.942473  5720 consensus_queue.cc:237] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.947562  5618 ts_tablet_manager.cc:1428] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.000s
I20260812 19:21:08.951360  5618 tablet_bootstrap.cc:492] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93: Bootstrap starting.
I20260812 19:21:08.958873  5618 tablet_bootstrap.cc:654] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:08.971426  5717 raft_consensus.cc:482] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:08.972652  5717 raft_consensus.cc:504] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:08.983812  5281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e7c4f90fea34a52aa0b66da6ddb052e" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
I20260812 19:21:08.984539  5717 leader_election.cc:288] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:08.984622  5281 raft_consensus.cc:2454] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 0.
I20260812 19:21:08.986493  5495 leader_election.cc:302] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:08.988348  5717 raft_consensus.cc:2781] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:08.988772  5717 raft_consensus.cc:482] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:08.988966  5623 tablet_bootstrap.cc:492] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf: No bootstrap required, opened a new log
I20260812 19:21:08.992504  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e7c4f90fea34a52aa0b66da6ddb052e" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
I20260812 19:21:08.992344  5717 raft_consensus.cc:3037] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:08.993340  5623 ts_tablet_manager.cc:1397] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.020s
I20260812 19:21:08.996421  5618 tablet_bootstrap.cc:492] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93: No bootstrap required, opened a new log
I20260812 19:21:08.996910  5618 ts_tablet_manager.cc:1397] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.005s
I20260812 19:21:08.998129  5623 raft_consensus.cc:348] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:08.997713  5110 catalog_manager.cc:5495] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a40385c10c04a1eba3767425715efb1 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "7a40385c10c04a1eba3767425715efb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:08.999222  5623 raft_consensus.cc:374] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:08.999688  5623 raft_consensus.cc:729] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Initialized, Role: FOLLOWER
I20260812 19:21:09.000634  5623 consensus_queue.cc:260] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
W20260812 19:21:09.002496  5497 leader_election.cc:341] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:09.003108  5717 raft_consensus.cc:504] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.003863  5623 ts_tablet_manager.cc:1428] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260812 19:21:09.005149  5623 tablet_bootstrap.cc:492] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf: Bootstrap starting.
I20260812 19:21:09.000659  5110 catalog_manager.cc:5495] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a40385c10c04a1eba3767425715efb1 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "7a40385c10c04a1eba3767425715efb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:08.999789  5618 raft_consensus.cc:348] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.006531  5618 raft_consensus.cc:374] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:09.006541  5281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e7c4f90fea34a52aa0b66da6ddb052e" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:09.006981  5618 raft_consensus.cc:729] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Initialized, Role: FOLLOWER
I20260812 19:21:09.007311  5281 raft_consensus.cc:3037] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:09.007846  5618 consensus_queue.cc:260] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.010561  5618 ts_tablet_manager.cc:1428] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260812 19:21:09.005209  5717 leader_election.cc:288] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:09.013855  5281 raft_consensus.cc:2454] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 1.
I20260812 19:21:09.015117  5495 leader_election.cc:302] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:09.015486  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e7c4f90fea34a52aa0b66da6ddb052e" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:09.015894  5717 raft_consensus.cc:2781] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:09.016440  5717 raft_consensus.cc:686] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Becoming Leader. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:09.017340  5717 consensus_queue.cc:237] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
W20260812 19:21:09.019111  5497 leader_election.cc:341] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:09.023106  5623 tablet_bootstrap.cc:654] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:09.034377  5731 raft_consensus.cc:482] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:09.035027  5731 raft_consensus.cc:504] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.036584  5623 tablet_bootstrap.cc:492] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf: No bootstrap required, opened a new log
I20260812 19:21:09.037137  5623 ts_tablet_manager.cc:1397] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.008s
I20260812 19:21:09.037549  5731 leader_election.cc:288] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:09.038818  5731 raft_consensus.cc:482] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:09.040098  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
I20260812 19:21:09.040612  5550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1" is_pre_election: true
I20260812 19:21:09.041122  5422 raft_consensus.cc:2379] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4b010d4147f4b438ec1b520f84d9d93 in current term 1: Already voted for candidate 7a40385c10c04a1eba3767425715efb1 in this term.
I20260812 19:21:09.039443  5731 raft_consensus.cc:504] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.042765  5223 leader_election.cc:302] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1
I20260812 19:21:09.042948  5110 catalog_manager.cc:5495] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a40385c10c04a1eba3767425715efb1 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "7a40385c10c04a1eba3767425715efb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:09.043988  5732 raft_consensus.cc:3037] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:09.045490  5623 raft_consensus.cc:348] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.046236  5623 raft_consensus.cc:374] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:09.046489  5623 raft_consensus.cc:729] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Initialized, Role: FOLLOWER
I20260812 19:21:09.047205  5623 consensus_queue.cc:260] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.050179  5623 ts_tablet_manager.cc:1428] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260812 19:21:09.051153  5623 tablet_bootstrap.cc:492] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf: Bootstrap starting.
I20260812 19:21:09.055404  5731 leader_election.cc:288] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:09.059844  5732 raft_consensus.cc:2726] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:09.057600  5623 tablet_bootstrap.cc:654] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:09.057523  5550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dced490192de4aaca7dccacdfded1596" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1" is_pre_election: true
I20260812 19:21:09.058197  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dced490192de4aaca7dccacdfded1596" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356ae6f7ee30414e97fdef8340814baf" is_pre_election: true
I20260812 19:21:09.061094  5422 raft_consensus.cc:2379] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4b010d4147f4b438ec1b520f84d9d93 in current term 1: Already voted for candidate 7a40385c10c04a1eba3767425715efb1 in this term.
I20260812 19:21:09.062536  5223 leader_election.cc:302] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b010d4147f4b438ec1b520f84d9d93; no voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1
I20260812 19:21:09.063380  5732 raft_consensus.cc:3037] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:09.068439  5732 raft_consensus.cc:2726] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:09.071377  5623 tablet_bootstrap.cc:492] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf: No bootstrap required, opened a new log
I20260812 19:21:09.071796  5623 ts_tablet_manager.cc:1397] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.003s
I20260812 19:21:09.073961  5623 raft_consensus.cc:348] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.074491  5623 raft_consensus.cc:374] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:09.074704  5623 raft_consensus.cc:729] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Initialized, Role: FOLLOWER
I20260812 19:21:09.075281  5623 consensus_queue.cc:260] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.077291  5623 ts_tablet_manager.cc:1428] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260812 19:21:09.078728  5623 tablet_bootstrap.cc:492] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf: Bootstrap starting.
I20260812 19:21:09.085733  5623 tablet_bootstrap.cc:654] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:09.093417  5623 tablet_bootstrap.cc:492] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf: No bootstrap required, opened a new log
I20260812 19:21:09.093824  5623 ts_tablet_manager.cc:1397] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.007s
I20260812 19:21:09.096112  5623 raft_consensus.cc:348] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.096642  5623 raft_consensus.cc:374] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:09.096832  5623 raft_consensus.cc:729] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Initialized, Role: FOLLOWER
I20260812 19:21:09.097440  5623 consensus_queue.cc:260] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.099665  5623 ts_tablet_manager.cc:1428] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260812 19:21:09.120800  5422 raft_consensus.cc:3037] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:09.148661  5550 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27"
dest_uuid: "7a40385c10c04a1eba3767425715efb1"
mode: GRACEFUL
new_leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:47132
I20260812 19:21:09.149537  5550 raft_consensus.cc:595] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Received request to transfer leadership to TS c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:09.167428  5422 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2d34a1970c2b4eb2b9ad047662a2f45b"
dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
mode: GRACEFUL
new_leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:48846
I20260812 19:21:09.167943  5422 raft_consensus.cc:595] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 1 LEADER]: Received request to transfer leadership to TS c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:09.173121  5550 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07"
dest_uuid: "7a40385c10c04a1eba3767425715efb1"
mode: GRACEFUL
new_leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:47132
I20260812 19:21:09.173692  5550 raft_consensus.cc:595] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Received request to transfer leadership to TS c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:09.179221  5550 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "89608281e35945d88c5fbd969a02135a"
dest_uuid: "7a40385c10c04a1eba3767425715efb1"
mode: GRACEFUL
new_leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:47132
I20260812 19:21:09.179734  5550 raft_consensus.cc:595] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Received request to transfer leadership to TS c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:09.184929  5422 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7"
dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
mode: GRACEFUL
new_leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:48846
I20260812 19:21:09.185467  5422 raft_consensus.cc:595] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 1 LEADER]: Received request to transfer leadership to TS c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:09.190593  5550 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021"
dest_uuid: "7a40385c10c04a1eba3767425715efb1"
mode: GRACEFUL
new_leader_uuid: "356ae6f7ee30414e97fdef8340814baf"
 from {username='slave'} at 127.0.0.1:47132
I20260812 19:21:09.191145  5550 raft_consensus.cc:595] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Received request to transfer leadership to TS 356ae6f7ee30414e97fdef8340814baf
I20260812 19:21:09.196362  5550 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "db8e6b83637e4d049b4e905e64fe128a"
dest_uuid: "7a40385c10c04a1eba3767425715efb1"
mode: GRACEFUL
new_leader_uuid: "356ae6f7ee30414e97fdef8340814baf"
 from {username='slave'} at 127.0.0.1:47132
I20260812 19:21:09.196847  5550 raft_consensus.cc:595] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Received request to transfer leadership to TS 356ae6f7ee30414e97fdef8340814baf
I20260812 19:21:09.202019  5550 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8"
dest_uuid: "7a40385c10c04a1eba3767425715efb1"
mode: GRACEFUL
new_leader_uuid: "356ae6f7ee30414e97fdef8340814baf"
 from {username='slave'} at 127.0.0.1:47132
I20260812 19:21:09.202526  5550 raft_consensus.cc:595] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Received request to transfer leadership to TS 356ae6f7ee30414e97fdef8340814baf
I20260812 19:21:09.207602  5550 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8e7c4f90fea34a52aa0b66da6ddb052e"
dest_uuid: "7a40385c10c04a1eba3767425715efb1"
mode: GRACEFUL
new_leader_uuid: "356ae6f7ee30414e97fdef8340814baf"
 from {username='slave'} at 127.0.0.1:47132
I20260812 19:21:09.208112  5550 raft_consensus.cc:595] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Received request to transfer leadership to TS 356ae6f7ee30414e97fdef8340814baf
I20260812 19:21:09.261264  5755 raft_consensus.cc:979] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf: : Instructing follower c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:09.261991  5754 raft_consensus.cc:1067] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 1 LEADER]: Signalling peer c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:09.263895  5281 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2d34a1970c2b4eb2b9ad047662a2f45b"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:53602
I20260812 19:21:09.264528  5281 raft_consensus.cc:482] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:09.264917  5281 raft_consensus.cc:3037] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.270607  5281 raft_consensus.cc:504] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.272446  5281 leader_election.cc:288] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 2 election: Requested vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:09.273677  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d34a1970c2b4eb2b9ad047662a2f45b" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:09.273895  5550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d34a1970c2b4eb2b9ad047662a2f45b" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:09.274386  5422 raft_consensus.cc:3032] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:21:09.274801  5422 raft_consensus.cc:729] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Running, Role: LEADER
I20260812 19:21:09.274863  5550 raft_consensus.cc:3037] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.275803  5422 consensus_queue.cc:260] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.277354  5422 raft_consensus.cc:3037] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.278590  5717 consensus_queue.cc:1035] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:09.279784  5720 consensus_queue.cc:1035] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:09.283311  5550 raft_consensus.cc:2454] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 2.
I20260812 19:21:09.284727  5223 leader_election.cc:302] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:09.285722  5732 raft_consensus.cc:2781] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:21:09.286255  5732 raft_consensus.cc:686] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Becoming Leader. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:09.287256  5732 consensus_queue.cc:237] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.292368  5422 raft_consensus.cc:2454] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 2.
I20260812 19:21:09.294154  5419 raft_consensus.cc:3037] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:09.311050  5421 raft_consensus.cc:3037] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:09.329887  5677 consensus_queue.cc:1035] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:09.318858  5109 catalog_manager.cc:5495] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 reported cstate change: term changed from 1 to 2, leader changed from 356ae6f7ee30414e97fdef8340814baf (127.3.253.2) to c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:09.355290  5717 raft_consensus.cc:979] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1: : Instructing follower 356ae6f7ee30414e97fdef8340814baf to start an election
I20260812 19:21:09.355854  5717 raft_consensus.cc:1067] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Signalling peer 356ae6f7ee30414e97fdef8340814baf to start an election
I20260812 19:21:09.358203  5419 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8"
dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
 from {username='slave'} at 127.0.0.1:51826
I20260812 19:21:09.358945  5419 raft_consensus.cc:482] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:09.359417  5419 raft_consensus.cc:3037] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.361600  5720 raft_consensus.cc:979] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1: : Instructing follower c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:09.362100  5720 raft_consensus.cc:1067] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Signalling peer c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:09.367832  5276 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:53600
I20260812 19:21:09.368472  5276 raft_consensus.cc:482] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:09.368906  5276 raft_consensus.cc:3037] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.369299  5717 raft_consensus.cc:979] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1: : Instructing follower c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:09.369920  5677 raft_consensus.cc:1067] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Signalling peer c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:09.372280  5287 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "89608281e35945d88c5fbd969a02135a"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:53600
I20260812 19:21:09.372291  5419 raft_consensus.cc:504] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.372870  5287 raft_consensus.cc:482] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:09.373308  5287 raft_consensus.cc:3037] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.375118  5676 consensus_queue.cc:1035] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:09.380064  5550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:09.380119  5281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:09.380939  5550 raft_consensus.cc:3032] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:21:09.381170  5281 raft_consensus.cc:3037] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.381397  5550 raft_consensus.cc:729] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:09.382453  5755 raft_consensus.cc:979] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf: : Instructing follower c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:09.383086  5755 raft_consensus.cc:1067] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 1 LEADER]: Signalling peer c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:09.382493  5550 consensus_queue.cc:260] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.384471  5550 raft_consensus.cc:3037] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.385375  5284 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:53602
I20260812 19:21:09.385946  5284 raft_consensus.cc:482] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:09.386341  5284 raft_consensus.cc:3037] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.396080  5281 raft_consensus.cc:2454] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 2.
I20260812 19:21:09.392771  5419 leader_election.cc:288] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 2 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:09.397621  5361 leader_election.cc:302] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:09.401711  5754 raft_consensus.cc:2781] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:21:09.401382  5287 raft_consensus.cc:504] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.402889  5754 raft_consensus.cc:686] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Becoming Leader. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Running, Role: LEADER
I20260812 19:21:09.400924  5550 raft_consensus.cc:2454] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 2.
I20260812 19:21:09.404119  5754 consensus_queue.cc:237] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.407141  5276 raft_consensus.cc:504] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.413260  5549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89608281e35945d88c5fbd969a02135a" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:09.413992  5549 raft_consensus.cc:3032] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:21:09.414314  5549 raft_consensus.cc:729] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:09.409607  5419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89608281e35945d88c5fbd969a02135a" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:09.415021  5419 raft_consensus.cc:3037] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.415308  5549 consensus_queue.cc:260] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.416460  5676 raft_consensus.cc:979] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1: : Instructing follower 356ae6f7ee30414e97fdef8340814baf to start an election
I20260812 19:21:09.416965  5677 raft_consensus.cc:1067] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Signalling peer 356ae6f7ee30414e97fdef8340814baf to start an election
I20260812 19:21:09.408882  5284 raft_consensus.cc:504] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.416659  5549 raft_consensus.cc:3037] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.420198  5284 leader_election.cc:288] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 2 election: Requested vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:09.421818  5422 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021"
dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
 from {username='slave'} at 127.0.0.1:51826
I20260812 19:21:09.422480  5422 raft_consensus.cc:482] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:09.422640  5276 leader_election.cc:288] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 2 election: Requested vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:09.446570  5754 raft_consensus.cc:482] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:09.425995  5419 raft_consensus.cc:2454] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 2.
I20260812 19:21:09.451457  5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:09.451579  5754 raft_consensus.cc:504] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.452327  5548 raft_consensus.cc:3032] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:21:09.447048  5287 leader_election.cc:288] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 2 election: Requested vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:09.422876  5421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:09.452817  5223 leader_election.cc:302] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:09.453879  5732 raft_consensus.cc:2781] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:21:09.454442  5732 raft_consensus.cc:686] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Becoming Leader. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:09.423864  5414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:09.422931  5422 raft_consensus.cc:3037] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.455096  5414 raft_consensus.cc:3037] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.455471  5732 consensus_queue.cc:237] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.454598  5754 leader_election.cc:288] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:09.427336  5676 consensus_queue.cc:1035] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260812 19:21:09.457957  5547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e7c4f90fea34a52aa0b66da6ddb052e" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a40385c10c04a1eba3767425715efb1" is_pre_election: true
I20260812 19:21:09.461521  5287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e7c4f90fea34a52aa0b66da6ddb052e" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93" is_pre_election: true
I20260812 19:21:09.462602  5287 raft_consensus.cc:2379] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 356ae6f7ee30414e97fdef8340814baf in current term 1: Already voted for candidate 7a40385c10c04a1eba3767425715efb1 in this term.
I20260812 19:21:09.435237  5550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:09.463065  5422 raft_consensus.cc:504] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.463881  5361 leader_election.cc:302] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf; no voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:09.465260  5421 raft_consensus.cc:3032] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:21:09.465657  5421 raft_consensus.cc:729] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Running, Role: LEADER
I20260812 19:21:09.466753  5547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:09.466552  5421 consensus_queue.cc:260] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.467381  5547 raft_consensus.cc:3032] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:21:09.467738  5547 raft_consensus.cc:729] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:09.468189  5421 raft_consensus.cc:3037] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.463374  5550 raft_consensus.cc:3037] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.468631  5547 consensus_queue.cc:260] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.470064  5547 raft_consensus.cc:3037] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.469935  5276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:09.470861  5276 raft_consensus.cc:3037] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.471474  5720 raft_consensus.cc:979] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1: : Instructing follower c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:09.471971  5720 raft_consensus.cc:1067] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Signalling peer c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:09.474097  5284 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:53600
I20260812 19:21:09.474761  5284 raft_consensus.cc:482] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:09.474953  5754 raft_consensus.cc:3037] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:09.452718  5548 raft_consensus.cc:729] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:09.430896  5109 catalog_manager.cc:5495] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf reported cstate change: term changed from 1 to 2, leader changed from 7a40385c10c04a1eba3767425715efb1 (127.3.253.3) to 356ae6f7ee30414e97fdef8340814baf (127.3.253.2). New cstate: current_term: 2 leader_uuid: "356ae6f7ee30414e97fdef8340814baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:09.476351  5548 consensus_queue.cc:260] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.477905  5548 raft_consensus.cc:3037] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.475159  5284 raft_consensus.cc:3037] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.484076  5547 raft_consensus.cc:2454] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 2.
I20260812 19:21:09.485493  5362 leader_election.cc:302] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1; no voters: 
I20260812 19:21:09.486528  5755 raft_consensus.cc:2781] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:21:09.487238  5422 leader_election.cc:288] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 2 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:09.486415  5284 raft_consensus.cc:504] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:09.493932  5284 leader_election.cc:288] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 2 election: Requested vote from peers 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:09.496789  5422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:09.497496  5422 raft_consensus.cc:3037] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.501626  5754 raft_consensus.cc:2726] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:09.490092  5755 raft_consensus.cc:686] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Becoming Leader. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Running, Role: LEADER
I20260812 19:21:09.502676  5550 raft_consensus.cc:2454] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 2.
I20260812 19:21:09.504732  5422 raft_consensus.cc:2454] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 2.
I20260812 19:21:09.505008  5755 consensus_queue.cc:237] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.505702  5223 leader_election.cc:302] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:09.506933  5732 raft_consensus.cc:2781] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:21:09.507133  5223 leader_election.cc:302] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:09.507472  5732 raft_consensus.cc:686] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Becoming Leader. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:09.507670  5549 raft_consensus.cc:2454] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 2.
I20260812 19:21:09.508427  5732 consensus_queue.cc:237] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.510965  5731 raft_consensus.cc:2781] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:21:09.511431  5731 raft_consensus.cc:686] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Becoming Leader. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:09.512256  5731 consensus_queue.cc:237] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:09.523315  5276 raft_consensus.cc:2454] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 2.
I20260812 19:21:09.523809  5414 raft_consensus.cc:2454] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 2.
I20260812 19:21:09.528290  5110 catalog_manager.cc:5495] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 reported cstate change: term changed from 1 to 2, leader changed from 7a40385c10c04a1eba3767425715efb1 (127.3.253.3) to c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:09.529258  5109 catalog_manager.cc:5495] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf reported cstate change: term changed from 1 to 2, leader changed from 7a40385c10c04a1eba3767425715efb1 (127.3.253.3) to 356ae6f7ee30414e97fdef8340814baf (127.3.253.2). New cstate: current_term: 2 leader_uuid: "356ae6f7ee30414e97fdef8340814baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:09.531714  5421 raft_consensus.cc:2454] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 2.
I20260812 19:21:09.519186  5547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:09.546060  5713 consensus_queue.cc:1035] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:09.546542  5547 raft_consensus.cc:3032] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:21:09.547024  5547 raft_consensus.cc:729] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:09.548028  5547 consensus_queue.cc:260] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:09.549367  5547 raft_consensus.cc:3037] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.535789  5548 raft_consensus.cc:2454] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 2.
I20260812 19:21:09.537458  5223 leader_election.cc:302] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:09.554816  5732 raft_consensus.cc:2781] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:21:09.555343  5732 raft_consensus.cc:686] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Becoming Leader. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:09.556229  5732 consensus_queue.cc:237] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.562711  5109 catalog_manager.cc:5495] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 reported cstate change: term changed from 1 to 2, leader changed from 356ae6f7ee30414e97fdef8340814baf (127.3.253.2) to c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:09.564023  5547 raft_consensus.cc:2454] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 2.
I20260812 19:21:09.565807  5109 catalog_manager.cc:5495] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 reported cstate change: term changed from 1 to 2, leader changed from 7a40385c10c04a1eba3767425715efb1 (127.3.253.3) to c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:09.567610  5713 consensus_queue.cc:1035] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:09.580168  5676 consensus_queue.cc:1035] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:09.586014  5110 catalog_manager.cc:5495] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 reported cstate change: term changed from 1 to 2, leader changed from 7a40385c10c04a1eba3767425715efb1 (127.3.253.3) to c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:09.592785  5713 raft_consensus.cc:979] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1: : Instructing follower 356ae6f7ee30414e97fdef8340814baf to start an election
I20260812 19:21:09.593304  5676 raft_consensus.cc:1067] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Signalling peer 356ae6f7ee30414e97fdef8340814baf to start an election
I20260812 19:21:09.595108  5419 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8e7c4f90fea34a52aa0b66da6ddb052e"
dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
 from {username='slave'} at 127.0.0.1:51826
I20260812 19:21:09.595921  5419 raft_consensus.cc:482] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:09.596410  5419 raft_consensus.cc:3037] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.604696  5419 raft_consensus.cc:504] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.606948  5419 leader_election.cc:288] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 2 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:09.607880  5276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e7c4f90fea34a52aa0b66da6ddb052e" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:09.608340  5547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e7c4f90fea34a52aa0b66da6ddb052e" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:09.608649  5276 raft_consensus.cc:3037] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.609030  5547 raft_consensus.cc:3032] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:21:09.609424  5547 raft_consensus.cc:729] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:09.610265  5547 consensus_queue.cc:260] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.611502  5547 raft_consensus.cc:3037] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.615368  5276 raft_consensus.cc:2454] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 2.
I20260812 19:21:09.616602  5361 leader_election.cc:302] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:09.617547  5755 raft_consensus.cc:2781] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:21:09.617951  5547 raft_consensus.cc:2454] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 2.
I20260812 19:21:09.618027  5755 raft_consensus.cc:686] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Becoming Leader. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Running, Role: LEADER
I20260812 19:21:09.618963  5755 consensus_queue.cc:237] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.626391  5109 catalog_manager.cc:5495] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf reported cstate change: term changed from 1 to 2, leader changed from 7a40385c10c04a1eba3767425715efb1 (127.3.253.3) to 356ae6f7ee30414e97fdef8340814baf (127.3.253.2). New cstate: current_term: 2 leader_uuid: "356ae6f7ee30414e97fdef8340814baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:09.649962  5713 raft_consensus.cc:979] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1: : Instructing follower 356ae6f7ee30414e97fdef8340814baf to start an election
I20260812 19:21:09.650472  5676 raft_consensus.cc:1067] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Signalling peer 356ae6f7ee30414e97fdef8340814baf to start an election
I20260812 19:21:09.652175  5419 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "db8e6b83637e4d049b4e905e64fe128a"
dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
 from {username='slave'} at 127.0.0.1:51826
I20260812 19:21:09.652706  5419 raft_consensus.cc:482] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:09.653065  5419 raft_consensus.cc:3037] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.657953  5419 raft_consensus.cc:504] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.659567  5419 leader_election.cc:288] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 2 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:09.660616  5276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db8e6b83637e4d049b4e905e64fe128a" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:09.660729  5547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db8e6b83637e4d049b4e905e64fe128a" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:09.661356  5276 raft_consensus.cc:3037] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.661412  5547 raft_consensus.cc:3032] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:21:09.661839  5547 raft_consensus.cc:729] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:09.662536  5547 consensus_queue.cc:260] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.663544  5547 raft_consensus.cc:3037] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:09.668341  5276 raft_consensus.cc:2454] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 2.
I20260812 19:21:09.669638  5361 leader_election.cc:302] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:09.669936  5547 raft_consensus.cc:2454] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 2.
I20260812 19:21:09.670405  5755 raft_consensus.cc:2781] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:21:09.670954  5755 raft_consensus.cc:686] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Becoming Leader. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Running, Role: LEADER
I20260812 19:21:09.671728  5755 consensus_queue.cc:237] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:09.678391  5109 catalog_manager.cc:5495] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf reported cstate change: term changed from 1 to 2, leader changed from 7a40385c10c04a1eba3767425715efb1 (127.3.253.3) to 356ae6f7ee30414e97fdef8340814baf (127.3.253.2). New cstate: current_term: 2 leader_uuid: "356ae6f7ee30414e97fdef8340814baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:09.680545  5419 raft_consensus.cc:1261] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:09.681840  5732 consensus_queue.cc:1035] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:09.690754  5547 raft_consensus.cc:1261] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:09.693156  5732 consensus_queue.cc:1035] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:09.886756  5547 raft_consensus.cc:1261] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Refusing update from remote peer 356ae6f7ee30414e97fdef8340814baf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:09.888352  5755 consensus_queue.cc:1035] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:09.889575  5547 raft_consensus.cc:1261] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:09.891104  5732 consensus_queue.cc:1035] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:09.899957  5276 raft_consensus.cc:1261] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Refusing update from remote peer 356ae6f7ee30414e97fdef8340814baf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:09.908803  5634 consensus_queue.cc:1035] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:21:09.912017  5419 raft_consensus.cc:1261] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:09.914899  5732 consensus_queue.cc:1035] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:21:10.000581  5419 raft_consensus.cc:1261] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:10.002027  5732 consensus_queue.cc:1035] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:10.011104  5548 raft_consensus.cc:1261] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:10.013017  5732 consensus_queue.cc:1035] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:10.023025  5419 raft_consensus.cc:1261] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:10.024529  5732 consensus_queue.cc:1035] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:21:10.036465  5547 raft_consensus.cc:1261] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:10.037652  5548 raft_consensus.cc:1261] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:10.038038  5731 consensus_queue.cc:1035] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:10.039587  5787 consensus_queue.cc:1035] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:21:10.044485  5276 raft_consensus.cc:1261] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Refusing update from remote peer 356ae6f7ee30414e97fdef8340814baf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:10.046762  5634 consensus_queue.cc:1035] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:21:10.053879  5550 raft_consensus.cc:1261] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Refusing update from remote peer 356ae6f7ee30414e97fdef8340814baf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:10.056289  5634 consensus_queue.cc:1035] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:21:10.059885  5276 raft_consensus.cc:1261] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Refusing update from remote peer 356ae6f7ee30414e97fdef8340814baf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:10.061641  5755 consensus_queue.cc:1035] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:21:10.071606  5419 raft_consensus.cc:1261] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:10.073494  5732 consensus_queue.cc:1035] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:21:10.082424  5547 raft_consensus.cc:1261] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Refusing update from remote peer 356ae6f7ee30414e97fdef8340814baf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:10.085855  5548 raft_consensus.cc:1261] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Refusing update from remote peer 356ae6f7ee30414e97fdef8340814baf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:10.088292  5755 consensus_queue.cc:1035] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:21:10.089923  5755 consensus_queue.cc:1035] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:10.105392  5276 raft_consensus.cc:1261] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Refusing update from remote peer 356ae6f7ee30414e97fdef8340814baf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:21:10.107676  5634 consensus_queue.cc:1035] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:12.244468  4084 auto_leader_rebalancer-test.cc:339] The leader distribution is 
I20260812 19:21:12.245556  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:12.268987  5276 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
mode: GRACEFUL
new_leader_uuid: "7a40385c10c04a1eba3767425715efb1"
 from {username='slave'} at 127.0.0.1:37856
I20260812 19:21:12.269513  5276 raft_consensus.cc:595] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Received request to transfer leadership to TS 7a40385c10c04a1eba3767425715efb1
I20260812 19:21:12.271956  5276 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
mode: GRACEFUL
new_leader_uuid: "7a40385c10c04a1eba3767425715efb1"
 from {username='slave'} at 127.0.0.1:37856
I20260812 19:21:12.272413  5276 raft_consensus.cc:595] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Received request to transfer leadership to TS 7a40385c10c04a1eba3767425715efb1
I20260812 19:21:12.273288  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260812 19:21:12.273767  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:12.452713  5813 raft_consensus.cc:979] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93: : Instructing follower 7a40385c10c04a1eba3767425715efb1 to start an election
I20260812 19:21:12.453212  5821 raft_consensus.cc:1067] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Signalling peer 7a40385c10c04a1eba3767425715efb1 to start an election
I20260812 19:21:12.454737  5548 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07"
dest_uuid: "7a40385c10c04a1eba3767425715efb1"
 from {username='slave'} at 127.0.0.1:48676
I20260812 19:21:12.455180  5548 raft_consensus.cc:482] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:12.455479  5548 raft_consensus.cc:3037] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:12.461019  5548 raft_consensus.cc:504] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:12.462602  5548 leader_election.cc:288] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 3 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:12.463516  5276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:12.463769  5419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:12.464251  5276 raft_consensus.cc:3032] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:21:12.464352  5419 raft_consensus.cc:3037] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:12.464598  5276 raft_consensus.cc:729] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:12.465322  5276 consensus_queue.cc:260] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:12.466261  5276 raft_consensus.cc:3037] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:12.469374  5419 raft_consensus.cc:2454] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 3.
I20260812 19:21:12.470535  5497 leader_election.cc:302] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1; no voters: 
I20260812 19:21:12.471377  5812 raft_consensus.cc:2781] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:21:12.471298  5276 raft_consensus.cc:2454] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 3.
I20260812 19:21:12.472837  5812 raft_consensus.cc:686] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 3 LEADER]: Becoming Leader. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:12.473595  5812 consensus_queue.cc:237] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:12.482060  5110 catalog_manager.cc:5495] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 reported cstate change: term changed from 2 to 3, leader changed from c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1) to 7a40385c10c04a1eba3767425715efb1 (127.3.253.3). New cstate: current_term: 3 leader_uuid: "7a40385c10c04a1eba3767425715efb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:12.583492  5813 raft_consensus.cc:979] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93: : Instructing follower 7a40385c10c04a1eba3767425715efb1 to start an election
I20260812 19:21:12.584012  5821 raft_consensus.cc:1067] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Signalling peer 7a40385c10c04a1eba3767425715efb1 to start an election
I20260812 19:21:12.585527  5547 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27"
dest_uuid: "7a40385c10c04a1eba3767425715efb1"
 from {username='slave'} at 127.0.0.1:48676
I20260812 19:21:12.586045  5547 raft_consensus.cc:482] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:12.586397  5547 raft_consensus.cc:3037] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:12.592124  5547 raft_consensus.cc:504] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:12.593832  5547 leader_election.cc:288] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 3 election: Requested vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149)
I20260812 19:21:12.594853  5419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:12.595005  5276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:12.595531  5419 raft_consensus.cc:3037] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:12.595542  5276 raft_consensus.cc:3032] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:21:12.596053  5276 raft_consensus.cc:729] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:12.597081  5276 consensus_queue.cc:260] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:12.598544  5276 raft_consensus.cc:3037] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:12.603639  5419 raft_consensus.cc:2454] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 3.
I20260812 19:21:12.604970  5497 leader_election.cc:302] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1; no voters: 
I20260812 19:21:12.605818  5812 raft_consensus.cc:2781] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:21:12.606302  5812 raft_consensus.cc:686] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 3 LEADER]: Becoming Leader. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:12.606290  5276 raft_consensus.cc:2454] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 3.
I20260812 19:21:12.607578  5812 consensus_queue.cc:237] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:12.620203  5110 catalog_manager.cc:5495] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 reported cstate change: term changed from 2 to 3, leader changed from c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1) to 7a40385c10c04a1eba3767425715efb1 (127.3.253.3). New cstate: current_term: 3 leader_uuid: "7a40385c10c04a1eba3767425715efb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:12.867074  5276 raft_consensus.cc:1261] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Refusing update from remote peer 7a40385c10c04a1eba3767425715efb1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:21:12.868515  5812 consensus_queue.cc:1035] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:21:12.882812  5419 raft_consensus.cc:1261] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Refusing update from remote peer 7a40385c10c04a1eba3767425715efb1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:21:12.884836  5812 consensus_queue.cc:1035] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:21:12.991984  5276 raft_consensus.cc:1261] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Refusing update from remote peer 7a40385c10c04a1eba3767425715efb1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:21:12.993412  5843 consensus_queue.cc:1035] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:21:13.007004  5419 raft_consensus.cc:1261] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Refusing update from remote peer 7a40385c10c04a1eba3767425715efb1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:21:13.010040  5823 consensus_queue.cc:1035] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:21:13.275292  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:13.284588  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:13.285074  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:14.286127  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:14.292264  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:14.292754  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:15.293581  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:15.299499  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:15.299998  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:16.300992  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:16.307107  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:16.307627  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:17.308642  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:17.314380  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:17.314944  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:18.315732  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:18.321301  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:18.321789  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:19.322621  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:19.327976  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:19.328483  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:20.329460  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:20.335954  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:20.336551  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:21.337472  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:21.344755  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:21.345218  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:22.377578  4084 auto_leader_rebalancer-test.cc:358] The leader distribution is 
I20260812 19:21:22.383607  5548 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27"
dest_uuid: "7a40385c10c04a1eba3767425715efb1"
mode: GRACEFUL
new_leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:47132
I20260812 19:21:22.384383  5548 raft_consensus.cc:595] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 3 LEADER]: Received request to transfer leadership to TS c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:22.392035  5548 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07"
dest_uuid: "7a40385c10c04a1eba3767425715efb1"
mode: GRACEFUL
new_leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:47132
I20260812 19:21:22.392637  5548 raft_consensus.cc:595] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 3 LEADER]: Received request to transfer leadership to TS c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:22.402842  5421 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021"
dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
mode: GRACEFUL
new_leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:48846
I20260812 19:21:22.403527  5421 raft_consensus.cc:595] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Received request to transfer leadership to TS c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:22.408885  5419 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "db8e6b83637e4d049b4e905e64fe128a"
dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
mode: GRACEFUL
new_leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:48846
I20260812 19:21:22.409487  5419 raft_consensus.cc:595] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Received request to transfer leadership to TS c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:22.414556  5419 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8"
dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
mode: GRACEFUL
new_leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:48846
I20260812 19:21:22.415089  5419 raft_consensus.cc:595] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Received request to transfer leadership to TS c4b010d4147f4b438ec1b520f84d9d93
I20260812 19:21:22.429296  5868 raft_consensus.cc:979] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf: : Instructing follower c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:22.429910  5867 raft_consensus.cc:1067] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Signalling peer c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:22.431555  5284 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:53602
I20260812 19:21:22.432174  5284 raft_consensus.cc:482] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:22.432510  5284 raft_consensus.cc:3037] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:22.439623  5284 raft_consensus.cc:504] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:22.441798  5284 leader_election.cc:288] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 3 election: Requested vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:22.442912  5419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:22.443231  5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:22.443811  5419 raft_consensus.cc:3032] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:21:22.443885  5548 raft_consensus.cc:3037] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:22.444146  5419 raft_consensus.cc:729] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Running, Role: LEADER
I20260812 19:21:22.445024  5419 consensus_queue.cc:260] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:22.446193  5419 raft_consensus.cc:3037] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:22.450484  5548 raft_consensus.cc:2454] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 3.
I20260812 19:21:22.452103  5419 raft_consensus.cc:2454] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 3.
I20260812 19:21:22.452092  5223 leader_election.cc:302] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:22.453161  5857 raft_consensus.cc:2781] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:21:22.454123  5857 raft_consensus.cc:686] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 LEADER]: Becoming Leader. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:22.455029  5857 consensus_queue.cc:237] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:22.462092  5110 catalog_manager.cc:5495] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 reported cstate change: term changed from 2 to 3, leader changed from 356ae6f7ee30414e97fdef8340814baf (127.3.253.2) to c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1). New cstate: current_term: 3 leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:22.550609  5868 raft_consensus.cc:979] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf: : Instructing follower c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:22.551119  5867 raft_consensus.cc:1067] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Signalling peer c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:22.552666  5284 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:53602
I20260812 19:21:22.553167  5284 raft_consensus.cc:482] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:22.553483  5284 raft_consensus.cc:3037] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:22.559043  5284 raft_consensus.cc:504] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:22.560626  5284 leader_election.cc:288] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 3 election: Requested vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:22.561640  5419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:22.562227  5419 raft_consensus.cc:3032] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:21:22.561896  5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b940c5579654cb4bfa011d2fb201021" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:22.562578  5419 raft_consensus.cc:729] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Running, Role: LEADER
I20260812 19:21:22.562781  5548 raft_consensus.cc:3037] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:22.563591  5419 consensus_queue.cc:260] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:22.565353  5419 raft_consensus.cc:3037] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:22.572521  5812 raft_consensus.cc:979] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1: : Instructing follower c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:22.572993  5548 raft_consensus.cc:2454] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 3.
I20260812 19:21:22.573549  5878 raft_consensus.cc:1067] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 3 LEADER]: Signalling peer c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:22.573557  5419 raft_consensus.cc:2454] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 3.
I20260812 19:21:22.574946  5223 leader_election.cc:302] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:22.575673  5857 raft_consensus.cc:2781] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:21:22.576022  5284 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:53600
I20260812 19:21:22.576347  5857 raft_consensus.cc:686] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 LEADER]: Becoming Leader. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:22.576628  5284 raft_consensus.cc:482] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:22.577008  5284 raft_consensus.cc:3037] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:21:22.577716  5857 consensus_queue.cc:237] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:22.582980  5284 raft_consensus.cc:504] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:22.585795  5284 leader_election.cc:288] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 4 election: Requested vote from peers 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:22.586541  5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:22.587052  5419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ae788179bfc4e028fe0471ae6858a27" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:22.587383  5548 raft_consensus.cc:3032] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:21:22.587678  5419 raft_consensus.cc:3037] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:21:22.587836  5548 raft_consensus.cc:729] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:22.587126  5110 catalog_manager.cc:5495] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 reported cstate change: term changed from 2 to 3, leader changed from 356ae6f7ee30414e97fdef8340814baf (127.3.253.2) to c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1). New cstate: current_term: 3 leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:22.589118  5548 consensus_queue.cc:260] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:22.590955  5548 raft_consensus.cc:3037] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:21:22.595359  5419 raft_consensus.cc:2454] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 4.
I20260812 19:21:22.596838  5223 leader_election.cc:302] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:22.597592  5857 raft_consensus.cc:2781] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:21:22.598598  5857 raft_consensus.cc:686] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 LEADER]: Becoming Leader. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:22.600092  5548 raft_consensus.cc:2454] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 4.
I20260812 19:21:22.600636  5857 consensus_queue.cc:237] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } }
I20260812 19:21:22.613057  5110 catalog_manager.cc:5495] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 reported cstate change: term changed from 3 to 4, leader changed from 7a40385c10c04a1eba3767425715efb1 (127.3.253.3) to c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1). New cstate: current_term: 4 leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:22.730507  5868 raft_consensus.cc:979] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf: : Instructing follower c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:22.732059  5867 raft_consensus.cc:1067] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Signalling peer c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:22.734340  5284 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "db8e6b83637e4d049b4e905e64fe128a"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:53602
I20260812 19:21:22.734891  5284 raft_consensus.cc:482] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:22.735185  5284 raft_consensus.cc:3037] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:22.739861  5284 raft_consensus.cc:504] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:22.741505  5284 leader_election.cc:288] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 3 election: Requested vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:22.742522  5419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db8e6b83637e4d049b4e905e64fe128a" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:22.743184  5419 raft_consensus.cc:3032] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:21:22.743490  5419 raft_consensus.cc:729] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Running, Role: LEADER
I20260812 19:21:22.743456  5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db8e6b83637e4d049b4e905e64fe128a" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:22.744158  5548 raft_consensus.cc:3037] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:22.744540  5419 consensus_queue.cc:260] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:22.745926  5419 raft_consensus.cc:3037] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:22.750340  5548 raft_consensus.cc:2454] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 3.
I20260812 19:21:22.751272  5223 leader_election.cc:302] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a40385c10c04a1eba3767425715efb1, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:22.751829  5419 raft_consensus.cc:2454] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 3.
I20260812 19:21:22.752005  5857 raft_consensus.cc:2781] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:21:22.752744  5857 raft_consensus.cc:686] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 3 LEADER]: Becoming Leader. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:22.753938  5857 consensus_queue.cc:237] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:22.763731  5110 catalog_manager.cc:5495] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 reported cstate change: term changed from 2 to 3, leader changed from 356ae6f7ee30414e97fdef8340814baf (127.3.253.2) to c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1). New cstate: current_term: 3 leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:22.860690  5548 raft_consensus.cc:1261] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:21:22.862015  5857 consensus_queue.cc:1035] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:21:22.881945  5419 raft_consensus.cc:1261] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:21:22.883873  5869 consensus_queue.cc:1035] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:21:22.894405  5812 raft_consensus.cc:979] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1: : Instructing follower c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:22.894922  5812 raft_consensus.cc:1067] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 3 LEADER]: Signalling peer c4b010d4147f4b438ec1b520f84d9d93 to start an election
I20260812 19:21:22.896986  5284 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
 from {username='slave'} at 127.0.0.1:53600
I20260812 19:21:22.897428  5284 raft_consensus.cc:482] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:22.897680  5284 raft_consensus.cc:3037] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:21:22.904431  5284 raft_consensus.cc:504] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:22.905790  5284 leader_election.cc:288] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 4 election: Requested vote from peers 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:22.906900  5419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:22.907100  5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "c4b010d4147f4b438ec1b520f84d9d93" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:22.907451  5419 raft_consensus.cc:3037] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:21:22.907627  5548 raft_consensus.cc:3032] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:21:22.907946  5548 raft_consensus.cc:729] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:22.908627  5548 consensus_queue.cc:260] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:22.909482  5548 raft_consensus.cc:3037] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:21:22.912504  5419 raft_consensus.cc:2454] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 4.
I20260812 19:21:22.913913  5223 leader_election.cc:302] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:22.914748  5869 raft_consensus.cc:2781] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:21:22.915398  5869 raft_consensus.cc:686] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 LEADER]: Becoming Leader. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:22.915844  5548 raft_consensus.cc:2454] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b010d4147f4b438ec1b520f84d9d93 in term 4.
I20260812 19:21:22.917176  5869 consensus_queue.cc:237] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:22.927156  5110 catalog_manager.cc:5495] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 reported cstate change: term changed from 3 to 4, leader changed from 7a40385c10c04a1eba3767425715efb1 (127.3.253.3) to c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1). New cstate: current_term: 4 leader_uuid: "c4b010d4147f4b438ec1b520f84d9d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:23.042776  5548 raft_consensus.cc:1261] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 4 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 19:21:23.044116  5869 consensus_queue.cc:1035] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:21:23.056246  5419 raft_consensus.cc:1261] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [term 4 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 19:21:23.058337  5857 consensus_queue.cc:1035] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:21:23.061846  5548 raft_consensus.cc:1261] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:21:23.065752  5857 consensus_queue.cc:1035] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:21:23.082808  5419 raft_consensus.cc:1261] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:21:23.084528  5857 consensus_queue.cc:1035] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:21:23.221575  5419 raft_consensus.cc:1261] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:21:23.224014  5857 consensus_queue.cc:1035] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:21:23.240142  5548 raft_consensus.cc:1261] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:21:23.241751  5857 consensus_queue.cc:1035] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:21:23.357939  5548 raft_consensus.cc:1261] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 4 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 19:21:23.359118  5857 consensus_queue.cc:1035] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:21:23.368680  5421 raft_consensus.cc:1261] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 4 FOLLOWER]: Refusing update from remote peer c4b010d4147f4b438ec1b520f84d9d93: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 19:21:23.370572  5857 consensus_queue.cc:1035] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:21:25.454156  4084 auto_leader_rebalancer-test.cc:373] The leader distribution is 
I20260812 19:21:25.454825  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:25.461953  5284 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
mode: GRACEFUL
new_leader_uuid: "356ae6f7ee30414e97fdef8340814baf"
 from {username='slave'} at 127.0.0.1:37856
I20260812 19:21:25.462658  5284 raft_consensus.cc:595] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Received request to transfer leadership to TS 356ae6f7ee30414e97fdef8340814baf
I20260812 19:21:25.465370  5284 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
mode: GRACEFUL
new_leader_uuid: "7a40385c10c04a1eba3767425715efb1"
 from {username='slave'} at 127.0.0.1:37856
I20260812 19:21:25.465936  5284 raft_consensus.cc:595] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 LEADER]: Received request to transfer leadership to TS 7a40385c10c04a1eba3767425715efb1
I20260812 19:21:25.468251  5284 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
mode: GRACEFUL
new_leader_uuid: "7a40385c10c04a1eba3767425715efb1"
 from {username='slave'} at 127.0.0.1:37856
I20260812 19:21:25.468712  5284 raft_consensus.cc:595] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 LEADER]: Received request to transfer leadership to TS 7a40385c10c04a1eba3767425715efb1
I20260812 19:21:25.470919  5284 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "89608281e35945d88c5fbd969a02135a"
dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
mode: GRACEFUL
new_leader_uuid: "356ae6f7ee30414e97fdef8340814baf"
 from {username='slave'} at 127.0.0.1:37856
I20260812 19:21:25.471371  5284 raft_consensus.cc:595] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Received request to transfer leadership to TS 356ae6f7ee30414e97fdef8340814baf
I20260812 19:21:25.472517  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260812 19:21:25.473173  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:25.640352  5917 raft_consensus.cc:979] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93: : Instructing follower 356ae6f7ee30414e97fdef8340814baf to start an election
I20260812 19:21:25.640822  5918 raft_consensus.cc:1067] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Signalling peer 356ae6f7ee30414e97fdef8340814baf to start an election
I20260812 19:21:25.642191  5419 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7"
dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
 from {username='slave'} at 127.0.0.1:51836
I20260812 19:21:25.642607  5419 raft_consensus.cc:482] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:25.642902  5419 raft_consensus.cc:3037] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:25.648967  5419 raft_consensus.cc:504] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:25.650847  5419 leader_election.cc:288] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 3 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:25.651952  5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:25.651989  5284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d33a4ba5664054b80766af27c2e7a7" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:25.652643  5548 raft_consensus.cc:3037] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:25.652752  5284 raft_consensus.cc:3032] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:21:25.653079  5284 raft_consensus.cc:729] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:25.653709  5284 consensus_queue.cc:260] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:25.654773  5284 raft_consensus.cc:3037] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:25.657727  5548 raft_consensus.cc:2454] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 3.
I20260812 19:21:25.659086  5362 leader_election.cc:302] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1; no voters: 
I20260812 19:21:25.659719  5284 raft_consensus.cc:2454] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 3.
I20260812 19:21:25.659873  5883 raft_consensus.cc:2781] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:21:25.661116  5883 raft_consensus.cc:686] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 3 LEADER]: Becoming Leader. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Running, Role: LEADER
I20260812 19:21:25.662043  5883 consensus_queue.cc:237] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:25.668560  5104 catalog_manager.cc:5495] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf reported cstate change: term changed from 2 to 3, leader changed from c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1) to 356ae6f7ee30414e97fdef8340814baf (127.3.253.2). New cstate: current_term: 3 leader_uuid: "356ae6f7ee30414e97fdef8340814baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:25.740773  5917 raft_consensus.cc:979] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93: : Instructing follower 356ae6f7ee30414e97fdef8340814baf to start an election
I20260812 19:21:25.741274  5918 raft_consensus.cc:1067] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Signalling peer 356ae6f7ee30414e97fdef8340814baf to start an election
I20260812 19:21:25.742632  5419 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "89608281e35945d88c5fbd969a02135a"
dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
 from {username='slave'} at 127.0.0.1:51836
I20260812 19:21:25.743093  5419 raft_consensus.cc:482] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:25.743340  5419 raft_consensus.cc:3037] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:25.749310  5917 raft_consensus.cc:979] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93: : Instructing follower 7a40385c10c04a1eba3767425715efb1 to start an election
I20260812 19:21:25.749925  5918 raft_consensus.cc:1067] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 LEADER]: Signalling peer 7a40385c10c04a1eba3767425715efb1 to start an election
I20260812 19:21:25.750067  5419 raft_consensus.cc:504] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:25.751819  5548 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8"
dest_uuid: "7a40385c10c04a1eba3767425715efb1"
 from {username='slave'} at 127.0.0.1:48676
I20260812 19:21:25.752297  5548 raft_consensus.cc:482] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:25.752624  5548 raft_consensus.cc:3037] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:21:25.752864  5284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89608281e35945d88c5fbd969a02135a" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:25.753403  5284 raft_consensus.cc:3032] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:21:25.753708  5284 raft_consensus.cc:729] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:25.754303  5284 consensus_queue.cc:260] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:25.755208  5284 raft_consensus.cc:3037] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:25.758194  5548 raft_consensus.cc:504] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:25.753427  5547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89608281e35945d88c5fbd969a02135a" candidate_uuid: "356ae6f7ee30414e97fdef8340814baf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a40385c10c04a1eba3767425715efb1"
I20260812 19:21:25.752579  5419 leader_election.cc:288] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 3 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 7a40385c10c04a1eba3767425715efb1 (127.3.253.3:37579)
I20260812 19:21:25.758998  5547 raft_consensus.cc:3037] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:25.761148  5284 raft_consensus.cc:2454] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 3.
I20260812 19:21:25.762275  5276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:25.762375  5361 leader_election.cc:302] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, c4b010d4147f4b438ec1b520f84d9d93; no voters: 
I20260812 19:21:25.762316  5419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e800a4938b1453eb019bccef7a713e8" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:25.763141  5276 raft_consensus.cc:3032] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:21:25.763339  5419 raft_consensus.cc:3037] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:21:25.763463  5548 leader_election.cc:288] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 4 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:25.763464  5883 raft_consensus.cc:2781] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:21:25.763581  5276 raft_consensus.cc:729] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:25.764254  5883 raft_consensus.cc:686] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 3 LEADER]: Becoming Leader. State: Replica: 356ae6f7ee30414e97fdef8340814baf, State: Running, Role: LEADER
I20260812 19:21:25.765333  5883 consensus_queue.cc:237] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:25.764783  5276 consensus_queue.cc:260] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:25.767009  5276 raft_consensus.cc:3037] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:21:25.768224  5547 raft_consensus.cc:2454] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356ae6f7ee30414e97fdef8340814baf in term 3.
I20260812 19:21:25.771440  5419 raft_consensus.cc:2454] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 4.
I20260812 19:21:25.772890  5497 leader_election.cc:302] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1; no voters: 
I20260812 19:21:25.773921  5812 raft_consensus.cc:2781] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:21:25.774288  5104 catalog_manager.cc:5495] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf reported cstate change: term changed from 2 to 3, leader changed from c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1) to 356ae6f7ee30414e97fdef8340814baf (127.3.253.2). New cstate: current_term: 3 leader_uuid: "356ae6f7ee30414e97fdef8340814baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:25.775307  5812 raft_consensus.cc:686] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 4 LEADER]: Becoming Leader. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:25.775614  5276 raft_consensus.cc:2454] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 4.
I20260812 19:21:25.776073  5812 consensus_queue.cc:237] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:25.784757  5110 catalog_manager.cc:5495] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 reported cstate change: term changed from 3 to 4, leader changed from c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1) to 7a40385c10c04a1eba3767425715efb1 (127.3.253.3). New cstate: current_term: 4 leader_uuid: "7a40385c10c04a1eba3767425715efb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:25.792666  5918 raft_consensus.cc:979] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93: : Instructing follower 7a40385c10c04a1eba3767425715efb1 to start an election
I20260812 19:21:25.793316  5917 raft_consensus.cc:1067] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 LEADER]: Signalling peer 7a40385c10c04a1eba3767425715efb1 to start an election
I20260812 19:21:25.795112  5547 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07"
dest_uuid: "7a40385c10c04a1eba3767425715efb1"
 from {username='slave'} at 127.0.0.1:48676
I20260812 19:21:25.795579  5547 raft_consensus.cc:482] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:21:25.795863  5547 raft_consensus.cc:3037] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:21:25.800288  5547 raft_consensus.cc:504] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:25.801908  5547 leader_election.cc:288] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 5 election: Requested vote from peers c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149), 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217)
I20260812 19:21:25.802819  5276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c4b010d4147f4b438ec1b520f84d9d93"
I20260812 19:21:25.803014  5419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3fb5889a5d45ab890a37efa5dc6e07" candidate_uuid: "7a40385c10c04a1eba3767425715efb1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "356ae6f7ee30414e97fdef8340814baf"
I20260812 19:21:25.803352  5276 raft_consensus.cc:3032] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:21:25.803561  5419 raft_consensus.cc:3037] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:21:25.803704  5276 raft_consensus.cc:729] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c4b010d4147f4b438ec1b520f84d9d93, State: Running, Role: LEADER
I20260812 19:21:25.804561  5276 consensus_queue.cc:260] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:25.805593  5276 raft_consensus.cc:3037] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:21:25.808255  5419 raft_consensus.cc:2454] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 5.
I20260812 19:21:25.809352  5497 leader_election.cc:302] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356ae6f7ee30414e97fdef8340814baf, 7a40385c10c04a1eba3767425715efb1; no voters: 
I20260812 19:21:25.809866  5276 raft_consensus.cc:2454] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a40385c10c04a1eba3767425715efb1 in term 5.
I20260812 19:21:25.810060  5812 raft_consensus.cc:2781] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:21:25.810482  5812 raft_consensus.cc:686] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 5 LEADER]: Becoming Leader. State: Replica: 7a40385c10c04a1eba3767425715efb1, State: Running, Role: LEADER
I20260812 19:21:25.811275  5812 consensus_queue.cc:237] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } }
I20260812 19:21:25.817554  5110 catalog_manager.cc:5495] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 reported cstate change: term changed from 4 to 5, leader changed from c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1) to 7a40385c10c04a1eba3767425715efb1 (127.3.253.3). New cstate: current_term: 5 leader_uuid: "7a40385c10c04a1eba3767425715efb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:26.064982  5276 raft_consensus.cc:1261] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Refusing update from remote peer 356ae6f7ee30414e97fdef8340814baf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:21:26.066231  5883 consensus_queue.cc:1035] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:21:26.077137  5547 raft_consensus.cc:1261] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Refusing update from remote peer 356ae6f7ee30414e97fdef8340814baf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:21:26.078441  5883 consensus_queue.cc:1035] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:21:26.273590  5419 raft_consensus.cc:1261] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 4 FOLLOWER]: Refusing update from remote peer 7a40385c10c04a1eba3767425715efb1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 19:21:26.275089  5812 consensus_queue.cc:1035] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:21:26.276140  5276 raft_consensus.cc:1261] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Refusing update from remote peer 356ae6f7ee30414e97fdef8340814baf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:21:26.277501  5883 consensus_queue.cc:1035] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:21:26.289557  5276 raft_consensus.cc:1261] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 FOLLOWER]: Refusing update from remote peer 7a40385c10c04a1eba3767425715efb1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 19:21:26.292645  5547 raft_consensus.cc:1261] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Refusing update from remote peer 356ae6f7ee30414e97fdef8340814baf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:21:26.294840  5883 consensus_queue.cc:1035] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a40385c10c04a1eba3767425715efb1" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 37579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:21:26.297961  5933 consensus_queue.cc:1035] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:21:26.375703  5419 raft_consensus.cc:1261] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 5 FOLLOWER]: Refusing update from remote peer 7a40385c10c04a1eba3767425715efb1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260812 19:21:26.377413  5958 consensus_queue.cc:1035] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356ae6f7ee30414e97fdef8340814baf" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:21:26.388880  5276 raft_consensus.cc:1261] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 5 FOLLOWER]: Refusing update from remote peer 7a40385c10c04a1eba3767425715efb1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260812 19:21:26.390326  5958 consensus_queue.cc:1035] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b010d4147f4b438ec1b520f84d9d93" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:21:26.474135  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:26.479542  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:26.480017  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:27.480952  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:27.486240  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:27.486913  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:28.487845  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:28.492960  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:28.493383  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:29.494410  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:29.500114  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:29.500568  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:30.501544  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:30.507472  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:30.507910  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:31.508736  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:31.513852  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:31.514288  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:32.515228  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:32.520479  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:32.520917  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:33.522117  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:33.528693  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:33.529198  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:34.530026  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:21:34.535876  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:21:34.536314  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:21:35.572608  4084 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260812 19:21:35.575690  4084 tablet_server.cc:178] TabletServer@127.3.253.1:0 shutting down...
W20260812 19:21:35.577658  5361 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260812 19:21:35.586292  5361 consensus_peers.cc:487] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf -> Peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Couldn't send request to peer c4b010d4147f4b438ec1b520f84d9d93. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:21:35.618428  5495 consensus_peers.cc:487] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 -> Peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Couldn't send request to peer c4b010d4147f4b438ec1b520f84d9d93. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:21:35.880905  5495 consensus_peers.cc:487] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 -> Peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Couldn't send request to peer c4b010d4147f4b438ec1b520f84d9d93. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:21:35.882054  5361 consensus_peers.cc:487] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf -> Peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Couldn't send request to peer c4b010d4147f4b438ec1b520f84d9d93. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:21:35.882843  5495 consensus_peers.cc:487] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 -> Peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Couldn't send request to peer c4b010d4147f4b438ec1b520f84d9d93. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:35.895586  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:21:35.896345  4084 tablet_replica.cc:330] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93: stopping tablet replica
I20260812 19:21:35.897367  4084 raft_consensus.cc:2229] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:35.898237  4084 raft_consensus.cc:2258] T 4a3fb5889a5d45ab890a37efa5dc6e07 P c4b010d4147f4b438ec1b520f84d9d93 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:35.900367  4084 tablet_replica.cc:330] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93: stopping tablet replica
I20260812 19:21:35.900878  4084 raft_consensus.cc:2229] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:35.901288  4084 raft_consensus.cc:2258] T 31d33a4ba5664054b80766af27c2e7a7 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:35.903218  4084 tablet_replica.cc:330] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93: stopping tablet replica
I20260812 19:21:35.903668  4084 raft_consensus.cc:2229] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:21:35.904496  4084 raft_consensus.cc:2258] T 2d34a1970c2b4eb2b9ad047662a2f45b P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:35.906138  4084 tablet_replica.cc:330] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93: stopping tablet replica
I20260812 19:21:35.906574  4084 raft_consensus.cc:2229] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:21:35.907385  4084 raft_consensus.cc:2258] T 3b940c5579654cb4bfa011d2fb201021 P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:35.908986  4084 tablet_replica.cc:330] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93: stopping tablet replica
I20260812 19:21:35.909420  4084 raft_consensus.cc:2229] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:35.909809  4084 raft_consensus.cc:2258] T 89608281e35945d88c5fbd969a02135a P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:35.911535  4084 tablet_replica.cc:330] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93: stopping tablet replica
I20260812 19:21:35.911947  4084 raft_consensus.cc:2229] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:35.912328  4084 raft_consensus.cc:2258] T 8e7c4f90fea34a52aa0b66da6ddb052e P c4b010d4147f4b438ec1b520f84d9d93 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:35.914126  4084 tablet_replica.cc:330] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93: stopping tablet replica
I20260812 19:21:35.914598  4084 raft_consensus.cc:2229] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:21:35.915594  4084 raft_consensus.cc:2258] T db8e6b83637e4d049b4e905e64fe128a P c4b010d4147f4b438ec1b520f84d9d93 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:35.917646  4084 tablet_replica.cc:330] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93: stopping tablet replica
I20260812 19:21:35.918044  4084 raft_consensus.cc:2229] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:35.918412  4084 raft_consensus.cc:2258] T dced490192de4aaca7dccacdfded1596 P c4b010d4147f4b438ec1b520f84d9d93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:35.920115  4084 tablet_replica.cc:330] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93: stopping tablet replica
I20260812 19:21:35.920600  4084 raft_consensus.cc:2229] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:35.921057  4084 raft_consensus.cc:2258] T 3e800a4938b1453eb019bccef7a713e8 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:35.922905  4084 tablet_replica.cc:330] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93: stopping tablet replica
I20260812 19:21:35.923317  4084 raft_consensus.cc:2229] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 LEADER]: Raft consensus shutting down.
I20260812 19:21:35.924077  4084 raft_consensus.cc:2258] T 7ae788179bfc4e028fe0471ae6858a27 P c4b010d4147f4b438ec1b520f84d9d93 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:35.957082  4084 tablet_server.cc:194] TabletServer@127.3.253.1:0 shutdown complete.
I20260812 19:21:35.988318  4084 tablet_server.cc:178] TabletServer@127.3.253.2:0 shutting down...
W20260812 19:21:36.007184  5361 consensus_peers.cc:487] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf -> Peer c4b010d4147f4b438ec1b520f84d9d93 (127.3.253.1:46149): Couldn't send request to peer c4b010d4147f4b438ec1b520f84d9d93. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:36.025664  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:21:36.026484  4084 tablet_replica.cc:330] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf: stopping tablet replica
I20260812 19:21:36.027312  4084 raft_consensus.cc:2229] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:36.027925  4084 raft_consensus.cc:2258] T db8e6b83637e4d049b4e905e64fe128a P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.030265  4084 tablet_replica.cc:330] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf: stopping tablet replica
I20260812 19:21:36.030911  4084 raft_consensus.cc:2229] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:36.031466  4084 raft_consensus.cc:2258] T 7ae788179bfc4e028fe0471ae6858a27 P 356ae6f7ee30414e97fdef8340814baf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.033919  4084 tablet_replica.cc:330] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf: stopping tablet replica
I20260812 19:21:36.034657  4084 raft_consensus.cc:2229] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:36.035195  4084 raft_consensus.cc:2258] T 3b940c5579654cb4bfa011d2fb201021 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.036948  4084 tablet_replica.cc:330] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf: stopping tablet replica
I20260812 19:21:36.037462  4084 raft_consensus.cc:2229] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:21:36.038340  4084 raft_consensus.cc:2258] T 31d33a4ba5664054b80766af27c2e7a7 P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.040155  4084 tablet_replica.cc:330] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf: stopping tablet replica
I20260812 19:21:36.040650  4084 raft_consensus.cc:2229] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:21:36.041450  4084 raft_consensus.cc:2258] T 8e7c4f90fea34a52aa0b66da6ddb052e P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.043455  4084 tablet_replica.cc:330] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf: stopping tablet replica
I20260812 19:21:36.044131  4084 raft_consensus.cc:2229] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:21:36.044940  4084 raft_consensus.cc:2258] T 89608281e35945d88c5fbd969a02135a P 356ae6f7ee30414e97fdef8340814baf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.046896  4084 tablet_replica.cc:330] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf: stopping tablet replica
I20260812 19:21:36.047394  4084 raft_consensus.cc:2229] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:36.047864  4084 raft_consensus.cc:2258] T 2d34a1970c2b4eb2b9ad047662a2f45b P 356ae6f7ee30414e97fdef8340814baf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.049541  4084 tablet_replica.cc:330] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf: stopping tablet replica
I20260812 19:21:36.049953  4084 raft_consensus.cc:2229] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:36.050379  4084 raft_consensus.cc:2258] T 3e800a4938b1453eb019bccef7a713e8 P 356ae6f7ee30414e97fdef8340814baf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.051923  4084 tablet_replica.cc:330] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf: stopping tablet replica
I20260812 19:21:36.052315  4084 raft_consensus.cc:2229] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:36.052682  4084 raft_consensus.cc:2258] T dced490192de4aaca7dccacdfded1596 P 356ae6f7ee30414e97fdef8340814baf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.054358  4084 tablet_replica.cc:330] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf: stopping tablet replica
I20260812 19:21:36.054811  4084 raft_consensus.cc:2229] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 5 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:36.055296  4084 raft_consensus.cc:2258] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 356ae6f7ee30414e97fdef8340814baf [term 5 FOLLOWER]: Raft consensus is shut down!
W20260812 19:21:36.065575  5497 consensus_peers.cc:487] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 -> Peer 356ae6f7ee30414e97fdef8340814baf (127.3.253.2:34217): Couldn't send request to peer 356ae6f7ee30414e97fdef8340814baf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:36.088553  4084 tablet_server.cc:194] TabletServer@127.3.253.2:0 shutdown complete.
I20260812 19:21:36.114956  4084 tablet_server.cc:178] TabletServer@127.3.253.3:0 shutting down...
I20260812 19:21:36.143052  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:21:36.143854  4084 tablet_replica.cc:330] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1: stopping tablet replica
I20260812 19:21:36.144577  4084 raft_consensus.cc:2229] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 5 LEADER]: Raft consensus shutting down.
I20260812 19:21:36.145514  4084 raft_consensus.cc:2258] T 4a3fb5889a5d45ab890a37efa5dc6e07 P 7a40385c10c04a1eba3767425715efb1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.147468  4084 tablet_replica.cc:330] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1: stopping tablet replica
I20260812 19:21:36.147996  4084 raft_consensus.cc:2229] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:36.148473  4084 raft_consensus.cc:2258] T 3b940c5579654cb4bfa011d2fb201021 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.150179  4084 tablet_replica.cc:330] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1: stopping tablet replica
I20260812 19:21:36.150732  4084 raft_consensus.cc:2229] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:21:36.151526  4084 raft_consensus.cc:2258] T dced490192de4aaca7dccacdfded1596 P 7a40385c10c04a1eba3767425715efb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.153188  4084 tablet_replica.cc:330] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1: stopping tablet replica
I20260812 19:21:36.153681  4084 raft_consensus.cc:2229] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 4 LEADER]: Raft consensus shutting down.
I20260812 19:21:36.154433  4084 raft_consensus.cc:2258] T 3e800a4938b1453eb019bccef7a713e8 P 7a40385c10c04a1eba3767425715efb1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.156128  4084 tablet_replica.cc:330] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1: stopping tablet replica
I20260812 19:21:36.156648  4084 raft_consensus.cc:2229] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:36.157061  4084 raft_consensus.cc:2258] T db8e6b83637e4d049b4e905e64fe128a P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.158799  4084 tablet_replica.cc:330] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1: stopping tablet replica
I20260812 19:21:36.159281  4084 raft_consensus.cc:2229] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:36.159690  4084 raft_consensus.cc:2258] T 31d33a4ba5664054b80766af27c2e7a7 P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.161412  4084 tablet_replica.cc:330] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1: stopping tablet replica
I20260812 19:21:36.161864  4084 raft_consensus.cc:2229] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:36.162267  4084 raft_consensus.cc:2258] T 7ae788179bfc4e028fe0471ae6858a27 P 7a40385c10c04a1eba3767425715efb1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.163888  4084 tablet_replica.cc:330] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1: stopping tablet replica
I20260812 19:21:36.164346  4084 raft_consensus.cc:2229] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:36.164811  4084 raft_consensus.cc:2258] T 8e7c4f90fea34a52aa0b66da6ddb052e P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.166422  4084 tablet_replica.cc:330] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1: stopping tablet replica
I20260812 19:21:36.166934  4084 raft_consensus.cc:2229] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:36.167380  4084 raft_consensus.cc:2258] T 89608281e35945d88c5fbd969a02135a P 7a40385c10c04a1eba3767425715efb1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.168903  4084 tablet_replica.cc:330] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1: stopping tablet replica
I20260812 19:21:36.169335  4084 raft_consensus.cc:2229] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:36.169782  4084 raft_consensus.cc:2258] T 2d34a1970c2b4eb2b9ad047662a2f45b P 7a40385c10c04a1eba3767425715efb1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.198958  4084 tablet_server.cc:194] TabletServer@127.3.253.3:0 shutdown complete.
I20260812 19:21:36.221182  4084 master.cc:537] Master@127.3.253.62:41975 shutting down...
I20260812 19:21:36.246905  4084 raft_consensus.cc:2229] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:21:36.247570  4084 raft_consensus.cc:2258] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:36.247982  4084 tablet_replica.cc:330] T 00000000000000000000000000000000 P fb341fdbc9f44ea28e2e1688407d3264: stopping tablet replica
W20260812 19:21:36.694794  5168 debug-util.cc:398] Leaking SignalData structure 0x7b080004d900 after lost signal to thread 4090
W20260812 19:21:37.265211  4084 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 5168)
W20260812 19:21:38.265729  4084 thread.cc:536] Waited for 2000ms trying to join with diag-logger (tid 5168)
I20260812 19:21:39.003772  4084 master.cc:552] Master@127.3.253.62:41975 shutdown complete.
356ae6f7ee30414e97fdef8340814baf  4
7a40385c10c04a1eba3767425715efb1  1
c4b010d4147f4b438ec1b520f84d9d93  5
356ae6f7ee30414e97fdef8340814baf  4
7a40385c10c04a1eba3767425715efb1  3
c4b010d4147f4b438ec1b520f84d9d93  3
356ae6f7ee30414e97fdef8340814baf  1
7a40385c10c04a1eba3767425715efb1  1
c4b010d4147f4b438ec1b520f84d9d93  8
356ae6f7ee30414e97fdef8340814baf  3
7a40385c10c04a1eba3767425715efb1  3
c4b010d4147f4b438ec1b520f84d9d93  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (32854 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260812 19:21:39.053385  4084 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.253.62:46555
I20260812 19:21:39.054559  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:21:39.060719  6013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:39.061715  6014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:39.062153  6016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:21:39.063031  4084 server_base.cc:1034] running on GCE node
I20260812 19:21:39.064129  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:21:39.064317  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:21:39.064491  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562499064479 us; error 0 us; skew 500 ppm
I20260812 19:21:39.065078  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:21:39.067801  4084 webserver.cc:460] Webserver started at http://127.3.253.62:40347/ using document root <none> and password file <none>
I20260812 19:21:39.068312  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:21:39.068524  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:21:39.068838  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:21:39.070117  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/master-0-root/instance:
uuid: "4483e3a69e644cbea699c6f7c9c1da9e"
format_stamp: "Formatted at 2026-08-12 19:21:39 on dist-test-slave-3kk6"
I20260812 19:21:39.075409  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260812 19:21:39.079253  6025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:39.080199  4084 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260812 19:21:39.080516  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/master-0-root
uuid: "4483e3a69e644cbea699c6f7c9c1da9e"
format_stamp: "Formatted at 2026-08-12 19:21:39 on dist-test-slave-3kk6"
I20260812 19:21:39.080782  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:21:39.093815  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:21:39.095274  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:21:39.137154  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.62:46555
I20260812 19:21:39.137279  6116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.62:46555 every 8 connection(s)
I20260812 19:21:39.141347  6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.151619  6118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Bootstrap starting.
I20260812 19:21:39.156111  6118 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:39.160666  6118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: No bootstrap required, opened a new log
I20260812 19:21:39.162837  6118 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4483e3a69e644cbea699c6f7c9c1da9e" member_type: VOTER }
I20260812 19:21:39.163326  6118 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:39.163581  6118 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4483e3a69e644cbea699c6f7c9c1da9e, State: Initialized, Role: FOLLOWER
I20260812 19:21:39.164291  6118 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4483e3a69e644cbea699c6f7c9c1da9e" member_type: VOTER }
I20260812 19:21:39.164747  6118 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 19:21:39.165016  6118 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 19:21:39.165328  6118 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:39.169719  6118 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4483e3a69e644cbea699c6f7c9c1da9e" member_type: VOTER }
I20260812 19:21:39.170291  6118 leader_election.cc:302] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4483e3a69e644cbea699c6f7c9c1da9e; no voters: 
I20260812 19:21:39.171571  6118 leader_election.cc:288] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 19:21:39.172060  6124 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:39.173533  6124 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [term 1 LEADER]: Becoming Leader. State: Replica: 4483e3a69e644cbea699c6f7c9c1da9e, State: Running, Role: LEADER
I20260812 19:21:39.174163  6124 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4483e3a69e644cbea699c6f7c9c1da9e" member_type: VOTER }
I20260812 19:21:39.174692  6118 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 19:21:39.179920  6125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4483e3a69e644cbea699c6f7c9c1da9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4483e3a69e644cbea699c6f7c9c1da9e" member_type: VOTER } }
I20260812 19:21:39.180163  6126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4483e3a69e644cbea699c6f7c9c1da9e. Latest consensus state: current_term: 1 leader_uuid: "4483e3a69e644cbea699c6f7c9c1da9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4483e3a69e644cbea699c6f7c9c1da9e" member_type: VOTER } }
I20260812 19:21:39.180855  6125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [sys.catalog]: This master's current role is: LEADER
I20260812 19:21:39.180948  6126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [sys.catalog]: This master's current role is: LEADER
I20260812 19:21:39.183955  6136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 19:21:39.189812  6136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 19:21:39.192123  4084 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 19:21:39.199653  6136 catalog_manager.cc:1347] Generated new cluster ID: a1c1a00843dc446199e4ad1807bc8383
I20260812 19:21:39.199990  6136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:21:39.257898  6136 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 19:21:39.259758  6136 catalog_manager.cc:1504] Loading token signing keys...
I20260812 19:21:39.275907  6136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Generated new TSK 0
I20260812 19:21:39.276778  6136 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:21:39.323875  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:21:39.330233  6155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:39.331627  6156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:21:39.333931  4084 server_base.cc:1034] running on GCE node
W20260812 19:21:39.334259  6161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:21:39.335418  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:21:39.335623  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:21:39.335840  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562499335808 us; error 0 us; skew 500 ppm
I20260812 19:21:39.336427  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:21:39.339303  4084 webserver.cc:460] Webserver started at http://127.3.253.1:37081/ using document root <none> and password file <none>
I20260812 19:21:39.339865  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:21:39.340080  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:21:39.340384  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:21:39.341630  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-0-root/instance:
uuid: "a1541d11be514114966dc1e92a345298"
format_stamp: "Formatted at 2026-08-12 19:21:39 on dist-test-slave-3kk6"
I20260812 19:21:39.346757  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260812 19:21:39.350299  6170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:39.351284  4084 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 19:21:39.351629  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-0-root
uuid: "a1541d11be514114966dc1e92a345298"
format_stamp: "Formatted at 2026-08-12 19:21:39 on dist-test-slave-3kk6"
I20260812 19:21:39.351956  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:21:39.369489  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:21:39.370802  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:21:39.372371  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:21:39.374835  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:21:39.375070  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:39.375322  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:21:39.375499  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:39.418553  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.1:46707
I20260812 19:21:39.418754  6272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.1:46707 every 8 connection(s)
I20260812 19:21:39.423244  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:21:39.431689  6278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:39.434808  6284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:39.435781  6287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:21:39.436398  4084 server_base.cc:1034] running on GCE node
I20260812 19:21:39.438685  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:21:39.438949  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:21:39.439102  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562499439093 us; error 0 us; skew 500 ppm
I20260812 19:21:39.439738  6273 heartbeater.cc:347] Connected to a master server at 127.3.253.62:46555
I20260812 19:21:39.439824  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:21:39.440227  6273 heartbeater.cc:464] Registering TS with master...
I20260812 19:21:39.441145  6273 heartbeater.cc:511] Master 127.3.253.62:46555 requested a full tablet report, sending...
I20260812 19:21:39.443009  4084 webserver.cc:460] Webserver started at http://127.3.253.2:34941/ using document root <none> and password file <none>
I20260812 19:21:39.443531  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:21:39.443495  6060 ts_manager.cc:194] Registered new tserver with Master: a1541d11be514114966dc1e92a345298 (127.3.253.1:46707)
I20260812 19:21:39.443888  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:21:39.444197  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:21:39.445392  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-1-root/instance:
uuid: "54f83319db6b49929cc8f18a66a66975"
format_stamp: "Formatted at 2026-08-12 19:21:39 on dist-test-slave-3kk6"
I20260812 19:21:39.445727  6060 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38508
I20260812 19:21:39.450326  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.007s
I20260812 19:21:39.454322  6293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:39.455262  4084 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 19:21:39.455510  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-1-root
uuid: "54f83319db6b49929cc8f18a66a66975"
format_stamp: "Formatted at 2026-08-12 19:21:39 on dist-test-slave-3kk6"
I20260812 19:21:39.455756  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:21:39.470849  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:21:39.472249  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:21:39.473901  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:21:39.476488  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:21:39.476683  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:39.476992  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:21:39.477159  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:39.524902  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.2:39969
I20260812 19:21:39.525038  6399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.2:39969 every 8 connection(s)
I20260812 19:21:39.530290  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:21:39.538700  6403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:39.540242  6404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:39.543505  6406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:21:39.545946  4084 server_base.cc:1034] running on GCE node
I20260812 19:21:39.546149  6400 heartbeater.cc:347] Connected to a master server at 127.3.253.62:46555
I20260812 19:21:39.546602  6400 heartbeater.cc:464] Registering TS with master...
I20260812 19:21:39.546996  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:21:39.547194  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:21:39.547410  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562499547379 us; error 0 us; skew 500 ppm
I20260812 19:21:39.547508  6400 heartbeater.cc:511] Master 127.3.253.62:46555 requested a full tablet report, sending...
I20260812 19:21:39.548017  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:21:39.550069  6060 ts_manager.cc:194] Registered new tserver with Master: 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:39.550840  4084 webserver.cc:460] Webserver started at http://127.3.253.3:43273/ using document root <none> and password file <none>
I20260812 19:21:39.551349  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:21:39.551604  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:21:39.551966  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:21:39.552253  6060 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38512
I20260812 19:21:39.553414  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-2-root/instance:
uuid: "bdfa5579d4534c618c00db6b4a841c81"
format_stamp: "Formatted at 2026-08-12 19:21:39 on dist-test-slave-3kk6"
I20260812 19:21:39.558238  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260812 19:21:39.561820  6412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:39.562611  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 19:21:39.562984  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-2-root
uuid: "bdfa5579d4534c618c00db6b4a841c81"
format_stamp: "Formatted at 2026-08-12 19:21:39 on dist-test-slave-3kk6"
I20260812 19:21:39.563285  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:21:39.574918  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:21:39.576303  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:21:39.577879  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:21:39.580061  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:21:39.580272  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:39.580510  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:21:39.580672  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:39.630429  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.3:42599
I20260812 19:21:39.630550  6521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.3:42599 every 8 connection(s)
I20260812 19:21:39.647352  6522 heartbeater.cc:347] Connected to a master server at 127.3.253.62:46555
I20260812 19:21:39.647778  6522 heartbeater.cc:464] Registering TS with master...
I20260812 19:21:39.648488  6522 heartbeater.cc:511] Master 127.3.253.62:46555 requested a full tablet report, sending...
I20260812 19:21:39.650607  6060 ts_manager.cc:194] Registered new tserver with Master: bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:39.651424  4084 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017349505s
I20260812 19:21:39.653026  6060 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38524
I20260812 19:21:39.654836  4084 test_util.cc:268] Using random seed: 2133406872
I20260812 19:21:39.684427  6060 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38532:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 19:21:39.690953  6060 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:21:39.906740  6223 tablet_service.cc:1467] Processing CreateTablet for tablet 82ee24e5b3dd4df3bd9647d68d3ced5e (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260812 19:21:39.908421  6223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82ee24e5b3dd4df3bd9647d68d3ced5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.917322  6210 tablet_service.cc:1467] Processing CreateTablet for tablet f1b6d90aaa384b5fb66f3320981f1aa0 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260812 19:21:39.917747  6209 tablet_service.cc:1467] Processing CreateTablet for tablet 3bc485edcf4e4bbc84bff9c14c471284 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260812 19:21:39.912014  6219 tablet_service.cc:1467] Processing CreateTablet for tablet d1275ccc06f94fcdaa82a73420569651 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260812 19:21:39.918922  6210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1b6d90aaa384b5fb66f3320981f1aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.914292  6218 tablet_service.cc:1467] Processing CreateTablet for tablet 7e0797ad50cb46cfb10b4a38cc815917 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260812 19:21:39.915010  6212 tablet_service.cc:1467] Processing CreateTablet for tablet 6554cc94d5d248589dde19ca72bd508a (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260812 19:21:39.916697  6215 tablet_service.cc:1467] Processing CreateTablet for tablet c8fcb9244e2242f0bb95ee6cb9a69d50 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260812 19:21:39.920089  6208 tablet_service.cc:1467] Processing CreateTablet for tablet ff48be70624f412e9bf485b5e489adf3 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260812 19:21:39.920899  6218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e0797ad50cb46cfb10b4a38cc815917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.921525  6215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8fcb9244e2242f0bb95ee6cb9a69d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.922551  6207 tablet_service.cc:1467] Processing CreateTablet for tablet bacc9fc105004c639dc9ed487bd8dd97 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260812 19:21:39.923064  6212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6554cc94d5d248589dde19ca72bd508a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.923959  6207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bacc9fc105004c639dc9ed487bd8dd97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.926227  6206 tablet_service.cc:1467] Processing CreateTablet for tablet 4eac496b52764773a5bb2dceffc30dc3 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260812 19:21:39.927067  6219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1275ccc06f94fcdaa82a73420569651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.927749  6206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4eac496b52764773a5bb2dceffc30dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.934482  6209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bc485edcf4e4bbc84bff9c14c471284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.939605  6208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff48be70624f412e9bf485b5e489adf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.950030  6219 tablet_service.cc:1467] Processing CreateTablet for tablet e47beaf4e3f74103977b8ba04492ff79 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260812 19:21:39.955315  6219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e47beaf4e3f74103977b8ba04492ff79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.973201  6210 tablet_service.cc:1467] Processing CreateTablet for tablet 6f50bde12f2b4852a014b508724cf2ca (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260812 19:21:39.973618  6219 tablet_service.cc:1467] Processing CreateTablet for tablet 9444dc5105264169a510f4261e7a1f40 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260812 19:21:39.981810  6210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f50bde12f2b4852a014b508724cf2ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.981833  6341 tablet_service.cc:1467] Processing CreateTablet for tablet 82ee24e5b3dd4df3bd9647d68d3ced5e (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260812 19:21:39.983536  6341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82ee24e5b3dd4df3bd9647d68d3ced5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.984011  6339 tablet_service.cc:1467] Processing CreateTablet for tablet d1275ccc06f94fcdaa82a73420569651 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260812 19:21:39.985601  6339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1275ccc06f94fcdaa82a73420569651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.988972  6462 tablet_service.cc:1467] Processing CreateTablet for tablet d1275ccc06f94fcdaa82a73420569651 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260812 19:21:39.990303  6453 tablet_service.cc:1467] Processing CreateTablet for tablet 6554cc94d5d248589dde19ca72bd508a (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260812 19:21:39.991976  6457 tablet_service.cc:1467] Processing CreateTablet for tablet 7e0797ad50cb46cfb10b4a38cc815917 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260812 19:21:39.993366  6337 tablet_service.cc:1467] Processing CreateTablet for tablet c8fcb9244e2242f0bb95ee6cb9a69d50 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260812 19:21:39.990531  6462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1275ccc06f94fcdaa82a73420569651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.995095  6453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6554cc94d5d248589dde19ca72bd508a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.995245  6209 tablet_service.cc:1467] Processing CreateTablet for tablet b02969fd01604c6eb8dad2ecb92d0224 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260812 19:21:39.995563  6452 tablet_service.cc:1467] Processing CreateTablet for tablet f1b6d90aaa384b5fb66f3320981f1aa0 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260812 19:21:39.996622  6449 tablet_service.cc:1467] Processing CreateTablet for tablet ff48be70624f412e9bf485b5e489adf3 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260812 19:21:39.998641  6463 tablet_service.cc:1467] Processing CreateTablet for tablet 82ee24e5b3dd4df3bd9647d68d3ced5e (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260812 19:21:39.999140  6447 tablet_service.cc:1467] Processing CreateTablet for tablet bacc9fc105004c639dc9ed487bd8dd97 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260812 19:21:40.001014  6336 tablet_service.cc:1467] Processing CreateTablet for tablet 6554cc94d5d248589dde19ca72bd508a (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260812 19:21:40.001434  6450 tablet_service.cc:1467] Processing CreateTablet for tablet 3bc485edcf4e4bbc84bff9c14c471284 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260812 19:21:39.991976  6338 tablet_service.cc:1467] Processing CreateTablet for tablet 7e0797ad50cb46cfb10b4a38cc815917 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260812 19:21:40.003096  6454 tablet_service.cc:1467] Processing CreateTablet for tablet c8fcb9244e2242f0bb95ee6cb9a69d50 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260812 19:21:40.003669  6337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8fcb9244e2242f0bb95ee6cb9a69d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.996624  6209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b02969fd01604c6eb8dad2ecb92d0224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:39.997189  6452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1b6d90aaa384b5fb66f3320981f1aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.011328  6454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8fcb9244e2242f0bb95ee6cb9a69d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.009204  6334 tablet_service.cc:1467] Processing CreateTablet for tablet f1b6d90aaa384b5fb66f3320981f1aa0 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260812 19:21:40.011225  6330 tablet_service.cc:1467] Processing CreateTablet for tablet ff48be70624f412e9bf485b5e489adf3 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260812 19:21:40.012578  6334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1b6d90aaa384b5fb66f3320981f1aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.013823  6327 tablet_service.cc:1467] Processing CreateTablet for tablet bacc9fc105004c639dc9ed487bd8dd97 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260812 19:21:40.009258  6331 tablet_service.cc:1467] Processing CreateTablet for tablet 3bc485edcf4e4bbc84bff9c14c471284 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260812 19:21:40.015110  6457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e0797ad50cb46cfb10b4a38cc815917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.015357  6327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bacc9fc105004c639dc9ed487bd8dd97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.015764  6450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bc485edcf4e4bbc84bff9c14c471284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.017450  6463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82ee24e5b3dd4df3bd9647d68d3ced5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.017515  6331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bc485edcf4e4bbc84bff9c14c471284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.018221  6449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff48be70624f412e9bf485b5e489adf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.017993  6325 tablet_service.cc:1467] Processing CreateTablet for tablet 4eac496b52764773a5bb2dceffc30dc3 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260812 19:21:40.019490  6325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4eac496b52764773a5bb2dceffc30dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.020848  6330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff48be70624f412e9bf485b5e489adf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.021746  6447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bacc9fc105004c639dc9ed487bd8dd97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.028422  6444 tablet_service.cc:1467] Processing CreateTablet for tablet 4eac496b52764773a5bb2dceffc30dc3 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260812 19:21:40.030009  6444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4eac496b52764773a5bb2dceffc30dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.041065  6544 tablet_bootstrap.cc:492] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:40.054715  6207 tablet_service.cc:1467] Processing CreateTablet for tablet aa4b7bb14bdb4198a276add34849a84e (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260812 19:21:40.056129  6336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6554cc94d5d248589dde19ca72bd508a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.063891  6338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e0797ad50cb46cfb10b4a38cc815917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.076606  6223 tablet_service.cc:1467] Processing CreateTablet for tablet 9e38bc4707784979b4d00b45879a8f0b (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260812 19:21:40.082254  6215 tablet_service.cc:1467] Processing CreateTablet for tablet fd2a75ee87424ce9809bec32f2ae38fa (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260812 19:21:40.103047  6208 tablet_service.cc:1467] Processing CreateTablet for tablet f2920c51f14548a48637e645e719d9cd (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260812 19:21:40.104533  6207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa4b7bb14bdb4198a276add34849a84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.108798  6544 tablet_bootstrap.cc:654] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:40.046557  6206 tablet_service.cc:1467] Processing CreateTablet for tablet d3d1eb75377449c8b2ea3ee9e6622404 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260812 19:21:40.118289  6219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9444dc5105264169a510f4261e7a1f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.120391  6208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2920c51f14548a48637e645e719d9cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.121304  6341 tablet_service.cc:1467] Processing CreateTablet for tablet e47beaf4e3f74103977b8ba04492ff79 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260812 19:21:40.122880  6341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e47beaf4e3f74103977b8ba04492ff79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.125959  6210 tablet_service.cc:1467] Processing CreateTablet for tablet b231cd9f80874e2dbe40dcd1f4c8e1f4 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260812 19:21:40.127413  6210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b231cd9f80874e2dbe40dcd1f4c8e1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.140079  6215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd2a75ee87424ce9809bec32f2ae38fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.139930  6212 tablet_service.cc:1467] Processing CreateTablet for tablet f7798b18b2fb4b0baa349294c1006e91 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260812 19:21:40.141860  6212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7798b18b2fb4b0baa349294c1006e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.144631  6206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3d1eb75377449c8b2ea3ee9e6622404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.146337  6223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e38bc4707784979b4d00b45879a8f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.131992  6463 tablet_service.cc:1467] Processing CreateTablet for tablet e47beaf4e3f74103977b8ba04492ff79 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260812 19:21:40.150488  6463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e47beaf4e3f74103977b8ba04492ff79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.176810  6453 tablet_service.cc:1467] Processing CreateTablet for tablet b231cd9f80874e2dbe40dcd1f4c8e1f4 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260812 19:21:40.179745  6447 tablet_service.cc:1467] Processing CreateTablet for tablet 9444dc5105264169a510f4261e7a1f40 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260812 19:21:40.183656  6331 tablet_service.cc:1467] Processing CreateTablet for tablet 9444dc5105264169a510f4261e7a1f40 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260812 19:21:40.186136  6334 tablet_service.cc:1467] Processing CreateTablet for tablet 6f50bde12f2b4852a014b508724cf2ca (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
W20260812 19:21:40.188041  6138 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:21:40.189576  6330 tablet_service.cc:1467] Processing CreateTablet for tablet b02969fd01604c6eb8dad2ecb92d0224 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260812 19:21:40.151667  6209 tablet_service.cc:1467] Processing CreateTablet for tablet 1e69ce57e6c74dea9e207b6ae03c43b2 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260812 19:21:40.199731  6209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e69ce57e6c74dea9e207b6ae03c43b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.178431  6452 tablet_service.cc:1467] Processing CreateTablet for tablet 6f50bde12f2b4852a014b508724cf2ca (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260812 19:21:40.202945  6331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9444dc5105264169a510f4261e7a1f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.204349  6330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b02969fd01604c6eb8dad2ecb92d0224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.203531  6223 tablet_service.cc:1467] Processing CreateTablet for tablet c4c2eb0bf29b48b3ae29c175fe03718f (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260812 19:21:40.207113  6334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f50bde12f2b4852a014b508724cf2ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.207253  6223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4c2eb0bf29b48b3ae29c175fe03718f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.236650  6453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b231cd9f80874e2dbe40dcd1f4c8e1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.237394  6452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f50bde12f2b4852a014b508724cf2ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.238052  6447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9444dc5105264169a510f4261e7a1f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.240703  6212 tablet_service.cc:1467] Processing CreateTablet for tablet 5bf9c8ef81414ede8e942ee03b95a816 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260812 19:21:40.243844  6210 tablet_service.cc:1467] Processing CreateTablet for tablet 95d32ece4a8c43b6a779d59f9981db43 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260812 19:21:40.245421  6210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95d32ece4a8c43b6a779d59f9981db43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.248728  6212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bf9c8ef81414ede8e942ee03b95a816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.253120  6341 tablet_service.cc:1467] Processing CreateTablet for tablet aa4b7bb14bdb4198a276add34849a84e (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260812 19:21:40.254787  6218 tablet_service.cc:1467] Processing CreateTablet for tablet 4995e2d6140a4fa3a2dadad444b9a924 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260812 19:21:40.258383  6338 tablet_service.cc:1467] Processing CreateTablet for tablet 9e38bc4707784979b4d00b45879a8f0b (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260812 19:21:40.260983  6341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa4b7bb14bdb4198a276add34849a84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.276612  6325 tablet_service.cc:1467] Processing CreateTablet for tablet d3d1eb75377449c8b2ea3ee9e6622404 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260812 19:21:40.277905  6325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3d1eb75377449c8b2ea3ee9e6622404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.279024  6338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e38bc4707784979b4d00b45879a8f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.279881  6223 tablet_service.cc:1467] Processing CreateTablet for tablet 9e3bf4ae67ff4aaa9287a253c6db6575 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260812 19:21:40.282266  6223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e3bf4ae67ff4aaa9287a253c6db6575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.285874  6330 tablet_service.cc:1467] Processing CreateTablet for tablet fd2a75ee87424ce9809bec32f2ae38fa (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260812 19:21:40.218219  6454 tablet_service.cc:1467] Processing CreateTablet for tablet b02969fd01604c6eb8dad2ecb92d0224 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260812 19:21:40.270469  6449 tablet_service.cc:1467] Processing CreateTablet for tablet 9e38bc4707784979b4d00b45879a8f0b (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260812 19:21:40.287602  6454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b02969fd01604c6eb8dad2ecb92d0224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.288340  6218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4995e2d6140a4fa3a2dadad444b9a924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.286669  6336 tablet_service.cc:1467] Processing CreateTablet for tablet b231cd9f80874e2dbe40dcd1f4c8e1f4 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260812 19:21:40.289368  6336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b231cd9f80874e2dbe40dcd1f4c8e1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.256494  6545 tablet_bootstrap.cc:492] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:40.173192  6544 tablet_bootstrap.cc:492] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:40.298291  6544 ts_tablet_manager.cc:1397] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.258s	user 0.012s	sys 0.007s
I20260812 19:21:40.301761  6544 raft_consensus.cc:348] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:21:40.302953  6544 raft_consensus.cc:374] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:40.303696  6544 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:40.292663  6337 tablet_service.cc:1467] Processing CreateTablet for tablet f7798b18b2fb4b0baa349294c1006e91 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260812 19:21:40.268034  6334 tablet_service.cc:1467] Processing CreateTablet for tablet f2920c51f14548a48637e645e719d9cd (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260812 19:21:40.295193  6462 tablet_service.cc:1467] Processing CreateTablet for tablet d3d1eb75377449c8b2ea3ee9e6622404 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260812 19:21:40.306995  6330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd2a75ee87424ce9809bec32f2ae38fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.308823  6334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2920c51f14548a48637e645e719d9cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.314939  6337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7798b18b2fb4b0baa349294c1006e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.309950  6544 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:21:40.319947  6331 tablet_service.cc:1467] Processing CreateTablet for tablet 9e3bf4ae67ff4aaa9287a253c6db6575 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260812 19:21:40.226131  6457 tablet_service.cc:1467] Processing CreateTablet for tablet aa4b7bb14bdb4198a276add34849a84e (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260812 19:21:40.324916  6215 tablet_service.cc:1467] Processing CreateTablet for tablet fe2a7dc98f92406fbf459b7c9d812bf7 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260812 19:21:40.298069  6327 tablet_service.cc:1467] Processing CreateTablet for tablet 1e69ce57e6c74dea9e207b6ae03c43b2 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260812 19:21:40.271986  6546 tablet_bootstrap.cc:492] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:40.291015  6449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e38bc4707784979b4d00b45879a8f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.332258  6452 tablet_service.cc:1467] Processing CreateTablet for tablet fd2a75ee87424ce9809bec32f2ae38fa (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260812 19:21:40.345323  6546 tablet_bootstrap.cc:654] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:40.332624  6450 tablet_service.cc:1467] Processing CreateTablet for tablet f2920c51f14548a48637e645e719d9cd (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260812 19:21:40.349674  6327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e69ce57e6c74dea9e207b6ae03c43b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.336753  6444 tablet_service.cc:1467] Processing CreateTablet for tablet f7798b18b2fb4b0baa349294c1006e91 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260812 19:21:40.355989  6452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd2a75ee87424ce9809bec32f2ae38fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.356652  6444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7798b18b2fb4b0baa349294c1006e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.361358  6453 tablet_service.cc:1467] Processing CreateTablet for tablet 1e69ce57e6c74dea9e207b6ae03c43b2 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260812 19:21:40.362365  6450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2920c51f14548a48637e645e719d9cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.350636  6545 tablet_bootstrap.cc:654] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:40.371004  6331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e3bf4ae67ff4aaa9287a253c6db6575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.378875  6462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3d1eb75377449c8b2ea3ee9e6622404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.381007  6273 heartbeater.cc:503] Master 127.3.253.62:46555 was elected leader, sending a full tablet report...
I20260812 19:21:40.381551  6454 tablet_service.cc:1467] Processing CreateTablet for tablet c4c2eb0bf29b48b3ae29c175fe03718f (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260812 19:21:40.384680  6447 tablet_service.cc:1467] Processing CreateTablet for tablet 5bf9c8ef81414ede8e942ee03b95a816 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260812 19:21:40.387408  6457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa4b7bb14bdb4198a276add34849a84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.391390  6325 tablet_service.cc:1467] Processing CreateTablet for tablet 4995e2d6140a4fa3a2dadad444b9a924 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260812 19:21:40.393373  6453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e69ce57e6c74dea9e207b6ae03c43b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.375474  6341 tablet_service.cc:1467] Processing CreateTablet for tablet 5bf9c8ef81414ede8e942ee03b95a816 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260812 19:21:40.401048  6330 tablet_service.cc:1467] Processing CreateTablet for tablet 95d32ece4a8c43b6a779d59f9981db43 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260812 19:21:40.405043  6339 tablet_service.cc:1467] Processing CreateTablet for tablet c7441e51865745dea6bedf82183de6c0 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260812 19:21:40.405659  6218 tablet_service.cc:1467] Processing CreateTablet for tablet c59df69987ce4bc38077cd7681552414 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260812 19:21:40.407876  6208 tablet_service.cc:1467] Processing CreateTablet for tablet cb5046f0183a45f4a5ae164f4ff6792c (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260812 19:21:40.402871  6207 tablet_service.cc:1467] Processing CreateTablet for tablet c7441e51865745dea6bedf82183de6c0 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260812 19:21:40.409123  6218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c59df69987ce4bc38077cd7681552414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.410115  6208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb5046f0183a45f4a5ae164f4ff6792c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.411201  6215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe2a7dc98f92406fbf459b7c9d812bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.369019  6338 tablet_service.cc:1467] Processing CreateTablet for tablet c4c2eb0bf29b48b3ae29c175fe03718f (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260812 19:21:40.404213  6212 tablet_service.cc:1467] Processing CreateTablet for tablet 0715e834130d426f8038cf97eecb0687 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260812 19:21:40.417305  6212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0715e834130d426f8038cf97eecb0687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.417946  6210 tablet_service.cc:1467] Processing CreateTablet for tablet 982b09b6d3b34920ac161f2649012c72 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260812 19:21:40.420341  6210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 982b09b6d3b34920ac161f2649012c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.413836  6454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4c2eb0bf29b48b3ae29c175fe03718f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.423920  6207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7441e51865745dea6bedf82183de6c0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:21:40.426611  6274 tablet.cc:2369] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:21:40.415654  6325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4995e2d6140a4fa3a2dadad444b9a924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.449028  6447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bf9c8ef81414ede8e942ee03b95a816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.461143  6337 tablet_service.cc:1467] Processing CreateTablet for tablet fe2a7dc98f92406fbf459b7c9d812bf7 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260812 19:21:40.462845  6544 ts_tablet_manager.cc:1428] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.164s	user 0.008s	sys 0.006s
I20260812 19:21:40.422318  6223 tablet_service.cc:1467] Processing CreateTablet for tablet 529ed979cd2842acb5bc24debb151b93 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260812 19:21:40.467075  6330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95d32ece4a8c43b6a779d59f9981db43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.436385  6546 tablet_bootstrap.cc:492] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:40.471083  6546 ts_tablet_manager.cc:1397] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.199s	user 0.011s	sys 0.004s
I20260812 19:21:40.471328  6341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bf9c8ef81414ede8e942ee03b95a816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.471022  6463 tablet_service.cc:1467] Processing CreateTablet for tablet 4995e2d6140a4fa3a2dadad444b9a924 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260812 19:21:40.475713  6452 tablet_service.cc:1467] Processing CreateTablet for tablet 95d32ece4a8c43b6a779d59f9981db43 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260812 19:21:40.479115  6339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7441e51865745dea6bedf82183de6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.493966  6452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95d32ece4a8c43b6a779d59f9981db43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.499542  6336 tablet_service.cc:1467] Processing CreateTablet for tablet 0715e834130d426f8038cf97eecb0687 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260812 19:21:40.501127  6336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0715e834130d426f8038cf97eecb0687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.474308  6546 raft_consensus.cc:348] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:40.503229  6546 raft_consensus.cc:374] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:40.503603  6546 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:40.504434  6546 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:40.506779  6463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4995e2d6140a4fa3a2dadad444b9a924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.511510  6338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4c2eb0bf29b48b3ae29c175fe03718f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.520510  6334 tablet_service.cc:1467] Processing CreateTablet for tablet c59df69987ce4bc38077cd7681552414 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260812 19:21:40.522187  6334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c59df69987ce4bc38077cd7681552414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.487689  6449 tablet_service.cc:1467] Processing CreateTablet for tablet 0715e834130d426f8038cf97eecb0687 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260812 19:21:40.524364  6206 tablet_service.cc:1467] Processing CreateTablet for tablet 7230832bbf3743e0a33e68f405d6b124 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260812 19:21:40.526106  6457 tablet_service.cc:1467] Processing CreateTablet for tablet 9e3bf4ae67ff4aaa9287a253c6db6575 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260812 19:21:40.534729  6212 tablet_service.cc:1467] Processing CreateTablet for tablet 0b2666b0bd6d48eaac74445d6da5cf58 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260812 19:21:40.535782  6545 tablet_bootstrap.cc:492] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:40.536299  6545 ts_tablet_manager.cc:1397] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.280s	user 0.028s	sys 0.036s
I20260812 19:21:40.543442  6545 raft_consensus.cc:348] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:40.544240  6545 raft_consensus.cc:374] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:40.544550  6545 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:40.547420  6545 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:40.548125  6219 tablet_service.cc:1467] Processing CreateTablet for tablet 5d49af1f98624af48adc92f25f5a2be7 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260812 19:21:40.550736  6209 tablet_service.cc:1467] Processing CreateTablet for tablet 08db676d084c41abaa2e196e5c2653b5 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260812 19:21:40.554517  6544 tablet_bootstrap.cc:492] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:40.555761  6400 heartbeater.cc:503] Master 127.3.253.62:46555 was elected leader, sending a full tablet report...
I20260812 19:21:40.559309  6462 tablet_service.cc:1467] Processing CreateTablet for tablet fe2a7dc98f92406fbf459b7c9d812bf7 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260812 19:21:40.560137  6457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e3bf4ae67ff4aaa9287a253c6db6575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.562332  6544 tablet_bootstrap.cc:654] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:40.562445  6449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0715e834130d426f8038cf97eecb0687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.563393  6223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 529ed979cd2842acb5bc24debb151b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.564087  6212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b2666b0bd6d48eaac74445d6da5cf58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.564859  6209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08db676d084c41abaa2e196e5c2653b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.568253  6444 tablet_service.cc:1467] Processing CreateTablet for tablet c7441e51865745dea6bedf82183de6c0 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260812 19:21:40.569242  6444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7441e51865745dea6bedf82183de6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.570011  6219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d49af1f98624af48adc92f25f5a2be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.575167  6462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe2a7dc98f92406fbf459b7c9d812bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.597517  6325 tablet_service.cc:1467] Processing CreateTablet for tablet cb5046f0183a45f4a5ae164f4ff6792c (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260812 19:21:40.597517  6208 tablet_service.cc:1467] Processing CreateTablet for tablet d0976a98f9404c3d8150d0de9a8b385c (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260812 19:21:40.602684  6208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0976a98f9404c3d8150d0de9a8b385c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.606272  6215 tablet_service.cc:1467] Processing CreateTablet for tablet 1ed681895af14e88b9b457a6b6a85e1a (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260812 19:21:40.607753  6215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ed681895af14e88b9b457a6b6a85e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.614169  6454 tablet_service.cc:1467] Processing CreateTablet for tablet c59df69987ce4bc38077cd7681552414 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260812 19:21:40.615769  6206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7230832bbf3743e0a33e68f405d6b124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.618400  6337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe2a7dc98f92406fbf459b7c9d812bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.620671  6210 tablet_service.cc:1467] Processing CreateTablet for tablet 89d6b10f5ff448f592a41c3a77692cfe (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260812 19:21:40.623908  6545 ts_tablet_manager.cc:1428] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.087s	user 0.004s	sys 0.012s
I20260812 19:21:40.624176  6447 tablet_service.cc:1467] Processing CreateTablet for tablet cb5046f0183a45f4a5ae164f4ff6792c (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260812 19:21:40.629684  6327 tablet_service.cc:1467] Processing CreateTablet for tablet 0b2666b0bd6d48eaac74445d6da5cf58 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260812 19:21:40.632886  6341 tablet_service.cc:1467] Processing CreateTablet for tablet 982b09b6d3b34920ac161f2649012c72 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260812 19:21:40.635861  6338 tablet_service.cc:1467] Processing CreateTablet for tablet 529ed979cd2842acb5bc24debb151b93 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260812 19:21:40.637200  6209 tablet_service.cc:1467] Processing CreateTablet for tablet 545108632fab48129db7f032619a1e55 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260812 19:21:40.578953  6218 tablet_service.cc:1467] Processing CreateTablet for tablet 42ff4c3d452047f29f09437fda663aed (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260812 19:21:40.640877  6454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c59df69987ce4bc38077cd7681552414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.650205  6545 tablet_bootstrap.cc:492] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:40.650832  6522 heartbeater.cc:503] Master 127.3.253.62:46555 was elected leader, sending a full tablet report...
I20260812 19:21:40.653198  6453 tablet_service.cc:1467] Processing CreateTablet for tablet 529ed979cd2842acb5bc24debb151b93 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260812 19:21:40.651877  6210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89d6b10f5ff448f592a41c3a77692cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.670078  6330 tablet_service.cc:1467] Processing CreateTablet for tablet 7230832bbf3743e0a33e68f405d6b124 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260812 19:21:40.673554  6218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42ff4c3d452047f29f09437fda663aed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.673676  6546 ts_tablet_manager.cc:1428] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.202s	user 0.009s	sys 0.009s
I20260812 19:21:40.675626  6209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 545108632fab48129db7f032619a1e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.676636  6546 tablet_bootstrap.cc:492] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:40.654570  6453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 529ed979cd2842acb5bc24debb151b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.681682  6545 tablet_bootstrap.cc:654] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:40.686584  6447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb5046f0183a45f4a5ae164f4ff6792c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.689615  6449 tablet_service.cc:1467] Processing CreateTablet for tablet 982b09b6d3b34920ac161f2649012c72 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260812 19:21:40.690058  6463 tablet_service.cc:1467] Processing CreateTablet for tablet 0b2666b0bd6d48eaac74445d6da5cf58 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260812 19:21:40.682049  6452 tablet_service.cc:1467] Processing CreateTablet for tablet 7230832bbf3743e0a33e68f405d6b124 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260812 19:21:40.692395  6325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb5046f0183a45f4a5ae164f4ff6792c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.699698  6449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 982b09b6d3b34920ac161f2649012c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.714234  6457 tablet_service.cc:1467] Processing CreateTablet for tablet 08db676d084c41abaa2e196e5c2653b5 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260812 19:21:40.716535  6212 tablet_service.cc:1467] Processing CreateTablet for tablet 67c9cd7e3397473ba76fb87340b6c6e0 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260812 19:21:40.717581  6327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b2666b0bd6d48eaac74445d6da5cf58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.718573  6212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67c9cd7e3397473ba76fb87340b6c6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.716734  6339 tablet_service.cc:1467] Processing CreateTablet for tablet 42ff4c3d452047f29f09437fda663aed (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260812 19:21:40.725955  6339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42ff4c3d452047f29f09437fda663aed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.725766  6210 tablet_service.cc:1467] Processing CreateTablet for tablet 04c512eaceae43d2a378065361eb4854 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260812 19:21:40.731395  6334 tablet_service.cc:1467] Processing CreateTablet for tablet 1ed681895af14e88b9b457a6b6a85e1a (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260812 19:21:40.731973  6210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04c512eaceae43d2a378065361eb4854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.732827  6334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ed681895af14e88b9b457a6b6a85e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.701901  6450 tablet_service.cc:1467] Processing CreateTablet for tablet 5d49af1f98624af48adc92f25f5a2be7 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260812 19:21:40.736627  6559 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:40.737119  6559 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:40.739043  6341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 982b09b6d3b34920ac161f2649012c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.739760  6559 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:40.744462  6544 tablet_bootstrap.cc:492] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:40.745002  6544 ts_tablet_manager.cc:1397] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.191s	user 0.011s	sys 0.018s
I20260812 19:21:40.739446  6207 tablet_service.cc:1467] Processing CreateTablet for tablet 0d8cbc6671344bd789fa2d3e4986c4b4 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260812 19:21:40.747052  6330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7230832bbf3743e0a33e68f405d6b124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.762794  6338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 529ed979cd2842acb5bc24debb151b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.763616  6331 tablet_service.cc:1467] Processing CreateTablet for tablet 5d49af1f98624af48adc92f25f5a2be7 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260812 19:21:40.764966  6331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d49af1f98624af48adc92f25f5a2be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.771479  6223 tablet_service.cc:1467] Processing CreateTablet for tablet fa4336f7dd434c238a9022aa16490450 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260812 19:21:40.772202  6544 raft_consensus.cc:348] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:40.773065  6544 raft_consensus.cc:374] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:40.697321  6336 tablet_service.cc:1467] Processing CreateTablet for tablet 08db676d084c41abaa2e196e5c2653b5 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260812 19:21:40.774430  6336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08db676d084c41abaa2e196e5c2653b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.773088  6548 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:40.774912  6548 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:21:40.777652  6548 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:40.773434  6544 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:40.722175  6219 tablet_service.cc:1467] Processing CreateTablet for tablet 4ed79a983adf41fb8e94a099bb3c0974 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260812 19:21:40.785380  6545 tablet_bootstrap.cc:492] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:40.791026  6544 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:40.792887  6337 tablet_service.cc:1467] Processing CreateTablet for tablet 89d6b10f5ff448f592a41c3a77692cfe (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260812 19:21:40.799356  6337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89d6b10f5ff448f592a41c3a77692cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.800743  6544 ts_tablet_manager.cc:1428] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.002s
I20260812 19:21:40.801311  6208 tablet_service.cc:1467] Processing CreateTablet for tablet e76f36493d454308b43951f8eb142b7e (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260812 19:21:40.801812  6544 tablet_bootstrap.cc:492] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:40.802580  6545 ts_tablet_manager.cc:1397] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.153s	user 0.020s	sys 0.016s
I20260812 19:21:40.802644  6457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08db676d084c41abaa2e196e5c2653b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.773452  6207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d8cbc6671344bd789fa2d3e4986c4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.812088  6219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ed79a983adf41fb8e94a099bb3c0974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.812899  6208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e76f36493d454308b43951f8eb142b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.813563  6223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa4336f7dd434c238a9022aa16490450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.819886  6444 tablet_service.cc:1467] Processing CreateTablet for tablet 42ff4c3d452047f29f09437fda663aed (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260812 19:21:40.792884  6212 tablet_service.cc:1467] Processing CreateTablet for tablet 6454eb944afe4306b52388febd0f82bb (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260812 19:21:40.830171  6212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6454eb944afe4306b52388febd0f82bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.848810  6206 tablet_service.cc:1467] Processing CreateTablet for tablet 099703c7d52b4644ae3c1098ddcc0282 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260812 19:21:40.850162  6206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 099703c7d52b4644ae3c1098ddcc0282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.808715  6209 tablet_service.cc:1467] Processing CreateTablet for tablet 8b1f6c5d06f046a1818f453d9b609502 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260812 19:21:40.811208  6463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b2666b0bd6d48eaac74445d6da5cf58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.766530  6546 tablet_bootstrap.cc:654] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:40.860360  6557 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:40.860903  6557 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:40.861879  6325 tablet_service.cc:1467] Processing CreateTablet for tablet d0976a98f9404c3d8150d0de9a8b385c (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260812 19:21:40.866732  6444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42ff4c3d452047f29f09437fda663aed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.877758  6325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0976a98f9404c3d8150d0de9a8b385c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.881181  6544 tablet_bootstrap.cc:654] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:40.881536  6452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7230832bbf3743e0a33e68f405d6b124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.889351  6209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b1f6c5d06f046a1818f453d9b609502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.897691  6450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d49af1f98624af48adc92f25f5a2be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.906366  6557 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:40.905280  6454 tablet_service.cc:1467] Processing CreateTablet for tablet 1ed681895af14e88b9b457a6b6a85e1a (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260812 19:21:40.940662  6040 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 45244us
I20260812 19:21:40.963119  6462 tablet_service.cc:1467] Processing CreateTablet for tablet d0976a98f9404c3d8150d0de9a8b385c (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260812 19:21:40.964510  6462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0976a98f9404c3d8150d0de9a8b385c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.964855  6453 tablet_service.cc:1467] Processing CreateTablet for tablet 89d6b10f5ff448f592a41c3a77692cfe (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260812 19:21:40.968609  6453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89d6b10f5ff448f592a41c3a77692cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.972435  6223 tablet_service.cc:1467] Processing CreateTablet for tablet 93caa3d3062a45cbad94ff4ba511f2e0 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260812 19:21:40.974802  6223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93caa3d3062a45cbad94ff4ba511f2e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.976136  6454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ed681895af14e88b9b457a6b6a85e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.980420  6334 tablet_service.cc:1467] Processing CreateTablet for tablet 04c512eaceae43d2a378065361eb4854 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260812 19:21:40.981813  6334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04c512eaceae43d2a378065361eb4854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.980420  6330 tablet_service.cc:1467] Processing CreateTablet for tablet 67c9cd7e3397473ba76fb87340b6c6e0 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260812 19:21:40.985121  6330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67c9cd7e3397473ba76fb87340b6c6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.984575  6327 tablet_service.cc:1467] Processing CreateTablet for tablet 6454eb944afe4306b52388febd0f82bb (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260812 19:21:40.986223  6327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6454eb944afe4306b52388febd0f82bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.986912  6339 tablet_service.cc:1467] Processing CreateTablet for tablet 0d8cbc6671344bd789fa2d3e4986c4b4 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260812 19:21:40.988145  6339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d8cbc6671344bd789fa2d3e4986c4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.988116  6337 tablet_service.cc:1467] Processing CreateTablet for tablet 4ed79a983adf41fb8e94a099bb3c0974 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260812 19:21:40.989504  6337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ed79a983adf41fb8e94a099bb3c0974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.988116  6338 tablet_service.cc:1467] Processing CreateTablet for tablet 8b1f6c5d06f046a1818f453d9b609502 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260812 19:21:40.991896  6338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b1f6c5d06f046a1818f453d9b609502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:40.951121  6341 tablet_service.cc:1467] Processing CreateTablet for tablet 545108632fab48129db7f032619a1e55 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260812 19:21:41.040508  6210 tablet_service.cc:1467] Processing CreateTablet for tablet d2d336a1bcca41809d1c89b7833de9a5 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260812 19:21:41.041893  6210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2d336a1bcca41809d1c89b7833de9a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.042171  6215 tablet_service.cc:1467] Processing CreateTablet for tablet 2661573faf994c8f9bb837f55af974d9 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260812 19:21:41.043267  6341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 545108632fab48129db7f032619a1e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.044035  6215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2661573faf994c8f9bb837f55af974d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.047906  6331 tablet_service.cc:1467] Processing CreateTablet for tablet e76f36493d454308b43951f8eb142b7e (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260812 19:21:41.048187  6218 tablet_service.cc:1467] Processing CreateTablet for tablet 956de4b24b3d4a2693e1dcc392b1dd00 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260812 19:21:41.049332  6331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e76f36493d454308b43951f8eb142b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.049388  6218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 956de4b24b3d4a2693e1dcc392b1dd00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.061105  6336 tablet_service.cc:1467] Processing CreateTablet for tablet fa4336f7dd434c238a9022aa16490450 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260812 19:21:41.073562  6447 tablet_service.cc:1467] Processing CreateTablet for tablet 545108632fab48129db7f032619a1e55 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260812 19:21:41.074761  6545 raft_consensus.cc:348] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:21:41.075814  6545 raft_consensus.cc:374] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.076161  6545 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.077086  6545 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:21:41.087381  6546 tablet_bootstrap.cc:492] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:41.088083  6546 ts_tablet_manager.cc:1397] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.412s	user 0.023s	sys 0.008s
I20260812 19:21:41.092679  6208 tablet_service.cc:1467] Processing CreateTablet for tablet b6ca6db9aa4e4bdd829dc087e97096a0 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260812 19:21:41.062590  6336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa4336f7dd434c238a9022aa16490450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.113504  6337 tablet_service.cc:1467] Processing CreateTablet for tablet 93caa3d3062a45cbad94ff4ba511f2e0 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260812 19:21:41.130764  6208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6ca6db9aa4e4bdd829dc087e97096a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.132325  6546 raft_consensus.cc:348] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:21:41.144449  6219 tablet_service.cc:1467] Processing CreateTablet for tablet c3c085c12bc74f5b8a4f6f69990e1a82 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260812 19:21:41.148823  6548 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:41.160470  6548 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.161336  6219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3c085c12bc74f5b8a4f6f69990e1a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.162619  6548 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:41.149127  6545 ts_tablet_manager.cc:1428] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.290s	user 0.009s	sys 0.004s
I20260812 19:21:41.149712  6207 tablet_service.cc:1467] Processing CreateTablet for tablet f4ae22a8efcc4f26bdc2d4cc4266111a (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260812 19:21:41.164889  6207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4ae22a8efcc4f26bdc2d4cc4266111a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.166677  6444 tablet_service.cc:1467] Processing CreateTablet for tablet 67c9cd7e3397473ba76fb87340b6c6e0 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260812 19:21:41.166363  6545 tablet_bootstrap.cc:492] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:41.159917  6447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 545108632fab48129db7f032619a1e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.141958  6546 raft_consensus.cc:374] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.184309  6546 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.152081  6463 tablet_service.cc:1467] Processing CreateTablet for tablet 0d8cbc6671344bd789fa2d3e4986c4b4 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260812 19:21:41.168190  6325 tablet_service.cc:1467] Processing CreateTablet for tablet 099703c7d52b4644ae3c1098ddcc0282 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260812 19:21:41.187909  6463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d8cbc6671344bd789fa2d3e4986c4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.195847  6449 tablet_service.cc:1467] Processing CreateTablet for tablet 04c512eaceae43d2a378065361eb4854 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260812 19:21:41.197718  6449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04c512eaceae43d2a378065361eb4854. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:21:41.208034  6138 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:21:41.224519  6337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93caa3d3062a45cbad94ff4ba511f2e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.235042  6444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67c9cd7e3397473ba76fb87340b6c6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.255110  6559 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:41.256470  6559 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:21:41.260452  6559 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:41.185525  6546 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:21:41.266832  6334 tablet_service.cc:1467] Processing CreateTablet for tablet d2d336a1bcca41809d1c89b7833de9a5 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260812 19:21:41.296175  6325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 099703c7d52b4644ae3c1098ddcc0282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.298010  6334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2d336a1bcca41809d1c89b7833de9a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.269855  6330 tablet_service.cc:1467] Processing CreateTablet for tablet 2661573faf994c8f9bb837f55af974d9 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260812 19:21:41.318717  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:41.270581  6546 ts_tablet_manager.cc:1428] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.182s	user 0.009s	sys 0.003s
I20260812 19:21:41.282051  6452 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38134 (request call id 34) took 1049 ms. Trace:
I20260812 19:21:41.325924  6546 tablet_bootstrap.cc:492] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:41.343668  6546 tablet_bootstrap.cc:654] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
W20260812 19:21:41.355196  6040 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 75066.1us
I20260812 19:21:41.356602  6330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2661573faf994c8f9bb837f55af974d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.350489  6453 tablet_service.cc:1467] Processing CreateTablet for tablet 6454eb944afe4306b52388febd0f82bb (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260812 19:21:41.360013  6453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6454eb944afe4306b52388febd0f82bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.360252  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:41.323771  6452 rpcz_store.cc:276] 0812 19:21:40.233067 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:21:40.677911 (+444844us) service_pool.cc:227] Handling call
0812 19:21:40.780654 (+102743us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:21:40.832345 (+ 51691us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:21:41.106073 (+273728us) tablet_metadata.cc:641] Metadata flushed
0812 19:21:41.281376 (+175303us) tablet_replica.cc:205] Creating consensus instance
0812 19:21:41.281954 (+   578us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:21:41.364156  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:41.364755  6546 tablet_bootstrap.cc:492] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:41.364907  6359 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:41.365265  6546 ts_tablet_manager.cc:1397] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.010s
I20260812 19:21:41.365052  6452 tablet_service.cc:1467] Processing CreateTablet for tablet 8b1f6c5d06f046a1818f453d9b609502 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260812 19:21:41.366430  6452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b1f6c5d06f046a1818f453d9b609502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.287470  6544 tablet_bootstrap.cc:492] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:41.368582  6546 raft_consensus.cc:348] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.370826  6338 tablet_service.cc:1467] Processing CreateTablet for tablet f4ae22a8efcc4f26bdc2d4cc4266111a (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260812 19:21:41.371852  6416 leader_election.cc:341] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:41.373950  6454 tablet_service.cc:1467] Processing CreateTablet for tablet 4ed79a983adf41fb8e94a099bb3c0974 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260812 19:21:41.406419  6463 tablet_service.cc:1467] Processing CreateTablet for tablet d2d336a1bcca41809d1c89b7833de9a5 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260812 19:21:41.407027  6416 leader_election.cc:341] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:41.407480  6416 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:41.386447  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:41.388826  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:41.408826  6359 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:41.409431  6559 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:41.387656  6341 tablet_service.cc:1467] Processing CreateTablet for tablet b6ca6db9aa4e4bdd829dc087e97096a0 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260812 19:21:41.389140  6450 tablet_service.cc:1467] Processing CreateTablet for tablet fa4336f7dd434c238a9022aa16490450 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260812 19:21:41.392004  6325 tablet_service.cc:1467] Processing CreateTablet for tablet c3c085c12bc74f5b8a4f6f69990e1a82 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260812 19:21:41.393394  6457 tablet_service.cc:1467] Processing CreateTablet for tablet 099703c7d52b4644ae3c1098ddcc0282 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260812 19:21:41.399236  6327 tablet_service.cc:1467] Processing CreateTablet for tablet 956de4b24b3d4a2693e1dcc392b1dd00 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260812 19:21:41.397944  6447 tablet_service.cc:1467] Processing CreateTablet for tablet 93caa3d3062a45cbad94ff4ba511f2e0 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260812 19:21:41.405125  6546 raft_consensus.cc:374] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.413836  6546 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.414629  6546 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.417057  6546 ts_tablet_manager.cc:1428] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.004s
I20260812 19:21:41.417518  6545 tablet_bootstrap.cc:654] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:41.418111  6546 tablet_bootstrap.cc:492] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:41.406191  6544 ts_tablet_manager.cc:1397] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.605s	user 0.057s	sys 0.025s
I20260812 19:21:41.384608  6462 tablet_service.cc:1467] Processing CreateTablet for tablet e76f36493d454308b43951f8eb142b7e (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260812 19:21:41.408774  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:41.385772  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:41.389362  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:21:41.411831  6297 leader_election.cc:341] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:41.411734  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:41.430881  6559 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:41.412919  6338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4ae22a8efcc4f26bdc2d4cc4266111a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.431298  6559 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:41.431674  6559 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:41.431770  6178 leader_election.cc:341] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:41.421398  6544 raft_consensus.cc:348] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.433647  6544 raft_consensus.cc:374] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.433986  6544 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.430275  6242 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:41.435050  6548 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:41.434742  6544 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.437187  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:41.438921  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:41.439831  6559 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:21:41.440526  6178 leader_election.cc:341] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:41.440968  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:41.442746  6327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 956de4b24b3d4a2693e1dcc392b1dd00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.444636  6548 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:41.445086  6548 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:41.447731  6341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6ca6db9aa4e4bdd829dc087e97096a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.448588  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:21:41.450068  6297 leader_election.cc:341] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:41.450503  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:41.451035  6325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3c085c12bc74f5b8a4f6f69990e1a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.451404  6557 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:41.452234  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:41.454125  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:41.447785  6483 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:41.454782  6354 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:41.459766  6546 tablet_bootstrap.cc:654] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:41.460011  6447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93caa3d3062a45cbad94ff4ba511f2e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.461997  6454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ed79a983adf41fb8e94a099bb3c0974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.441802  6559 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:41.486855  6463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2d336a1bcca41809d1c89b7833de9a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.495031  6450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa4336f7dd434c238a9022aa16490450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.498688  6457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 099703c7d52b4644ae3c1098ddcc0282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.502981  6462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e76f36493d454308b43951f8eb142b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.508347  6354 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:41.509758  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:41.510670  6559 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:41.521879  6444 tablet_service.cc:1467] Processing CreateTablet for tablet 956de4b24b3d4a2693e1dcc392b1dd00 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260812 19:21:41.523329  6444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 956de4b24b3d4a2693e1dcc392b1dd00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.532270  6545 tablet_bootstrap.cc:492] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:41.532823  6545 ts_tablet_manager.cc:1397] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.367s	user 0.023s	sys 0.000s
I20260812 19:21:41.490315  6548 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:21:41.538115  6242 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 1: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:21:41.540449  6545 raft_consensus.cc:348] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.541551  6545 raft_consensus.cc:374] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.541939  6545 raft_consensus.cc:729] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.511250  6591 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:41.542531  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:41.545007  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:41.545794  6354 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:41.547217  6548 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:41.556838  6452 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38134 (request call id 47) took 1017 ms. Trace:
I20260812 19:21:41.557421  6452 rpcz_store.cc:276] 0812 19:21:40.539792 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:21:41.364132 (+824340us) service_pool.cc:227] Handling call
0812 19:21:41.365973 (+  1841us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:21:41.366068 (+    95us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:21:41.528151 (+162083us) tablet_metadata.cc:641] Metadata flushed
0812 19:21:41.555696 (+ 27545us) tablet_replica.cc:205] Creating consensus instance
0812 19:21:41.556771 (+  1075us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:21:41.560192  6452 tablet_service.cc:1467] Processing CreateTablet for tablet f4ae22a8efcc4f26bdc2d4cc4266111a (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260812 19:21:41.556221  6449 tablet_service.cc:1467] Processing CreateTablet for tablet 2661573faf994c8f9bb837f55af974d9 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260812 19:21:41.566167  6454 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38134 (request call id 48) took 1026 ms. Trace:
I20260812 19:21:41.567242  6449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2661573faf994c8f9bb837f55af974d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.572611  6444 tablet_service.cc:1467] Processing CreateTablet for tablet b6ca6db9aa4e4bdd829dc087e97096a0 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260812 19:21:41.574040  6444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6ca6db9aa4e4bdd829dc087e97096a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.566565  6454 rpcz_store.cc:276] 0812 19:21:40.540092 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:21:41.372992 (+832900us) service_pool.cc:227] Handling call
0812 19:21:41.407079 (+ 34087us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:21:41.407205 (+   126us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:21:41.542311 (+135106us) tablet_metadata.cc:641] Metadata flushed
0812 19:21:41.563571 (+ 21260us) tablet_replica.cc:205] Creating consensus instance
0812 19:21:41.566104 (+  2533us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:21:41.576320  6462 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38134 (request call id 49) took 1036 ms. Trace:
I20260812 19:21:41.576723  6462 rpcz_store.cc:276] 0812 19:21:40.540390 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:21:41.383508 (+843118us) service_pool.cc:227] Handling call
0812 19:21:41.432817 (+ 49309us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:21:41.432917 (+   100us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:21:41.544387 (+111470us) tablet_metadata.cc:641] Metadata flushed
0812 19:21:41.565377 (+ 20990us) tablet_replica.cc:205] Creating consensus instance
0812 19:21:41.576256 (+ 10879us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:21:41.578848  6454 tablet_service.cc:1467] Processing CreateTablet for tablet c3c085c12bc74f5b8a4f6f69990e1a82 (DEFAULT_TABLE table=test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260812 19:21:41.580237  6454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3c085c12bc74f5b8a4f6f69990e1a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.587420  6453 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38134 (request call id 46) took 1048 ms. Trace:
I20260812 19:21:41.587988  6453 rpcz_store.cc:276] 0812 19:21:40.539471 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:21:41.202198 (+662727us) service_pool.cc:227] Handling call
0812 19:21:41.359349 (+157151us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:21:41.359453 (+   104us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:21:41.485135 (+125682us) tablet_metadata.cc:641] Metadata flushed
0812 19:21:41.586746 (+101611us) tablet_replica.cc:205] Creating consensus instance
0812 19:21:41.587337 (+   591us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:21:41.594548  6449 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38134 (request call id 54) took 1020 ms. Trace:
I20260812 19:21:41.596912  6452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4ae22a8efcc4f26bdc2d4cc4266111a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:41.604764  6548 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:41.605238  6548 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.598783  6544 ts_tablet_manager.cc:1428] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.180s	user 0.025s	sys 0.041s
I20260812 19:21:41.599231  6546 tablet_bootstrap.cc:492] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:41.600987  6334 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45938 (request call id 53) took 1027 ms. Trace:
I20260812 19:21:41.601609  6327 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45938 (request call id 55) took 1026 ms. Trace:
I20260812 19:21:41.607959  6548 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:41.607661  6334 rpcz_store.cc:276] 0812 19:21:40.573288 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:21:41.264553 (+691265us) service_pool.cc:227] Handling call
0812 19:21:41.288979 (+ 24426us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:21:41.289090 (+   111us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:21:41.461631 (+172541us) tablet_metadata.cc:641] Metadata flushed
0812 19:21:41.600494 (+138863us) tablet_replica.cc:205] Creating consensus instance
0812 19:21:41.600930 (+   436us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:21:41.610412  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:41.608193  6327 rpcz_store.cc:276] 0812 19:21:40.574767 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:21:41.342065 (+767298us) service_pool.cc:227] Handling call
0812 19:21:41.413721 (+ 71656us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:21:41.413829 (+   108us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:21:41.483473 (+ 69644us) tablet_metadata.cc:641] Metadata flushed
0812 19:21:41.600951 (+117478us) tablet_replica.cc:205] Creating consensus instance
0812 19:21:41.601535 (+   584us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:21:41.596498  6545 consensus_queue.cc:260] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.611972  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:41.611275  6544 tablet_bootstrap.cc:492] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:41.611109  6354 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:41.602806  6449 rpcz_store.cc:276] 0812 19:21:40.574248 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:21:41.498220 (+923972us) service_pool.cc:227] Handling call
0812 19:21:41.566695 (+ 68475us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:21:41.566824 (+   129us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:21:41.583078 (+ 16254us) tablet_metadata.cc:641] Metadata flushed
0812 19:21:41.594147 (+ 11069us) tablet_replica.cc:205] Creating consensus instance
0812 19:21:41.594500 (+   353us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:21:41.613940  6546 ts_tablet_manager.cc:1397] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.196s	user 0.038s	sys 0.052s
W20260812 19:21:41.614122  6178 leader_election.cc:341] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:41.616168  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:41.618996  6590 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:41.619402  6590 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:41.619724  6590 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:41.620332  6546 raft_consensus.cc:348] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.621347  6546 raft_consensus.cc:374] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.621624  6546 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.623901  6463 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38134 (request call id 53) took 1050 ms. Trace:
I20260812 19:21:41.623740  6546 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.624321  6463 rpcz_store.cc:276] 0812 19:21:40.573596 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:21:41.400202 (+826606us) service_pool.cc:227] Handling call
0812 19:21:41.407284 (+  7082us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:21:41.407517 (+   233us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:21:41.525188 (+117671us) tablet_metadata.cc:641] Metadata flushed
0812 19:21:41.619983 (+ 94795us) tablet_replica.cc:205] Creating consensus instance
0812 19:21:41.623828 (+  3845us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3299}
I20260812 19:21:41.626222  6546 ts_tablet_manager.cc:1428] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260812 19:21:41.627015  6450 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38134 (request call id 50) took 1086 ms. Trace:
I20260812 19:21:41.627346  6546 tablet_bootstrap.cc:492] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:41.628054  6450 rpcz_store.cc:276] 0812 19:21:40.540683 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:21:41.388275 (+847592us) service_pool.cc:227] Handling call
0812 19:21:41.410474 (+ 22199us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:21:41.412229 (+  1755us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:21:41.602021 (+189792us) tablet_metadata.cc:641] Metadata flushed
0812 19:21:41.615644 (+ 13623us) tablet_replica.cc:205] Creating consensus instance
0812 19:21:41.626957 (+ 11313us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:21:41.622324  6559 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:41.632737  6559 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:21:41.635362  6546 tablet_bootstrap.cc:654] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:41.636183  6544 tablet_bootstrap.cc:654] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:41.641264  6457 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38134 (request call id 51) took 1069 ms. Trace:
I20260812 19:21:41.641674  6457 rpcz_store.cc:276] 0812 19:21:40.572066 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:21:41.392574 (+820508us) service_pool.cc:227] Handling call
0812 19:21:41.413652 (+ 21078us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:21:41.413765 (+   113us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:21:41.562396 (+148631us) tablet_metadata.cc:641] Metadata flushed
0812 19:21:41.631632 (+ 69236us) tablet_replica.cc:205] Creating consensus instance
0812 19:21:41.641197 (+  9565us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:21:41.642787  6447 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38134 (request call id 52) took 1070 ms. Trace:
I20260812 19:21:41.643168  6447 rpcz_store.cc:276] 0812 19:21:40.572838 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:21:41.396892 (+824054us) service_pool.cc:227] Handling call
0812 19:21:41.422522 (+ 25630us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:21:41.422632 (+   110us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:21:41.581523 (+158891us) tablet_metadata.cc:641] Metadata flushed
0812 19:21:41.642264 (+ 60741us) tablet_replica.cc:205] Creating consensus instance
0812 19:21:41.642723 (+   459us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:21:41.651727  6545 ts_tablet_manager.cc:1428] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.119s	user 0.023s	sys 0.005s
I20260812 19:21:41.653766  6545 tablet_bootstrap.cc:492] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:41.655088  6590 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.657940  6546 tablet_bootstrap.cc:492] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:41.657898  6590 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:41.658612  6546 ts_tablet_manager.cc:1397] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.001s
I20260812 19:21:41.659933  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:41.660799  6590 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:21:41.661301  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:41.661546  6546 raft_consensus.cc:348] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.661965  6354 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:41.662281  6546 raft_consensus.cc:374] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.662580  6546 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.663298  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:41.663692  6546 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:41.665233  6178 leader_election.cc:341] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:41.666347  6546 ts_tablet_manager.cc:1428] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260812 19:21:41.671182  6545 tablet_bootstrap.cc:654] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:41.672936  6354 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:41.674780  6546 tablet_bootstrap.cc:492] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:41.674618  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:41.676110  6590 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:41.676810  6590 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:41.677539  6590 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.673640  6060 catalog_manager.cc:5495] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:41.684932  6544 tablet_bootstrap.cc:492] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:41.685724  6544 ts_tablet_manager.cc:1397] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.024s
I20260812 19:21:41.690603  6546 tablet_bootstrap.cc:654] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:41.694589  6544 raft_consensus.cc:348] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.695902  6544 raft_consensus.cc:374] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.694124  6059 catalog_manager.cc:5495] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:41.696563  6544 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.698220  6544 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.705178  6545 tablet_bootstrap.cc:492] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:41.705960  6545 ts_tablet_manager.cc:1397] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.000s
I20260812 19:21:41.706506  6544 ts_tablet_manager.cc:1428] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.011s
I20260812 19:21:41.708165  6544 tablet_bootstrap.cc:492] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:41.709100  6546 tablet_bootstrap.cc:492] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:41.709712  6546 ts_tablet_manager.cc:1397] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.006s
I20260812 19:21:41.711148  6545 raft_consensus.cc:348] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.712185  6545 raft_consensus.cc:374] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.712549  6545 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.712707  6546 raft_consensus.cc:348] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.713510  6545 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.714795  6546 raft_consensus.cc:374] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.715179  6546 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.716348  6544 tablet_bootstrap.cc:654] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:41.716001  6546 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.716768  6545 ts_tablet_manager.cc:1428] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260812 19:21:41.718438  6545 tablet_bootstrap.cc:492] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:41.725605  6546 ts_tablet_manager.cc:1428] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.004s
I20260812 19:21:41.727221  6546 tablet_bootstrap.cc:492] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:41.729171  6544 tablet_bootstrap.cc:492] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:41.729889  6544 ts_tablet_manager.cc:1397] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.003s
I20260812 19:21:41.732141  6545 tablet_bootstrap.cc:654] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:41.735541  6544 raft_consensus.cc:348] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.736821  6544 raft_consensus.cc:374] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.737357  6544 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.738449  6544 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.739872  6546 tablet_bootstrap.cc:654] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:41.743142  6559 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:41.743644  6544 ts_tablet_manager.cc:1428] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.013s	user 0.013s	sys 0.003s
I20260812 19:21:41.743939  6559 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.745507  6544 tablet_bootstrap.cc:492] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:41.749404  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:21:41.751873  6416 leader_election.cc:341] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:41.753455  6557 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:41.754312  6557 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.755801  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:41.759356  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:41.760485  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:41.761190  6242 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:41.762702  6557 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:21:41.762835  6297 leader_election.cc:341] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:41.763695  6416 leader_election.cc:341] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:41.764330  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:41.764267  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:41.765820  6597 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:41.766625  6557 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:41.767103  6559 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:41.767354  6557 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:41.768172  6557 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:41.783304  6545 tablet_bootstrap.cc:492] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:41.783634  6546 tablet_bootstrap.cc:492] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:41.783906  6545 ts_tablet_manager.cc:1397] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.066s	user 0.021s	sys 0.039s
I20260812 19:21:41.784287  6546 ts_tablet_manager.cc:1397] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.031s
I20260812 19:21:41.784667  6544 tablet_bootstrap.cc:654] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:41.788348  6546 raft_consensus.cc:348] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.792202  6546 raft_consensus.cc:374] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.792850  6546 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.790926  6545 raft_consensus.cc:348] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.793421  6545 raft_consensus.cc:374] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.793769  6545 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.793807  6546 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.794947  6545 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.798795  6545 ts_tablet_manager.cc:1428] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.003s
I20260812 19:21:41.803550  6545 tablet_bootstrap.cc:492] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:41.807418  6546 ts_tablet_manager.cc:1428] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.003s
I20260812 19:21:41.812808  6546 tablet_bootstrap.cc:492] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:41.816337  6545 tablet_bootstrap.cc:654] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:41.827294  6546 tablet_bootstrap.cc:654] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:41.828611  6615 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:41.829461  6615 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.833302  6615 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:41.835973  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:41.837375  6242 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:41.839030  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:41.840131  6483 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:41.843987  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:41.852241  6615 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:41.854072  6615 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:41.856107  6615 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:41.860105  6557 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.864912  6557 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:41.866477  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:41.867199  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:41.867442  6242 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:41.869370  6297 leader_election.cc:341] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:41.875185  6544 tablet_bootstrap.cc:492] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:41.875185  6545 tablet_bootstrap.cc:492] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:41.876303  6545 ts_tablet_manager.cc:1397] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.039s
I20260812 19:21:41.877475  6546 tablet_bootstrap.cc:492] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:41.878276  6546 ts_tablet_manager.cc:1397] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.021s
I20260812 19:21:41.878607  6615 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.880618  6242 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:41.881618  6545 raft_consensus.cc:348] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.882459  6546 raft_consensus.cc:348] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.882958  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:41.883261  6544 ts_tablet_manager.cc:1397] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.138s	user 0.035s	sys 0.044s
I20260812 19:21:41.883323  6546 raft_consensus.cc:374] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.882865  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:41.883797  6546 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.884356  6242 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:41.884749  6557 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:41.884828  6546 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.888410  6544 raft_consensus.cc:348] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.889765  6544 raft_consensus.cc:374] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.890296  6544 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.891530  6544 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.893182  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:41.894150  6483 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:41.882685  6545 raft_consensus.cc:374] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.894840  6545 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.895992  6545 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.900158  6545 ts_tablet_manager.cc:1428] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.003s
I20260812 19:21:41.901818  6544 ts_tablet_manager.cc:1428] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.003s
I20260812 19:21:41.903273  6544 tablet_bootstrap.cc:492] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:41.911597  6615 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:41.913625  6545 tablet_bootstrap.cc:492] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:41.918701  6544 tablet_bootstrap.cc:654] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:41.919422  6615 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:41.923062  6483 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:41.939023  6544 tablet_bootstrap.cc:492] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:41.947829  6544 ts_tablet_manager.cc:1397] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.019s
I20260812 19:21:41.940640  6627 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:41.948298  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:41.939683  6557 raft_consensus.cc:686] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:41.948421  6615 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.953223  6557 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.954921  6631 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:41.956727  6631 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:41.957612  6544 raft_consensus.cc:348] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.959026  6544 raft_consensus.cc:374] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:41.959470  6544 raft_consensus.cc:729] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:41.958117  6631 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.960708  6544 consensus_queue.cc:260] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.963734  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:41.965462  6559 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:41.966082  6559 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.966440  6242 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:41.964844  6627 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.971117  6559 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:41.972329  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:41.973558  6546 ts_tablet_manager.cc:1428] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.095s	user 0.029s	sys 0.041s
I20260812 19:21:41.973613  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:21:41.974668  6416 leader_election.cc:341] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:41.975034  6546 tablet_bootstrap.cc:492] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:41.974720  6241 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
W20260812 19:21:41.973925  6297 leader_election.cc:341] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:41.976995  6632 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:41.977799  6627 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:41.977797  6632 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:41.980020  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:41.981750  6632 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:41.981899  6559 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:41.982517  6559 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:41.982399  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:41.983207  6559 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:41.986266  6297 leader_election.cc:341] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:41.986281  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:41.987450  6615 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:41.988628  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:41.989708  6241 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:41.990620  6546 tablet_bootstrap.cc:654] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:41.993692  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:41.990640  6545 tablet_bootstrap.cc:654] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:41.994560  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:21:41.995116  6297 leader_election.cc:341] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:41.995796  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:41.996474  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:41.996891  6615 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:41.997623  6615 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:41.998131  6628 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:41.998509  6615 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:42.000283  6297 leader_election.cc:341] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.001164  6544 ts_tablet_manager.cc:1428] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.051s	user 0.011s	sys 0.000s
W20260812 19:21:42.005548  6297 leader_election.cc:341] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.006422  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:42.011220  6544 tablet_bootstrap.cc:492] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:42.019785  6546 tablet_bootstrap.cc:492] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:42.020370  6546 ts_tablet_manager.cc:1397] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.010s
I20260812 19:21:42.022830  6631 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:42.024271  6544 tablet_bootstrap.cc:654] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.024499  6546 raft_consensus.cc:348] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.025434  6546 raft_consensus.cc:374] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.025789  6546 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.026610  6546 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.034252  6546 ts_tablet_manager.cc:1428] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260812 19:21:42.035180  6545 tablet_bootstrap.cc:492] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:42.035575  6546 tablet_bootstrap.cc:492] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:42.035884  6545 ts_tablet_manager.cc:1397] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.123s	user 0.024s	sys 0.000s
I20260812 19:21:42.037412  6597 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:42.043896  6631 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:42.041904  6545 raft_consensus.cc:348] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.045121  6545 raft_consensus.cc:374] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.044911  6631 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.045780  6545 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.049320  6546 tablet_bootstrap.cc:654] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.049676  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:42.049124  6545 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:42.052160  6297 leader_election.cc:341] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.043982  6055 catalog_manager.cc:5495] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:42.056814  6631 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:42.057432  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:42.059012  6545 ts_tablet_manager.cc:1428] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.003s
W20260812 19:21:42.060190  6297 leader_election.cc:341] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.031045  6615 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.031045  6559 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.061739  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:42.063771  6631 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:42.069692  6590 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:42.070240  6590 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.073324  6590 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:42.073526  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:42.074553  6559 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:42.075199  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:21:42.076930  6178 leader_election.cc:341] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.077283  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:42.078617  6482 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:42.080554  6545 tablet_bootstrap.cc:492] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:42.080263  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:42.082533  6615 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:42.082607  6590 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:42.084079  6590 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:42.084690  6590 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.074363  6241 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.088621  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:42.089553  6242 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.092286  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:21:42.094343  6416 leader_election.cc:341] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.094175  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:21:42.120477  6297 leader_election.cc:341] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:42.122561  6178 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:42.128329  6544 tablet_bootstrap.cc:492] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:42.134699  6546 tablet_bootstrap.cc:492] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:42.135421  6546 ts_tablet_manager.cc:1397] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.041s
I20260812 19:21:42.134593  6590 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.136922  6055 catalog_manager.cc:5495] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:42.140161  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:42.141045  6241 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
W20260812 19:21:42.142467  6178 leader_election.cc:341] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.143838  6546 raft_consensus.cc:348] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.145030  6546 raft_consensus.cc:374] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.145449  6546 raft_consensus.cc:729] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.139107  6544 ts_tablet_manager.cc:1397] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.131s	user 0.015s	sys 0.019s
I20260812 19:21:42.146387  6546 consensus_queue.cc:260] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.148892  6546 ts_tablet_manager.cc:1428] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260812 19:21:42.150017  6546 tablet_bootstrap.cc:492] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:42.151906  6544 raft_consensus.cc:348] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.152768  6544 raft_consensus.cc:374] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.156523  6544 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.156931  6595 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:42.157431  6544 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.160168  6544 ts_tablet_manager.cc:1428] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260812 19:21:42.161307  6544 tablet_bootstrap.cc:492] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:42.155995  6545 tablet_bootstrap.cc:654] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.165166  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:42.168247  6546 tablet_bootstrap.cc:654] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.172282  6595 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:42.175344  6595 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:42.169576  6590 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:42.176757  6595 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.178418  6544 tablet_bootstrap.cc:654] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.178109  6242 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:42.183040  6559 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:42.183887  6559 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.194274  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:42.202150  6631 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:42.204608  6631 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:42.200301  6615 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:42.207736  6615 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.206753  6559 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:42.211257  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:42.212302  6483 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.205879  6631 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.220409  6615 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:42.221099  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:21:42.223316  6416 leader_election.cc:341] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.224195  6545 tablet_bootstrap.cc:492] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:42.223866  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:42.224633  6545 ts_tablet_manager.cc:1397] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.021s
I20260812 19:21:42.224851  6354 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
W20260812 19:21:42.229270  6138 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:21:42.229846  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:21:42.234467  6545 raft_consensus.cc:348] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.235780  6545 raft_consensus.cc:374] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.236462  6545 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.232820  6595 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:42.237483  6595 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:42.238021  6595 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.239481  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:42.240410  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:42.238766  6545 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:42.251214  6297 leader_election.cc:341] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:42.252434  6297 leader_election.cc:341] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.253096  6297 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:42.250514  6545 ts_tablet_manager.cc:1428] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260812 19:21:42.253103  6544 tablet_bootstrap.cc:492] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:42.254809  6615 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:42.255168  6544 ts_tablet_manager.cc:1397] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.094s	user 0.022s	sys 0.016s
I20260812 19:21:42.259941  6545 tablet_bootstrap.cc:492] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:42.263978  6544 raft_consensus.cc:348] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.269860  6544 raft_consensus.cc:374] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.270380  6544 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.271637  6544 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.275038  6615 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:42.275898  6615 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.278309  6544 ts_tablet_manager.cc:1428] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260812 19:21:42.279800  6615 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:42.282660  6544 tablet_bootstrap.cc:492] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:42.281545  6590 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:42.286137  6590 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.286688  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:42.286520  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:21:42.292358  6297 leader_election.cc:341] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:42.293578  6297 leader_election.cc:341] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.295609  6590 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:42.297441  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:42.296097  6546 tablet_bootstrap.cc:492] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:42.298544  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:42.298945  6546 ts_tablet_manager.cc:1397] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.149s	user 0.025s	sys 0.045s
I20260812 19:21:42.299361  6482 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:42.249760  6055 catalog_manager.cc:5495] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:42.297586  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:42.301154  6545 tablet_bootstrap.cc:654] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.300693  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:42.301995  6631 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:42.304237  6548 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:42.304901  6548 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:42.305572  6548 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.316663  6483 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:42.319803  6059 catalog_manager.cc:5495] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:42.295528  6595 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.326445  6546 raft_consensus.cc:348] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.327401  6546 raft_consensus.cc:374] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.327788  6546 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.328842  6546 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.332653  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:42.333565  6354 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.333329  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:42.334574  6546 ts_tablet_manager.cc:1428] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.000s
W20260812 19:21:42.335665  6416 leader_election.cc:341] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.339596  6546 tablet_bootstrap.cc:492] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:42.346292  6545 tablet_bootstrap.cc:492] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:42.347036  6545 ts_tablet_manager.cc:1397] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.087s	user 0.020s	sys 0.000s
I20260812 19:21:42.347724  6546 tablet_bootstrap.cc:654] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.348253  6595 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:42.351064  6545 raft_consensus.cc:348] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.353297  6544 tablet_bootstrap.cc:654] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.354887  6545 raft_consensus.cc:374] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.355262  6545 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.356241  6545 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.358911  6545 ts_tablet_manager.cc:1428] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260812 19:21:42.353596  6548 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.360005  6545 tablet_bootstrap.cc:492] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
W20260812 19:21:42.359927  6297 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:42.360889  6615 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:42.369298  6548 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:21:42.369540  6178 leader_election.cc:341] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.375092  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:42.379916  6590 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:42.383335  6590 raft_consensus.cc:686] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:42.383641  6664 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:42.385613  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:42.386617  6359 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.384635  6590 consensus_queue.cc:237] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.391763  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:42.392761  6483 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.384598  6354 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:42.405144  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:21:42.408999  6595 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:42.410462  6595 raft_consensus.cc:686] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:42.417444  6595 consensus_queue.cc:237] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.431532  6544 tablet_bootstrap.cc:492] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:42.432157  6544 ts_tablet_manager.cc:1397] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.150s	user 0.034s	sys 0.027s
I20260812 19:21:42.432740  6545 tablet_bootstrap.cc:654] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.435631  6546 tablet_bootstrap.cc:492] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:42.436211  6546 ts_tablet_manager.cc:1397] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.097s	user 0.018s	sys 0.000s
I20260812 19:21:42.442529  6590 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:42.443400  6590 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.443653  6546 raft_consensus.cc:348] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.447181  6546 raft_consensus.cc:374] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.447541  6546 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.449877  6590 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:42.451435  6559 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:42.452407  6559 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.445227  6359 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:42.448132  6546 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.444137  6483 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:42.456790  6544 raft_consensus.cc:348] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.467584  6544 raft_consensus.cc:374] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.468082  6544 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.468655  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:42.469081  6544 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.469422  6559 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:42.470693  6664 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:42.471582  6546 ts_tablet_manager.cc:1428] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260812 19:21:42.471517  6664 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:42.466231  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:42.472908  6546 tablet_bootstrap.cc:492] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:42.471544  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:42.472800  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:42.473073  6664 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.455709  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:42.476562  6238 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:42.478984  6353 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:42.480994  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:42.481951  6590 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:42.482338  6590 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:42.482784  6590 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.477389  6544 ts_tablet_manager.cc:1428] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.013s
I20260812 19:21:42.484905  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:42.487074  6482 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:42.488973  6595 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:42.490217  6544 tablet_bootstrap.cc:492] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:42.490492  6595 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:42.491074  6595 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.503145  6060 catalog_manager.cc:5495] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:42.516045  6595 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.510354  6590 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.521239  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:42.520249  6590 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:42.522869  6238 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 1: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:21:42.523432  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:42.526687  6353 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.528226  6546 tablet_bootstrap.cc:654] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.529347  6544 tablet_bootstrap.cc:654] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.523897  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:42.530575  6482 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:42.530337  6595 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:42.532613  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:42.536051  6545 tablet_bootstrap.cc:492] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:42.536603  6545 ts_tablet_manager.cc:1397] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.177s	user 0.016s	sys 0.004s
I20260812 19:21:42.539152  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:42.543555  6595 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:21:42.549710  6545 raft_consensus.cc:348] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.550915  6545 raft_consensus.cc:374] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.551754  6545 raft_consensus.cc:729] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.553172  6545 consensus_queue.cc:260] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.561100  6590 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:42.561866  6590 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.564677  6545 ts_tablet_manager.cc:1428] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.004s
I20260812 19:21:42.566156  6545 tablet_bootstrap.cc:492] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:42.572124  6353 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:42.574187  6590 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:42.578382  6055 catalog_manager.cc:5495] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:42.579542  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:42.580428  6544 tablet_bootstrap.cc:492] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:42.580514  6354 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:42.581056  6544 ts_tablet_manager.cc:1397] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.028s
I20260812 19:21:42.581451  6631 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:42.582161  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:42.582706  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:42.582950  6483 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:42.583786  6590 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:42.584378  6590 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:42.584930  6590 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.588224  6546 tablet_bootstrap.cc:492] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:42.588749  6546 ts_tablet_manager.cc:1397] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.116s	user 0.011s	sys 0.011s
I20260812 19:21:42.589890  6055 catalog_manager.cc:5495] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:42.593451  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:42.594884  6664 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:42.595181  6615 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:42.595681  6664 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:42.595916  6544 raft_consensus.cc:348] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.596822  6544 raft_consensus.cc:374] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.597268  6544 raft_consensus.cc:729] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.597172  6664 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.598066  6544 consensus_queue.cc:260] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.599347  6546 raft_consensus.cc:348] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.600050  6546 raft_consensus.cc:374] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.600302  6546 raft_consensus.cc:729] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.600437  6544 ts_tablet_manager.cc:1428] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260812 19:21:42.596057  6545 tablet_bootstrap.cc:654] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.600924  6546 consensus_queue.cc:260] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.603869  6544 tablet_bootstrap.cc:492] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:42.613063  6546 ts_tablet_manager.cc:1428] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.008s
I20260812 19:21:42.613449  6544 tablet_bootstrap.cc:654] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.614151  6546 tablet_bootstrap.cc:492] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:42.634447  6546 tablet_bootstrap.cc:654] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.622334  6595 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260812 19:21:42.651902  6590 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.655364  6545 tablet_bootstrap.cc:492] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:42.656062  6545 ts_tablet_manager.cc:1397] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.021s
I20260812 19:21:42.660647  6590 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:42.661904  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:42.663198  6353 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.664310  6544 tablet_bootstrap.cc:492] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:42.664834  6544 ts_tablet_manager.cc:1397] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.014s
W20260812 19:21:42.656726  6416 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:42.675498  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:42.677723  6483 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.681795  6481 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.688915  6544 raft_consensus.cc:348] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.689857  6545 raft_consensus.cc:348] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.690168  6353 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:42.690845  6545 raft_consensus.cc:374] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.691238  6545 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.691819  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:42.691993  6545 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.693464  6664 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:42.694253  6544 raft_consensus.cc:374] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.694165  6664 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:42.694171  6545 ts_tablet_manager.cc:1428] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.007s
I20260812 19:21:42.695739  6545 tablet_bootstrap.cc:492] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:42.695564  6664 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.696509  6483 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
W20260812 19:21:42.697000  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:42.699827  6544 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.700803  6544 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.704025  6544 ts_tablet_manager.cc:1428] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.003s
I20260812 19:21:42.705452  6544 tablet_bootstrap.cc:492] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:42.714057  6615 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:42.720566  6544 tablet_bootstrap.cc:654] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.722826  6546 tablet_bootstrap.cc:492] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:42.723296  6546 ts_tablet_manager.cc:1397] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.010s
I20260812 19:21:42.761837  6545 tablet_bootstrap.cc:654] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.744885  6055 catalog_manager.cc:5495] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:42.764708  6055 catalog_manager.cc:5495] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:42.767686  6546 raft_consensus.cc:348] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.768457  6546 raft_consensus.cc:374] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.768818  6546 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.769623  6546 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.772450  6546 ts_tablet_manager.cc:1428] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260812 19:21:42.774087  6546 tablet_bootstrap.cc:492] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:42.775478  6595 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:42.775936  6595 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.777968  6595 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:42.780556  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:42.783788  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:42.785104  6559 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:21:42.785676  6559 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.788969  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:42.789734  6559 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:42.793602  6703 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:42.804275  6544 tablet_bootstrap.cc:492] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:42.804787  6544 ts_tablet_manager.cc:1397] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.100s	user 0.017s	sys 0.024s
I20260812 19:21:42.820803  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:42.822325  6544 raft_consensus.cc:348] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.823172  6544 raft_consensus.cc:374] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.823437  6544 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.824018  6544 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.826124  6544 ts_tablet_manager.cc:1428] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260812 19:21:42.827073  6544 tablet_bootstrap.cc:492] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:42.822893  6546 tablet_bootstrap.cc:654] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.828483  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:42.831620  6545 tablet_bootstrap.cc:492] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:42.832199  6545 ts_tablet_manager.cc:1397] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.137s	user 0.011s	sys 0.015s
I20260812 19:21:42.833756  6544 tablet_bootstrap.cc:654] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.833686  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:42.835009  6704 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:21:42.837957  6545 raft_consensus.cc:348] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.838806  6545 raft_consensus.cc:374] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.839133  6545 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.839717  6546 tablet_bootstrap.cc:492] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:42.840159  6546 ts_tablet_manager.cc:1397] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.003s
I20260812 19:21:42.840241  6545 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.842708  6546 raft_consensus.cc:348] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.843323  6546 raft_consensus.cc:374] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.843555  6546 raft_consensus.cc:729] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.844143  6546 consensus_queue.cc:260] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.846055  6546 ts_tablet_manager.cc:1428] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260812 19:21:42.847397  6546 tablet_bootstrap.cc:492] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:42.853093  6546 tablet_bootstrap.cc:654] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.855029  6545 ts_tablet_manager.cc:1428] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260812 19:21:42.858850  6544 tablet_bootstrap.cc:492] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:42.859342  6544 ts_tablet_manager.cc:1397] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.019s
I20260812 19:21:42.859977  6546 tablet_bootstrap.cc:492] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:42.860399  6546 ts_tablet_manager.cc:1397] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260812 19:21:42.861876  6544 raft_consensus.cc:348] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.862607  6544 raft_consensus.cc:374] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.862912  6544 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.862730  6546 raft_consensus.cc:348] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.863512  6546 raft_consensus.cc:374] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.863797  6546 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:42.863672  6544 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.865868  6544 ts_tablet_manager.cc:1428] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 19:21:42.863266  6545 tablet_bootstrap.cc:492] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:42.866858  6544 tablet_bootstrap.cc:492] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:42.871325  6704 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:42.872128  6544 tablet_bootstrap.cc:654] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.872223  6545 tablet_bootstrap.cc:654] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.864399  6546 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.875774  6546 ts_tablet_manager.cc:1428] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260812 19:21:42.876876  6546 tablet_bootstrap.cc:492] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:42.877348  6704 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:42.878060  6704 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.882119  6704 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:42.883229  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:42.884074  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:42.884274  6242 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:42.884914  6354 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:42.886960  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:42.888648  6704 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:42.889149  6704 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:42.889616  6704 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.892625  6590 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:42.905357  6354 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.907605  6704 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.911389  6704 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:42.915880  6631 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:42.916105  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:42.917690  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:42.916913  6631 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.918828  6353 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.921435  6242 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:42.927181  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:21:42.931239  6297 leader_election.cc:341] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.931430  6631 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:42.933724  6545 tablet_bootstrap.cc:492] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:42.934414  6545 ts_tablet_manager.cc:1397] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.071s	user 0.020s	sys 0.010s
I20260812 19:21:42.938966  6704 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:21:42.939851  6416 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:42.939632  6704 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.942250  6664 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:42.942987  6704 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:42.945318  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:42.946571  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:42.947095  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:21:42.948614  6297 leader_election.cc:341] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.948802  6238 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:42.949208  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:42.951071  6416 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:42.952093  6631 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:42.953835  6704 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:42.954770  6704 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:42.955391  6704 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:42.954046  6416 leader_election.cc:341] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.965526  6546 tablet_bootstrap.cc:654] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:42.967751  6353 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:42.968899  6631 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:42.970229  6631 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.973527  6631 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:42.976406  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:42.978412  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:42.978809  6242 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:42.979343  6238 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:42.971859  6545 raft_consensus.cc:348] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.980572  6545 raft_consensus.cc:374] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:42.981032  6545 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
W20260812 19:21:42.980659  6297 leader_election.cc:341] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:42.981891  6545 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.983367  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:42.984367  6545 ts_tablet_manager.cc:1428] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260812 19:21:42.985217  6597 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:42.985939  6597 raft_consensus.cc:686] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:42.986227  6664 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:42.987663  6597 consensus_queue.cc:237] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:42.990861  6545 tablet_bootstrap.cc:492] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:42.998025  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:42.999681  6631 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:43.000326  6631 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:43.003177  6631 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.017603  6544 tablet_bootstrap.cc:492] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:43.018224  6544 ts_tablet_manager.cc:1397] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.152s	user 0.013s	sys 0.057s
I20260812 19:21:43.026532  6544 raft_consensus.cc:348] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.027510  6544 raft_consensus.cc:374] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.027825  6544 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.033175  6544 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.036164  6544 ts_tablet_manager.cc:1428] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260812 19:21:43.037308  6544 tablet_bootstrap.cc:492] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:43.040565  6545 tablet_bootstrap.cc:654] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.043045  6664 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:43.047972  6544 tablet_bootstrap.cc:654] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.052093  6631 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.056169  6631 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:43.058288  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:43.063372  6664 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:43.064391  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:43.064826  6664 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.065544  6238 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:43.071951  6297 leader_election.cc:341] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:43.070158  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:43.073375  6359 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:43.053112  6058 catalog_manager.cc:5495] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:43.074362  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:43.078235  6238 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:43.080730  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:43.082197  6631 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:43.083151  6631 raft_consensus.cc:686] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:21:43.083211  6178 leader_election.cc:341] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:43.084393  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:43.086222  6675 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:43.086824  6675 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:43.087498  6675 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.086947  6704 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.090803  6664 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:43.092263  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:43.090299  6704 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:43.084560  6631 consensus_queue.cc:237] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:43.097388  6416 leader_election.cc:341] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:43.125782  6482 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.105628  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:43.131968  6238 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.144866  6545 tablet_bootstrap.cc:492] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:43.145500  6545 ts_tablet_manager.cc:1397] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.155s	user 0.021s	sys 0.006s
I20260812 19:21:43.148545  6545 raft_consensus.cc:348] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.149456  6545 raft_consensus.cc:374] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.149767  6545 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.149878  6675 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.185568  6545 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.180749  6615 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:43.193233  6615 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.196547  6615 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:43.192215  6545 ts_tablet_manager.cc:1428] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.046s	user 0.011s	sys 0.000s
I20260812 19:21:43.198216  6545 tablet_bootstrap.cc:492] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:43.198415  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:43.207852  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:43.215301  6546 tablet_bootstrap.cc:492] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:43.215900  6546 ts_tablet_manager.cc:1397] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.339s	user 0.008s	sys 0.030s
W20260812 19:21:43.219563  6297 leader_election.cc:341] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:43.221004  6297 leader_election.cc:341] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:43.227273  6297 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:43.233693  6615 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:43.240049  6704 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:43.240989  6704 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.243060  6590 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:43.245425  6704 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:43.248562  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:43.249730  6359 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:43.253036  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:43.258723  6590 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:43.232547  6546 raft_consensus.cc:348] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.260440  6546 raft_consensus.cc:374] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260812 19:21:43.260691  6416 leader_election.cc:341] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:43.262502  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:21:43.264868  6704 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:43.266007  6704 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:21:43.270171  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 49231.8us
I20260812 19:21:43.271186  6704 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.269075  6545 tablet_bootstrap.cc:654] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.268514  6590 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:43.260811  6546 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.277474  6546 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.284649  6544 tablet_bootstrap.cc:492] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:43.285295  6544 ts_tablet_manager.cc:1397] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.248s	user 0.047s	sys 0.055s
I20260812 19:21:43.296132  6546 ts_tablet_manager.cc:1428] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.005s
I20260812 19:21:43.299875  6544 raft_consensus.cc:348] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.303359  6544 raft_consensus.cc:374] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.303879  6544 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.300004  6590 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:43.285264  6238 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:43.305809  6544 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.286794  6675 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:43.307893  6546 tablet_bootstrap.cc:492] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:43.313054  6544 ts_tablet_manager.cc:1428] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.001s
I20260812 19:21:43.314188  6544 tablet_bootstrap.cc:492] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:43.314947  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:43.316000  6353 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.324813  6704 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.328850  6704 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:43.382802  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:43.388741  6352 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.388567  6416 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:43.390379  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:43.391475  6482 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.392882  6597 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:43.393713  6546 tablet_bootstrap.cc:654] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.393800  6597 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:43.396242  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:43.396462  6597 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.329866  6353 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
W20260812 19:21:43.403646  6756 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260812 19:21:43.407085  6416 leader_election.cc:341] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:43.410320  6675 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:21:43.417923  6138 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:21:43.417728  6675 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.418815  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:43.420442  6590 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:43.420943  6675 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:43.421502  6590 raft_consensus.cc:686] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:43.423352  6590 consensus_queue.cc:237] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.427597  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:43.428781  6544 tablet_bootstrap.cc:654] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.437008  6060 catalog_manager.cc:5495] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:43.445971  6352 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
W20260812 19:21:43.447927  6178 leader_election.cc:341] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:43.461804  6545 tablet_bootstrap.cc:492] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:43.462525  6545 ts_tablet_manager.cc:1397] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.265s	user 0.015s	sys 0.015s
I20260812 19:21:43.468238  6545 raft_consensus.cc:348] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.470732  6482 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:43.474406  6544 tablet_bootstrap.cc:492] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:43.477397  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:43.479794  6545 raft_consensus.cc:374] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.483731  6545 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.481210  6546 tablet_bootstrap.cc:492] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:43.484937  6546 ts_tablet_manager.cc:1397] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.177s	user 0.018s	sys 0.033s
I20260812 19:21:43.484937  6544 ts_tablet_manager.cc:1397] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.171s	user 0.031s	sys 0.020s
I20260812 19:21:43.485354  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:21:43.485278  6703 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:43.486557  6704 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:43.487147  6704 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:43.485817  6545 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.488313  6704 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.494180  6546 raft_consensus.cc:348] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.495062  6546 raft_consensus.cc:374] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.495396  6546 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.496208  6546 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.498669  6546 ts_tablet_manager.cc:1428] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.000s
W20260812 19:21:43.498867  6178 leader_election.cc:341] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:43.499383  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:43.499702  6352 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.499974  6546 tablet_bootstrap.cc:492] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:43.500361  6675 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:43.507092  6060 catalog_manager.cc:5495] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:43.510521  6545 ts_tablet_manager.cc:1428] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260812 19:21:43.510258  6544 raft_consensus.cc:348] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.513988  6544 raft_consensus.cc:374] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.514381  6544 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.515447  6615 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:43.515231  6544 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.516016  6615 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.518241  6544 ts_tablet_manager.cc:1428] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260812 19:21:43.519768  6544 tablet_bootstrap.cc:492] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:43.521000  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:43.526605  6545 tablet_bootstrap.cc:492] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
W20260812 19:21:43.530380  6297 leader_election.cc:341] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:43.531334  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:21:43.533207  6297 leader_election.cc:341] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:43.533675  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:43.534910  6557 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:43.535321  6545 tablet_bootstrap.cc:654] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.518390  6615 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:43.539845  6546 tablet_bootstrap.cc:654] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.543298  6238 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.547876  6544 tablet_bootstrap.cc:654] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.559054  6055 catalog_manager.cc:5495] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:43.566555  6545 tablet_bootstrap.cc:492] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:43.567293  6545 ts_tablet_manager.cc:1397] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.009s
I20260812 19:21:43.570001  6545 raft_consensus.cc:348] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.570868  6545 raft_consensus.cc:374] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.571149  6545 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.571431  6615 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:43.571831  6545 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.573935  6545 ts_tablet_manager.cc:1428] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 19:21:43.575066  6545 tablet_bootstrap.cc:492] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:43.598058  6704 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:43.610564  6545 tablet_bootstrap.cc:654] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
W20260812 19:21:43.621749  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:43.655059  6544 tablet_bootstrap.cc:492] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:43.655767  6544 ts_tablet_manager.cc:1397] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.136s	user 0.019s	sys 0.029s
I20260812 19:21:43.660015  6544 raft_consensus.cc:348] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.661049  6544 raft_consensus.cc:374] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.661412  6544 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.671422  6546 tablet_bootstrap.cc:492] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:43.671926  6546 ts_tablet_manager.cc:1397] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.172s	user 0.029s	sys 0.034s
I20260812 19:21:43.670198  6544 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.673398  6545 tablet_bootstrap.cc:492] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:43.673965  6545 ts_tablet_manager.cc:1397] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.002s
I20260812 19:21:43.674368  6544 ts_tablet_manager.cc:1428] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260812 19:21:43.677265  6544 tablet_bootstrap.cc:492] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:43.676929  6545 raft_consensus.cc:348] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.678045  6545 raft_consensus.cc:374] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.678406  6545 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.679217  6545 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.682024  6545 ts_tablet_manager.cc:1428] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260812 19:21:43.683291  6545 tablet_bootstrap.cc:492] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:43.684062  6544 tablet_bootstrap.cc:654] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.689456  6545 tablet_bootstrap.cc:654] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.692119  6664 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:43.692664  6664 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.693907  6546 raft_consensus.cc:348] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.694590  6546 raft_consensus.cc:374] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.694882  6546 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.695469  6546 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.696023  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:43.697814  6546 ts_tablet_manager.cc:1428] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
W20260812 19:21:43.698122  6178 leader_election.cc:341] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:43.698849  6546 tablet_bootstrap.cc:492] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:43.704047  6704 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:43.704555  6544 tablet_bootstrap.cc:492] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:43.705120  6544 ts_tablet_manager.cc:1397] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.028s	user 0.003s	sys 0.013s
I20260812 19:21:43.704667  6704 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.707808  6544 raft_consensus.cc:348] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.708606  6544 raft_consensus.cc:374] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.708499  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:43.708982  6544 raft_consensus.cc:729] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.709656  6544 consensus_queue.cc:260] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:43.710505  6178 leader_election.cc:341] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:43.710974  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:43.711413  6544 ts_tablet_manager.cc:1428] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260812 19:21:43.711933  6546 tablet_bootstrap.cc:654] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.712111  6755 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:43.712783  6544 tablet_bootstrap.cc:492] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:43.713470  6664 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:43.714187  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:43.715830  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:43.716140  6545 tablet_bootstrap.cc:492] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:43.716727  6545 ts_tablet_manager.cc:1397] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.006s
I20260812 19:21:43.717360  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:43.718863  6597 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:43.720737  6545 raft_consensus.cc:348] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.726853  6545 raft_consensus.cc:374] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.722960  6055 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:43.727383  6545 raft_consensus.cc:729] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.728240  6545 consensus_queue.cc:260] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.725481  6544 tablet_bootstrap.cc:654] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.714151  6704 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:43.731462  6545 ts_tablet_manager.cc:1428] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260812 19:21:43.738001  6544 tablet_bootstrap.cc:492] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:43.735230  6546 tablet_bootstrap.cc:492] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:43.738483  6544 ts_tablet_manager.cc:1397] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.002s
I20260812 19:21:43.738803  6546 ts_tablet_manager.cc:1397] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.003s
I20260812 19:21:43.740702  6545 tablet_bootstrap.cc:492] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:43.742509  6544 raft_consensus.cc:348] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.743381  6544 raft_consensus.cc:374] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.744066  6544 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.744745  6544 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.745951  6477 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.746976  6544 ts_tablet_manager.cc:1428] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260812 19:21:43.746366  6546 raft_consensus.cc:348] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.750444  6546 raft_consensus.cc:374] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.750820  6546 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.748088  6544 tablet_bootstrap.cc:492] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:43.751531  6546 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.756405  6546 ts_tablet_manager.cc:1428] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260812 19:21:43.760869  6545 tablet_bootstrap.cc:654] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.761569  6546 tablet_bootstrap.cc:492] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:43.763108  6664 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:43.763633  6664 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.765834  6664 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:43.766548  6544 tablet_bootstrap.cc:654] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.767514  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:43.768988  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:43.770308  6704 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:43.770844  6704 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.771791  6546 tablet_bootstrap.cc:654] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.773008  6704 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:43.779614  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:43.780560  6242 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:43.782493  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:43.783324  6352 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:43.783475  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:21:43.782518  6178 leader_election.cc:341] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:43.785465  6178 leader_election.cc:341] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:43.785905  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:43.786767  6664 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:43.784670  6704 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:43.789510  6704 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:43.789928  6704 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.797847  6704 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.802443  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:43.803179  6242 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.804011  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:43.804685  6352 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.811730  6352 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:43.812812  6242 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:43.812987  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:43.814267  6597 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:43.814828  6597 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:43.815632  6597 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.822358  6545 tablet_bootstrap.cc:492] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:43.822989  6545 ts_tablet_manager.cc:1397] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.021s
I20260812 19:21:43.825908  6704 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:43.826601  6545 raft_consensus.cc:348] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.828058  6545 raft_consensus.cc:374] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.831444  6545 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.831087  6544 tablet_bootstrap.cc:492] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:43.832697  6544 ts_tablet_manager.cc:1397] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.085s	user 0.026s	sys 0.011s
I20260812 19:21:43.834892  6545 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.840220  6545 ts_tablet_manager.cc:1428] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.006s
I20260812 19:21:43.837339  6544 raft_consensus.cc:348] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.841480  6544 raft_consensus.cc:374] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.841850  6544 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.842778  6544 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.844300  6545 tablet_bootstrap.cc:492] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:43.845817  6544 ts_tablet_manager.cc:1428] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260812 19:21:43.847293  6544 tablet_bootstrap.cc:492] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:43.856302  6060 catalog_manager.cc:5495] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:43.862905  6544 tablet_bootstrap.cc:654] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.863806  6546 tablet_bootstrap.cc:492] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:43.864271  6546 ts_tablet_manager.cc:1397] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.103s	user 0.021s	sys 0.002s
I20260812 19:21:43.866825  6546 raft_consensus.cc:348] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.867513  6546 raft_consensus.cc:374] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.867779  6546 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.868386  6546 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.870446  6546 ts_tablet_manager.cc:1428] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 19:21:43.871397  6544 tablet_bootstrap.cc:492] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:43.871919  6544 ts_tablet_manager.cc:1397] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.005s
I20260812 19:21:43.872715  6546 tablet_bootstrap.cc:492] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:43.875519  6545 tablet_bootstrap.cc:654] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.875226  6544 raft_consensus.cc:348] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.876111  6544 raft_consensus.cc:374] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.876471  6544 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.877398  6544 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.880353  6544 ts_tablet_manager.cc:1428] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260812 19:21:43.882272  6546 tablet_bootstrap.cc:654] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.887212  6545 tablet_bootstrap.cc:492] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:43.887655  6545 ts_tablet_manager.cc:1397] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.004s
I20260812 19:21:43.882417  6544 tablet_bootstrap.cc:492] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:43.890216  6545 raft_consensus.cc:348] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.890939  6545 raft_consensus.cc:374] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.891206  6545 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.891868  6545 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.893884  6545 ts_tablet_manager.cc:1428] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 19:21:43.895047  6545 tablet_bootstrap.cc:492] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:43.896886  6544 tablet_bootstrap.cc:654] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.898049  6352 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.900388  6545 tablet_bootstrap.cc:654] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:43.907220  6615 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:43.909391  6615 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.916976  6544 tablet_bootstrap.cc:492] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:43.917445  6544 ts_tablet_manager.cc:1397] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.000s
I20260812 19:21:43.920058  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:43.920132  6544 raft_consensus.cc:348] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.920823  6242 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:43.920859  6544 raft_consensus.cc:374] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:43.922857  6544 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:43.923668  6544 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:43.926381  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:43.926793  6544 ts_tablet_manager.cc:1428] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.007s
I20260812 19:21:43.927289  6557 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:43.927665  6557 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:43.928041  6557 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:43.927758  6544 tablet_bootstrap.cc:492] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:43.931627  6615 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:43.937887  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:43.936278  6704 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260812 19:21:44.004982  6546 tablet_bootstrap.cc:492] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:44.005524  6546 ts_tablet_manager.cc:1397] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.133s	user 0.020s	sys 0.035s
I20260812 19:21:43.990201  6664 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:44.006026  6477 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:44.011987  6664 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.016471  6597 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:44.019281  6675 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:44.020140  6544 tablet_bootstrap.cc:654] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.019474  6664 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:44.021579  6545 tablet_bootstrap.cc:492] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:44.029495  6545 ts_tablet_manager.cc:1397] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.135s	user 0.029s	sys 0.036s
I20260812 19:21:44.029479  6615 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:44.034266  6615 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.037784  6615 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:44.040027  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:44.039762  6545 raft_consensus.cc:348] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.045475  6545 raft_consensus.cc:374] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.046991  6664 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:44.045851  6545 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.047524  6664 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.048854  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:44.050184  6664 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:44.044207  6597 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:44.051913  6597 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.053357  6557 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.053768  6597 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:21:44.053893  6416 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:44.055717  6545 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.066468  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:44.066709  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:44.067430  6242 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:44.069964  6557 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:44.073087  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:44.072209  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:44.073751  6241 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:44.074379  6546 raft_consensus.cc:348] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.076535  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:44.077154  6241 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.076819  6546 raft_consensus.cc:374] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.073873  6477 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.070796  6545 ts_tablet_manager.cc:1428] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260812 19:21:44.088181  6546 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.092239  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:44.090408  6544 tablet_bootstrap.cc:492] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:44.093389  6544 ts_tablet_manager.cc:1397] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.166s	user 0.009s	sys 0.006s
I20260812 19:21:44.093703  6545 tablet_bootstrap.cc:492] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:44.091202  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:44.083626  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:44.094842  6352 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:44.092622  6546 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.096716  6544 raft_consensus.cc:348] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.097388  6544 raft_consensus.cc:374] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.097232  6359 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:44.097673  6544 raft_consensus.cc:729] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.099256  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:44.100193  6477 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:44.093616  6241 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:44.103410  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:44.104249  6615 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:44.098310  6544 consensus_queue.cc:260] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.104871  6615 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:44.115499  6544 ts_tablet_manager.cc:1428] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260812 19:21:44.116192  6615 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.119491  6704 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:44.120015  6704 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:44.083648  6178 leader_election.cc:341] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:44.111176  6557 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:21:44.127990  6546 ts_tablet_manager.cc:1428] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.122s	user 0.006s	sys 0.002s
I20260812 19:21:44.132615  6557 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:21:44.133178  6557 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:44.134979  6704 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:44.139613  6544 tablet_bootstrap.cc:492] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:44.142557  6545 tablet_bootstrap.cc:654] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.143191  6546 tablet_bootstrap.cc:492] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:44.146349  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:44.144850  6055 catalog_manager.cc:5495] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:44.146232  6703 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:44.147845  6703 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:44.148204  6703 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:44.148536  6703 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.150149  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:44.151202  6353 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:44.156291  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:44.154213  6477 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:44.129268  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 45663.2us
W20260812 19:21:44.175139  6178 leader_election.cc:341] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:44.175223  6416 leader_election.cc:341] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:44.186075  6546 tablet_bootstrap.cc:654] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.189244  6703 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.191398  6544 tablet_bootstrap.cc:654] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.178468  6827 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:44.191459  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:44.194970  6824 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:44.193394  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:21:44.192521  6827 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:44.198171  6831 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260812 19:21:44.203255  6178 leader_election.cc:341] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:44.205750  6703 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:44.208072  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:44.208766  6238 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.212776  6832 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:44.213143  6832 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:44.213444  6832 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.219944  6545 tablet_bootstrap.cc:492] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:44.220856  6545 ts_tablet_manager.cc:1397] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.127s	user 0.013s	sys 0.003s
I20260812 19:21:44.221307  6824 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:44.224639  6238 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:44.227550  6827 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:44.228653  6557 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.228681  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:44.249704  6238 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:44.251209  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:44.253197  6827 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:44.253669  6827 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:44.254153  6827 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.261752  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:44.262887  6675 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:44.263341  6675 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:44.263736  6675 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.231992  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:44.246388  6353 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:21:44.246258  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:44.271042  6352 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:44.275578  6297 leader_election.cc:341] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:44.274590  6545 raft_consensus.cc:348] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.279592  6545 raft_consensus.cc:374] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.279999  6545 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.284102  6546 tablet_bootstrap.cc:492] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:44.284646  6546 ts_tablet_manager.cc:1397] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.142s	user 0.020s	sys 0.018s
I20260812 19:21:44.287950  6557 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:44.231348  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:44.289183  6545 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:44.289873  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 58628.2us
I20260812 19:21:44.291183  6703 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:44.297595  6546 raft_consensus.cc:348] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.298023  6703 raft_consensus.cc:686] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:44.298297  6546 raft_consensus.cc:374] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.298561  6546 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.298900  6703 consensus_queue.cc:237] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.293720  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:44.294801  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:44.296156  6545 ts_tablet_manager.cc:1428] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.000s
I20260812 19:21:44.300724  6546 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.303853  6833 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:44.305917  6833 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:21:44.306295  6833 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:44.307798  6833 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.308804  6544 tablet_bootstrap.cc:492] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:44.310110  6544 ts_tablet_manager.cc:1397] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.180s	user 0.019s	sys 0.017s
I20260812 19:21:44.310075  6833 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:44.293689  6832 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.314118  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:44.315186  6631 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:21:44.300292  6675 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.324213  6546 ts_tablet_manager.cc:1428] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260812 19:21:44.326388  6352 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:44.333938  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:44.334618  6352 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.342934  6597 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:44.343600  6545 tablet_bootstrap.cc:492] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:44.355123  6546 tablet_bootstrap.cc:492] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:44.351944  6675 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:44.332151  6827 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.359261  6832 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:44.360795  6827 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:44.361893  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:44.361891  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:44.362429  6544 raft_consensus.cc:348] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.363981  6544 raft_consensus.cc:374] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.364358  6544 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
W20260812 19:21:44.367165  6297 leader_election.cc:341] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:44.365715  6544 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.350338  6352 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:44.371809  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:44.372367  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:44.372675  6544 ts_tablet_manager.cc:1428] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.001s
I20260812 19:21:44.372996  6241 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.368682  6238 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.373661  6544 tablet_bootstrap.cc:492] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:44.375692  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:21:44.375887  6178 leader_election.cc:341] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:44.376271  6359 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.381750  6241 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:44.384128  6545 tablet_bootstrap.cc:654] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.384671  6359 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:44.388038  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:44.388167  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:44.388994  6597 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:44.389441  6597 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:44.392001  6597 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.394902  6675 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:44.395377  6675 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:44.396087  6060 catalog_manager.cc:5495] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:44.398052  6238 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:44.400629  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:44.401305  6827 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:44.401772  6827 raft_consensus.cc:686] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:44.402546  6827 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.408860  6675 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.412967  6833 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:44.444762  6546 tablet_bootstrap.cc:654] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.450534  6060 catalog_manager.cc:5495] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:44.454820  6544 tablet_bootstrap.cc:654] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.476869  6545 tablet_bootstrap.cc:492] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:44.477393  6545 ts_tablet_manager.cc:1397] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.011s
I20260812 19:21:44.477164  6058 catalog_manager.cc:5495] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:44.484176  6824 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:44.484952  6824 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.488284  6824 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:44.491001  6833 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:44.492283  6833 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.492712  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:21:44.499325  6178 leader_election.cc:341] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:44.501389  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:44.503720  6827 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:21:44.504333  6178 leader_election.cc:341] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:44.504889  6178 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:44.504456  6827 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.506502  6833 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:44.507529  6827 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:44.515973  6545 raft_consensus.cc:348] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.517637  6545 raft_consensus.cc:374] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.516077  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:44.516758  6824 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:44.518975  6477 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:44.519996  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:44.520792  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:44.517015  6060 catalog_manager.cc:5495] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:44.520040  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:21:44.522176  6416 leader_election.cc:341] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:44.522583  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:44.523505  6238 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
W20260812 19:21:44.524281  6416 leader_election.cc:341] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:44.524915  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:44.525908  6833 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:44.526059  6827 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:44.526881  6827 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:44.527559  6827 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.518193  6545 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.529492  6545 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.533217  6545 ts_tablet_manager.cc:1428] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.002s
I20260812 19:21:44.541791  6833 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:44.545943  6544 tablet_bootstrap.cc:492] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:44.542551  6833 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.548866  6544 ts_tablet_manager.cc:1397] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.175s	user 0.017s	sys 0.021s
I20260812 19:21:44.550540  6833 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:44.552558  6545 tablet_bootstrap.cc:492] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:44.554383  6546 tablet_bootstrap.cc:492] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:44.554986  6546 ts_tablet_manager.cc:1397] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.202s	user 0.028s	sys 0.021s
I20260812 19:21:44.563478  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:44.564462  6238 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:44.559007  6544 raft_consensus.cc:348] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.566552  6544 raft_consensus.cc:374] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.566927  6544 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.567613  6544 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.569545  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:21:44.572083  6138 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:21:44.572713  6544 ts_tablet_manager.cc:1428] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.009s
I20260812 19:21:44.574013  6544 tablet_bootstrap.cc:492] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:44.580775  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:44.584354  6546 raft_consensus.cc:348] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.585368  6546 raft_consensus.cc:374] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.585669  6546 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.586455  6546 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.573803  6827 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.587997  6833 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:44.588531  6833 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:44.588929  6833 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.590903  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:44.591766  6238 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.602950  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:44.605173  6477 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.610152  6545 tablet_bootstrap.cc:654] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.611522  6546 ts_tablet_manager.cc:1428] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
W20260812 19:21:44.615824  6416 leader_election.cc:341] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:44.622817  6833 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.626134  6833 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:44.627266  6546 tablet_bootstrap.cc:492] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:44.636442  6544 tablet_bootstrap.cc:654] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.609835  6827 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:44.638005  6615 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:44.643275  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:44.644194  6242 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.648031  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:21:44.650568  6416 leader_election.cc:341] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:44.637203  6477 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:44.658903  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:44.661289  6615 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:44.662040  6615 raft_consensus.cc:686] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:44.664338  6827 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:44.663724  6615 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.667320  6545 tablet_bootstrap.cc:492] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:44.667886  6545 ts_tablet_manager.cc:1397] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.116s	user 0.023s	sys 0.010s
I20260812 19:21:44.669193  6238 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:44.672297  6545 raft_consensus.cc:348] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.673233  6545 raft_consensus.cc:374] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.673575  6545 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.677521  6544 tablet_bootstrap.cc:492] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:44.679898  6544 ts_tablet_manager.cc:1397] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.007s
I20260812 19:21:44.679186  6546 tablet_bootstrap.cc:654] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.696971  6545 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.699333  6545 ts_tablet_manager.cc:1428] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.010s
I20260812 19:21:44.700412  6545 tablet_bootstrap.cc:492] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:44.703420  6242 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:44.707079  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:44.711283  6544 raft_consensus.cc:348] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.712392  6544 raft_consensus.cc:374] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.712627  6544 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.714432  6775 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:44.713443  6544 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.718936  6775 raft_consensus.cc:686] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:44.720117  6775 consensus_queue.cc:237] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.734475  6060 catalog_manager.cc:5495] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:44.739454  6544 ts_tablet_manager.cc:1428] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.005s
I20260812 19:21:44.740893  6544 tablet_bootstrap.cc:492] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:44.748551  6545 tablet_bootstrap.cc:654] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.752660  6546 tablet_bootstrap.cc:492] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:44.754019  6546 ts_tablet_manager.cc:1397] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.127s	user 0.010s	sys 0.015s
I20260812 19:21:44.754869  6544 tablet_bootstrap.cc:654] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.761409  6546 raft_consensus.cc:348] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.762398  6546 raft_consensus.cc:374] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.762754  6546 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.763652  6546 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.767112  6546 ts_tablet_manager.cc:1428] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260812 19:21:44.772475  6546 tablet_bootstrap.cc:492] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:44.787587  6544 tablet_bootstrap.cc:492] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:44.787850  6546 tablet_bootstrap.cc:654] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.788051  6544 ts_tablet_manager.cc:1397] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.016s
I20260812 19:21:44.791132  6544 raft_consensus.cc:348] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.791927  6544 raft_consensus.cc:374] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.792181  6544 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.792354  6545 tablet_bootstrap.cc:492] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:44.792892  6545 ts_tablet_manager.cc:1397] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.012s
I20260812 19:21:44.792804  6544 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.794909  6544 ts_tablet_manager.cc:1428] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260812 19:21:44.795966  6544 tablet_bootstrap.cc:492] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:44.796700  6545 raft_consensus.cc:348] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.797518  6545 raft_consensus.cc:374] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.797796  6545 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.798487  6545 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.801606  6545 ts_tablet_manager.cc:1428] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260812 19:21:44.802285  6557 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:44.803671  6545 tablet_bootstrap.cc:492] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:44.815724  6545 tablet_bootstrap.cc:654] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.830495  6544 tablet_bootstrap.cc:654] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
W20260812 19:21:44.832742  6297 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:44.842047  6546 tablet_bootstrap.cc:492] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:44.842527  6546 ts_tablet_manager.cc:1397] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.006s
I20260812 19:21:44.844211  6060 catalog_manager.cc:5495] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:44.845743  6546 raft_consensus.cc:348] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.846465  6546 raft_consensus.cc:374] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.846745  6546 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.847353  6546 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.856349  6775 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:44.857981  6545 tablet_bootstrap.cc:492] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:44.858495  6545 ts_tablet_manager.cc:1397] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.006s
I20260812 19:21:44.863960  6544 tablet_bootstrap.cc:492] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:44.867884  6544 ts_tablet_manager.cc:1397] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.010s
I20260812 19:21:44.864923  6545 raft_consensus.cc:348] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.868693  6545 raft_consensus.cc:374] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.869261  6545 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.870643  6557 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:44.870468  6775 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:44.871423  6557 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.874012  6557 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:44.876278  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:44.876334  6545 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.879362  6546 ts_tablet_manager.cc:1428] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260812 19:21:44.879889  6544 raft_consensus.cc:348] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.880946  6544 raft_consensus.cc:374] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.881286  6544 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.884918  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:44.885802  6238 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:44.886754  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:44.895205  6546 tablet_bootstrap.cc:492] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:44.897365  6557 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:44.904917  6546 tablet_bootstrap.cc:654] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.906153  6544 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.908593  6545 ts_tablet_manager.cc:1428] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.049s	user 0.011s	sys 0.001s
I20260812 19:21:44.919442  6557 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:44.922806  6544 ts_tablet_manager.cc:1428] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260812 19:21:44.923583  6545 tablet_bootstrap.cc:492] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:44.926198  6544 tablet_bootstrap.cc:492] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:44.946713  6546 tablet_bootstrap.cc:492] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:44.947330  6546 ts_tablet_manager.cc:1397] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.003s
I20260812 19:21:44.950232  6545 tablet_bootstrap.cc:654] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.953333  6824 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:44.951581  6546 raft_consensus.cc:348] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.956858  6546 raft_consensus.cc:374] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:44.957145  6546 raft_consensus.cc:729] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:44.958021  6546 consensus_queue.cc:260] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.964236  6546 ts_tablet_manager.cc:1428] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260812 19:21:44.971679  6675 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:44.974833  6544 tablet_bootstrap.cc:654] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:44.974884  6546 tablet_bootstrap.cc:492] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:44.972465  6675 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:44.981016  6832 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260812 19:21:44.987950  6675 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:44.990399  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:44.996704  6775 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:44.999596  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:45.005671  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:45.011319  6824 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:45.020442  6557 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:45.021803  6557 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.034118  6546 tablet_bootstrap.cc:654] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:45.034974  6545 tablet_bootstrap.cc:492] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:45.035396  6545 ts_tablet_manager.cc:1397] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.112s	user 0.021s	sys 0.034s
I20260812 19:21:45.039850  6483 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.038503  6557 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.047118  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:45.048297  6482 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:45.050011  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:45.051762  6631 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:45.053428  6631 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:45.053957  6631 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.071447  6775 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:45.072304  6775 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.075588  6775 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:45.080210  6557 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:45.080786  6544 tablet_bootstrap.cc:492] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:45.080590  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:45.081408  6544 ts_tablet_manager.cc:1397] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.156s	user 0.009s	sys 0.014s
I20260812 19:21:45.080806  6557 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.092718  6557 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:21:45.093585  6416 leader_election.cc:341] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:45.094492  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:45.096342  6482 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:45.097352  6631 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.098308  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:45.099678  6557 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:45.101224  6557 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:45.101850  6557 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.106909  6544 raft_consensus.cc:348] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.094151  6902 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:45.107820  6544 raft_consensus.cc:374] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:45.100533  6631 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.108160  6544 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:45.108608  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:45.108925  6544 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.109426  6483 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.111326  6546 tablet_bootstrap.cc:492] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:45.116683  6546 ts_tablet_manager.cc:1397] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.143s	user 0.020s	sys 0.009s
I20260812 19:21:45.115932  6544 ts_tablet_manager.cc:1428] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.007s
I20260812 19:21:45.114681  6901 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:45.119518  6901 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.122414  6557 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.124562  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:45.125793  6352 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 1: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:21:45.126180  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:45.126847  6242 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:45.128499  6544 tablet_bootstrap.cc:492] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:45.128376  6546 raft_consensus.cc:348] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.129179  6546 raft_consensus.cc:374] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:45.129488  6546 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:45.131016  6483 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:45.131950  6546 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.132453  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:45.154618  6242 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.154848  6675 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:45.148288  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:45.155494  6675 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.134862  6545 raft_consensus.cc:348] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.157418  6545 raft_consensus.cc:374] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:45.157677  6545 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:45.131880  6901 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.158344  6545 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.159482  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:45.166034  6546 ts_tablet_manager.cc:1428] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.008s
I20260812 19:21:45.166203  6675 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.167536  6546 tablet_bootstrap.cc:492] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:45.169894  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:45.161448  6483 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:45.170730  6352 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:45.162779  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:45.172260  6631 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:45.172969  6631 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:45.173730  6238 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.178287  6545 ts_tablet_manager.cc:1428] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.143s	user 0.009s	sys 0.006s
I20260812 19:21:45.180804  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:45.174108  6631 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.188236  6902 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:45.188822  6902 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:45.189409  6902 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.191140  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:45.192104  6545 tablet_bootstrap.cc:492] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:45.193840  6827 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:45.208213  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:45.209439  6824 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:45.209836  6557 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.210059  6824 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:45.209471  6544 tablet_bootstrap.cc:654] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:45.210745  6824 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.226239  6546 tablet_bootstrap.cc:654] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:45.232987  6242 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:45.235512  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:45.236543  6483 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:45.249064  6824 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.250296  6546 tablet_bootstrap.cc:492] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:45.250958  6546 ts_tablet_manager.cc:1397] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.084s	user 0.025s	sys 0.001s
I20260812 19:21:45.251382  6824 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.261480  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:45.264287  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:45.264961  6483 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.266672  6352 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 1: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:21:45.278891  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:45.279729  6232 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 1: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:21:45.282150  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:45.285264  6545 tablet_bootstrap.cc:654] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:45.292940  6544 tablet_bootstrap.cc:492] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:45.293610  6544 ts_tablet_manager.cc:1397] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.175s	user 0.020s	sys 0.016s
I20260812 19:21:45.294901  6557 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:45.295198  6833 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:45.270157  6902 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.309412  6546 raft_consensus.cc:348] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.310418  6546 raft_consensus.cc:374] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:45.310781  6546 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:45.313620  6901 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:45.311596  6546 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.313254  6544 raft_consensus.cc:348] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.314077  6901 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.317605  6901 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.315534  6544 raft_consensus.cc:374] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:45.319644  6544 raft_consensus.cc:729] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:45.320283  6544 consensus_queue.cc:260] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.321547  6241 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 1: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:21:45.325901  6902 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.325793  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:45.326501  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:45.323473  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:45.323935  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:45.323705  6059 catalog_manager.cc:5495] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:45.378448  6901 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:45.325826  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:45.334124  6827 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:45.406488  6631 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:21:45.406787  6353 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:45.407114  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 80790.3us
I20260812 19:21:45.408119  6827 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.410033  6827 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.397235  6546 ts_tablet_manager.cc:1428] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.146s	user 0.008s	sys 0.000s
I20260812 19:21:45.406034  6477 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.412130  6546 tablet_bootstrap.cc:492] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:45.405912  6901 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:45.327586  6178 leader_election.cc:341] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:45.415782  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 88227.7us
I20260812 19:21:45.416155  6901 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.400172  6544 ts_tablet_manager.cc:1428] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.106s	user 0.029s	sys 0.040s
I20260812 19:21:45.420739  6353 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:45.421769  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:45.422096  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:45.423877  6545 tablet_bootstrap.cc:492] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:45.424307  6545 ts_tablet_manager.cc:1397] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.232s	user 0.012s	sys 0.003s
I20260812 19:21:45.426239  6544 tablet_bootstrap.cc:492] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:45.426759  6545 raft_consensus.cc:348] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.429903  6545 raft_consensus.cc:374] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:45.430176  6545 raft_consensus.cc:729] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:45.308187  6483 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:45.431293  6545 consensus_queue.cc:260] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.433398  6544 tablet_bootstrap.cc:654] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:45.434556  6832 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:45.439152  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:45.441108  6545 ts_tablet_manager.cc:1428] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260812 19:21:45.442363  6545 tablet_bootstrap.cc:492] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:45.446801  6546 tablet_bootstrap.cc:654] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:45.453717  6827 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:45.464768  6477 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
W20260812 19:21:45.465113  6178 leader_election.cc:341] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:45.466239  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:45.467378  6902 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:45.467790  6544 tablet_bootstrap.cc:492] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:45.467155  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:45.468282  6544 ts_tablet_manager.cc:1397] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.004s
I20260812 19:21:45.469122  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:45.468752  6597 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:45.474098  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:45.475549  6902 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:45.476300  6902 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:45.477442  6544 raft_consensus.cc:348] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.478734  6544 raft_consensus.cc:374] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:45.480574  6544 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
W20260812 19:21:45.483071  6178 leader_election.cc:341] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:45.482463  6297 leader_election.cc:341] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:45.483583  6544 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.488989  6544 ts_tablet_manager.cc:1428] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260812 19:21:45.490150  6544 tablet_bootstrap.cc:492] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:45.477885  6902 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.501307  6597 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:45.502209  6597 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:45.502784  6297 leader_election.cc:341] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:45.506970  6597 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:45.508116  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:45.509618  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:45.511703  6631 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:45.513263  6545 tablet_bootstrap.cc:654] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:45.470355  6827 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.517601  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:45.524003  6824 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:45.524734  6824 raft_consensus.cc:686] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:45.526018  6824 consensus_queue.cc:237] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:45.532384  6178 leader_election.cc:341] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:45.540841  6827 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.542387  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:45.543682  6482 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:45.545635  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:45.542490  6178 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:45.547156  6631 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:45.547737  6631 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:45.548249  6631 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.555989  6901 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:45.557345  6675 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:45.559072  6546 tablet_bootstrap.cc:492] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:45.558102  6675 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.559614  6546 ts_tablet_manager.cc:1397] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.148s	user 0.011s	sys 0.010s
I20260812 19:21:45.561534  6477 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.562167  6675 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.566910  6546 raft_consensus.cc:348] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.567694  6546 raft_consensus.cc:374] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:45.567983  6546 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:45.568691  6546 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.570468  6546 ts_tablet_manager.cc:1428] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260812 19:21:45.574043  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:21:45.577891  6178 leader_election.cc:341] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:45.579643  6544 tablet_bootstrap.cc:654] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:45.581821  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:21:45.584472  6178 leader_election.cc:341] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:45.585580  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:45.591553  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:45.591871  6631 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.592640  6242 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:45.595522  6631 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.596493  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:45.597512  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:45.601292  6482 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.601464  6824 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:45.598948  6546 tablet_bootstrap.cc:492] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:45.599255  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:45.606885  6238 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.609225  6416 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:45.620081  6824 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:45.620832  6824 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.620712  6631 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:45.625077  6824 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.627562  6482 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:45.628259  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:45.629290  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:45.630498  6631 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:45.631515  6631 raft_consensus.cc:686] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:45.631677  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:21:45.634958  6178 leader_election.cc:341] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:45.632844  6631 consensus_queue.cc:237] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:45.636024  6178 leader_election.cc:341] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:45.633220  6060 catalog_manager.cc:5495] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:45.636714  6178 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:45.638732  6824 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:45.637974  6060 catalog_manager.cc:5495] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:45.637053  6238 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:45.639984  6545 tablet_bootstrap.cc:492] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:45.648535  6545 ts_tablet_manager.cc:1397] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.206s	user 0.010s	sys 0.011s
I20260812 19:21:45.650933  6546 tablet_bootstrap.cc:654] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
W20260812 19:21:45.661096  6138 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:21:45.662503  6597 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:45.673039  6824 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:21:45.673928  6824 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.677395  6824 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.681602  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:45.682245  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:45.683801  6352 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:21:45.682557  6482 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:21:45.689739  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:45.696576  6824 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:21:45.697150  6824 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:21:45.697700  6824 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:45.700928  6545 raft_consensus.cc:348] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.701644  6545 raft_consensus.cc:374] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:45.701951  6545 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:45.702847  6545 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.704792  6545 ts_tablet_manager.cc:1428] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260812 19:21:45.705724  6545 tablet_bootstrap.cc:492] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:45.716451  6824 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.719379  6544 tablet_bootstrap.cc:492] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:45.719918  6544 ts_tablet_manager.cc:1397] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.230s	user 0.014s	sys 0.011s
I20260812 19:21:45.722970  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:45.726511  6352 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:21:45.727764  6544 raft_consensus.cc:348] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.729772  6544 raft_consensus.cc:374] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:45.728899  6824 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.730021  6544 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:45.733392  6544 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.735499  6631 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:45.737777  6544 ts_tablet_manager.cc:1428] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260812 19:21:45.739127  6545 tablet_bootstrap.cc:654] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:45.741755  6544 tablet_bootstrap.cc:492] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:45.740214  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:45.744161  6597 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:45.744583  6557 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:45.747434  6597 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.749959  6557 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.763146  6546 tablet_bootstrap.cc:492] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:45.763680  6546 ts_tablet_manager.cc:1397] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.165s	user 0.006s	sys 0.014s
I20260812 19:21:45.765300  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:45.767284  6242 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:45.767376  6597 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:45.770246  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:45.770907  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:45.771322  6597 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:45.771327  6477 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:21:45.773279  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:45.774302  6901 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:21:45.776719  6546 raft_consensus.cc:348] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.777410  6546 raft_consensus.cc:374] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:45.777657  6546 raft_consensus.cc:729] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:45.775142  6901 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 2 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:45.771867  6352 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:45.780375  6546 consensus_queue.cc:260] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.768432  6557 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.784183  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:45.785276  6242 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:45.786072  6546 ts_tablet_manager.cc:1428] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.003s
I20260812 19:21:45.791267  6901 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.793201  6546 tablet_bootstrap.cc:492] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:45.791311  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:45.794595  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:45.795353  6631 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:45.795909  6631 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:45.796464  6631 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:45.798223  6297 leader_election.cc:341] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:45.771895  6597 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:45.800870  6597 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.824885  6631 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.828842  6545 tablet_bootstrap.cc:492] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:45.836694  6545 ts_tablet_manager.cc:1397] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.131s	user 0.007s	sys 0.019s
I20260812 19:21:45.828035  6060 catalog_manager.cc:5495] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:45.839391  6545 raft_consensus.cc:348] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.840054  6545 raft_consensus.cc:374] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:45.840318  6545 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:45.840948  6545 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.844579  6597 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.846695  6597 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:45.835021  6544 tablet_bootstrap.cc:654] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:45.855008  6557 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:45.855786  6557 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.858466  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:45.859418  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:45.859436  6483 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.860244  6557 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.862900  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:45.863618  6353 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.863817  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:45.864656  6238 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.860733  6242 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:45.870198  6545 ts_tablet_manager.cc:1428] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260812 19:21:45.874799  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:45.875460  6482 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:21:45.875609  6058 catalog_manager.cc:5495] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 1 to 2, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:45.877297  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:45.871474  6631 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.879549  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:45.878402  6483 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:45.878367  6557 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:21:45.888031  6557 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:45.888407  6557 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:45.888644  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:45.890102  6545 tablet_bootstrap.cc:492] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:45.891377  6631 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:45.897678  6631 raft_consensus.cc:686] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:45.899026  6546 tablet_bootstrap.cc:654] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:45.907249  6238 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:45.899081  6631 consensus_queue.cc:237] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.911098  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:45.912130  6597 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:45.912842  6597 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:45.916142  6353 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:45.917905  6597 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.922057  6557 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.930161  6544 tablet_bootstrap.cc:492] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:45.930877  6544 ts_tablet_manager.cc:1397] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.190s	user 0.018s	sys 0.012s
I20260812 19:21:45.931950  6557 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:45.934032  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:45.933887  6544 raft_consensus.cc:348] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.934762  6544 raft_consensus.cc:374] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:45.934831  6242 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:45.935067  6544 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:45.935833  6544 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.937956  6544 ts_tablet_manager.cc:1428] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260812 19:21:45.941175  6058 catalog_manager.cc:5495] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:45.943068  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:45.943681  6483 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:45.946739  6060 catalog_manager.cc:5495] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:45.952966  6544 tablet_bootstrap.cc:492] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:45.960683  6545 tablet_bootstrap.cc:654] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:45.960915  6546 tablet_bootstrap.cc:492] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:45.961436  6546 ts_tablet_manager.cc:1397] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.168s	user 0.021s	sys 0.023s
I20260812 19:21:45.964797  6546 raft_consensus.cc:348] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.965673  6546 raft_consensus.cc:374] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:45.965958  6546 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:45.966630  6546 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:45.967921  6901 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:45.969496  6824 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:45.970273  6546 ts_tablet_manager.cc:1428] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.008s
I20260812 19:21:45.971467  6546 tablet_bootstrap.cc:492] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:45.976562  6544 tablet_bootstrap.cc:654] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:45.984885  6824 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:46.003479  6546 tablet_bootstrap.cc:654] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:46.028880  6545 tablet_bootstrap.cc:492] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:46.032485  6545 ts_tablet_manager.cc:1397] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.143s	user 0.015s	sys 0.016s
I20260812 19:21:46.018290  6483 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:21:46.035779  6557 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:46.036870  6557 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.040689  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:21:46.044042  6557 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:46.048650  6631 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:21:46.052137  6545 raft_consensus.cc:348] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.052861  6545 raft_consensus.cc:374] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:46.053112  6545 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:46.051750  6631 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:46.060957  6631 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.065215  6544 tablet_bootstrap.cc:492] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:46.065644  6544 ts_tablet_manager.cc:1397] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.113s	user 0.039s	sys 0.022s
I20260812 19:21:46.062116  6545 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.079180  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:46.082269  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:46.085985  6545 ts_tablet_manager.cc:1428] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.008s
I20260812 19:21:46.083194  6238 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
W20260812 19:21:46.088691  6297 leader_election.cc:341] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:46.095130  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 67049.6us
I20260812 19:21:46.106489  6545 tablet_bootstrap.cc:492] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:46.107230  6901 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:46.107895  6901 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.115196  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:46.115602  6544 raft_consensus.cc:348] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.116076  6901 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:46.116389  6544 raft_consensus.cc:374] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:46.116721  6544 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
W20260812 19:21:46.117385  6178 leader_election.cc:341] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:46.117584  6544 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.118919  6546 tablet_bootstrap.cc:492] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:46.119482  6546 ts_tablet_manager.cc:1397] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.148s	user 0.009s	sys 0.019s
I20260812 19:21:46.120500  6544 ts_tablet_manager.cc:1428] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.055s	user 0.002s	sys 0.006s
I20260812 19:21:46.121646  6544 tablet_bootstrap.cc:492] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:46.123189  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:46.124465  6615 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:46.125176  6615 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:46.125877  6615 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:46.148927  6901 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:46.149788  6901 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.150553  6546 raft_consensus.cc:348] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.151314  6546 raft_consensus.cc:374] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:46.151554  6546 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:46.149801  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:46.153097  6675 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260812 19:21:46.156554  6546 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.162091  6901 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:46.177516  6546 ts_tablet_manager.cc:1428] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.058s	user 0.004s	sys 0.007s
I20260812 19:21:46.167965  6059 catalog_manager.cc:5495] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 2 to 3, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:46.178890  6546 tablet_bootstrap.cc:492] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:46.180186  6980 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:46.182068  6545 tablet_bootstrap.cc:654] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:46.184170  6544 tablet_bootstrap.cc:654] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:46.189178  6827 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:46.189847  6827 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.205390  6827 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:46.214250  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:46.215270  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:46.216384  6238 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:46.218575  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:21:46.223402  6297 leader_election.cc:341] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:46.221372  6980 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:46.227399  6980 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:46.227766  6980 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:46.227712  6615 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.206344  6631 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260812 19:21:46.235571  6615 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:46.241200  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:46.242075  6238 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:46.242161  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:46.257514  6238 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
W20260812 19:21:46.257274  6297 leader_election.cc:341] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:46.260401  6546 tablet_bootstrap.cc:654] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:46.260341  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:46.264504  6631 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:46.265141  6631 raft_consensus.cc:686] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:21:46.258885  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 88383.4us
W20260812 19:21:46.268554  6178 leader_election.cc:341] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:46.268610  6631 consensus_queue.cc:237] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.269485  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:46.274343  6980 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.277287  6980 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:46.271418  6983 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:46.287885  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:46.290968  6483 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:46.291633  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:46.299345  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:46.300493  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:46.302215  6238 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:46.302896  6544 tablet_bootstrap.cc:492] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:46.303529  6544 ts_tablet_manager.cc:1397] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.182s	user 0.016s	sys 0.021s
I20260812 19:21:46.307871  6475 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3. Ops: []
W20260812 19:21:46.311954  6297 leader_election.cc:341] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:46.305353  6557 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260812 19:21:46.353377  6544 raft_consensus.cc:348] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.354316  6544 raft_consensus.cc:374] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:46.355362  6544 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:46.356655  6544 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.365572  6544 ts_tablet_manager.cc:1428] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.003s
W20260812 19:21:46.370431  6178 leader_election.cc:341] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:46.372907  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:46.374279  6544 tablet_bootstrap.cc:492] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:46.375047  6901 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:46.375440  6901 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:46.375767  6901 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:46.384857  6983 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260812 19:21:46.388198  6983 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:21:46.388648  6983 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:46.388835  6545 tablet_bootstrap.cc:492] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:46.389995  6545 ts_tablet_manager.cc:1397] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.284s	user 0.012s	sys 0.019s
I20260812 19:21:46.392926  6238 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:46.395722  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:46.389796  6983 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.399760  6983 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:21:46.407959  6827 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:46.415309  6827 raft_consensus.cc:686] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:46.416777  6827 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.442348  6546 tablet_bootstrap.cc:492] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:46.443254  6546 ts_tablet_manager.cc:1397] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.265s	user 0.019s	sys 0.012s
I20260812 19:21:46.446295  6544 tablet_bootstrap.cc:654] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:46.445729  6545 raft_consensus.cc:348] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.447234  6545 raft_consensus.cc:374] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:46.447561  6545 raft_consensus.cc:729] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:46.448510  6545 consensus_queue.cc:260] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.451771  6615 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:46.452268  6615 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.448257  6976 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260812 19:21:46.446866  6675 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:46.455595  6675 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.459208  6675 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:46.461992  6615 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:46.465306  6545 ts_tablet_manager.cc:1428] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.075s	user 0.010s	sys 0.003s
I20260812 19:21:46.467715  6352 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3. Ops: []
I20260812 19:21:46.467489  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:21:46.471226  6178 leader_election.cc:341] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:46.477880  6545 tablet_bootstrap.cc:492] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:46.481261  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:46.481842  6238 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:46.469523  6901 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.474893  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:46.485724  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:46.488232  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:46.488209  6059 catalog_manager.cc:5495] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:21:46.497252  6297 leader_election.cc:341] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:46.519749  6178 leader_election.cc:341] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:46.520407  6178 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:46.524271  6824 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:46.546232  6970 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
W20260812 19:21:46.570363  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 73139.3us
W20260812 19:21:46.570550  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 50857.6us
I20260812 19:21:46.575232  6546 raft_consensus.cc:348] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.578276  6901 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:46.576136  6546 raft_consensus.cc:374] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:46.582991  6546 raft_consensus.cc:729] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:46.589759  6546 consensus_queue.cc:260] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.591039  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:46.594988  6546 ts_tablet_manager.cc:1428] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.151s	user 0.007s	sys 0.008s
I20260812 19:21:46.598204  6999 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:46.594815  6475 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:46.682374  6545 tablet_bootstrap.cc:654] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:46.686779  6546 tablet_bootstrap.cc:492] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:46.689981  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:46.683842  6999 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:46.710047  6999 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:46.703935  6178 leader_election.cc:341] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:46.712970  6058 catalog_manager.cc:5495] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:46.732627  6482 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:21:46.741739  6615 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:21:46.744581  6481 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:46.785053  6230 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260812 19:21:46.791020  6230 pending_rounds.cc:76] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 1
I20260812 19:21:46.791497  6230 pending_rounds.cc:97] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260812 19:21:46.793968  6557 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260812 19:21:46.803952  6544 tablet_bootstrap.cc:492] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:46.804731  6544 ts_tablet_manager.cc:1397] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.431s	user 0.010s	sys 0.026s
I20260812 19:21:46.807843  6546 tablet_bootstrap.cc:654] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:46.809886  6230 raft_consensus.cc:2866] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:21:46.828908  6544 raft_consensus.cc:348] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.837809  6544 raft_consensus.cc:374] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:46.838620  6544 raft_consensus.cc:729] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:46.839875  6544 consensus_queue.cc:260] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.820545  6999 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.852555  6544 ts_tablet_manager.cc:1428] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.004s
I20260812 19:21:46.858906  6827 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.004s
I20260812 19:21:46.868249  6544 tablet_bootstrap.cc:492] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:46.872730  6475 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:46.880066  6998 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:46.880733  6998 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.884477  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:46.885906  6983 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:46.886600  6983 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:46.887475  6545 tablet_bootstrap.cc:492] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:46.888029  6545 ts_tablet_manager.cc:1397] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.414s	user 0.054s	sys 0.015s
I20260812 19:21:46.887658  6983 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.889767  6998 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:46.891381  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:21:46.895555  6297 leader_election.cc:341] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:46.899833  6545 raft_consensus.cc:348] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.902359  6545 raft_consensus.cc:374] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:46.904155  6999 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:46.912899  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:46.914403  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:21:46.916347  6297 leader_election.cc:341] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:46.901289  6998 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:46.917186  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:46.917869  6242 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:46.923604  6545 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:46.929448  6545 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:46.933182  6545 ts_tablet_manager.cc:1428] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.003s
I20260812 19:21:46.934239  6545 tablet_bootstrap.cc:492] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:46.935247  6998 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:21:46.936362  6297 leader_election.cc:341] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:46.936842  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:46.938176  6998 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:46.926270  6242 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
W20260812 19:21:46.977665  6138 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:21:46.977743  6546 tablet_bootstrap.cc:492] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:46.985208  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:46.992105  6544 tablet_bootstrap.cc:654] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:46.992105  6545 tablet_bootstrap.cc:654] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:46.987365  6546 ts_tablet_manager.cc:1397] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.306s	user 0.026s	sys 0.037s
I20260812 19:21:46.997944  6998 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:47.003157  6998 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:47.006009  6998 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.010089  6546 raft_consensus.cc:348] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.012876  6546 raft_consensus.cc:374] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.013257  6546 raft_consensus.cc:729] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.013871  6546 consensus_queue.cc:260] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.021864  6546 ts_tablet_manager.cc:1428] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260812 19:21:47.025219  6546 tablet_bootstrap.cc:492] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:47.024386  6060 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:47.059469  6999 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:47.073514  6546 tablet_bootstrap.cc:654] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.080821  6545 tablet_bootstrap.cc:492] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:47.081298  6545 ts_tablet_manager.cc:1397] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.147s	user 0.022s	sys 0.031s
I20260812 19:21:47.088405  6058 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:47.096813  6544 tablet_bootstrap.cc:492] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:47.097389  6544 ts_tablet_manager.cc:1397] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.229s	user 0.015s	sys 0.020s
I20260812 19:21:47.098206  6545 raft_consensus.cc:348] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.099138  6545 raft_consensus.cc:374] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.099466  6545 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.100119  6545 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.101589  6482 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:47.102679  6545 ts_tablet_manager.cc:1428] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260812 19:21:47.104260  6545 tablet_bootstrap.cc:492] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:47.106390  6544 raft_consensus.cc:348] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.107105  6544 raft_consensus.cc:374] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.107401  6544 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.110142  6544 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.111272  6545 tablet_bootstrap.cc:654] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.114331  6544 ts_tablet_manager.cc:1428] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260812 19:21:47.125607  6545 tablet_bootstrap.cc:492] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:47.126420  6545 ts_tablet_manager.cc:1397] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.006s
I20260812 19:21:47.127437  6999 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:47.130295  6545 raft_consensus.cc:348] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.131421  6545 raft_consensus.cc:374] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.131814  6545 raft_consensus.cc:729] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.133793  6545 consensus_queue.cc:260] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.135437  6544 tablet_bootstrap.cc:492] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:47.137063  6545 ts_tablet_manager.cc:1428] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260812 19:21:47.138713  6545 tablet_bootstrap.cc:492] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:47.158066  6545 tablet_bootstrap.cc:654] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.164469  6544 tablet_bootstrap.cc:654] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.176743  6901 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.177606  6901 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.201439  6901 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:47.203270  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:21:47.205281  6178 leader_election.cc:341] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.206507  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:21:47.208985  6178 leader_election.cc:341] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.209559  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:47.211125  6979 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:47.237845  6545 tablet_bootstrap.cc:492] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:47.238554  6545 ts_tablet_manager.cc:1397] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.100s	user 0.014s	sys 0.018s
I20260812 19:21:47.242259  6545 raft_consensus.cc:348] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.243016  6545 raft_consensus.cc:374] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.243283  6545 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.247004  6545 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.252053  6545 ts_tablet_manager.cc:1428] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260812 19:21:47.253211  6545 tablet_bootstrap.cc:492] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:47.259604  6544 tablet_bootstrap.cc:492] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:47.260043  6546 tablet_bootstrap.cc:492] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:47.260092  6544 ts_tablet_manager.cc:1397] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.017s
I20260812 19:21:47.260540  6546 ts_tablet_manager.cc:1397] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.236s	user 0.001s	sys 0.026s
I20260812 19:21:47.264122  6544 raft_consensus.cc:348] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.264859  6544 raft_consensus.cc:374] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.265121  6544 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.265069  6546 raft_consensus.cc:348] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.265936  6546 raft_consensus.cc:374] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.266204  6546 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.265826  6544 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.266875  6546 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.267911  6544 ts_tablet_manager.cc:1428] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260812 19:21:47.267964  6545 tablet_bootstrap.cc:654] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.278693  6546 ts_tablet_manager.cc:1428] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.008s
I20260812 19:21:47.278954  6544 tablet_bootstrap.cc:492] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:47.279783  6546 tablet_bootstrap.cc:492] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:47.286361  6901 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.287351  6901 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.297259  6901 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:47.298703  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:21:47.301061  6178 leader_election.cc:341] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.304203  6999 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.308010  6999 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.309968  7007 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.311271  6999 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:47.310788  7007 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.315326  7007 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:47.325662  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:47.325870  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:21:47.328392  6297 leader_election.cc:341] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.335397  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:21:47.337189  6297 leader_election.cc:341] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.336995  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:47.338037  6349 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:47.339252  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:47.341257  6615 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:47.342031  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:47.347237  6833 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:47.347896  6833 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:47.348474  6833 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:47.353498  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:21:47.355288  6178 leader_election.cc:341] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.356141  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:47.365096  6901 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:47.370640  6557 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.371457  6557 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.375784  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:21:47.377321  6297 leader_election.cc:341] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.380339  6901 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:21:47.383694  6416 leader_election.cc:341] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.401120  6546 tablet_bootstrap.cc:654] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.406203  7009 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.412560  7009 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.425925  7009 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:47.440407  6544 tablet_bootstrap.cc:654] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.440260  7044 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.440927  7044 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.444460  7044 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:47.450529  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:47.451543  6557 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:21:47.456606  6297 leader_election.cc:341] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.457012  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:47.463871  6545 tablet_bootstrap.cc:492] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
W20260812 19:21:47.464742  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 60644.1us
I20260812 19:21:47.465124  6545 ts_tablet_manager.cc:1397] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.212s	user 0.023s	sys 0.027s
I20260812 19:21:47.468741  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:47.469523  6242 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 1: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:21:47.461125  6998 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:47.479506  6544 tablet_bootstrap.cc:492] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:47.480079  6544 ts_tablet_manager.cc:1397] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.201s	user 0.014s	sys 0.006s
I20260812 19:21:47.483415  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:47.484040  6242 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:47.488602  6546 tablet_bootstrap.cc:492] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:47.489069  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:47.489104  6546 ts_tablet_manager.cc:1397] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.210s	user 0.048s	sys 0.064s
W20260812 19:21:47.491557  6178 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:47.490900  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:47.493467  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:47.478987  6833 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.495643  6474 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:47.499188  6546 raft_consensus.cc:348] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.499920  6546 raft_consensus.cc:374] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.500188  6546 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.501430  6544 raft_consensus.cc:348] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.502113  6544 raft_consensus.cc:374] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.502357  6544 raft_consensus.cc:729] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.503330  6546 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.505601  6833 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:47.503010  6544 consensus_queue.cc:260] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.508244  7007 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:47.508579  7007 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:47.508877  7007 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:47.509322  6544 ts_tablet_manager.cc:1428] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.002s
I20260812 19:21:47.510855  6546 ts_tablet_manager.cc:1428] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260812 19:21:47.513485  6998 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:47.521512  6545 raft_consensus.cc:348] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.522504  6545 raft_consensus.cc:374] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.522907  6545 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.523767  6545 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.533687  6546 tablet_bootstrap.cc:492] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:47.537678  6544 tablet_bootstrap.cc:492] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:47.537087  7007 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.540076  7007 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:47.540772  6545 ts_tablet_manager.cc:1428] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.004s
I20260812 19:21:47.543859  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:47.544217  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:47.545365  6350 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:47.547070  6545 tablet_bootstrap.cc:492] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:47.547088  6998 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.547858  6998 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.554615  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:47.555361  6242 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:47.560233  6998 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:47.561414  6350 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:47.564450  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:47.565645  6482 raft_consensus.cc:2379] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:47.565840  6545 tablet_bootstrap.cc:654] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.567592  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:47.570500  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:47.575081  6557 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:47.579042  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:47.579414  6546 tablet_bootstrap.cc:654] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.580324  6242 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:47.583204  6557 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:47.581446  6416 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:21:47.589748  6416 leader_election.cc:341] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.590796  7007 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:47.592242  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:47.596388  7007 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:47.596966  7007 raft_consensus.cc:686] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:47.597802  7007 consensus_queue.cc:237] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:47.606849  6416 leader_election.cc:341] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.610003  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:47.610355  6350 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:47.612596  6544 tablet_bootstrap.cc:654] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.613185  6833 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:47.617879  6833 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:47.618834  6833 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.620923  6827 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:47.631855  6545 tablet_bootstrap.cc:492] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:47.633064  6545 ts_tablet_manager.cc:1397] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.086s	user 0.032s	sys 0.022s
I20260812 19:21:47.635888  6545 raft_consensus.cc:348] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.638959  6545 raft_consensus.cc:374] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.639245  6545 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.639885  6545 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.640985  7007 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.641435  7007 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.642023  6545 ts_tablet_manager.cc:1428] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260812 19:21:47.643762  7007 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:47.644110  6545 tablet_bootstrap.cc:492] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:47.646149  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:47.646472  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:47.647113  6235 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
W20260812 19:21:47.648438  6416 leader_election.cc:341] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.652201  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:47.653570  6544 tablet_bootstrap.cc:492] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:47.654103  6544 ts_tablet_manager.cc:1397] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.117s	user 0.009s	sys 0.014s
I20260812 19:21:47.653841  6060 catalog_manager.cc:5495] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:47.657260  6833 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:47.657794  6833 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:47.658254  6833 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:47.660409  6546 tablet_bootstrap.cc:492] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:47.661069  6546 ts_tablet_manager.cc:1397] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.128s	user 0.018s	sys 0.005s
I20260812 19:21:47.664743  6546 raft_consensus.cc:348] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.665501  6546 raft_consensus.cc:374] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.665774  6546 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.666074  6544 raft_consensus.cc:348] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.666817  6544 raft_consensus.cc:374] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.667068  6544 raft_consensus.cc:729] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.667757  6544 consensus_queue.cc:260] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.670610  6544 ts_tablet_manager.cc:1428] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260812 19:21:47.671577  6544 tablet_bootstrap.cc:492] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:47.666299  6833 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.673110  6545 tablet_bootstrap.cc:654] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.666371  6546 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.677187  6546 ts_tablet_manager.cc:1428] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.002s
I20260812 19:21:47.679006  6546 tablet_bootstrap.cc:492] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:47.680322  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:47.681042  6242 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:47.688325  6544 tablet_bootstrap.cc:654] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.689186  6833 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:47.692360  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:47.693259  6546 tablet_bootstrap.cc:654] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
W20260812 19:21:47.693718  6416 leader_election.cc:341] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.697863  6242 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:47.699113  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:47.699777  6833 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:47.700829  6833 raft_consensus.cc:686] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:47.706544  6545 tablet_bootstrap.cc:492] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:47.707062  6545 ts_tablet_manager.cc:1397] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.009s
I20260812 19:21:47.707433  6544 tablet_bootstrap.cc:492] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:47.706751  6833 consensus_queue.cc:237] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.707886  6544 ts_tablet_manager.cc:1397] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.011s
I20260812 19:21:47.709617  6545 raft_consensus.cc:348] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.710314  6545 raft_consensus.cc:374] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.710551  6545 raft_consensus.cc:729] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.711328  6545 consensus_queue.cc:260] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.712867  6545 ts_tablet_manager.cc:1428] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 19:21:47.713783  6545 tablet_bootstrap.cc:492] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:47.713680  6544 raft_consensus.cc:348] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.715384  6544 raft_consensus.cc:374] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.715751  6544 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.716504  6544 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.719108  6544 ts_tablet_manager.cc:1428] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260812 19:21:47.720221  6545 tablet_bootstrap.cc:654] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.720394  6544 tablet_bootstrap.cc:492] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:47.726153  6544 tablet_bootstrap.cc:654] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.729867  6546 tablet_bootstrap.cc:492] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:47.730513  6546 ts_tablet_manager.cc:1397] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.005s
I20260812 19:21:47.733815  6546 raft_consensus.cc:348] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.734778  6546 raft_consensus.cc:374] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.735110  6546 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.739566  6544 tablet_bootstrap.cc:492] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:47.740164  6544 ts_tablet_manager.cc:1397] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260812 19:21:47.741917  6546 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.744364  6546 ts_tablet_manager.cc:1428] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260812 19:21:47.744808  6545 tablet_bootstrap.cc:492] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:47.745389  6545 ts_tablet_manager.cc:1397] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.032s	user 0.004s	sys 0.008s
I20260812 19:21:47.745826  6546 tablet_bootstrap.cc:492] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:47.748806  6545 raft_consensus.cc:348] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.749632  6545 raft_consensus.cc:374] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.749967  6545 raft_consensus.cc:729] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.750741  6545 consensus_queue.cc:260] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.751504  6060 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:47.753679  6545 ts_tablet_manager.cc:1428] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260812 19:21:47.753492  6544 raft_consensus.cc:348] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.754278  6544 raft_consensus.cc:374] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.754603  6544 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.753808  6060 catalog_manager.cc:5495] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:47.755074  6546 tablet_bootstrap.cc:654] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.755501  6545 tablet_bootstrap.cc:492] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:47.755342  6544 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.761847  7045 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.762709  7045 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.769270  6545 tablet_bootstrap.cc:654] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.771190  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:47.772395  6544 ts_tablet_manager.cc:1428] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260812 19:21:47.773478  6544 tablet_bootstrap.cc:492] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298: Bootstrap starting.
W20260812 19:21:47.779417  6178 leader_election.cc:341] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.781276  7045 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:47.781877  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:21:47.783587  6178 leader_election.cc:341] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.783720  6544 tablet_bootstrap.cc:654] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.784005  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:47.784770  7045 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:47.787694  6545 tablet_bootstrap.cc:492] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:47.788309  6546 tablet_bootstrap.cc:492] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:47.788401  6545 ts_tablet_manager.cc:1397] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.015s
I20260812 19:21:47.788914  6546 ts_tablet_manager.cc:1397] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.004s
I20260812 19:21:47.791945  6545 raft_consensus.cc:348] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.792743  6545 raft_consensus.cc:374] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.793249  6545 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.793546  6546 raft_consensus.cc:348] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.794096  6545 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.794517  6546 raft_consensus.cc:374] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.795419  7045 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.797312  6545 ts_tablet_manager.cc:1428] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260812 19:21:47.796720  7045 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.798588  6545 tablet_bootstrap.cc:492] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:47.801729  7045 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:47.795094  6546 raft_consensus.cc:729] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.803370  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:47.804032  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:47.804219  6546 consensus_queue.cc:260] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:47.805745  6178 leader_election.cc:341] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.806746  6546 ts_tablet_manager.cc:1428] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.000s
W20260812 19:21:47.806882  6178 leader_election.cc:341] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.807248  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:47.807879  6546 tablet_bootstrap.cc:492] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:47.808364  6983 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:47.809587  6545 tablet_bootstrap.cc:654] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.822118  6998 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.823137  6998 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.834770  6545 tablet_bootstrap.cc:492] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:47.835000  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:47.835320  6545 ts_tablet_manager.cc:1397] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.014s
I20260812 19:21:47.838822  6545 raft_consensus.cc:348] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.839593  6545 raft_consensus.cc:374] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.839929  6545 raft_consensus.cc:729] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.840628  6545 consensus_queue.cc:260] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.843724  6545 ts_tablet_manager.cc:1428] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260812 19:21:47.844779  6545 tablet_bootstrap.cc:492] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:47.831861  6998 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:47.848701  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:47.849586  6242 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:47.851100  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:47.854379  6546 tablet_bootstrap.cc:654] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.857160  6544 tablet_bootstrap.cc:492] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:47.857033  6557 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:47.857621  6544 ts_tablet_manager.cc:1397] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.084s	user 0.021s	sys 0.029s
I20260812 19:21:47.867277  6983 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.868846  6983 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.879843  6544 raft_consensus.cc:348] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.880686  6544 raft_consensus.cc:374] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.880966  6544 raft_consensus.cc:729] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.881117  6545 tablet_bootstrap.cc:654] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.881719  6544 consensus_queue.cc:260] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.886967  6983 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:47.887465  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:21:47.889379  6178 leader_election.cc:341] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.890499  7045 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.891099  7045 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.890581  6544 ts_tablet_manager.cc:1428] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.033s	user 0.013s	sys 0.001s
I20260812 19:21:47.894477  6544 tablet_bootstrap.cc:492] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:47.894400  7045 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:47.898329  6557 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:47.901772  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:47.903831  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:47.906311  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:21:47.908541  6178 leader_election.cc:341] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:47.912232  6178 leader_election.cc:341] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.912673  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:21:47.919308  6178 leader_election.cc:341] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:47.919613  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:47.921996  6557 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.922219  6983 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:47.922494  6557 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.924296  7045 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:47.925166  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:47.927212  6545 tablet_bootstrap.cc:492] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:47.927711  6545 ts_tablet_manager.cc:1397] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.026s
I20260812 19:21:47.928488  6544 tablet_bootstrap.cc:654] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.929474  6557 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:47.931546  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:47.933032  6546 tablet_bootstrap.cc:492] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:47.935730  6546 ts_tablet_manager.cc:1397] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.128s	user 0.016s	sys 0.017s
I20260812 19:21:47.936987  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:47.938159  6557 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:47.939042  6545 raft_consensus.cc:348] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.939813  6545 raft_consensus.cc:374] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.940070  6545 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.940793  6545 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.942075  6546 raft_consensus.cc:348] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.943102  6546 raft_consensus.cc:374] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.943423  6545 ts_tablet_manager.cc:1428] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.006s
I20260812 19:21:47.943487  6546 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.944721  6545 tablet_bootstrap.cc:492] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:47.944876  6546 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.948246  6546 ts_tablet_manager.cc:1428] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260812 19:21:47.950209  6546 tablet_bootstrap.cc:492] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:47.952697  6545 tablet_bootstrap.cc:654] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.958137  6544 tablet_bootstrap.cc:492] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:47.961623  6544 ts_tablet_manager.cc:1397] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.013s
I20260812 19:21:47.962594  6350 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:47.961117  6546 tablet_bootstrap.cc:654] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.967214  6544 raft_consensus.cc:348] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.968114  6544 raft_consensus.cc:374] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.968454  6544 raft_consensus.cc:729] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.969149  6545 tablet_bootstrap.cc:492] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:47.969684  6545 ts_tablet_manager.cc:1397] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.010s
I20260812 19:21:47.969285  6544 consensus_queue.cc:260] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.972991  6544 ts_tablet_manager.cc:1428] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260812 19:21:47.974560  6544 tablet_bootstrap.cc:492] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:47.976001  6545 raft_consensus.cc:348] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.976786  6545 raft_consensus.cc:374] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:47.977061  6545 raft_consensus.cc:729] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:47.977875  6545 consensus_queue.cc:260] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:47.979669  6545 ts_tablet_manager.cc:1428] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.002s
I20260812 19:21:47.980605  6545 tablet_bootstrap.cc:492] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:47.988138  6544 tablet_bootstrap.cc:654] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:47.997090  7041 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:47.998056  7041 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.002959  6833 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:48.003536  6545 tablet_bootstrap.cc:654] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:48.003840  6833 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.004854  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:48.005973  6241 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:48.007583  6833 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:48.009857  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:48.011925  6970 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:48.012442  6970 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:48.012856  6970 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.015753  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:48.018244  7007 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:48.019184  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:48.020334  6241 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:48.026130  6970 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.028951  6970 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:48.036309  7041 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:21:48.022482  6416 leader_election.cc:341] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:48.045220  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:48.049402  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:48.050199  6235 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.057257  6544 tablet_bootstrap.cc:492] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:48.058171  6544 ts_tablet_manager.cc:1397] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.084s	user 0.015s	sys 0.025s
I20260812 19:21:48.057951  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:48.052232  7041 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:48.060302  6354 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.064150  6545 tablet_bootstrap.cc:492] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:48.064688  6545 ts_tablet_manager.cc:1397] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.010s
I20260812 19:21:48.072232  7007 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:48.072916  6546 tablet_bootstrap.cc:492] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:48.073410  6546 ts_tablet_manager.cc:1397] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.123s	user 0.023s	sys 0.018s
I20260812 19:21:48.073107  7007 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.077108  7007 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:48.079440  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:48.075623  6545 raft_consensus.cc:348] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.081897  6545 raft_consensus.cc:374] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:48.082831  6241 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.084215  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:48.084925  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:48.085290  6230 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:48.085845  6359 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:48.086133  7045 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:48.061271  7041 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:48.095100  7041 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.082195  6545 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:48.100937  6545 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.106004  6546 raft_consensus.cc:348] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.106848  6546 raft_consensus.cc:374] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:48.107162  6546 raft_consensus.cc:729] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:48.086997  7045 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.116278  7045 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:48.107820  6546 consensus_queue.cc:260] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.129830  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:48.130030  6544 raft_consensus.cc:348] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.131356  6544 raft_consensus.cc:374] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:48.131727  6544 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:48.132360  6545 ts_tablet_manager.cc:1428] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.067s	user 0.011s	sys 0.001s
W20260812 19:21:48.135706  6138 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:21:48.137346  6546 ts_tablet_manager.cc:1428] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.064s	user 0.000s	sys 0.012s
I20260812 19:21:48.136792  6544 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.135226  6970 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:48.139940  6545 tablet_bootstrap.cc:492] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:48.140146  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:48.140239  6970 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:48.140839  6481 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:48.140925  6970 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.141845  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:48.142724  6352 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:48.144745  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:48.146157  6546 tablet_bootstrap.cc:492] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:48.139333  7043 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:48.165246  6544 ts_tablet_manager.cc:1428] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.107s	user 0.004s	sys 0.007s
I20260812 19:21:48.171471  6675 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:48.172857  6354 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:48.172370  6675 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.182972  6615 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:48.187098  6675 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:48.186574  6615 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.190299  6615 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:48.167665  7045 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:48.195935  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:48.197104  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:48.205579  6474 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:48.206185  6235 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:48.208128  7007 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:48.208864  7007 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.210561  6675 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:48.202574  7045 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:48.211308  6675 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.212128  7045 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.203739  6230 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:48.159703  7043 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:48.215094  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 70409.8us
I20260812 19:21:48.215354  6544 tablet_bootstrap.cc:492] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:48.215509  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:48.216635  6615 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:48.217275  6615 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:48.217968  6615 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.217917  7043 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:48.201254  7041 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.223894  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:48.225574  7041 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:21:48.228792  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 67721.6us
I20260812 19:21:48.240950  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:48.222149  6970 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.243132  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:48.258016  7007 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:48.260182  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:48.260622  6546 tablet_bootstrap.cc:654] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:48.260905  6359 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:48.255252  6983 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:48.268638  6983 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.269783  6970 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:48.269717  7007 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:48.270972  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:48.265458  6235 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:48.261588  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:21:48.265609  7103 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260812 19:21:48.273521  6236 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.270548  6983 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:48.277352  7045 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:48.289621  6178 leader_election.cc:341] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:48.291910  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46591.4us
I20260812 19:21:48.292394  6545 tablet_bootstrap.cc:654] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:48.292775  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:48.294123  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:48.298465  7041 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260812 19:21:48.291878  6675 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:48.298730  6970 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:48.306463  6615 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.307015  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:48.307642  6354 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:48.308565  6615 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:48.309994  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:48.310802  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:48.311868  6230 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:48.318810  6416 leader_election.cc:341] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:48.317833  7045 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:48.321472  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:48.321823  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:48.306097  6970 raft_consensus.cc:686] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:48.324939  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:48.317929  7043 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:48.329568  7043 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:48.329931  7043 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.334143  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:48.334776  6242 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.318280  7041 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
W20260812 19:21:48.336280  6178 leader_election.cc:341] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:48.337924  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:48.339298  7113 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:48.339396  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:48.339772  7113 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:48.340139  7113 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.340530  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:21:48.342042  6416 leader_election.cc:341] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:48.342916  6416 leader_election.cc:341] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:48.343246  6416 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:48.345660  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:48.346319  6475 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.346115  7007 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:48.338495  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:48.348275  6353 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.350601  6178 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:48.363293  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:48.364153  6474 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.342015  6675 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:48.381750  6475 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:48.382157  7116 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260812 19:21:48.354069  7007 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:48.354238  6970 consensus_queue.cc:237] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.389364  7113 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.392364  7113 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:48.395278  6546 tablet_bootstrap.cc:492] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:48.395747  6546 ts_tablet_manager.cc:1397] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.252s	user 0.010s	sys 0.015s
I20260812 19:21:48.395634  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:48.397650  6242 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:48.396701  6354 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.402148  6544 tablet_bootstrap.cc:654] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
W20260812 19:21:48.410975  7111 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260812 19:21:48.415984  6546 raft_consensus.cc:348] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.424824  6546 raft_consensus.cc:374] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:48.425231  6546 raft_consensus.cc:729] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:48.426007  6546 consensus_queue.cc:260] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.430042  6546 ts_tablet_manager.cc:1428] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
W20260812 19:21:48.438056  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 83811.8us
I20260812 19:21:48.439468  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:48.434267  7041 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:48.442374  7113 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:48.453732  7113 raft_consensus.cc:686] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:48.455025  7113 consensus_queue.cc:237] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.455325  6236 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:48.439796  6230 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:48.458374  6546 tablet_bootstrap.cc:492] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:48.458340  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:48.460479  6615 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:48.461404  6615 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:48.448742  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:48.463758  6615 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.460114  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:48.469709  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:48.478737  6983 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:21:48.450287  7041 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.476763  7116 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:48.479215  7130 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:48.494643  7041 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:48.495380  7116 raft_consensus.cc:686] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:48.494344  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:48.475274  6353 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:48.496882  6242 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:48.499778  7116 consensus_queue.cc:237] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.496387  7130 raft_consensus.cc:686] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:48.507923  7043 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.508307  7130 consensus_queue.cc:237] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.509622  6482 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:48.509500  6474 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:48.521899  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:48.534138  6350 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.540825  7043 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:48.566782  6354 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:48.601680  6060 catalog_manager.cc:5495] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:48.656773  6350 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:48.660742  6827 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:48.661371  6827 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.669129  6545 tablet_bootstrap.cc:492] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:48.669639  6545 ts_tablet_manager.cc:1397] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.530s	user 0.026s	sys 0.027s
I20260812 19:21:48.674278  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:48.680259  6827 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:48.706707  6544 tablet_bootstrap.cc:492] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:48.710198  6544 ts_tablet_manager.cc:1397] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.532s	user 0.013s	sys 0.020s
I20260812 19:21:48.713400  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:48.722973  7128 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:48.723748  7128 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:48.728660  6545 raft_consensus.cc:348] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:48.730535  6297 leader_election.cc:341] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:48.733121  6545 raft_consensus.cc:374] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:48.733450  6545 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:48.732618  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:48.735700  6545 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.738546  6545 ts_tablet_manager.cc:1428] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.003s
I20260812 19:21:48.740995  6546 tablet_bootstrap.cc:654] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:48.734465  6059 catalog_manager.cc:5495] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:48.748538  6545 tablet_bootstrap.cc:492] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
W20260812 19:21:48.748962  6297 leader_election.cc:341] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:48.749425  6297 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:48.755457  6615 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:48.747337  7128 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:48.780355  7139 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260812 19:21:48.795011  6544 raft_consensus.cc:348] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.796118  6544 raft_consensus.cc:374] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:48.796538  6544 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:48.797327  6544 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.800028  6544 ts_tablet_manager.cc:1428] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.000s
I20260812 19:21:48.814121  6544 tablet_bootstrap.cc:492] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:48.819715  6545 tablet_bootstrap.cc:654] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:48.829427  6546 tablet_bootstrap.cc:492] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:48.830117  6546 ts_tablet_manager.cc:1397] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.387s	user 0.015s	sys 0.004s
I20260812 19:21:48.840577  6546 raft_consensus.cc:348] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.843050  6546 raft_consensus.cc:374] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:48.843397  6546 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:48.844280  6544 tablet_bootstrap.cc:654] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:48.844385  6546 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.848667  6546 ts_tablet_manager.cc:1428] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.000s
W20260812 19:21:48.849411  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 357314us
I20260812 19:21:48.850010  6546 tablet_bootstrap.cc:492] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:48.853447  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:48.856443  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:48.865276  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:48.866567  6349 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 1: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:21:48.879051  6546 tablet_bootstrap.cc:654] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:48.880991  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:48.882151  6970 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:48.882718  6970 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:48.883273  6970 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:48.916582  6970 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.934566  6970 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:48.962698  6545 tablet_bootstrap.cc:492] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:48.963460  6545 ts_tablet_manager.cc:1397] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.215s	user 0.027s	sys 0.015s
I20260812 19:21:48.972291  6545 raft_consensus.cc:348] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.972980  6544 tablet_bootstrap.cc:492] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:48.973119  6545 raft_consensus.cc:374] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:48.973464  6545 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:48.973541  6544 ts_tablet_manager.cc:1397] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.160s	user 0.016s	sys 0.011s
I20260812 19:21:48.974295  6545 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.976939  6545 ts_tablet_manager.cc:1428] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260812 19:21:48.996031  7041 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:48.998257  6544 raft_consensus.cc:348] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:48.999178  6544 raft_consensus.cc:374] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:48.999536  6544 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:49.000450  6544 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.008548  6545 tablet_bootstrap.cc:492] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
W20260812 19:21:49.012099  6416 leader_election.cc:341] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:49.013087  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:49.017516  6544 ts_tablet_manager.cc:1428] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260812 19:21:49.015832  6055 catalog_manager.cc:5495] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:49.018641  7125 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:21:49.031430  6544 tablet_bootstrap.cc:492] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:49.067401  7125 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:49.068219  7125 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.077183  7125 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:49.077248  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:49.079213  6546 tablet_bootstrap.cc:492] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:49.079734  6546 ts_tablet_manager.cc:1397] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.230s	user 0.026s	sys 0.081s
I20260812 19:21:49.082799  6615 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:49.084825  6546 raft_consensus.cc:348] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.088142  6546 raft_consensus.cc:374] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:49.088465  6546 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:49.088901  6545 tablet_bootstrap.cc:654] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:49.108472  6059 catalog_manager.cc:5495] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:49.106503  6546 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:49.122442  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 83708.6us
I20260812 19:21:49.125227  6546 ts_tablet_manager.cc:1428] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260812 19:21:49.139050  6546 tablet_bootstrap.cc:492] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:49.148156  6615 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:49.161152  7041 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:49.169021  7041 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.159024  7130 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
W20260812 19:21:49.213333  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 74439.3us
I20260812 19:21:49.201450  6983 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:49.227456  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:49.228423  6235 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:49.231678  7041 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:49.221055  7210 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260812 19:21:49.237609  6546 tablet_bootstrap.cc:654] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:49.222288  6983 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.252193  6983 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:49.253454  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:49.268675  6347 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:49.244470  6544 tablet_bootstrap.cc:654] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:49.258527  6615 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:49.271577  7143 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:49.272001  6615 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.272315  7143 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.274355  6615 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:49.293833  7113 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:49.293536  6983 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260812 19:21:49.297174  7113 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.305608  7113 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:49.317180  6060 catalog_manager.cc:5495] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:49.320890  6060 catalog_manager.cc:5495] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:49.332393  6545 tablet_bootstrap.cc:492] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:49.332938  6545 ts_tablet_manager.cc:1397] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.325s	user 0.012s	sys 0.011s
W20260812 19:21:49.334345  6138 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:21:49.337468  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:49.339895  6545 raft_consensus.cc:348] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.341150  6483 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:49.342880  6545 raft_consensus.cc:374] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:49.346769  6545 raft_consensus.cc:729] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:49.347625  6545 consensus_queue.cc:260] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.274580  6235 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:49.339978  7143 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:49.361750  6545 ts_tablet_manager.cc:1428] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260812 19:21:49.363958  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:21:49.367173  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 224972us
I20260812 19:21:49.370143  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:49.383350  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:49.384568  6475 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:49.395467  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:49.396605  6235 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
W20260812 19:21:49.399255  6416 leader_election.cc:341] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:49.403077  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:49.403999  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:49.418584  7235 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260812 19:21:49.425827  6178 leader_election.cc:341] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:49.407007  6546 tablet_bootstrap.cc:492] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:49.411617  6544 tablet_bootstrap.cc:492] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:49.427727  6544 ts_tablet_manager.cc:1397] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.398s	user 0.020s	sys 0.021s
I20260812 19:21:49.413684  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:49.411345  6545 tablet_bootstrap.cc:492] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:49.415162  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:49.429080  6546 ts_tablet_manager.cc:1397] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.290s	user 0.016s	sys 0.016s
W20260812 19:21:49.429440  6416 leader_election.cc:341] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:49.430339  6416 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:49.428519  6482 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
W20260812 19:21:49.433040  6178 leader_election.cc:341] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:49.433940  7235 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:49.436038  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:49.443089  6544 raft_consensus.cc:348] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.444391  6544 raft_consensus.cc:374] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:49.444959  6544 raft_consensus.cc:729] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:49.449410  7235 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:49.443089  6241 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:49.450228  7235 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:49.459371  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:49.505856  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:49.513038  6229 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:49.529407  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:49.531935  7162 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:49.532696  7162 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:49.533272  7162 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:49.541764  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 79574.8us
I20260812 19:21:49.547137  7218 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:49.547706  7218 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:49.546277  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:49.548257  7218 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:49.543380  6546 raft_consensus.cc:348] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.553668  6546 raft_consensus.cc:374] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:49.553983  6546 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:49.554575  6546 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.546110  7130 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:49.560937  7214 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260812 19:21:49.557714  7041 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:49.574136  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:49.574867  6546 ts_tablet_manager.cc:1428] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.145s	user 0.011s	sys 0.001s
I20260812 19:21:49.575058  6615 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:49.575645  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:21:49.575845  6178 leader_election.cc:341] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:49.576234  6178 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:49.593115  6546 tablet_bootstrap.cc:492] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
W20260812 19:21:49.596001  6416 leader_election.cc:341] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:49.596493  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:49.581024  7041 raft_consensus.cc:686] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:49.567574  7130 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:49.607450  7236 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260812 19:21:49.607342  7225 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260812 19:21:49.616849  7230 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:49.617920  7115 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:21:49.653612  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 74579.9us
I20260812 19:21:49.655395  6544 consensus_queue.cc:260] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.610409  7043 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260812 19:21:49.671375  6545 tablet_bootstrap.cc:654] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:49.673727  6983 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:49.696913  6544 ts_tablet_manager.cc:1428] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.269s	user 0.017s	sys 0.003s
I20260812 19:21:49.702538  6544 tablet_bootstrap.cc:492] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:49.711338  6546 tablet_bootstrap.cc:654] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:49.712672  6615 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:49.709118  7130 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:49.692907  7041 consensus_queue.cc:237] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.712781  7230 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:49.728653  7230 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.758340  7230 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:49.773571  7235 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.807168  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:49.808162  6353 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:49.775646  7218 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.812163  6544 tablet_bootstrap.cc:654] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:49.816594  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:49.817344  6349 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:49.822490  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:49.822587  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:49.823577  6482 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
W20260812 19:21:49.797776  7239 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.111s	user 0.002s	sys 0.004s
I20260812 19:21:49.825040  7219 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:49.825582  7219 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:49.826053  7219 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:49.844013  7235 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:49.858785  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:49.861676  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:49.857961  7218 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:49.867817  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:49.874967  6482 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:49.882030  6178 leader_election.cc:341] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:49.874217  7043 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:49.930586  6482 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:49.932412  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:49.934006  7218 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:49.859313  7162 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:49.894590  7043 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:49.943336  7043 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:49.975169  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:49.975649  7162 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:49.976218  6354 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 1: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:21:49.956440  7218 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:49.983184  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:49.987427  6242 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:49.989370  6546 tablet_bootstrap.cc:492] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:49.989912  6546 ts_tablet_manager.cc:1397] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.403s	user 0.020s	sys 0.026s
I20260812 19:21:49.966922  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:50.039152  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:50.041224  6242 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:50.045246  6545 tablet_bootstrap.cc:492] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:50.045900  6545 ts_tablet_manager.cc:1397] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.635s	user 0.026s	sys 0.039s
I20260812 19:21:50.050926  6827 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:50.051648  6827 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.053107  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:50.054049  6475 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:50.054265  7218 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.056716  7210 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:50.054353  6827 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:50.057305  7210 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.088975  7210 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:21:50.070390  7264 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
W20260812 19:21:50.070741  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 43795.5us
I20260812 19:21:50.074554  6546 raft_consensus.cc:348] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.091791  6546 raft_consensus.cc:374] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:50.092108  6546 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:50.080343  6544 tablet_bootstrap.cc:492] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:50.092995  6544 ts_tablet_manager.cc:1397] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.393s	user 0.024s	sys 0.014s
I20260812 19:21:50.086346  7219 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.095654  6544 raft_consensus.cc:348] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.101691  6544 raft_consensus.cc:374] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:50.102070  6544 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:50.102831  6544 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.104192  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:50.090428  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:50.106639  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:50.107865  6546 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:50.125156  6178 leader_election.cc:341] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:50.136044  6546 ts_tablet_manager.cc:1428] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.146s	user 0.006s	sys 0.002s
I20260812 19:21:50.136603  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:50.112284  7007 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260812 19:21:50.141211  6297 leader_election.cc:341] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:50.145368  6544 ts_tablet_manager.cc:1428] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.001s
I20260812 19:21:50.157100  6546 tablet_bootstrap.cc:492] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:50.154510  6224 raft_consensus.cc:2379] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 1: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:21:50.146006  7143 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:50.148085  6675 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:50.166232  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:21:50.167165  7270 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260812 19:21:50.168902  7271 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
I20260812 19:21:50.174036  7143 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:21:50.172700  6178 leader_election.cc:341] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:50.177762  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:50.182639  6545 raft_consensus.cc:348] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.183373  6545 raft_consensus.cc:374] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:50.183611  6545 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:50.184116  6545 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.188596  7204 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:21:50.205880  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 58781.4us
I20260812 19:21:50.209699  7043 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.213761  6545 ts_tablet_manager.cc:1428] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.168s	user 0.007s	sys 0.002s
I20260812 19:21:50.214092  7043 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:50.161967  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:50.172201  6675 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.224282  6675 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:50.233341  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:50.234169  6350 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:50.222597  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:50.215041  6473 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:50.241430  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:50.253021  6344 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:50.254251  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:50.254308  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:21:50.254997  7143 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.272787  7152 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:50.273406  7152 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:50.273931  7152 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:50.261312  7219 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:50.264029  7204 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:50.267917  6350 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:50.293607  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:50.304319  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:50.305590  6473 raft_consensus.cc:2379] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:50.285292  7204 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:21:50.290058  7257 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260812 19:21:50.309849  6178 leader_election.cc:341] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:50.312484  7041 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:50.314944  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:21:50.321871  7041 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:50.322718  7041 raft_consensus.cc:686] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:50.324154  7041 consensus_queue.cc:237] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.321895  6544 tablet_bootstrap.cc:492] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:50.309860  7204 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:50.383733  6545 tablet_bootstrap.cc:492] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
W20260812 19:21:50.390339  7284 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260812 19:21:50.459951  6138 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:21:50.467902  6546 tablet_bootstrap.cc:654] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
W20260812 19:21:50.478457  6178 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:21:50.479954  7285 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260812 19:21:50.487066  7152 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.494918  7204 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.506042  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:50.510564  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:50.511443  6359 raft_consensus.cc:2379] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:50.511561  6347 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:50.512626  6544 tablet_bootstrap.cc:654] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:50.519402  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:50.521982  7252 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:21:50.524259  7204 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:50.547896  7152 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:50.549557  6545 tablet_bootstrap.cc:654] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:50.550395  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:50.557494  6475 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:50.565981  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:21:50.572847  6178 leader_election.cc:341] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:50.571587  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:50.603495  7115 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260812 19:21:50.604815  6475 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:50.573414  6059 catalog_manager.cc:5495] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
W20260812 19:21:50.613866  6297 leader_election.cc:341] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:50.615612  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:21:50.635519  7255 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:50.615036  7214 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:50.636616  7255 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:50.636660  6347 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:50.654459  6544 tablet_bootstrap.cc:492] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:50.654481  6545 tablet_bootstrap.cc:492] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:50.655124  6544 ts_tablet_manager.cc:1397] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.334s	user 0.017s	sys 0.022s
I20260812 19:21:50.655241  6545 ts_tablet_manager.cc:1397] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.274s	user 0.018s	sys 0.008s
I20260812 19:21:50.617085  7230 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260812 19:21:50.658037  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:50.664753  6546 tablet_bootstrap.cc:492] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:50.665243  6546 ts_tablet_manager.cc:1397] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.514s	user 0.027s	sys 0.022s
I20260812 19:21:50.660956  7252 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:50.666369  7252 raft_consensus.cc:686] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:50.667049  6544 raft_consensus.cc:348] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.667913  6544 raft_consensus.cc:374] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:50.668218  6544 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:50.668812  6544 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.645941  7255 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.674201  6544 ts_tablet_manager.cc:1428] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.003s
I20260812 19:21:50.675098  6546 raft_consensus.cc:348] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.676146  6546 raft_consensus.cc:374] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:50.676515  6546 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:50.643349  7214 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.667723  7252 consensus_queue.cc:237] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.677376  6546 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.699182  6546 ts_tablet_manager.cc:1428] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.005s
I20260812 19:21:50.700881  6546 tablet_bootstrap.cc:492] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:50.703253  6544 tablet_bootstrap.cc:492] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:50.713747  7214 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:50.714524  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:50.724191  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:50.739415  6545 raft_consensus.cc:348] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.781294  6545 raft_consensus.cc:374] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:50.781692  6545 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:50.782514  6545 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:50.789609  6416 leader_election.cc:341] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:50.791235  6416 leader_election.cc:341] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:50.791723  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:50.803198  6545 ts_tablet_manager.cc:1428] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.147s	user 0.004s	sys 0.025s
I20260812 19:21:50.777746  7143 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260812 19:21:50.813761  6545 tablet_bootstrap.cc:492] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:50.802493  7171 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:50.835134  6546 tablet_bootstrap.cc:654] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:50.829041  7255 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260812 19:21:50.868216  6544 tablet_bootstrap.cc:654] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:50.869024  7130 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:50.869799  7230 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:50.870925  7230 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:50.904592  7308 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260812 19:21:50.927268  7255 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:50.941735  7255 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.944571  7255 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:50.946170  7230 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:50.946002  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:50.939292  7214 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:50.951407  7214 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:50.952795  6477 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:50.954041  7214 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:50.959880  6545 tablet_bootstrap.cc:654] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:50.964928  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:50.968772  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:50.969573  6235 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:50.968890  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:50.970969  7143 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:50.971371  7143 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:50.971748  7143 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:50.972427  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:50.975189  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:21:50.976855  6178 leader_election.cc:341] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:50.979666  6178 leader_election.cc:341] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:50.980300  6178 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:50.987249  7230 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:51.012981  7143 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.014292  6359 raft_consensus.cc:2379] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 1: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:21:51.007339  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:51.017563  6229 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:51.025583  7143 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:51.030316  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:51.032260  7235 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:51.032666  7235 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:51.032996  7235 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:51.033522  6544 tablet_bootstrap.cc:492] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:51.033970  6544 ts_tablet_manager.cc:1397] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.332s	user 0.024s	sys 0.029s
I20260812 19:21:51.032114  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:51.036870  6544 raft_consensus.cc:348] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.037626  6544 raft_consensus.cc:374] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.037910  6544 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.038570  6546 tablet_bootstrap.cc:492] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:51.040918  6546 ts_tablet_manager.cc:1397] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.340s	user 0.011s	sys 0.012s
I20260812 19:21:51.047437  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:51.048089  6236 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:51.052392  7235 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.053627  6475 raft_consensus.cc:2379] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:51.054404  6060 catalog_manager.cc:5495] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:51.038617  6544 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.062763  6545 tablet_bootstrap.cc:492] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:51.063303  6545 ts_tablet_manager.cc:1397] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.254s	user 0.013s	sys 0.002s
I20260812 19:21:51.064075  6544 ts_tablet_manager.cc:1428] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.004s
I20260812 19:21:51.065102  6544 tablet_bootstrap.cc:492] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:51.072181  7235 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:51.073374  6236 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:51.074368  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:51.075223  6544 tablet_bootstrap.cc:654] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.075625  7162 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:51.076157  7162 raft_consensus.cc:686] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:51.076731  7115 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:51.077011  7162 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.080080  6546 raft_consensus.cc:348] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.101413  6546 raft_consensus.cc:374] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.101814  6546 raft_consensus.cc:729] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.083781  6545 raft_consensus.cc:348] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.090199  6058 catalog_manager.cc:5495] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:51.097899  7230 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:51.104498  6545 raft_consensus.cc:374] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.104799  7230 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.105382  6546 consensus_queue.cc:260] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.107028  7230 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:51.104827  6545 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.107733  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:51.108474  6545 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.100648  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:51.082588  7242 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:51.109894  6236 raft_consensus.cc:2379] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 1: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:21:51.110183  6178 leader_election.cc:341] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:51.112052  6546 ts_tablet_manager.cc:1428] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
I20260812 19:21:51.115154  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:51.117161  6546 tablet_bootstrap.cc:492] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:51.118289  6545 ts_tablet_manager.cc:1428] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.002s
I20260812 19:21:51.119668  6545 tablet_bootstrap.cc:492] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
W20260812 19:21:51.120338  6178 leader_election.cc:341] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:51.120904  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:51.103555  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:51.124090  7218 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:51.125835  6545 tablet_bootstrap.cc:654] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.135565  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:51.138940  7115 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:21:51.157262  6059 catalog_manager.cc:5495] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:51.193151  6546 tablet_bootstrap.cc:654] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.193212  6545 tablet_bootstrap.cc:492] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:51.193801  6545 ts_tablet_manager.cc:1397] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.001s
I20260812 19:21:51.199970  6545 raft_consensus.cc:348] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.200773  6545 raft_consensus.cc:374] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.201054  6545 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.201687  6545 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.207588  6060 catalog_manager.cc:5495] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:51.209748  6544 tablet_bootstrap.cc:492] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:51.210286  6544 ts_tablet_manager.cc:1397] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.145s	user 0.041s	sys 0.062s
I20260812 19:21:51.211889  6545 ts_tablet_manager.cc:1428] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260812 19:21:51.213466  6545 tablet_bootstrap.cc:492] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:51.225457  7249 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:51.232905  7249 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:51.235373  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:51.236055  7249 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:51.236995  6545 tablet_bootstrap.cc:654] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.246083  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:51.249872  6544 raft_consensus.cc:348] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.255573  6059 catalog_manager.cc:5495] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:51.261904  6544 raft_consensus.cc:374] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.262305  6544 raft_consensus.cc:729] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.262454  6059 catalog_manager.cc:5495] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:51.263099  6544 consensus_queue.cc:260] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.263589  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:51.265604  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:51.265986  6544 ts_tablet_manager.cc:1428] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.055s	user 0.001s	sys 0.009s
I20260812 19:21:51.266939  7249 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:51.268095  6544 tablet_bootstrap.cc:492] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:51.269716  6545 tablet_bootstrap.cc:492] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:51.275346  6473 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:51.274245  6545 ts_tablet_manager.cc:1397] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.007s
I20260812 19:21:51.279881  6545 raft_consensus.cc:348] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.289108  7219 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:51.291782  6545 raft_consensus.cc:374] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.292188  6545 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.291209  6546 tablet_bootstrap.cc:492] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:51.297680  6546 ts_tablet_manager.cc:1397] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.181s	user 0.017s	sys 0.001s
I20260812 19:21:51.297590  6545 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.305650  6546 raft_consensus.cc:348] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.306371  6546 raft_consensus.cc:374] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.306617  6546 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.306763  6545 ts_tablet_manager.cc:1428] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.002s
I20260812 19:21:51.307296  6546 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.307752  6545 tablet_bootstrap.cc:492] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:51.311674  6546 ts_tablet_manager.cc:1428] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260812 19:21:51.311719  6544 tablet_bootstrap.cc:654] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.313009  6546 tablet_bootstrap.cc:492] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:51.326526  7219 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:51.327112  7125 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:51.327616  7125 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.329533  7125 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:51.333350  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:21:51.335878  6416 leader_election.cc:341] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:51.340878  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:51.341542  6235 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:51.353516  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:51.354521  7041 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:51.354910  7041 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:51.355265  7041 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:51.357050  7219 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:51.357602  7219 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.359243  6544 tablet_bootstrap.cc:492] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:51.359721  6544 ts_tablet_manager.cc:1397] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.092s	user 0.005s	sys 0.008s
I20260812 19:21:51.359920  7219 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:51.361861  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:21:51.363657  6178 leader_election.cc:341] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:51.361907  6544 raft_consensus.cc:348] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.367822  6544 raft_consensus.cc:374] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.368150  6544 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.368819  6544 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.377238  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:51.380525  7041 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:21:51.383409  6178 leader_election.cc:341] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:51.383953  7041 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:51.383917  6178 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:51.384986  6544 ts_tablet_manager.cc:1428] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260812 19:21:51.384915  7218 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:51.385731  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:51.386549  6235 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:51.387025  6546 tablet_bootstrap.cc:654] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.388983  6545 tablet_bootstrap.cc:654] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.396405  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:21:51.398828  6416 leader_election.cc:341] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:51.401309  6235 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:51.404052  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:51.405196  7041 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:51.405722  7125 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:51.406209  7125 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.408267  7125 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:51.409123  7041 raft_consensus.cc:686] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:51.410271  7041 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.416311  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:51.417759  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:51.386049  6544 tablet_bootstrap.cc:492] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
W20260812 19:21:51.423072  6416 leader_election.cc:341] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:51.424412  6545 tablet_bootstrap.cc:492] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:51.443078  6545 ts_tablet_manager.cc:1397] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.136s	user 0.010s	sys 0.004s
I20260812 19:21:51.445843  6545 raft_consensus.cc:348] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.446719  6545 raft_consensus.cc:374] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.447052  6545 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.447753  6545 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.450107  6545 ts_tablet_manager.cc:1428] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260812 19:21:51.451236  6545 tablet_bootstrap.cc:492] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
W20260812 19:21:51.454922  6416 leader_election.cc:341] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:51.455401  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:51.460613  7125 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:51.461313  6545 tablet_bootstrap.cc:654] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.466295  6545 tablet_bootstrap.cc:492] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:51.466794  6545 ts_tablet_manager.cc:1397] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.004s
I20260812 19:21:51.470854  6545 raft_consensus.cc:348] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.475847  6059 catalog_manager.cc:5495] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:51.478390  6544 tablet_bootstrap.cc:654] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.482800  6546 tablet_bootstrap.cc:492] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:51.502254  6545 raft_consensus.cc:374] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.504040  6545 raft_consensus.cc:729] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.505084  6545 consensus_queue.cc:260] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.483494  6345 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:51.507867  6545 ts_tablet_manager.cc:1428] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
W20260812 19:21:51.508239  6138 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:21:51.509548  6545 tablet_bootstrap.cc:492] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:51.510084  6546 ts_tablet_manager.cc:1397] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.197s	user 0.032s	sys 0.013s
I20260812 19:21:51.512586  6546 raft_consensus.cc:348] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.513094  6546 raft_consensus.cc:374] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.513335  6546 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.516600  6546 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.521451  6545 tablet_bootstrap.cc:654] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.529554  6544 tablet_bootstrap.cc:492] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:51.530143  6544 ts_tablet_manager.cc:1397] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.005s
I20260812 19:21:51.533448  6544 raft_consensus.cc:348] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.536006  6546 ts_tablet_manager.cc:1428] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260812 19:21:51.537392  6546 tablet_bootstrap.cc:492] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:51.539012  7041 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:51.539597  7041 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.541419  7041 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:51.534406  6544 raft_consensus.cc:374] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.545346  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:51.546216  6544 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.546372  6236 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:51.546904  6544 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.547747  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:51.549091  7115 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:51.549459  7115 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:51.549767  7115 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:51.549867  6546 tablet_bootstrap.cc:654] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.554689  7218 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:51.555147  7218 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.557082  7218 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:51.558599  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:51.559448  6544 ts_tablet_manager.cc:1428] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
W20260812 19:21:51.560012  6178 leader_election.cc:341] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:51.561746  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:21:51.562999  6178 leader_election.cc:341] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:51.563540  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:51.564677  7218 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:51.564338  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:51.566671  6544 tablet_bootstrap.cc:492] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:51.567116  6345 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:51.563903  7115 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.571542  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:51.571831  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:51.572182  6344 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:51.575973  7255 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:51.569331  7115 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:51.578995  6236 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:51.589767  7143 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:51.590509  7143 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.591216  6344 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:51.592619  6545 tablet_bootstrap.cc:492] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:51.592984  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:51.593439  7143 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:51.595007  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:51.596241  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:51.596675  6235 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:51.597680  6546 tablet_bootstrap.cc:492] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
W20260812 19:21:51.597918  6297 leader_election.cc:341] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:51.598150  6546 ts_tablet_manager.cc:1397] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.000s
I20260812 19:21:51.598609  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:51.595852  7115 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:51.594583  6545 ts_tablet_manager.cc:1397] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.021s
I20260812 19:21:51.595715  6544 tablet_bootstrap.cc:654] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.600630  7143 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:51.601120  7143 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:51.601625  7143 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:51.600272  7115 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:51.604936  7115 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.608592  6546 raft_consensus.cc:348] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.609607  6546 raft_consensus.cc:374] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.609854  6546 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.611619  6545 raft_consensus.cc:348] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.612566  6545 raft_consensus.cc:374] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.616791  6545 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.617656  6545 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.610421  6546 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.620501  7255 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:51.621784  6546 ts_tablet_manager.cc:1428] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260812 19:21:51.644167  6236 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:51.655951  6546 tablet_bootstrap.cc:492] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:51.659317  6545 ts_tablet_manager.cc:1428] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.002s
I20260812 19:21:51.668936  6545 tablet_bootstrap.cc:492] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:51.669291  7143 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.682358  6224 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:51.698428  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:51.699476  6229 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:51.694876  7143 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:51.711318  6544 tablet_bootstrap.cc:492] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:51.711848  6544 ts_tablet_manager.cc:1397] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.145s	user 0.038s	sys 0.040s
I20260812 19:21:51.717262  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:51.721544  6545 tablet_bootstrap.cc:654] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
W20260812 19:21:51.725193  6297 leader_election.cc:341] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:51.730491  6546 tablet_bootstrap.cc:654] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.731556  6229 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:51.732969  6058 catalog_manager.cc:5495] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:51.740623  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:51.743058  7255 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:51.743588  7255 raft_consensus.cc:686] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:51.744499  7255 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.768428  6544 raft_consensus.cc:348] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.769157  6544 raft_consensus.cc:374] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.769461  6544 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.771586  6545 tablet_bootstrap.cc:492] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:51.772073  6545 ts_tablet_manager.cc:1397] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.002s
I20260812 19:21:51.774729  6545 raft_consensus.cc:348] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.775413  6545 raft_consensus.cc:374] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.775655  6545 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.776232  6545 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.779009  6545 ts_tablet_manager.cc:1428] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260812 19:21:51.779897  6544 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.783171  6544 ts_tablet_manager.cc:1428] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.005s
I20260812 19:21:51.786820  6058 catalog_manager.cc:5495] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:51.789245  6544 tablet_bootstrap.cc:492] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:51.792546  6545 tablet_bootstrap.cc:492] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:51.793165  6546 tablet_bootstrap.cc:492] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:51.794323  6546 ts_tablet_manager.cc:1397] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.139s	user 0.018s	sys 0.014s
I20260812 19:21:51.798641  6546 raft_consensus.cc:348] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.799916  6546 raft_consensus.cc:374] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.800233  6546 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.800976  6546 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.804267  6546 ts_tablet_manager.cc:1428] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260812 19:21:51.805377  6546 tablet_bootstrap.cc:492] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:51.806936  6545 tablet_bootstrap.cc:654] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.812168  6544 tablet_bootstrap.cc:654] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.826154  6546 tablet_bootstrap.cc:654] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.840538  6544 tablet_bootstrap.cc:492] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:51.841248  6544 ts_tablet_manager.cc:1397] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.018s
I20260812 19:21:51.842835  6545 tablet_bootstrap.cc:492] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:51.843302  6545 ts_tablet_manager.cc:1397] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.051s	user 0.005s	sys 0.014s
I20260812 19:21:51.858225  6544 raft_consensus.cc:348] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.861555  6544 raft_consensus.cc:374] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.861897  6544 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.862715  6544 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.864630  6546 tablet_bootstrap.cc:492] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:51.865621  6546 ts_tablet_manager.cc:1397] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.025s
I20260812 19:21:51.868427  6545 raft_consensus.cc:348] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.869722  6546 raft_consensus.cc:348] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.871001  6546 raft_consensus.cc:374] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.871258  6546 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.871985  6544 ts_tablet_manager.cc:1428] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.001s
I20260812 19:21:51.871845  6546 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.869772  6545 raft_consensus.cc:374] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.873040  6545 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.873472  6544 tablet_bootstrap.cc:492] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:51.873965  6546 ts_tablet_manager.cc:1428] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260812 19:21:51.873862  6545 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.875092  6546 tablet_bootstrap.cc:492] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:51.876492  6545 ts_tablet_manager.cc:1428] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260812 19:21:51.877409  6545 tablet_bootstrap.cc:492] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Bootstrap starting.
I20260812 19:21:51.893918  6544 tablet_bootstrap.cc:654] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.900784  6545 tablet_bootstrap.cc:654] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.905074  6546 tablet_bootstrap.cc:654] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.909665  6544 tablet_bootstrap.cc:492] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:51.910256  6544 ts_tablet_manager.cc:1397] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.003s
I20260812 19:21:51.917268  6544 raft_consensus.cc:348] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.918015  6544 raft_consensus.cc:374] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:51.918298  6544 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
I20260812 19:21:51.918993  6544 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.919744  6344 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:51.921226  6359 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:51.922516  6544 ts_tablet_manager.cc:1428] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260812 19:21:51.924031  6544 tablet_bootstrap.cc:492] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: Bootstrap starting.
I20260812 19:21:51.925632  7230 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:51.926561  7230 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.930330  7230 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:51.931239  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:21:51.933454  6178 leader_election.cc:341] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:51.935004  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:51.966171  6474 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:51.968617  7235 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:51.969139  7235 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.971902  7235 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:51.981065  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:51.981936  6224 raft_consensus.cc:2379] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 1: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:21:51.983019  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:51.982002  6544 tablet_bootstrap.cc:654] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:51.988543  7125 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:51.990028  7125 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:51.990162  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:51.990494  7125 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.991951  7143 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:21:51.992580  7125 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:51.992523  7143 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:51.994969  7230 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:51.995489  7230 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:51.995937  7230 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:52.017386  7143 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:52.022976  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:51.981079  6545 tablet_bootstrap.cc:492] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: No bootstrap required, opened a new log
I20260812 19:21:52.028990  6545 ts_tablet_manager.cc:1397] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Time spent bootstrapping tablet: real 0.152s	user 0.015s	sys 0.040s
I20260812 19:21:52.030894  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:52.035094  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:52.039068  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:52.040119  6229 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:52.041690  7374 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:21:52.044327  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:52.049814  6416 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:21:52.103849  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 56826.5us
I20260812 19:21:52.105094  7115 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:52.103567  7219 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:52.110091  7255 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:52.110585  7255 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.109696  7219 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.113487  7219 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:52.114037  7115 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:52.118403  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:52.113931  7255 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:52.120185  6545 raft_consensus.cc:348] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.121053  6545 raft_consensus.cc:374] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:52.120810  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:52.121424  6545 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Initialized, Role: FOLLOWER
W20260812 19:21:52.123332  6178 leader_election.cc:341] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:52.122408  6545 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.125335  7218 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:52.127714  7143 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:52.127465  7218 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.128176  7143 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.129544  7218 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:52.126494  6545 ts_tablet_manager.cc:1428] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.007s
I20260812 19:21:52.130201  7143 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:52.146368  6546 tablet_bootstrap.cc:492] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:52.146988  6546 ts_tablet_manager.cc:1397] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.272s	user 0.073s	sys 0.107s
I20260812 19:21:52.125520  7115 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:52.149245  7230 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.150005  7115 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.152606  7115 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:52.155603  7230 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:52.172201  6546 raft_consensus.cc:348] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.173009  6546 raft_consensus.cc:374] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:52.173357  6546 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:52.174793  6546 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.159238  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:52.180027  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:52.187245  6546 ts_tablet_manager.cc:1428] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.004s
I20260812 19:21:52.173316  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:21:52.191215  6178 leader_election.cc:341] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:21:52.191927  6178 leader_election.cc:341] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:52.187063  6235 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
W20260812 19:21:52.194775  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 61603.9us
I20260812 19:21:52.196430  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:52.197707  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:21:52.204110  6546 tablet_bootstrap.cc:492] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:52.200022  7162 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:52.206952  7162 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:52.207433  7162 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:52.208575  6544 tablet_bootstrap.cc:492] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: No bootstrap required, opened a new log
I20260812 19:21:52.210631  6544 ts_tablet_manager.cc:1397] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: Time spent bootstrapping tablet: real 0.287s	user 0.025s	sys 0.015s
I20260812 19:21:52.208562  7404 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:52.201910  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:52.204931  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:52.212443  7404 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:52.213325  6475 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:52.213411  7401 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:52.213454  7404 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:52.221748  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:21:52.222308  6416 leader_election.cc:341] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:52.222937  6473 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:52.226119  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:52.227188  6477 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:52.229498  7404 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.230672  7403 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:52.231415  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:52.232426  6481 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 0.
I20260812 19:21:52.233281  7404 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:52.236452  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:52.237582  6235 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:52.257486  6546 tablet_bootstrap.cc:654] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:52.300763  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:52.255141  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:52.321481  6544 raft_consensus.cc:348] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.322268  6544 raft_consensus.cc:374] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:52.322535  6544 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Initialized, Role: FOLLOWER
W20260812 19:21:52.324927  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 69875.7us
I20260812 19:21:52.323282  6544 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.253701  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:52.324021  7219 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:52.327764  7374 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:21:52.255908  7404 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.088s
W20260812 19:21:52.345582  6416 leader_election.cc:341] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:52.273813  7162 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.337628  7242 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260812 19:21:52.339764  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:52.341521  7219 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:52.372871  6544 ts_tablet_manager.cc:1428] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: Time spent starting tablet: real 0.162s	user 0.010s	sys 0.013s
I20260812 19:21:52.371244  6241 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:52.384749  7162 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:52.367837  7219 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:52.370402  6477 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
W20260812 19:21:52.398705  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 77538us
I20260812 19:21:52.399741  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:52.408205  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:52.409051  6482 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:52.428560  6482 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:21:52.430023  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:21:52.447264  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47574.2us
I20260812 19:21:52.435446  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:21:52.448974  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 100663us
I20260812 19:21:52.450817  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:52.403401  7249 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260812 19:21:52.452654  7374 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:52.451736  7235 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260812 19:21:52.510371  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 80432.3us
I20260812 19:21:52.470013  6241 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:52.455688  6228 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:21:52.550599  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 92394us
I20260812 19:21:52.541229  7235 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:52.558763  7235 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:52.592278  6546 tablet_bootstrap.cc:492] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
W20260812 19:21:52.736737  6138 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:21:52.764673  6546 ts_tablet_manager.cc:1397] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.561s	user 0.017s	sys 0.061s
W20260812 19:21:52.611397  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 66858us
W20260812 19:21:52.638368  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 190454us
I20260812 19:21:52.676400  7374 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:21:52.765494  7235 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.787891  6546 raft_consensus.cc:348] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.772562  7374 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.789222  6546 raft_consensus.cc:374] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:52.793480  6546 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:52.631382  7162 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:52.794224  6546 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.636401  7414 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:52.694181  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:52.807840  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:52.809147  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:52.811947  7218 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:52.812423  7218 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:52.807951  7162 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.760308  7219 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.817431  7162 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:52.813704  7218 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.819427  7235 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:52.808823  7407 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:52.808663  7414 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:52.822616  7407 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.823266  7414 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:52.824714  6546 ts_tablet_manager.cc:1428] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260812 19:21:52.837119  6546 tablet_bootstrap.cc:492] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:52.819442  7219 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:52.842334  7421 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:52.854161  7421 raft_consensus.cc:686] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:52.844661  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:52.855878  7421 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.851814  7407 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:52.839211  6228 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
W20260812 19:21:52.871798  6416 leader_election.cc:341] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:52.879578  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:52.886253  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:52.887321  6477 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
W20260812 19:21:52.888329  6416 leader_election.cc:341] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:52.895915  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:52.896975  6344 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
I20260812 19:21:52.893849  7414 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.912045  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:52.913568  7414 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:52.916065  6235 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 1: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:21:52.916812  6178 leader_election.cc:341] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:52.928225  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:52.933239  6475 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:52.944772  6058 catalog_manager.cc:5495] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:52.937677  6059 catalog_manager.cc:5495] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:52.950564  6475 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:21:52.951130  6546 tablet_bootstrap.cc:654] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:52.953320  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:52.954344  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:52.954948  7401 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:52.955883  7401 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:52.956593  7401 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:52.960320  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:52.961573  6236 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 0.
W20260812 19:21:52.966928  6178 leader_election.cc:341] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:21:52.971621  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:52.973457  6470 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:52.974274  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:52.975823  7219 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:52.976701  7219 raft_consensus.cc:686] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:21:52.959383  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:52.985023  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:52.991883  7374 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:21:52.978453  7219 consensus_queue.cc:237] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:52.998025  7458 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:21:53.002765  7374 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:53.010906  7374 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:53.027348  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:53.028595  6241 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 0.
I20260812 19:21:53.032485  7401 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:53.043643  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:53.045431  7401 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:53.062430  7374 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:53.064608  6352 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 1: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:21:53.059826  6546 tablet_bootstrap.cc:492] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:53.068677  6546 ts_tablet_manager.cc:1397] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.237s	user 0.015s	sys 0.013s
I20260812 19:21:53.070221  7374 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:53.071483  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:21:53.072254  6546 raft_consensus.cc:348] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:53.072811  6474 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:53.073048  6546 raft_consensus.cc:374] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:53.073351  6546 raft_consensus.cc:729] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:53.074002  6546 consensus_queue.cc:260] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:53.076771  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:21:53.078411  7403 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:21:53.079927  6546 ts_tablet_manager.cc:1428] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260812 19:21:53.082823  6546 tablet_bootstrap.cc:492] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:53.088938  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:53.090207  6228 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:53.089972  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:53.102999  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:53.104151  7444 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:21:53.110598  6546 tablet_bootstrap.cc:654] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:53.113256  6228 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:53.121984  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:21:53.122884  7403 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:21:53.123558  7403 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:53.124738  7403 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:53.132416  6546 tablet_bootstrap.cc:492] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:53.133073  6546 ts_tablet_manager.cc:1397] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.011s
I20260812 19:21:53.142483  6546 raft_consensus.cc:348] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:53.143129  6546 raft_consensus.cc:374] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:53.143357  6546 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:53.143981  6546 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:53.145805  6546 ts_tablet_manager.cc:1428] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.006s
I20260812 19:21:53.146883  6546 tablet_bootstrap.cc:492] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Bootstrap starting.
I20260812 19:21:53.155880  6546 tablet_bootstrap.cc:654] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Neither blocks nor log segments found. Creating new log.
I20260812 19:21:53.155864  7471 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:53.156728  7471 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:53.193727  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:53.187466  7471 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:53.200687  6546 tablet_bootstrap.cc:492] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: No bootstrap required, opened a new log
I20260812 19:21:53.198129  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:53.201272  6546 ts_tablet_manager.cc:1397] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.013s
I20260812 19:21:53.202814  6474 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 1: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:21:53.205267  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:53.205817  6055 catalog_manager.cc:5495] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:53.206965  7471 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:53.208039  6546 raft_consensus.cc:348] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:53.208943  6546 raft_consensus.cc:374] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:21:53.209214  6546 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Initialized, Role: FOLLOWER
I20260812 19:21:53.209937  6546 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:53.211565  7374 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:53.214361  6546 ts_tablet_manager.cc:1428] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260812 19:21:53.212359  7374 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:53.218334  7374 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:53.220619  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:53.221939  6474 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 1: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:21:53.229446  7471 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:53.231602  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:53.236083  6058 catalog_manager.cc:5495] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:53.238204  6058 catalog_manager.cc:5495] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:53.234830  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:53.240576  7471 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:53.261566  7471 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:53.334874  7471 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:53.335618  7471 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:53.338147  7471 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:53.338742  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:53.339203  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:53.339792  6235 raft_consensus.cc:2379] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:53.340924  6297 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:53.341430  7471 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:53.347503  7471 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:53.384888  7446 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260812 19:21:53.397552  7471 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:53.402750  7403 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:53.427106  7219 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:53.438994  7453 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:53.448553  7458 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:21:53.516863  7115 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260812 19:21:53.550326  7502 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260812 19:21:53.565048  7420 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:53.566018  7420 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:53.570832  7420 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:53.575496  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:53.577099  6235 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 1: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:21:53.579392  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:21:53.580382  6470 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 1: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:21:53.581931  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:21:53.585220  7471 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:21:53.613257  7471 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:21:53.675740  7115 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260812 19:21:53.706388  7401 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:21:53.813547  6138 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:21:54.649119  7401 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:21:54.649724  7401 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:54.651835  7401 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:54.652554  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:21:54.652940  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:21:54.653249  6236 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:54.653612  6354 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:21:54.654421  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:54.655145  7401 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:21:54.655485  7401 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:21:54.655738  7401 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:54.662220  7401 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:54.663841  7401 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:54.664392  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:21:54.664799  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:21:54.665053  6236 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:54.665413  6354 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:21:54.670493  6236 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:21:54.671427  6354 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:21:54.671679  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:21:54.672466  7401 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:21:54.672996  7401 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:21:54.673804  7401 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:21:54.684572  6058 catalog_manager.cc:5495] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 0 to 2, leader changed from <none> to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:21:55.157179  6228 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260812 19:21:55.158476  7401 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:55.172494  6354 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260812 19:21:55.174211  7401 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:21:55.271776  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:21:55.279131  7528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:55.281186  7532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:21:55.305091  7530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:21:55.308897  4084 server_base.cc:1034] running on GCE node
I20260812 19:21:55.310022  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:21:55.310254  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:21:55.310427  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562515310414 us; error 0 us; skew 500 ppm
I20260812 19:21:55.311015  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:21:55.322338  4084 webserver.cc:460] Webserver started at http://127.3.253.4:42111/ using document root <none> and password file <none>
I20260812 19:21:55.323246  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:21:55.323647  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:21:55.324179  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:21:55.326197  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-3-root/instance:
uuid: "f4ef77b3328a44e8a21dd902b370e25a"
format_stamp: "Formatted at 2026-08-12 19:21:55 on dist-test-slave-3kk6"
I20260812 19:21:55.331153  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260812 19:21:55.335577  7544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:55.337399  4084 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260812 19:21:55.337828  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-3-root
uuid: "f4ef77b3328a44e8a21dd902b370e25a"
format_stamp: "Formatted at 2026-08-12 19:21:55 on dist-test-slave-3kk6"
I20260812 19:21:55.338325  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:21:55.364449  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:21:55.366387  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:21:55.368323  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:21:55.370873  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:21:55.371191  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:55.371476  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:21:55.371620  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:21:55.453680  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.4:35891
I20260812 19:21:55.453842  7647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.4:35891 every 8 connection(s)
I20260812 19:21:55.460369  4084 auto_leader_rebalancer-test.cc:413] add a tserver: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:21:55.485574  7649 heartbeater.cc:347] Connected to a master server at 127.3.253.62:46555
I20260812 19:21:55.486081  7649 heartbeater.cc:464] Registering TS with master...
I20260812 19:21:55.487011  7649 heartbeater.cc:511] Master 127.3.253.62:46555 requested a full tablet report, sending...
I20260812 19:21:55.488955  6058 ts_manager.cc:194] Registered new tserver with Master: f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:21:55.490639  6058 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60312
I20260812 19:21:55.937163  6354 consensus_queue.cc:237] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:55.945770  6475 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:21:55.945976  6236 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:21:55.947129  7526 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:55.948030  7471 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:55.959718  7471 raft_consensus.cc:2932] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:55.961450  6475 raft_consensus.cc:2932] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
W20260812 19:21:55.962720  6298 consensus_peers.cc:487] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe2a7dc98f92406fbf459b7c9d812bf7. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:55.967836  6236 raft_consensus.cc:2932] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:55.975833  6058 catalog_manager.cc:5495] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260812 19:21:56.027297  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 45158.1us
I20260812 19:21:56.035274  6228 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:56.056727  6354 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:21:56.058708  7453 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:21:56.056826  6475 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:21:56.062806  7453 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:56.091706  7687 raft_consensus.cc:2932] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
W20260812 19:21:56.148463  6179 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6554cc94d5d248589dde19ca72bd508a. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:56.153978  6352 raft_consensus.cc:2932] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:56.153630  6055 catalog_manager.cc:5495] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:56.165493  6474 raft_consensus.cc:2932] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:56.207250  6474 consensus_queue.cc:237] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:56.217804  6352 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:21:56.219377  6235 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:21:56.219270  7401 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:56.221076  7401 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:21:56.226940  7527 raft_consensus.cc:2932] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:56.233642  6352 raft_consensus.cc:2932] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:56.247519  6474 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
W20260812 19:21:56.250141  6417 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d49af1f98624af48adc92f25f5a2be7. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:21:56.258955  6417 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2d336a1bcca41809d1c89b7833de9a5. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:56.259143  6352 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:21:56.259285  6224 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:21:56.248468  6058 catalog_manager.cc:5495] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:56.261368  7527 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:56.271975  6235 raft_consensus.cc:2932] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:56.273757  7403 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:21:56.297490  7403 raft_consensus.cc:2932] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:56.304085  6224 raft_consensus.cc:2932] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:56.318084  6354 raft_consensus.cc:2932] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:56.328413  6058 catalog_manager.cc:5495] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:56.384804  7710 ts_tablet_manager.cc:927] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:56.388469  7710 tablet_copy_client.cc:316] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.2:39969
I20260812 19:21:56.421756  6374 tablet_copy_service.cc:140] P 54f83319db6b49929cc8f18a66a66975: Received BeginTabletCopySession request for tablet fe2a7dc98f92406fbf459b7c9d812bf7 from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:35822)
I20260812 19:21:56.422473  6374 tablet_copy_service.cc:161] P 54f83319db6b49929cc8f18a66a66975: Beginning new tablet copy session on tablet fe2a7dc98f92406fbf459b7c9d812bf7 from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:35822: session id = f4ef77b3328a44e8a21dd902b370e25a-fe2a7dc98f92406fbf459b7c9d812bf7
I20260812 19:21:56.445973  6374 tablet_copy_source_session.cc:205] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:21:56.456472  7710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe2a7dc98f92406fbf459b7c9d812bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:56.473151  7710 tablet_copy_client.cc:791] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:21:56.473773  7710 tablet_copy_client.cc:655] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:21:56.477861  7710 tablet_copy_client.cc:531] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:21:56.486479  7710 tablet_bootstrap.cc:492] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:21:56.493498  7649 heartbeater.cc:503] Master 127.3.253.62:46555 was elected leader, sending a full tablet report...
I20260812 19:21:56.514021  7710 tablet_bootstrap.cc:492] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:21:56.515046  7710 tablet_bootstrap.cc:492] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:21:56.515758  7710 ts_tablet_manager.cc:1397] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.030s	user 0.026s	sys 0.005s
I20260812 19:21:56.518143  7710 raft_consensus.cc:348] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:56.519088  7710 raft_consensus.cc:729] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:21:56.519718  7710 consensus_queue.cc:260] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:56.523320  7710 ts_tablet_manager.cc:1428] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260812 19:21:56.526257  6374 tablet_copy_service.cc:342] P 54f83319db6b49929cc8f18a66a66975: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-fe2a7dc98f92406fbf459b7c9d812bf7 received from {username='slave'} at 127.0.0.1:35822
I20260812 19:21:56.526634  6374 tablet_copy_service.cc:433] P 54f83319db6b49929cc8f18a66a66975: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-fe2a7dc98f92406fbf459b7c9d812bf7 on tablet fe2a7dc98f92406fbf459b7c9d812bf7 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:21:56.599602  7710 ts_tablet_manager.cc:927] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707)
I20260812 19:21:56.601369  7710 tablet_copy_client.cc:316] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.1:46707
I20260812 19:21:56.615759  6254 tablet_copy_service.cc:140] P a1541d11be514114966dc1e92a345298: Received BeginTabletCopySession request for tablet 6554cc94d5d248589dde19ca72bd508a from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:56292)
I20260812 19:21:56.616369  6254 tablet_copy_service.cc:161] P a1541d11be514114966dc1e92a345298: Beginning new tablet copy session on tablet 6554cc94d5d248589dde19ca72bd508a from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:56292: session id = f4ef77b3328a44e8a21dd902b370e25a-6554cc94d5d248589dde19ca72bd508a
I20260812 19:21:56.624218  6254 tablet_copy_source_session.cc:205] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:21:56.627730  7710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6554cc94d5d248589dde19ca72bd508a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:56.629997  7720 ts_tablet_manager.cc:927] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:56.631775  7720 tablet_copy_client.cc:316] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.3:42599
I20260812 19:21:56.648204  6500 tablet_copy_service.cc:140] P bdfa5579d4534c618c00db6b4a841c81: Received BeginTabletCopySession request for tablet 5d49af1f98624af48adc92f25f5a2be7 from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:33386)
I20260812 19:21:56.648861  6500 tablet_copy_service.cc:161] P bdfa5579d4534c618c00db6b4a841c81: Beginning new tablet copy session on tablet 5d49af1f98624af48adc92f25f5a2be7 from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:33386: session id = f4ef77b3328a44e8a21dd902b370e25a-5d49af1f98624af48adc92f25f5a2be7
I20260812 19:21:56.656708  6500 tablet_copy_source_session.cc:205] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:21:56.660287  7720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d49af1f98624af48adc92f25f5a2be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:56.667955  7710 tablet_copy_client.cc:791] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:21:56.668594  7710 tablet_copy_client.cc:655] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:21:56.674466  7710 tablet_copy_client.cc:531] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:21:56.678489  7720 tablet_copy_client.cc:791] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:21:56.680101  7720 tablet_copy_client.cc:655] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:21:56.683096  7710 tablet_bootstrap.cc:492] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:21:56.683996  7720 tablet_copy_client.cc:531] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:21:56.693324  7720 tablet_bootstrap.cc:492] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:21:56.728729  7720 tablet_bootstrap.cc:492] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:21:56.730034  7720 tablet_bootstrap.cc:492] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:21:56.731045  7720 ts_tablet_manager.cc:1397] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.038s	user 0.027s	sys 0.007s
I20260812 19:21:56.734850  7720 raft_consensus.cc:348] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:56.736217  7720 raft_consensus.cc:729] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:21:56.737171  7720 consensus_queue.cc:260] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:56.740362  7720 ts_tablet_manager.cc:1428] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260812 19:21:56.746318  6500 tablet_copy_service.cc:342] P bdfa5579d4534c618c00db6b4a841c81: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-5d49af1f98624af48adc92f25f5a2be7 received from {username='slave'} at 127.0.0.1:33386
I20260812 19:21:56.746745  6500 tablet_copy_service.cc:433] P bdfa5579d4534c618c00db6b4a841c81: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-5d49af1f98624af48adc92f25f5a2be7 on tablet 5d49af1f98624af48adc92f25f5a2be7 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:21:56.751926  7710 tablet_bootstrap.cc:492] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:21:56.752717  7710 tablet_bootstrap.cc:492] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:21:56.753276  7710 ts_tablet_manager.cc:1397] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.045s
I20260812 19:21:56.755702  7710 raft_consensus.cc:348] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:56.756563  7710 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:21:56.757100  7710 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:56.759346  7710 ts_tablet_manager.cc:1428] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260812 19:21:56.760810  6254 tablet_copy_service.cc:342] P a1541d11be514114966dc1e92a345298: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-6554cc94d5d248589dde19ca72bd508a received from {username='slave'} at 127.0.0.1:56292
I20260812 19:21:56.761168  6254 tablet_copy_service.cc:433] P a1541d11be514114966dc1e92a345298: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-6554cc94d5d248589dde19ca72bd508a on tablet 6554cc94d5d248589dde19ca72bd508a with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:21:56.828115  7710 ts_tablet_manager.cc:927] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:56.828384  7606 raft_consensus.cc:1203] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:21:56.830845  7710 tablet_copy_client.cc:316] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.3:42599
I20260812 19:21:56.833019  6500 tablet_copy_service.cc:140] P bdfa5579d4534c618c00db6b4a841c81: Received BeginTabletCopySession request for tablet d2d336a1bcca41809d1c89b7833de9a5 from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:33386)
I20260812 19:21:56.833560  6500 tablet_copy_service.cc:161] P bdfa5579d4534c618c00db6b4a841c81: Beginning new tablet copy session on tablet d2d336a1bcca41809d1c89b7833de9a5 from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:33386: session id = f4ef77b3328a44e8a21dd902b370e25a-d2d336a1bcca41809d1c89b7833de9a5
I20260812 19:21:56.841416  6500 tablet_copy_source_session.cc:205] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:21:56.844720  7710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2d336a1bcca41809d1c89b7833de9a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:56.861900  7710 tablet_copy_client.cc:791] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:21:56.862548  7710 tablet_copy_client.cc:655] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:21:56.866156  7710 tablet_copy_client.cc:531] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:21:56.874548  7710 tablet_bootstrap.cc:492] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:21:56.901930  7710 tablet_bootstrap.cc:492] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:21:56.902870  7710 tablet_bootstrap.cc:492] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:21:56.903437  7710 ts_tablet_manager.cc:1397] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.004s
I20260812 19:21:56.905668  7710 raft_consensus.cc:348] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:56.906430  7710 raft_consensus.cc:729] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:21:56.907056  7710 consensus_queue.cc:260] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:56.909461  7710 ts_tablet_manager.cc:1428] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260812 19:21:56.910898  6500 tablet_copy_service.cc:342] P bdfa5579d4534c618c00db6b4a841c81: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-d2d336a1bcca41809d1c89b7833de9a5 received from {username='slave'} at 127.0.0.1:33386
I20260812 19:21:56.911307  6500 tablet_copy_service.cc:433] P bdfa5579d4534c618c00db6b4a841c81: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-d2d336a1bcca41809d1c89b7833de9a5 on tablet d2d336a1bcca41809d1c89b7833de9a5 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:21:56.981750  7606 raft_consensus.cc:1203] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:21:57.194059  7606 raft_consensus.cc:1203] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:21:57.222719  7606 raft_consensus.cc:1203] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:21:57.380934  7670 raft_consensus.cc:1050] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:21:57.383605  7670 consensus_queue.cc:237] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:21:57.390740  7606 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:21:57.392158  7512 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:21:57.392702  6474 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:21:57.396191  7734 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:21:57.403231  6228 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:21:57.406335  7512 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:21:57.419224  7670 raft_consensus.cc:2932] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.426707  6235 raft_consensus.cc:2932] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.427798  6477 raft_consensus.cc:2932] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.447857  6055 catalog_manager.cc:5495] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.453447  7606 raft_consensus.cc:2932] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.508948  6345 consensus_queue.cc:237] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:21:57.513904  7606 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:21:57.514585  6474 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:21:57.515286  7734 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:21:57.520414  7751 raft_consensus.cc:1050] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:21:57.522492  7740 raft_consensus.cc:2932] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.522976  7751 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:21:57.524369  7607 raft_consensus.cc:2932] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.527141  7670 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:21:57.536163  6477 raft_consensus.cc:2932] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.545593  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet fe2a7dc98f92406fbf459b7c9d812bf7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:21:57.551112  6059 catalog_manager.cc:5495] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.559016  7607 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:21:57.560559  7751 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:21:57.567951  6345 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:21:57.572223  6207 tablet_service.cc:1514] Processing DeleteTablet for tablet fe2a7dc98f92406fbf459b7c9d812bf7 with delete_type TABLET_DATA_TOMBSTONED (TS a1541d11be514114966dc1e92a345298 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53166
I20260812 19:21:57.581858  7687 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:21:57.583475  6477 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:21:57.587337  7759 tablet_replica.cc:330] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:21:57.589124  7759 raft_consensus.cc:2229] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:57.590296  7759 raft_consensus.cc:2258] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:57.598145  7759 ts_tablet_manager.cc:1905] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:21:57.599224  7687 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:21:57.622082  7759 ts_tablet_manager.cc:1918] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:21:57.623075  7759 log.cc:1196] T fe2a7dc98f92406fbf459b7c9d812bf7 P a1541d11be514114966dc1e92a345298: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-0-root/wals/fe2a7dc98f92406fbf459b7c9d812bf7
I20260812 19:21:57.625157  6040 catalog_manager.cc:4841] TS a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): tablet fe2a7dc98f92406fbf459b7c9d812bf7 (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:21:57.623868  7687 raft_consensus.cc:2932] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.628078  6470 raft_consensus.cc:2932] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.639376  6354 raft_consensus.cc:2932] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.644140  7606 raft_consensus.cc:2932] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.655334  6060 catalog_manager.cc:5495] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:21:57.663805  7730 raft_consensus.cc:1050] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:21:57.666617  7730 consensus_queue.cc:237] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:21:57.683212  6224 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:21:57.703101  7607 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:21:57.704555  7751 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:21:57.710358  6354 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:21:57.712492  7751 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:21:57.718448  7603 raft_consensus.cc:2932] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.724603  6228 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:21:57.724643  6345 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:21:57.726092  7730 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:21:57.730403  7606 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:21:57.732790  7707 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:21:57.736122  7707 raft_consensus.cc:1050] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:21:57.736447  7730 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:21:57.738525  7707 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:21:57.740636  7769 raft_consensus.cc:2932] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.744786  6352 raft_consensus.cc:2932] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.754380  7607 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:21:57.754488  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 6554cc94d5d248589dde19ca72bd508a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:21:57.755930  7403 raft_consensus.cc:2932] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.760180  7607 raft_consensus.cc:2932] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.786984  6345 raft_consensus.cc:2932] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.779201  6060 catalog_manager.cc:5495] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.797761  6354 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:21:57.799088  7730 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:21:57.803860  7730 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:21:57.804275  6228 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:21:57.810515  7403 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:21:57.825549  6228 raft_consensus.cc:2932] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.834371  6452 tablet_service.cc:1514] Processing DeleteTablet for tablet 6554cc94d5d248589dde19ca72bd508a with delete_type TABLET_DATA_TOMBSTONED (TS bdfa5579d4534c618c00db6b4a841c81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38134
I20260812 19:21:57.820880  6060 catalog_manager.cc:5495] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.853192  7790 tablet_replica.cc:330] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:21:57.855108  7790 raft_consensus.cc:2229] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:57.858995  7790 raft_consensus.cc:2258] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:57.864118  7607 raft_consensus.cc:2932] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.866866  6224 raft_consensus.cc:2932] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.872283  7790 ts_tablet_manager.cc:1905] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:21:57.861315  7781 raft_consensus.cc:2932] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.888501  6477 consensus_queue.cc:237] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:21:57.880076  6058 catalog_manager.cc:5495] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.897477  7607 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:21:57.897979  6228 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:21:57.898893  7707 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:21:57.899982  7783 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:21:57.903044  6352 raft_consensus.cc:2932] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.911194  7403 raft_consensus.cc:2932] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.915866  7603 raft_consensus.cc:2932] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.920959  6235 raft_consensus.cc:2932] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.924467  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 5d49af1f98624af48adc92f25f5a2be7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:21:57.927268  6477 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:21:57.939884  7790 ts_tablet_manager.cc:1918] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:21:57.940506  7790 log.cc:1196] T 6554cc94d5d248589dde19ca72bd508a P bdfa5579d4534c618c00db6b4a841c81: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-2-root/wals/6554cc94d5d248589dde19ca72bd508a
I20260812 19:21:57.944897  6040 catalog_manager.cc:4841] TS bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): tablet 6554cc94d5d248589dde19ca72bd508a (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:21:57.952488  7603 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:21:57.939081  6054 catalog_manager.cc:5495] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.959391  7784 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:21:57.963083  6224 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:21:57.967455  7730 raft_consensus.cc:2932] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.970369  6325 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d49af1f98624af48adc92f25f5a2be7 with delete_type TABLET_DATA_TOMBSTONED (TS 54f83319db6b49929cc8f18a66a66975 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45938
I20260812 19:21:57.972441  7607 raft_consensus.cc:2932] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.978381  7707 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:21:57.983302  6224 raft_consensus.cc:2932] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.988835  7792 tablet_replica.cc:330] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:21:57.991329  7792 raft_consensus.cc:2229] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:57.994433  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet d2d336a1bcca41809d1c89b7833de9a5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:21:57.995177  6058 catalog_manager.cc:5495] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:21:57.997155  7792 raft_consensus.cc:2258] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:58.009721  7792 ts_tablet_manager.cc:1905] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:21:58.018955  6325 tablet_service.cc:1514] Processing DeleteTablet for tablet d2d336a1bcca41809d1c89b7833de9a5 with delete_type TABLET_DATA_TOMBSTONED (TS 54f83319db6b49929cc8f18a66a66975 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45938
I20260812 19:21:58.027431  7792 ts_tablet_manager.cc:1918] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:21:58.027997  7792 log.cc:1196] T 5d49af1f98624af48adc92f25f5a2be7 P 54f83319db6b49929cc8f18a66a66975: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-1-root/wals/5d49af1f98624af48adc92f25f5a2be7
I20260812 19:21:58.029944  7792 tablet_replica.cc:330] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:21:58.030048  6040 catalog_manager.cc:4841] TS 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): tablet 5d49af1f98624af48adc92f25f5a2be7 (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:21:58.030953  7792 raft_consensus.cc:2229] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:21:58.031486  7792 raft_consensus.cc:2258] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:21:58.033710  7792 ts_tablet_manager.cc:1905] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:21:58.046573  7792 ts_tablet_manager.cc:1918] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:21:58.047047  7792 log.cc:1196] T d2d336a1bcca41809d1c89b7833de9a5 P 54f83319db6b49929cc8f18a66a66975: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-1-root/wals/d2d336a1bcca41809d1c89b7833de9a5
I20260812 19:21:58.048413  6040 catalog_manager.cc:4841] TS 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): tablet d2d336a1bcca41809d1c89b7833de9a5 (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:21:59.064586  6352 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
W20260812 19:21:59.070811  6298 consensus_peers.cc:487] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb5046f0183a45f4a5ae164f4ff6792c. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:59.072038  6470 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:21:59.072634  6235 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:21:59.073343  7734 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:59.074944  7740 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:59.081549  7734 raft_consensus.cc:2932] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:59.083534  6470 raft_consensus.cc:2932] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:59.090101  6235 raft_consensus.cc:2932] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:59.108223  6352 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:59.114913  6054 catalog_manager.cc:5495] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:59.137830  6474 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:21:59.140636  7740 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260812 19:21:59.137914  6298 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2920c51f14548a48637e645e719d9cd. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:59.150348  6235 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:21:59.153672  7734 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:59.172367  7800 raft_consensus.cc:2932] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:59.174096  6235 raft_consensus.cc:2932] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:59.174546  6474 raft_consensus.cc:2932] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:59.190212  6058 catalog_manager.cc:5495] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:59.195151  6470 consensus_queue.cc:237] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:59.209698  6352 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260812 19:21:59.210508  6417 consensus_peers.cc:487] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 42ff4c3d452047f29f09437fda663aed. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:59.211359  6235 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:21:59.211263  7793 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:21:59.212728  7815 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:59.221931  7808 raft_consensus.cc:2932] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:59.224174  6352 raft_consensus.cc:2932] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:59.224931  6235 raft_consensus.cc:2932] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:59.236100  6470 consensus_queue.cc:237] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:59.252282  6054 catalog_manager.cc:5495] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260812 19:21:59.257479  6417 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ed79a983adf41fb8e94a099bb3c0974. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:21:59.257691  6352 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:21:59.258184  6235 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:21:59.258985  7808 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:59.259794  7815 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:21:59.288331  7815 raft_consensus.cc:2932] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:59.292596  6352 raft_consensus.cc:2932] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:59.292922  6235 raft_consensus.cc:2932] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:21:59.310420  6060 catalog_manager.cc:5495] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260812 19:21:59.550823  7833 ts_tablet_manager.cc:927] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:59.553195  7833 tablet_copy_client.cc:316] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.2:39969
I20260812 19:21:59.554742  6374 tablet_copy_service.cc:140] P 54f83319db6b49929cc8f18a66a66975: Received BeginTabletCopySession request for tablet f2920c51f14548a48637e645e719d9cd from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:35822)
I20260812 19:21:59.555222  6374 tablet_copy_service.cc:161] P 54f83319db6b49929cc8f18a66a66975: Beginning new tablet copy session on tablet f2920c51f14548a48637e645e719d9cd from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:35822: session id = f4ef77b3328a44e8a21dd902b370e25a-f2920c51f14548a48637e645e719d9cd
I20260812 19:21:59.561688  6374 tablet_copy_source_session.cc:205] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:21:59.564814  7833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2920c51f14548a48637e645e719d9cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:59.581264  7833 tablet_copy_client.cc:791] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:21:59.581884  7833 tablet_copy_client.cc:655] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:21:59.585974  7833 tablet_copy_client.cc:531] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:21:59.604046  7840 ts_tablet_manager.cc:927] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:59.604264  7833 tablet_bootstrap.cc:492] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:21:59.620653  7840 tablet_copy_client.cc:316] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.3:42599
I20260812 19:21:59.623203  6500 tablet_copy_service.cc:140] P bdfa5579d4534c618c00db6b4a841c81: Received BeginTabletCopySession request for tablet 42ff4c3d452047f29f09437fda663aed from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:33386)
I20260812 19:21:59.624003  6500 tablet_copy_service.cc:161] P bdfa5579d4534c618c00db6b4a841c81: Beginning new tablet copy session on tablet 42ff4c3d452047f29f09437fda663aed from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:33386: session id = f4ef77b3328a44e8a21dd902b370e25a-42ff4c3d452047f29f09437fda663aed
I20260812 19:21:59.635021  6500 tablet_copy_source_session.cc:205] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:21:59.640568  7840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42ff4c3d452047f29f09437fda663aed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:59.658716  7842 ts_tablet_manager.cc:927] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:21:59.675262  7842 tablet_copy_client.cc:316] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.2:39969
I20260812 19:21:59.677904  6374 tablet_copy_service.cc:140] P 54f83319db6b49929cc8f18a66a66975: Received BeginTabletCopySession request for tablet cb5046f0183a45f4a5ae164f4ff6792c from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:35822)
I20260812 19:21:59.678728  6374 tablet_copy_service.cc:161] P 54f83319db6b49929cc8f18a66a66975: Beginning new tablet copy session on tablet cb5046f0183a45f4a5ae164f4ff6792c from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:35822: session id = f4ef77b3328a44e8a21dd902b370e25a-cb5046f0183a45f4a5ae164f4ff6792c
I20260812 19:21:59.688323  7840 tablet_copy_client.cc:791] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:21:59.689379  7840 tablet_copy_client.cc:655] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:21:59.700314  7840 tablet_copy_client.cc:531] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:21:59.707396  6374 tablet_copy_source_session.cc:205] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:21:59.709573  7850 ts_tablet_manager.cc:927] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:21:59.710876  7842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb5046f0183a45f4a5ae164f4ff6792c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:59.714227  7840 tablet_bootstrap.cc:492] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:21:59.715109  7850 tablet_copy_client.cc:316] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.3:42599
I20260812 19:21:59.722313  6500 tablet_copy_service.cc:140] P bdfa5579d4534c618c00db6b4a841c81: Received BeginTabletCopySession request for tablet 4ed79a983adf41fb8e94a099bb3c0974 from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:33386)
I20260812 19:21:59.723169  6500 tablet_copy_service.cc:161] P bdfa5579d4534c618c00db6b4a841c81: Beginning new tablet copy session on tablet 4ed79a983adf41fb8e94a099bb3c0974 from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:33386: session id = f4ef77b3328a44e8a21dd902b370e25a-4ed79a983adf41fb8e94a099bb3c0974
I20260812 19:21:59.744747  7833 tablet_bootstrap.cc:492] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:21:59.745987  7833 tablet_bootstrap.cc:492] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:21:59.749552  6500 tablet_copy_source_session.cc:205] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:21:59.753988  7842 tablet_copy_client.cc:791] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:21:59.755262  7833 ts_tablet_manager.cc:1397] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.151s	user 0.027s	sys 0.035s
I20260812 19:21:59.760560  7850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ed79a983adf41fb8e94a099bb3c0974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:21:59.754925  7842 tablet_copy_client.cc:655] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:21:59.783797  7833 raft_consensus.cc:348] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:59.789119  7833 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:21:59.791941  7842 tablet_copy_client.cc:531] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:21:59.801288  7833 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:59.810947  7840 tablet_bootstrap.cc:492] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:21:59.812538  7840 tablet_bootstrap.cc:492] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:21:59.813642  7840 ts_tablet_manager.cc:1397] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.100s	user 0.031s	sys 0.020s
I20260812 19:21:59.828794  7842 tablet_bootstrap.cc:492] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:21:59.844550  7850 tablet_copy_client.cc:791] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:21:59.845887  7850 tablet_copy_client.cc:655] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:21:59.846602  7833 ts_tablet_manager.cc:1428] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.088s	user 0.012s	sys 0.007s
I20260812 19:21:59.851176  6374 tablet_copy_service.cc:342] P 54f83319db6b49929cc8f18a66a66975: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-f2920c51f14548a48637e645e719d9cd received from {username='slave'} at 127.0.0.1:35822
I20260812 19:21:59.851862  6374 tablet_copy_service.cc:433] P 54f83319db6b49929cc8f18a66a66975: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-f2920c51f14548a48637e645e719d9cd on tablet f2920c51f14548a48637e645e719d9cd with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:21:59.854874  7840 raft_consensus.cc:348] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:59.857451  7840 raft_consensus.cc:729] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:21:59.858562  7840 consensus_queue.cc:260] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:59.863960  7850 tablet_copy_client.cc:531] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:21:59.868201  7840 ts_tablet_manager.cc:1428] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.005s
I20260812 19:21:59.871884  6500 tablet_copy_service.cc:342] P bdfa5579d4534c618c00db6b4a841c81: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-42ff4c3d452047f29f09437fda663aed received from {username='slave'} at 127.0.0.1:33386
I20260812 19:21:59.872504  6500 tablet_copy_service.cc:433] P bdfa5579d4534c618c00db6b4a841c81: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-42ff4c3d452047f29f09437fda663aed on tablet 42ff4c3d452047f29f09437fda663aed with peer f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:21:59.879426  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60427.6us
I20260812 19:21:59.894294  7850 tablet_bootstrap.cc:492] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:21:59.896438  7842 tablet_bootstrap.cc:492] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:21:59.897502  7842 tablet_bootstrap.cc:492] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:21:59.898306  7842 ts_tablet_manager.cc:1397] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.070s	user 0.023s	sys 0.003s
I20260812 19:21:59.911348  7842 raft_consensus.cc:348] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:59.912352  7842 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:21:59.913061  7842 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:59.915867  7842 ts_tablet_manager.cc:1428] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.006s
I20260812 19:21:59.930315  6374 tablet_copy_service.cc:342] P 54f83319db6b49929cc8f18a66a66975: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-cb5046f0183a45f4a5ae164f4ff6792c received from {username='slave'} at 127.0.0.1:35822
I20260812 19:21:59.930814  6374 tablet_copy_service.cc:433] P 54f83319db6b49929cc8f18a66a66975: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-cb5046f0183a45f4a5ae164f4ff6792c on tablet cb5046f0183a45f4a5ae164f4ff6792c with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:21:59.959937  7850 tablet_bootstrap.cc:492] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:21:59.960897  7850 tablet_bootstrap.cc:492] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:21:59.961513  7850 ts_tablet_manager.cc:1397] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.034s
I20260812 19:21:59.966224  7850 raft_consensus.cc:348] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:59.967180  7850 raft_consensus.cc:729] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:21:59.967846  7850 consensus_queue.cc:260] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:21:59.970068  7850 ts_tablet_manager.cc:1428] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260812 19:21:59.972144  6500 tablet_copy_service.cc:342] P bdfa5579d4534c618c00db6b4a841c81: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-4ed79a983adf41fb8e94a099bb3c0974 received from {username='slave'} at 127.0.0.1:33386
I20260812 19:21:59.972594  6500 tablet_copy_service.cc:433] P bdfa5579d4534c618c00db6b4a841c81: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-4ed79a983adf41fb8e94a099bb3c0974 on tablet 4ed79a983adf41fb8e94a099bb3c0974 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:00.080667  7603 raft_consensus.cc:1203] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:22:00.149062  7603 raft_consensus.cc:1203] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:22:00.183907  7603 raft_consensus.cc:1203] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:22:00.226313  7603 raft_consensus.cc:1203] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:22:00.482939  7800 raft_consensus.cc:1050] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:00.485513  7800 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:00.513118  7603 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:00.514953  7853 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:00.521027  6474 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:00.522341  6235 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:00.522389  7800 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260812 19:22:00.524577  7857 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:00.534787  7853 raft_consensus.cc:2932] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.539248  6477 raft_consensus.cc:2932] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.543089  7603 raft_consensus.cc:2932] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.548818  6235 raft_consensus.cc:2932] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.564975  6058 catalog_manager.cc:5495] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.585172  7808 raft_consensus.cc:1050] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:00.587992  7808 consensus_queue.cc:237] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:00.596114  6345 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:00.597915  7707 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:00.605151  6354 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:00.609019  6235 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:00.616755  7607 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:00.611349  7793 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:00.618556  7857 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:00.620340  6477 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:00.621868  7867 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:00.621389  7603 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:00.628806  7793 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:00.628648  7867 raft_consensus.cc:2932] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.632246  7606 raft_consensus.cc:2932] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.638479  7793 raft_consensus.cc:2932] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.646358  6235 raft_consensus.cc:2932] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.651149  6477 raft_consensus.cc:2932] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.654052  6058 catalog_manager.cc:5495] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.669946  7853 raft_consensus.cc:1050] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:00.664440  6055 catalog_manager.cc:5495] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.673803  7603 raft_consensus.cc:2932] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.676630  6345 raft_consensus.cc:2932] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.682058  6207 tablet_service.cc:1514] Processing DeleteTablet for tablet cb5046f0183a45f4a5ae164f4ff6792c with delete_type TABLET_DATA_TOMBSTONED (TS a1541d11be514114966dc1e92a345298 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53166
I20260812 19:22:00.681224  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet cb5046f0183a45f4a5ae164f4ff6792c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:00.679829  7853 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:00.689448  7883 tablet_replica.cc:330] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:22:00.690725  7883 raft_consensus.cc:2229] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:00.691582  7883 raft_consensus.cc:2258] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:00.701259  7883 ts_tablet_manager.cc:1905] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:00.707347  7606 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:00.707904  6477 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:00.709865  6235 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:00.711794  7857 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:00.713001  7800 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:00.726420  6477 consensus_queue.cc:237] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:00.734875  6354 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:00.736228  7707 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:22:00.739609  7606 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:00.741727  7793 raft_consensus.cc:1050] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:00.741436  7886 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:00.743183  7808 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:22:00.744625  7793 consensus_queue.cc:237] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:00.747277  6354 raft_consensus.cc:2932] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.746011  7808 raft_consensus.cc:2932] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.779896  7607 raft_consensus.cc:2932] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.791006  7606 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:00.793206  7707 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:00.793581  7883 ts_tablet_manager.cc:1918] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:22:00.794198  7883 log.cc:1196] T cb5046f0183a45f4a5ae164f4ff6792c P a1541d11be514114966dc1e92a345298: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-0-root/wals/cb5046f0183a45f4a5ae164f4ff6792c
I20260812 19:22:00.809190  6058 catalog_manager.cc:5495] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:22:00.812171  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46150.1us
I20260812 19:22:00.818475  6345 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:00.821234  6235 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:00.822739  7853 raft_consensus.cc:2932] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:22:00.912107  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60135.3us
I20260812 19:22:00.919883  6040 catalog_manager.cc:4841] TS a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): tablet cb5046f0183a45f4a5ae164f4ff6792c (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:22:00.928556  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 42ff4c3d452047f29f09437fda663aed with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:00.940867  7707 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:00.948076  7707 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:00.967160  6470 raft_consensus.cc:2932] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:00.993695  6235 raft_consensus.cc:2932] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:01.001771  6207 tablet_service.cc:1514] Processing DeleteTablet for tablet 42ff4c3d452047f29f09437fda663aed with delete_type TABLET_DATA_TOMBSTONED (TS a1541d11be514114966dc1e92a345298 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53166
W20260812 19:22:01.015674  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 72279.9us
I20260812 19:22:01.003557  7883 tablet_replica.cc:330] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:22:01.072779  7883 raft_consensus.cc:2229] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:01.074307  7883 raft_consensus.cc:2258] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:01.091604  7606 raft_consensus.cc:2932] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:01.078902  6058 catalog_manager.cc:5495] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:22:01.137611  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 132787us
W20260812 19:22:01.171211  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 144257us
I20260812 19:22:01.174382  7883 ts_tablet_manager.cc:1905] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:01.283296  7941 raft_consensus.cc:2932] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:22:01.292416  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 244327us
I20260812 19:22:01.297832  6354 raft_consensus.cc:2932] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:01.337013  6345 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:01.361681  7603 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:01.363910  7938 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:01.365917  7606 raft_consensus.cc:2932] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:01.380964  7938 raft_consensus.cc:2932] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:01.396965  6055 catalog_manager.cc:5495] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:01.397830  7603 raft_consensus.cc:2932] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:01.426218  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet f2920c51f14548a48637e645e719d9cd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:01.443953  6058 catalog_manager.cc:5495] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:01.451005  7883 ts_tablet_manager.cc:1918] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:22:01.452677  7883 log.cc:1196] T 42ff4c3d452047f29f09437fda663aed P a1541d11be514114966dc1e92a345298: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-0-root/wals/42ff4c3d452047f29f09437fda663aed
I20260812 19:22:01.458618  6040 catalog_manager.cc:4841] TS a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): tablet 42ff4c3d452047f29f09437fda663aed (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:22:01.471087  6229 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:01.481475  6452 tablet_service.cc:1514] Processing DeleteTablet for tablet f2920c51f14548a48637e645e719d9cd with delete_type TABLET_DATA_TOMBSTONED (TS bdfa5579d4534c618c00db6b4a841c81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38134
I20260812 19:22:01.489409  7932 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260812 19:22:01.500830  6228 raft_consensus.cc:2932] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:01.520151  6224 raft_consensus.cc:2932] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:01.525848  7943 tablet_replica.cc:330] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:22:01.528016  7943 raft_consensus.cc:2229] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:01.529027  7943 raft_consensus.cc:2258] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:01.548549  6482 consensus_queue.cc:237] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:01.543921  7943 ts_tablet_manager.cc:1905] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:01.565225  7603 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:01.566557  6224 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:01.567842  7896 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:01.581336  7943 ts_tablet_manager.cc:1918] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:22:01.582692  7943 log.cc:1196] T f2920c51f14548a48637e645e719d9cd P bdfa5579d4534c618c00db6b4a841c81: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-2-root/wals/f2920c51f14548a48637e645e719d9cd
I20260812 19:22:01.574990  7898 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260812 19:22:01.596704  7898 raft_consensus.cc:2932] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:01.598377  7603 raft_consensus.cc:2932] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:01.604454  6040 catalog_manager.cc:4841] TS bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): tablet f2920c51f14548a48637e645e719d9cd (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:22:01.606896  6224 raft_consensus.cc:2932] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:01.613677  6055 catalog_manager.cc:5495] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:01.627738  6325 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ed79a983adf41fb8e94a099bb3c0974 with delete_type TABLET_DATA_TOMBSTONED (TS 54f83319db6b49929cc8f18a66a66975 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45938
I20260812 19:22:01.631201  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 4ed79a983adf41fb8e94a099bb3c0974 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:01.645783  7947 tablet_replica.cc:330] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:22:01.650799  7947 raft_consensus.cc:2229] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:01.652745  7947 raft_consensus.cc:2258] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:01.660053  7947 ts_tablet_manager.cc:1905] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:01.675495  7947 ts_tablet_manager.cc:1918] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:22:01.676102  7947 log.cc:1196] T 4ed79a983adf41fb8e94a099bb3c0974 P 54f83319db6b49929cc8f18a66a66975: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-1-root/wals/4ed79a983adf41fb8e94a099bb3c0974
I20260812 19:22:01.677734  6040 catalog_manager.cc:4841] TS 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): tablet 4ed79a983adf41fb8e94a099bb3c0974 (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:22:02.714185  6347 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:02.721127  6482 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260812 19:22:02.721230  6298 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b231cd9f80874e2dbe40dcd1f4c8e1f4. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:22:02.723389  7952 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:02.723874  6228 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:22:02.725639  7952 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:02.733053  7932 raft_consensus.cc:2932] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:02.735991  6474 raft_consensus.cc:2932] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:02.752630  6058 catalog_manager.cc:5495] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: config changed from index -1 to 3, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:02.756220  6228 raft_consensus.cc:2932] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:02.768355  6345 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:02.804663  6474 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260812 19:22:02.806591  6298 consensus_peers.cc:487] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 099703c7d52b4644ae3c1098ddcc0282. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:22:02.807407  6228 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:02.808676  7914 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:02.811606  7914 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:02.824443  7959 raft_consensus.cc:2932] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:02.826056  6482 raft_consensus.cc:2932] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:02.830535  6224 raft_consensus.cc:2932] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:02.848798  6345 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:02.856853  6058 catalog_manager.cc:5495] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:02.866200  6224 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:02.866200  6482 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:02.868454  7914 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260812 19:22:02.870783  6298 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4c2eb0bf29b48b3ae29c175fe03718f. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:22:02.872102  7914 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:02.891285  7959 raft_consensus.cc:2932] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:02.893018  6482 raft_consensus.cc:2932] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:02.893465  6235 raft_consensus.cc:2932] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:02.908592  6235 consensus_queue.cc:237] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:02.909512  6055 catalog_manager.cc:5495] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:02.926800  6482 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:02.927862  6345 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:02.930526  7933 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260812 19:22:02.935029  6179 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bacc9fc105004c639dc9ed487bd8dd97. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:22:02.934952  7948 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:02.942034  7933 raft_consensus.cc:2932] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:02.943920  6345 raft_consensus.cc:2932] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:02.946924  6482 raft_consensus.cc:2932] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:02.962287  6058 catalog_manager.cc:5495] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:03.257056  7983 ts_tablet_manager.cc:927] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:03.259284  7983 tablet_copy_client.cc:316] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.2:39969
I20260812 19:22:03.260974  6374 tablet_copy_service.cc:140] P 54f83319db6b49929cc8f18a66a66975: Received BeginTabletCopySession request for tablet b231cd9f80874e2dbe40dcd1f4c8e1f4 from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:35822)
I20260812 19:22:03.261529  6374 tablet_copy_service.cc:161] P 54f83319db6b49929cc8f18a66a66975: Beginning new tablet copy session on tablet b231cd9f80874e2dbe40dcd1f4c8e1f4 from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:35822: session id = f4ef77b3328a44e8a21dd902b370e25a-b231cd9f80874e2dbe40dcd1f4c8e1f4
I20260812 19:22:03.267608  6374 tablet_copy_source_session.cc:205] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:22:03.270946  7983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b231cd9f80874e2dbe40dcd1f4c8e1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:22:03.291615  7983 tablet_copy_client.cc:791] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:22:03.292229  7983 tablet_copy_client.cc:655] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:22:03.296054  7983 tablet_copy_client.cc:531] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:22:03.304589  7983 tablet_bootstrap.cc:492] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:22:03.326344  7983 tablet_bootstrap.cc:492] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:22:03.327253  7983 tablet_bootstrap.cc:492] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:22:03.327896  7983 ts_tablet_manager.cc:1397] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.008s
I20260812 19:22:03.330276  7983 raft_consensus.cc:348] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:03.331008  7983 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:22:03.331727  7983 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:03.340459  7983 ts_tablet_manager.cc:1428] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260812 19:22:03.343931  6374 tablet_copy_service.cc:342] P 54f83319db6b49929cc8f18a66a66975: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-b231cd9f80874e2dbe40dcd1f4c8e1f4 received from {username='slave'} at 127.0.0.1:35822
I20260812 19:22:03.344379  6374 tablet_copy_service.cc:433] P 54f83319db6b49929cc8f18a66a66975: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-b231cd9f80874e2dbe40dcd1f4c8e1f4 on tablet b231cd9f80874e2dbe40dcd1f4c8e1f4 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:03.400280  7983 ts_tablet_manager.cc:927] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:03.402616  7983 tablet_copy_client.cc:316] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.2:39969
I20260812 19:22:03.403654  7993 ts_tablet_manager.cc:927] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:03.404367  6374 tablet_copy_service.cc:140] P 54f83319db6b49929cc8f18a66a66975: Received BeginTabletCopySession request for tablet c4c2eb0bf29b48b3ae29c175fe03718f from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:35822)
I20260812 19:22:03.405038  6374 tablet_copy_service.cc:161] P 54f83319db6b49929cc8f18a66a66975: Beginning new tablet copy session on tablet c4c2eb0bf29b48b3ae29c175fe03718f from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:35822: session id = f4ef77b3328a44e8a21dd902b370e25a-c4c2eb0bf29b48b3ae29c175fe03718f
I20260812 19:22:03.405711  7993 tablet_copy_client.cc:316] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.2:39969
I20260812 19:22:03.407570  6373 tablet_copy_service.cc:140] P 54f83319db6b49929cc8f18a66a66975: Received BeginTabletCopySession request for tablet 099703c7d52b4644ae3c1098ddcc0282 from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:35822)
I20260812 19:22:03.408152  6373 tablet_copy_service.cc:161] P 54f83319db6b49929cc8f18a66a66975: Beginning new tablet copy session on tablet 099703c7d52b4644ae3c1098ddcc0282 from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:35822: session id = f4ef77b3328a44e8a21dd902b370e25a-099703c7d52b4644ae3c1098ddcc0282
I20260812 19:22:03.418701  6374 tablet_copy_source_session.cc:205] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:22:03.425889  6373 tablet_copy_source_session.cc:205] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:22:03.428627  7983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4c2eb0bf29b48b3ae29c175fe03718f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:22:03.429363  7993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 099703c7d52b4644ae3c1098ddcc0282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:22:03.446780  7993 tablet_copy_client.cc:791] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:22:03.447400  7993 tablet_copy_client.cc:655] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:22:03.452430  7993 tablet_copy_client.cc:531] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:22:03.459275  7983 tablet_copy_client.cc:791] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:22:03.460072  7983 tablet_copy_client.cc:655] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:22:03.463186  7993 tablet_bootstrap.cc:492] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:22:03.464360  7983 tablet_copy_client.cc:531] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:22:03.475332  7983 tablet_bootstrap.cc:492] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:22:03.492127  7993 tablet_bootstrap.cc:492] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:22:03.501015  7993 tablet_bootstrap.cc:492] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:22:03.501792  7993 ts_tablet_manager.cc:1397] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.008s
I20260812 19:22:03.504580  7993 raft_consensus.cc:348] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:03.505461  7993 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:22:03.515902  7993 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:03.518777  7996 ts_tablet_manager.cc:927] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707)
I20260812 19:22:03.521677  7993 ts_tablet_manager.cc:1428] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260812 19:22:03.523353  6373 tablet_copy_service.cc:342] P 54f83319db6b49929cc8f18a66a66975: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-099703c7d52b4644ae3c1098ddcc0282 received from {username='slave'} at 127.0.0.1:35822
I20260812 19:22:03.523775  6373 tablet_copy_service.cc:433] P 54f83319db6b49929cc8f18a66a66975: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-099703c7d52b4644ae3c1098ddcc0282 on tablet 099703c7d52b4644ae3c1098ddcc0282 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:03.527212  7983 tablet_bootstrap.cc:492] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:22:03.528108  7983 tablet_bootstrap.cc:492] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:22:03.528755  7983 ts_tablet_manager.cc:1397] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.012s
I20260812 19:22:03.531877  7983 raft_consensus.cc:348] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:03.532866  7983 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:22:03.533535  7983 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:03.536538  7983 ts_tablet_manager.cc:1428] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260812 19:22:03.538305  6373 tablet_copy_service.cc:342] P 54f83319db6b49929cc8f18a66a66975: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-c4c2eb0bf29b48b3ae29c175fe03718f received from {username='slave'} at 127.0.0.1:35822
I20260812 19:22:03.538731  6373 tablet_copy_service.cc:433] P 54f83319db6b49929cc8f18a66a66975: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-c4c2eb0bf29b48b3ae29c175fe03718f on tablet c4c2eb0bf29b48b3ae29c175fe03718f with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:03.550135  7996 tablet_copy_client.cc:316] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.1:46707
I20260812 19:22:03.552071  6254 tablet_copy_service.cc:140] P a1541d11be514114966dc1e92a345298: Received BeginTabletCopySession request for tablet bacc9fc105004c639dc9ed487bd8dd97 from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:56292)
I20260812 19:22:03.552665  6254 tablet_copy_service.cc:161] P a1541d11be514114966dc1e92a345298: Beginning new tablet copy session on tablet bacc9fc105004c639dc9ed487bd8dd97 from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:56292: session id = f4ef77b3328a44e8a21dd902b370e25a-bacc9fc105004c639dc9ed487bd8dd97
I20260812 19:22:03.565253  6254 tablet_copy_source_session.cc:205] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:22:03.629518  7996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bacc9fc105004c639dc9ed487bd8dd97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:22:03.707979  7996 tablet_copy_client.cc:791] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:22:03.709872  7996 tablet_copy_client.cc:655] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:22:03.719564  7996 tablet_copy_client.cc:531] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:22:03.739908  7996 tablet_bootstrap.cc:492] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:22:03.762874  7996 tablet_bootstrap.cc:492] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:22:03.764199  7996 tablet_bootstrap.cc:492] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:22:03.765048  7996 ts_tablet_manager.cc:1397] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.009s
I20260812 19:22:03.769521  7996 raft_consensus.cc:348] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:03.771917  7996 raft_consensus.cc:729] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:22:03.772895  7996 consensus_queue.cc:260] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:03.781733  7996 ts_tablet_manager.cc:1428] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.005s
I20260812 19:22:03.785071  6254 tablet_copy_service.cc:342] P a1541d11be514114966dc1e92a345298: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-bacc9fc105004c639dc9ed487bd8dd97 received from {username='slave'} at 127.0.0.1:56292
I20260812 19:22:03.785609  6254 tablet_copy_service.cc:433] P a1541d11be514114966dc1e92a345298: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-bacc9fc105004c639dc9ed487bd8dd97 on tablet bacc9fc105004c639dc9ed487bd8dd97 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:03.879720  7603 raft_consensus.cc:1203] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:22:03.882563  7603 raft_consensus.cc:1203] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260812 19:22:03.892738  7606 raft_consensus.cc:1203] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:22:03.896487  7606 raft_consensus.cc:1203] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:22:04.321271  7961 raft_consensus.cc:1050] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:04.324150  7961 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:04.335057  7603 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:04.335732  6474 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:04.335886  6228 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:04.337788  7914 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:04.338944  8004 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:04.341624  8003 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:04.361099  8003 raft_consensus.cc:1050] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:04.364471  8003 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:04.369270  8011 raft_consensus.cc:2932] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:04.376386  6224 raft_consensus.cc:2932] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:04.376458  6482 raft_consensus.cc:2932] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:04.388608  7603 raft_consensus.cc:2932] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:04.407369  6058 catalog_manager.cc:5495] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:04.415808  7606 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:04.419545  7914 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:04.426896  6482 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:04.426896  6224 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:04.431062  8004 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:04.436008  8004 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
W20260812 19:22:04.719971  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 217720us
I20260812 19:22:04.752094  8011 raft_consensus.cc:1050] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:04.755226  8011 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:04.770246  7606 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 LEARNER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260812 19:22:04.771938  8004 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:22:04.786741  7948 raft_consensus.cc:1050] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:04.789827  7948 consensus_queue.cc:237] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:04.810223  7606 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:04.811951  7948 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:04.812336  6354 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:04.814242  8020 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:04.830174  6481 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260812 19:22:04.832069  7914 raft_consensus.cc:2932] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:04.854957  6477 raft_consensus.cc:2932] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:04.863437  8036 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260812 19:22:04.865783  6470 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:04.894975  8011 raft_consensus.cc:2932] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:04.904490  6470 raft_consensus.cc:2932] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:04.939069  8039 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260812 19:22:04.959998  7603 raft_consensus.cc:2932] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:04.963979  7600 raft_consensus.cc:2932] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:04.978109  6235 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260812 19:22:05.014392  6242 raft_consensus.cc:2932] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:22:05.019081  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 60200.5us
I20260812 19:22:05.034977  6354 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:05.039726  8004 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:05.049410  7603 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:05.050083  6235 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:05.051249  8004 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:05.055838  8052 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260812 19:22:05.077463  8011 raft_consensus.cc:2932] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.105281  6054 catalog_manager.cc:5495] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index 3 to 4, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:05.108942  7600 raft_consensus.cc:2932] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.129040  7948 raft_consensus.cc:2932] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.136700  6230 raft_consensus.cc:2932] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.139098  6235 raft_consensus.cc:2932] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.142709  7606 raft_consensus.cc:2932] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.153805  6482 raft_consensus.cc:2932] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.157346  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet c4c2eb0bf29b48b3ae29c175fe03718f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:05.201308  6345 raft_consensus.cc:2932] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.244704  6055 catalog_manager.cc:5495] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.318809  6054 catalog_manager.cc:5495] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.337374  6054 catalog_manager.cc:5495] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:05.475764  6230 consensus_queue.cc:237] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:05.483897  6354 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:05.494449  6452 tablet_service.cc:1514] Processing DeleteTablet for tablet c4c2eb0bf29b48b3ae29c175fe03718f with delete_type TABLET_DATA_TOMBSTONED (TS bdfa5579d4534c618c00db6b4a841c81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38134
I20260812 19:22:05.507875  7606 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:05.509586  7948 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:22:05.515203  8077 tablet_replica.cc:330] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:22:05.515698  7599 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:05.516847  8077 raft_consensus.cc:2229] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:05.517705  8077 raft_consensus.cc:2258] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:05.518411  8018 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:05.520691  8077 ts_tablet_manager.cc:1905] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:05.527360  6482 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:05.531420  8052 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:05.542544  7961 raft_consensus.cc:2932] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.537732  7599 raft_consensus.cc:2932] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.546126  7948 raft_consensus.cc:2932] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.553639  7600 raft_consensus.cc:2932] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.559878  6475 raft_consensus.cc:2932] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.582284  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet bacc9fc105004c639dc9ed487bd8dd97 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:05.596756  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 099703c7d52b4644ae3c1098ddcc0282 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:05.606376  6054 catalog_manager.cc:5495] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:05.611116  8077 ts_tablet_manager.cc:1918] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:22:05.625317  6058 catalog_manager.cc:5495] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 reported cstate change: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:05.624156  8077 log.cc:1196] T c4c2eb0bf29b48b3ae29c175fe03718f P bdfa5579d4534c618c00db6b4a841c81: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-2-root/wals/c4c2eb0bf29b48b3ae29c175fe03718f
I20260812 19:22:05.629524  6040 catalog_manager.cc:4841] TS bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): tablet c4c2eb0bf29b48b3ae29c175fe03718f (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:22:05.635156  6207 tablet_service.cc:1514] Processing DeleteTablet for tablet 099703c7d52b4644ae3c1098ddcc0282 with delete_type TABLET_DATA_TOMBSTONED (TS a1541d11be514114966dc1e92a345298 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53166
I20260812 19:22:05.639379  6325 tablet_service.cc:1514] Processing DeleteTablet for tablet bacc9fc105004c639dc9ed487bd8dd97 with delete_type TABLET_DATA_TOMBSTONED (TS 54f83319db6b49929cc8f18a66a66975 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45938
I20260812 19:22:05.645390  8078 tablet_replica.cc:330] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:22:05.648175  8078 raft_consensus.cc:2229] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:05.648967  8078 raft_consensus.cc:2258] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:05.660957  6475 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:05.663249  8078 ts_tablet_manager.cc:1905] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:05.672777  6354 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:05.680297  7599 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:05.681234  6230 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:05.682902  8052 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:22:05.685696  8052 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:22:05.690420  8011 raft_consensus.cc:2932] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.691916  7600 raft_consensus.cc:2932] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.696956  8078 ts_tablet_manager.cc:1918] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:22:05.697528  8078 log.cc:1196] T 099703c7d52b4644ae3c1098ddcc0282 P a1541d11be514114966dc1e92a345298: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-0-root/wals/099703c7d52b4644ae3c1098ddcc0282
I20260812 19:22:05.707329  6040 catalog_manager.cc:4841] TS a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): tablet 099703c7d52b4644ae3c1098ddcc0282 (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:22:05.708444  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet b231cd9f80874e2dbe40dcd1f4c8e1f4 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:05.710942  6058 catalog_manager.cc:5495] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index 4 to 5, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:05.715183  8079 tablet_replica.cc:330] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:22:05.720081  7948 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:22:05.724591  6452 tablet_service.cc:1514] Processing DeleteTablet for tablet b231cd9f80874e2dbe40dcd1f4c8e1f4 with delete_type TABLET_DATA_TOMBSTONED (TS bdfa5579d4534c618c00db6b4a841c81 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38134
I20260812 19:22:05.725549  8077 tablet_replica.cc:330] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:22:05.724951  6235 raft_consensus.cc:2932] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.733079  8077 raft_consensus.cc:2229] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:05.733852  8077 raft_consensus.cc:2258] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:05.738363  8077 ts_tablet_manager.cc:1905] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:05.747296  6475 raft_consensus.cc:2932] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:05.763206  8079 raft_consensus.cc:2229] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:05.766155  8079 raft_consensus.cc:2258] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:05.773468  8079 ts_tablet_manager.cc:1905] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:05.774096  8077 ts_tablet_manager.cc:1918] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260812 19:22:05.775274  8077 log.cc:1196] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P bdfa5579d4534c618c00db6b4a841c81: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-2-root/wals/b231cd9f80874e2dbe40dcd1f4c8e1f4
I20260812 19:22:05.780396  6040 catalog_manager.cc:4841] TS bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): tablet b231cd9f80874e2dbe40dcd1f4c8e1f4 (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:22:05.792140  8079 ts_tablet_manager.cc:1918] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:22:05.793423  8079 log.cc:1196] T bacc9fc105004c639dc9ed487bd8dd97 P 54f83319db6b49929cc8f18a66a66975: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-1-root/wals/bacc9fc105004c639dc9ed487bd8dd97
I20260812 19:22:05.795603  6040 catalog_manager.cc:4841] TS 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): tablet bacc9fc105004c639dc9ed487bd8dd97 (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
W20260812 19:22:05.846077  6514 debug-util.cc:398] Leaking SignalData structure 0x7b080019a860 after lost signal to thread 4090
W20260812 19:22:05.847450  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08001c40e0 after lost signal to thread 6116
W20260812 19:22:05.848448  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08002f31e0 after lost signal to thread 6272
W20260812 19:22:05.849498  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08002ffa00 after lost signal to thread 6399
W20260812 19:22:05.850497  6514 debug-util.cc:398] Leaking SignalData structure 0x7b080031b620 after lost signal to thread 6521
W20260812 19:22:05.851476  6514 debug-util.cc:398] Leaking SignalData structure 0x7b0800315060 after lost signal to thread 7647
I20260812 19:22:06.833683  6475 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
W20260812 19:22:06.848392  6417 consensus_peers.cc:487] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0b2666b0bd6d48eaac74445d6da5cf58. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:22:06.849352  6347 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:06.851775  6235 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:06.850745  8075 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:06.858861  8030 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:06.867422  8035 raft_consensus.cc:2932] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:06.869370  6235 raft_consensus.cc:2932] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:06.873193  6347 raft_consensus.cc:2932] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:06.892344  6477 consensus_queue.cc:237] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:06.901362  6055 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260812 19:22:06.929351  6417 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa4b7bb14bdb4198a276add34849a84e. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:22:06.929896  6347 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:06.931392  6235 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:06.931370  8035 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:06.932987  8030 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:06.965816  8035 raft_consensus.cc:2932] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:06.972864  6354 raft_consensus.cc:2932] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:06.984313  6242 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:06.993157  6055 catalog_manager.cc:5495] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:06.999570  6230 raft_consensus.cc:2932] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
W20260812 19:22:07.012420  6179 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d8cbc6671344bd789fa2d3e4986c4b4. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:22:07.018064  6482 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:07.020768  7948 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:07.025000  6354 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:07.028455  7948 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:07.044662  8039 raft_consensus.cc:2932] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:07.048750  6354 raft_consensus.cc:2932] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:07.060523  6347 consensus_queue.cc:237] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:07.058140  6482 raft_consensus.cc:2932] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:07.078154  6060 catalog_manager.cc:5495] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260812 19:22:07.084846  6298 consensus_peers.cc:487] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e3bf4ae67ff4aaa9287a253c6db6575. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:22:07.087745  6228 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:07.088002  6477 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:07.091908  8011 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:07.092952  8094 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:07.129355  7961 raft_consensus.cc:2932] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:07.132890  6230 raft_consensus.cc:2932] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:07.135016  6477 raft_consensus.cc:2932] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:07.152642  6060 catalog_manager.cc:5495] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:07.317296  8113 ts_tablet_manager.cc:927] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:07.324756  8113 tablet_copy_client.cc:316] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.3:42599
I20260812 19:22:07.327031  6500 tablet_copy_service.cc:140] P bdfa5579d4534c618c00db6b4a841c81: Received BeginTabletCopySession request for tablet aa4b7bb14bdb4198a276add34849a84e from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:33386)
I20260812 19:22:07.327674  6500 tablet_copy_service.cc:161] P bdfa5579d4534c618c00db6b4a841c81: Beginning new tablet copy session on tablet aa4b7bb14bdb4198a276add34849a84e from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:33386: session id = f4ef77b3328a44e8a21dd902b370e25a-aa4b7bb14bdb4198a276add34849a84e
I20260812 19:22:07.347438  6500 tablet_copy_source_session.cc:205] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:22:07.352299  8113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa4b7bb14bdb4198a276add34849a84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:22:07.370692  8113 tablet_copy_client.cc:791] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:22:07.371330  8113 tablet_copy_client.cc:655] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:22:07.375783  8113 tablet_copy_client.cc:531] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:22:07.416699  8120 ts_tablet_manager.cc:927] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707)
I20260812 19:22:07.434172  8123 ts_tablet_manager.cc:927] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:07.436887  8113 tablet_bootstrap.cc:492] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:22:07.441051  8120 tablet_copy_client.cc:316] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.1:46707
I20260812 19:22:07.442879  6254 tablet_copy_service.cc:140] P a1541d11be514114966dc1e92a345298: Received BeginTabletCopySession request for tablet 0d8cbc6671344bd789fa2d3e4986c4b4 from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:56292)
I20260812 19:22:07.443459  6254 tablet_copy_service.cc:161] P a1541d11be514114966dc1e92a345298: Beginning new tablet copy session on tablet 0d8cbc6671344bd789fa2d3e4986c4b4 from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:56292: session id = f4ef77b3328a44e8a21dd902b370e25a-0d8cbc6671344bd789fa2d3e4986c4b4
I20260812 19:22:07.447711  8123 tablet_copy_client.cc:316] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.3:42599
I20260812 19:22:07.449502  6500 tablet_copy_service.cc:140] P bdfa5579d4534c618c00db6b4a841c81: Received BeginTabletCopySession request for tablet 0b2666b0bd6d48eaac74445d6da5cf58 from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:33386)
I20260812 19:22:07.450078  6500 tablet_copy_service.cc:161] P bdfa5579d4534c618c00db6b4a841c81: Beginning new tablet copy session on tablet 0b2666b0bd6d48eaac74445d6da5cf58 from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:33386: session id = f4ef77b3328a44e8a21dd902b370e25a-0b2666b0bd6d48eaac74445d6da5cf58
I20260812 19:22:07.464815  6500 tablet_copy_source_session.cc:205] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:22:07.465277  6254 tablet_copy_source_session.cc:205] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:22:07.468163  8123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b2666b0bd6d48eaac74445d6da5cf58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:22:07.471123  8120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d8cbc6671344bd789fa2d3e4986c4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:22:07.516960  8113 tablet_bootstrap.cc:492] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:22:07.516812  8120 tablet_copy_client.cc:791] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:22:07.517930  8120 tablet_copy_client.cc:655] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:22:07.518352  8113 tablet_bootstrap.cc:492] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:22:07.519481  8113 ts_tablet_manager.cc:1397] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.026s
I20260812 19:22:07.525357  8113 raft_consensus.cc:348] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:07.526724  8113 raft_consensus.cc:729] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:22:07.527770  8113 consensus_queue.cc:260] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:07.559316  8120 tablet_copy_client.cc:531] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:22:07.577006  8113 ts_tablet_manager.cc:1428] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.057s	user 0.014s	sys 0.018s
I20260812 19:22:07.579644  6500 tablet_copy_service.cc:342] P bdfa5579d4534c618c00db6b4a841c81: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-aa4b7bb14bdb4198a276add34849a84e received from {username='slave'} at 127.0.0.1:33386
I20260812 19:22:07.589277  6500 tablet_copy_service.cc:433] P bdfa5579d4534c618c00db6b4a841c81: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-aa4b7bb14bdb4198a276add34849a84e on tablet aa4b7bb14bdb4198a276add34849a84e with peer f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:07.604451  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 59232.2us
I20260812 19:22:07.608204  8113 ts_tablet_manager.cc:927] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:07.615149  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 63890.8us
I20260812 19:22:07.648169  8123 tablet_copy_client.cc:791] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:22:07.649053  8123 tablet_copy_client.cc:655] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:22:07.656503  8113 tablet_copy_client.cc:316] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.2:39969
I20260812 19:22:07.639057  8120 tablet_bootstrap.cc:492] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:22:07.669574  6373 tablet_copy_service.cc:140] P 54f83319db6b49929cc8f18a66a66975: Received BeginTabletCopySession request for tablet 9e3bf4ae67ff4aaa9287a253c6db6575 from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:35822)
I20260812 19:22:07.670478  6373 tablet_copy_service.cc:161] P 54f83319db6b49929cc8f18a66a66975: Beginning new tablet copy session on tablet 9e3bf4ae67ff4aaa9287a253c6db6575 from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:35822: session id = f4ef77b3328a44e8a21dd902b370e25a-9e3bf4ae67ff4aaa9287a253c6db6575
I20260812 19:22:07.686142  6373 tablet_copy_source_session.cc:205] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:22:07.691741  8113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e3bf4ae67ff4aaa9287a253c6db6575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:22:07.714748  8123 tablet_copy_client.cc:531] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:22:07.733402  8120 tablet_bootstrap.cc:492] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:22:07.737017  8120 tablet_bootstrap.cc:492] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:22:07.738008  8120 ts_tablet_manager.cc:1397] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.116s	user 0.032s	sys 0.005s
I20260812 19:22:07.757756  8123 tablet_bootstrap.cc:492] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:22:07.757014  8120 raft_consensus.cc:348] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:07.758607  8120 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:22:07.763602  8113 tablet_copy_client.cc:791] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:22:07.764276  8113 tablet_copy_client.cc:655] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:22:07.759497  8120 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:07.771282  8120 ts_tablet_manager.cc:1428] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.003s
I20260812 19:22:07.773672  6254 tablet_copy_service.cc:342] P a1541d11be514114966dc1e92a345298: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-0d8cbc6671344bd789fa2d3e4986c4b4 received from {username='slave'} at 127.0.0.1:56292
I20260812 19:22:07.774087  6254 tablet_copy_service.cc:433] P a1541d11be514114966dc1e92a345298: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-0d8cbc6671344bd789fa2d3e4986c4b4 on tablet 0d8cbc6671344bd789fa2d3e4986c4b4 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:07.784216  7599 raft_consensus.cc:1203] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:22:07.798039  8113 tablet_copy_client.cc:531] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:22:07.855216  8123 tablet_bootstrap.cc:492] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:22:07.863354  8123 tablet_bootstrap.cc:492] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:22:07.864449  8123 ts_tablet_manager.cc:1397] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.028s
I20260812 19:22:07.885968  7600 raft_consensus.cc:1203] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:22:07.897568  8113 tablet_bootstrap.cc:492] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:22:07.902635  8123 raft_consensus.cc:348] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:07.903813  8123 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:22:07.914875  8123 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:07.937482  8123 ts_tablet_manager.cc:1428] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.000s
I20260812 19:22:07.942529  6500 tablet_copy_service.cc:342] P bdfa5579d4534c618c00db6b4a841c81: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-0b2666b0bd6d48eaac74445d6da5cf58 received from {username='slave'} at 127.0.0.1:33386
I20260812 19:22:07.943365  6500 tablet_copy_service.cc:433] P bdfa5579d4534c618c00db6b4a841c81: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-0b2666b0bd6d48eaac74445d6da5cf58 on tablet 0b2666b0bd6d48eaac74445d6da5cf58 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:08.129233  8113 tablet_bootstrap.cc:492] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:22:08.130330  8113 tablet_bootstrap.cc:492] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:22:08.131146  8113 ts_tablet_manager.cc:1397] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.234s	user 0.065s	sys 0.045s
I20260812 19:22:08.134194  8113 raft_consensus.cc:348] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:08.135298  8113 raft_consensus.cc:729] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:22:08.136058  8113 consensus_queue.cc:260] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:08.139041  8113 ts_tablet_manager.cc:1428] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260812 19:22:08.149855  6373 tablet_copy_service.cc:342] P 54f83319db6b49929cc8f18a66a66975: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-9e3bf4ae67ff4aaa9287a253c6db6575 received from {username='slave'} at 127.0.0.1:35822
I20260812 19:22:08.150344  6373 tablet_copy_service.cc:433] P 54f83319db6b49929cc8f18a66a66975: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-9e3bf4ae67ff4aaa9287a253c6db6575 on tablet 9e3bf4ae67ff4aaa9287a253c6db6575 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:08.305961  7599 raft_consensus.cc:1203] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:22:08.350576  8075 raft_consensus.cc:1050] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:08.353044  8075 consensus_queue.cc:237] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:08.361958  7599 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:08.363672  8139 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:08.371860  6354 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:08.374152  8030 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:08.388790  6230 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:08.390532  8075 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:08.403326  8141 raft_consensus.cc:2932] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:08.404819  7600 raft_consensus.cc:2932] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:08.412716  7606 raft_consensus.cc:1203] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:22:08.438623  6228 raft_consensus.cc:2932] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:08.451361  7948 raft_consensus.cc:1050] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:08.454128  7948 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:08.459923  6055 catalog_manager.cc:5495] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:22:08.503165  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 46815.5us
I20260812 19:22:08.510035  6352 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:08.512935  8057 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:08.523870  6470 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:08.522881  6347 raft_consensus.cc:2932] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:08.545367  7600 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:08.550729  8057 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:08.554751  8127 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260812 19:22:08.639369  8057 raft_consensus.cc:2932] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:08.645496  7600 raft_consensus.cc:2932] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:08.652449  6475 raft_consensus.cc:2932] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:08.658880  6470 consensus_queue.cc:237] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:08.662712  6352 raft_consensus.cc:2932] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:08.692677  7606 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:08.694475  6242 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:08.700289  8156 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:08.702580  8153 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:08.703279  6054 catalog_manager.cc:5495] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:08.720309  8156 raft_consensus.cc:2932] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:08.722726  7606 raft_consensus.cc:2932] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:08.759625  6230 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:08.769405  6347 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:08.771580  7948 consensus_queue.cc:1037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:08.791258  8057 raft_consensus.cc:2932] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:08.796038  6352 raft_consensus.cc:2932] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:08.800897  6228 raft_consensus.cc:2932] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:08.804180  7606 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:08.813526  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet aa4b7bb14bdb4198a276add34849a84e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:08.814352  8167 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:08.848160  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 0d8cbc6671344bd789fa2d3e4986c4b4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:08.831569  6054 catalog_manager.cc:5495] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:08.872718  8128 raft_consensus.cc:1050] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:08.879060  7606 raft_consensus.cc:2932] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:08.885485  8139 raft_consensus.cc:1050] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:08.937060  6325 tablet_service.cc:1514] Processing DeleteTablet for tablet aa4b7bb14bdb4198a276add34849a84e with delete_type TABLET_DATA_TOMBSTONED (TS 54f83319db6b49929cc8f18a66a66975 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45938
I20260812 19:22:08.937575  6060 catalog_manager.cc:5495] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 reported cstate change: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New cstate: current_term: 1 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:08.929929  8128 consensus_queue.cc:237] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:08.964550  8177 tablet_replica.cc:330] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:22:08.960345  8139 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:08.978909  6452 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d8cbc6671344bd789fa2d3e4986c4b4 with delete_type TABLET_DATA_TOMBSTONED (TS bdfa5579d4534c618c00db6b4a841c81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38134
I20260812 19:22:08.997701  8178 tablet_replica.cc:330] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:22:09.009337  8178 raft_consensus.cc:2229] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:09.010417  8178 raft_consensus.cc:2258] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:09.023051  8178 ts_tablet_manager.cc:1905] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:09.027418  8177 raft_consensus.cc:2229] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:09.028728  8177 raft_consensus.cc:2258] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:09.034428  6481 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:09.034855  7606 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:09.037556  7606 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:09.045131  8177 ts_tablet_manager.cc:1905] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:09.047237  6228 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:09.046274  6347 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:09.049577  8094 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:09.057441  8075 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:09.060902  8159 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:09.064365  6228 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:09.067780  8159 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260812 19:22:09.080892  8011 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:09.084616  8144 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:09.160207  8178 ts_tablet_manager.cc:1918] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:22:09.165095  8178 log.cc:1196] T 0d8cbc6671344bd789fa2d3e4986c4b4 P bdfa5579d4534c618c00db6b4a841c81: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-2-root/wals/0d8cbc6671344bd789fa2d3e4986c4b4
W20260812 19:22:09.165867  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 82602.6us
W20260812 19:22:09.192605  8182 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260812 19:22:09.202721  6040 catalog_manager.cc:4841] TS bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): tablet 0d8cbc6671344bd789fa2d3e4986c4b4 (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:22:09.217773  8156 raft_consensus.cc:2932] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.220867  7600 raft_consensus.cc:2932] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.242770  8144 raft_consensus.cc:2932] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.245210  6235 raft_consensus.cc:2932] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.255892  6228 raft_consensus.cc:2932] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.273267  6054 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:09.279026  6060 catalog_manager.cc:5495] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.286051  6475 raft_consensus.cc:2932] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.293085  6352 raft_consensus.cc:2932] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.295853  8177 ts_tablet_manager.cc:1918] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:22:09.296491  8177 log.cc:1196] T aa4b7bb14bdb4198a276add34849a84e P 54f83319db6b49929cc8f18a66a66975: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-1-root/wals/aa4b7bb14bdb4198a276add34849a84e
I20260812 19:22:09.299579  7600 raft_consensus.cc:2932] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.317997  6477 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:09.322577  6040 catalog_manager.cc:4841] TS 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): tablet aa4b7bb14bdb4198a276add34849a84e (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:22:09.341926  7606 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:09.345525  8153 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:09.357926  8150 raft_consensus.cc:2932] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.366099  7606 raft_consensus.cc:2932] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.384980  6054 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.385275  6347 consensus_queue.cc:237] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:09.418604  6354 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:09.424787  6207 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b2666b0bd6d48eaac74445d6da5cf58 with delete_type TABLET_DATA_TOMBSTONED (TS a1541d11be514114966dc1e92a345298 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53166
I20260812 19:22:09.455286  7600 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:09.455905  8191 tablet_replica.cc:330] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:22:09.464301  6477 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:09.470432  8191 raft_consensus.cc:2229] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:09.469957  8141 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:09.467051  8144 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260812 19:22:09.484292  8191 raft_consensus.cc:2258] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:09.504307  8128 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:09.517207  8191 ts_tablet_manager.cc:1905] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:09.558063  8184 raft_consensus.cc:2932] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.563586  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 0b2666b0bd6d48eaac74445d6da5cf58 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:09.562204  6481 raft_consensus.cc:2932] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.563758  7600 raft_consensus.cc:2932] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.568476  6347 raft_consensus.cc:2932] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:22:09.591698  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47968.4us
I20260812 19:22:09.614814  8191 ts_tablet_manager.cc:1918] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:22:09.624845  8191 log.cc:1196] T 0b2666b0bd6d48eaac74445d6da5cf58 P a1541d11be514114966dc1e92a345298: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-0-root/wals/0b2666b0bd6d48eaac74445d6da5cf58
I20260812 19:22:09.635713  6040 catalog_manager.cc:4841] TS a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): tablet 0b2666b0bd6d48eaac74445d6da5cf58 (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:22:09.649750  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 9e3bf4ae67ff4aaa9287a253c6db6575 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:09.650920  6060 catalog_manager.cc:5495] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:09.693387  6207 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e3bf4ae67ff4aaa9287a253c6db6575 with delete_type TABLET_DATA_TOMBSTONED (TS a1541d11be514114966dc1e92a345298 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53166
I20260812 19:22:09.694837  8191 tablet_replica.cc:330] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:22:09.696106  8191 raft_consensus.cc:2229] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:09.696899  8191 raft_consensus.cc:2258] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:09.702759  8191 ts_tablet_manager.cc:1905] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:09.718416  8191 ts_tablet_manager.cc:1918] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:22:09.718835  8191 log.cc:1196] T 9e3bf4ae67ff4aaa9287a253c6db6575 P a1541d11be514114966dc1e92a345298: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-0-root/wals/9e3bf4ae67ff4aaa9287a253c6db6575
I20260812 19:22:09.720445  6040 catalog_manager.cc:4841] TS a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): tablet 9e3bf4ae67ff4aaa9287a253c6db6575 (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:22:10.754348  6347 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:10.761510  6481 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260812 19:22:10.761919  6298 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 982b09b6d3b34920ac161f2649012c72. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:22:10.763025  6235 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:10.763352  8203 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:10.764791  8129 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:10.772120  8203 raft_consensus.cc:2932] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:10.817175  6481 raft_consensus.cc:2932] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:10.821364  6235 raft_consensus.cc:2932] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:10.822358  6054 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:10.829735  6482 consensus_queue.cc:237] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
W20260812 19:22:10.861317  6417 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f50bde12f2b4852a014b508724cf2ca. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:22:10.863314  6347 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:10.865206  8153 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:10.874461  6235 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:10.876374  8153 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:10.917452  8199 raft_consensus.cc:2932] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:10.920904  6344 raft_consensus.cc:2932] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:10.923722  6228 raft_consensus.cc:2932] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:10.971334  6347 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:10.979966  6058 catalog_manager.cc:5495] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260812 19:22:11.022539  6298 consensus_peers.cc:487] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e76f36493d454308b43951f8eb142b7e. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:22:11.025997  6481 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:11.027493  8212 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:11.028002  6228 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:11.034371  8212 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:11.040941  8211 raft_consensus.cc:2932] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:11.050230  6481 raft_consensus.cc:2932] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:11.064558  6242 raft_consensus.cc:2932] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:11.069790  6054 catalog_manager.cc:5495] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:11.062274  6344 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
W20260812 19:22:11.111860  6298 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e47beaf4e3f74103977b8ba04492ff79. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:22:11.113055  6481 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:11.113483  6228 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:11.115056  8215 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:11.116214  8211 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:11.127545  8203 raft_consensus.cc:2932] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:11.131882  6482 raft_consensus.cc:2932] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:11.134054  6228 raft_consensus.cc:2932] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:11.156629  6060 catalog_manager.cc:5495] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: config changed from index -1 to 2, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:11.315975  8240 ts_tablet_manager.cc:927] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:11.318956  8240 tablet_copy_client.cc:316] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.3:42599
I20260812 19:22:11.320466  6500 tablet_copy_service.cc:140] P bdfa5579d4534c618c00db6b4a841c81: Received BeginTabletCopySession request for tablet 6f50bde12f2b4852a014b508724cf2ca from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:33386)
I20260812 19:22:11.321074  6500 tablet_copy_service.cc:161] P bdfa5579d4534c618c00db6b4a841c81: Beginning new tablet copy session on tablet 6f50bde12f2b4852a014b508724cf2ca from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:33386: session id = f4ef77b3328a44e8a21dd902b370e25a-6f50bde12f2b4852a014b508724cf2ca
I20260812 19:22:11.336302  6500 tablet_copy_source_session.cc:205] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:22:11.339540  8240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f50bde12f2b4852a014b508724cf2ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:22:11.362313  8240 tablet_copy_client.cc:791] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:22:11.363096  8240 tablet_copy_client.cc:655] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:22:11.367596  8240 tablet_copy_client.cc:531] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:22:11.375229  8242 ts_tablet_manager.cc:927] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:11.407236  8240 tablet_bootstrap.cc:492] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:22:11.423934  8242 tablet_copy_client.cc:316] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.2:39969
I20260812 19:22:11.425943  6373 tablet_copy_service.cc:140] P 54f83319db6b49929cc8f18a66a66975: Received BeginTabletCopySession request for tablet 982b09b6d3b34920ac161f2649012c72 from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:35822)
I20260812 19:22:11.426488  6373 tablet_copy_service.cc:161] P 54f83319db6b49929cc8f18a66a66975: Beginning new tablet copy session on tablet 982b09b6d3b34920ac161f2649012c72 from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:35822: session id = f4ef77b3328a44e8a21dd902b370e25a-982b09b6d3b34920ac161f2649012c72
I20260812 19:22:11.424263  8248 ts_tablet_manager.cc:927] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:11.435782  6373 tablet_copy_source_session.cc:205] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:22:11.448071  8242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 982b09b6d3b34920ac161f2649012c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:22:11.490551  8242 tablet_copy_client.cc:791] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:22:11.492216  8242 tablet_copy_client.cc:655] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:22:11.491319  8248 tablet_copy_client.cc:316] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.2:39969
I20260812 19:22:11.493871  6373 tablet_copy_service.cc:140] P 54f83319db6b49929cc8f18a66a66975: Received BeginTabletCopySession request for tablet e76f36493d454308b43951f8eb142b7e from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:35822)
I20260812 19:22:11.494448  6373 tablet_copy_service.cc:161] P 54f83319db6b49929cc8f18a66a66975: Beginning new tablet copy session on tablet e76f36493d454308b43951f8eb142b7e from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:35822: session id = f4ef77b3328a44e8a21dd902b370e25a-e76f36493d454308b43951f8eb142b7e
I20260812 19:22:11.497231  8242 tablet_copy_client.cc:531] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:22:11.493899  8240 tablet_bootstrap.cc:492] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:22:11.499712  8240 tablet_bootstrap.cc:492] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:22:11.502095  8240 ts_tablet_manager.cc:1397] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.095s	user 0.024s	sys 0.008s
I20260812 19:22:11.502758  6373 tablet_copy_source_session.cc:205] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:22:11.506171  8248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e76f36493d454308b43951f8eb142b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:22:11.507010  8240 raft_consensus.cc:348] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:11.507671  8240 raft_consensus.cc:729] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:22:11.508101  8240 consensus_queue.cc:260] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:11.516244  8242 tablet_bootstrap.cc:492] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:22:11.527695  8240 ts_tablet_manager.cc:1428] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260812 19:22:11.533135  6500 tablet_copy_service.cc:342] P bdfa5579d4534c618c00db6b4a841c81: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-6f50bde12f2b4852a014b508724cf2ca received from {username='slave'} at 127.0.0.1:33386
I20260812 19:22:11.533591  6500 tablet_copy_service.cc:433] P bdfa5579d4534c618c00db6b4a841c81: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-6f50bde12f2b4852a014b508724cf2ca on tablet 6f50bde12f2b4852a014b508724cf2ca with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:11.544292  8248 tablet_copy_client.cc:791] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:22:11.549639  8240 ts_tablet_manager.cc:927] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:11.569303  8240 tablet_copy_client.cc:316] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.2:39969
I20260812 19:22:11.571231  6373 tablet_copy_service.cc:140] P 54f83319db6b49929cc8f18a66a66975: Received BeginTabletCopySession request for tablet e47beaf4e3f74103977b8ba04492ff79 from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:35822)
I20260812 19:22:11.571877  6373 tablet_copy_service.cc:161] P 54f83319db6b49929cc8f18a66a66975: Beginning new tablet copy session on tablet e47beaf4e3f74103977b8ba04492ff79 from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:35822: session id = f4ef77b3328a44e8a21dd902b370e25a-e47beaf4e3f74103977b8ba04492ff79
I20260812 19:22:11.573326  8242 tablet_bootstrap.cc:492] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:22:11.577739  8248 tablet_copy_client.cc:655] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:22:11.588449  8248 tablet_copy_client.cc:531] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:22:11.582798  8242 tablet_bootstrap.cc:492] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:22:11.591714  8242 ts_tablet_manager.cc:1397] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.076s	user 0.030s	sys 0.025s
I20260812 19:22:11.596329  8242 raft_consensus.cc:348] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:11.597488  8242 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:22:11.598341  8242 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:11.600685  8248 tablet_bootstrap.cc:492] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:22:11.605060  8242 ts_tablet_manager.cc:1428] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260812 19:22:11.580412  6373 tablet_copy_source_session.cc:205] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:22:11.606938  6374 tablet_copy_service.cc:342] P 54f83319db6b49929cc8f18a66a66975: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-982b09b6d3b34920ac161f2649012c72 received from {username='slave'} at 127.0.0.1:35822
I20260812 19:22:11.607424  6374 tablet_copy_service.cc:433] P 54f83319db6b49929cc8f18a66a66975: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-982b09b6d3b34920ac161f2649012c72 on tablet 982b09b6d3b34920ac161f2649012c72 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:11.611456  8240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e47beaf4e3f74103977b8ba04492ff79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:22:11.637419  8240 tablet_copy_client.cc:791] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:22:11.638218  8240 tablet_copy_client.cc:655] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:22:11.643229  8240 tablet_copy_client.cc:531] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:22:11.678442  8240 tablet_bootstrap.cc:492] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:22:11.680598  8248 tablet_bootstrap.cc:492] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:22:11.682193  8248 tablet_bootstrap.cc:492] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:22:11.683066  8248 ts_tablet_manager.cc:1397] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.083s	user 0.026s	sys 0.022s
I20260812 19:22:11.693193  8248 raft_consensus.cc:348] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:11.694445  8248 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:22:11.695298  8248 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:11.698276  8248 ts_tablet_manager.cc:1428] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260812 19:22:11.708091  6373 tablet_copy_service.cc:342] P 54f83319db6b49929cc8f18a66a66975: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-e76f36493d454308b43951f8eb142b7e received from {username='slave'} at 127.0.0.1:35822
I20260812 19:22:11.708700  6373 tablet_copy_service.cc:433] P 54f83319db6b49929cc8f18a66a66975: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-e76f36493d454308b43951f8eb142b7e on tablet e76f36493d454308b43951f8eb142b7e with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:11.775493  8240 tablet_bootstrap.cc:492] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:22:11.776666  8240 tablet_bootstrap.cc:492] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:22:11.777808  8240 ts_tablet_manager.cc:1397] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 0.100s	user 0.041s	sys 0.035s
I20260812 19:22:11.780784  8240 raft_consensus.cc:348] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:11.781837  8240 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:22:11.782616  8240 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:11.785761  8240 ts_tablet_manager.cc:1428] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260812 19:22:11.792083  6373 tablet_copy_service.cc:342] P 54f83319db6b49929cc8f18a66a66975: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-e47beaf4e3f74103977b8ba04492ff79 received from {username='slave'} at 127.0.0.1:35822
I20260812 19:22:11.792557  6373 tablet_copy_service.cc:433] P 54f83319db6b49929cc8f18a66a66975: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-e47beaf4e3f74103977b8ba04492ff79 on tablet e47beaf4e3f74103977b8ba04492ff79 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:11.802515  7606 raft_consensus.cc:1203] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:22:11.888415  7606 raft_consensus.cc:1203] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:22:11.926436  7606 raft_consensus.cc:1203] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:22:12.066548  7606 raft_consensus.cc:1203] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 19:22:12.341593  8230 raft_consensus.cc:1050] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:12.344627  8230 consensus_queue.cc:237] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:12.349858  8267 raft_consensus.cc:1050] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:12.352408  8267 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:12.353271  8212 raft_consensus.cc:1050] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:12.356374  8212 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:12.371976  7606 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:12.378641  7600 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:12.379792  6242 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:12.381289  8203 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:12.382468  8129 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:12.396137  8199 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:12.409950  6354 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:12.412050  6474 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:12.415051  8212 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:12.417593  6228 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:12.423409  7606 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:12.423736  6481 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:12.425256  8129 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:12.426616  8203 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:12.467939  8212 raft_consensus.cc:2932] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:22:12.477926  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 60520.8us
I20260812 19:22:12.481567  8281 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:12.495018  6474 raft_consensus.cc:2932] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.501289  8282 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:12.514154  6228 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:12.528621  8296 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:12.542199  8280 raft_consensus.cc:2932] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.543545  6060 catalog_manager.cc:5495] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:12.563467  6235 raft_consensus.cc:2932] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.582827  7606 raft_consensus.cc:2932] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:22:12.595479  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 71847.7us
I20260812 19:22:12.597304  6352 raft_consensus.cc:2932] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.621901  6055 catalog_manager.cc:5495] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.634997  6228 raft_consensus.cc:2932] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.655915  8302 raft_consensus.cc:2932] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:22:12.658242  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 233182us
I20260812 19:22:12.659950  6235 raft_consensus.cc:2932] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.679066  7600 raft_consensus.cc:2932] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } attrs { replace: true } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.740469  8267 raft_consensus.cc:1050] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:22:12.743549  8267 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:12.741201  7603 raft_consensus.cc:2932] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.758200  6481 consensus_queue.cc:237] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:12.765842  7606 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:12.767410  8230 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:22:12.768857  7599 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 1 LEARNER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:12.770455  8302 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:12.774344  6235 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:12.784055  8280 raft_consensus.cc:2932] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.792361  7599 raft_consensus.cc:2932] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.803352  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 6f50bde12f2b4852a014b508724cf2ca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:12.815505  6481 raft_consensus.cc:2932] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.825704  6352 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:12.831395  6055 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:12.839901  6054 catalog_manager.cc:5495] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New cstate: current_term: 1 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.869737  6235 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:12.870609  6359 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:12.872423  8230 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:22:12.879434  6481 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 19:22:12.884897  7599 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:12.891068  8267 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:12.901067  8203 raft_consensus.cc:2932] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.902160  7599 raft_consensus.cc:2932] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.930240  8302 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:12.935597  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet e76f36493d454308b43951f8eb142b7e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:12.951299  6235 raft_consensus.cc:2932] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:12.960944  6325 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f50bde12f2b4852a014b508724cf2ca with delete_type TABLET_DATA_TOMBSTONED (TS 54f83319db6b49929cc8f18a66a66975 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45938
I20260812 19:22:12.970764  8318 tablet_replica.cc:330] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:22:12.972185  8318 raft_consensus.cc:2229] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:12.977656  8318 raft_consensus.cc:2258] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:12.989274  8318 ts_tablet_manager.cc:1905] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:12.998869  6055 catalog_manager.cc:5495] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:13.015273  6235 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:13.018927  7606 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:13.019126  6481 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:13.019371  8318 ts_tablet_manager.cc:1918] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:22:13.019876  8318 log.cc:1196] T 6f50bde12f2b4852a014b508724cf2ca P 54f83319db6b49929cc8f18a66a66975: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-1-root/wals/6f50bde12f2b4852a014b508724cf2ca
I20260812 19:22:13.021616  8302 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:13.024263  6207 tablet_service.cc:1514] Processing DeleteTablet for tablet e76f36493d454308b43951f8eb142b7e with delete_type TABLET_DATA_TOMBSTONED (TS a1541d11be514114966dc1e92a345298 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53166
I20260812 19:22:13.034361  8296 raft_consensus.cc:2932] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:13.046609  8295 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:13.049631  8322 tablet_replica.cc:330] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:22:13.050881  8322 raft_consensus.cc:2229] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:13.057368  8322 raft_consensus.cc:2258] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:13.060050  8295 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260812 19:22:13.068634  8322 ts_tablet_manager.cc:1905] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:13.074570  7603 raft_consensus.cc:2932] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:13.081351  8289 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:13.088284  6242 raft_consensus.cc:2932] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:13.095333  6482 raft_consensus.cc:2932] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:13.106637  6040 catalog_manager.cc:4841] TS 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): tablet 6f50bde12f2b4852a014b508724cf2ca (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:22:13.119282  6481 raft_consensus.cc:2932] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:13.120055  8129 raft_consensus.cc:2932] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:13.128216  8322 ts_tablet_manager.cc:1918] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:22:13.128998  8322 log.cc:1196] T e76f36493d454308b43951f8eb142b7e P a1541d11be514114966dc1e92a345298: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-0-root/wals/e76f36493d454308b43951f8eb142b7e
I20260812 19:22:13.132597  7606 raft_consensus.cc:2932] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:13.138748  6040 catalog_manager.cc:4841] TS a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): tablet e76f36493d454308b43951f8eb142b7e (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:22:13.133256  6235 raft_consensus.cc:2932] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:13.168704  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 982b09b6d3b34920ac161f2649012c72 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:13.169147  6054 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 reported cstate change: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:13.185185  6058 catalog_manager.cc:5495] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index 2 to 3, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:13.216225  6452 tablet_service.cc:1514] Processing DeleteTablet for tablet 982b09b6d3b34920ac161f2649012c72 with delete_type TABLET_DATA_TOMBSTONED (TS bdfa5579d4534c618c00db6b4a841c81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38134
I20260812 19:22:13.221858  6359 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:13.242129  7599 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:13.244199  8330 tablet_replica.cc:330] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:22:13.247009  8330 raft_consensus.cc:2229] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:13.254739  8330 raft_consensus.cc:2258] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:13.261519  6235 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 19:22:13.260378  8330 ts_tablet_manager.cc:1905] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:13.263370  8327 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:22:13.269183  8295 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:22:13.280678  8327 raft_consensus.cc:2932] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:13.290563  7606 raft_consensus.cc:2932] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:22:13.292075  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 56549.8us
I20260812 19:22:13.301333  8330 ts_tablet_manager.cc:1918] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:22:13.311479  8330 log.cc:1196] T 982b09b6d3b34920ac161f2649012c72 P bdfa5579d4534c618c00db6b4a841c81: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-2-root/wals/982b09b6d3b34920ac161f2649012c72
I20260812 19:22:13.331180  6040 catalog_manager.cc:4841] TS bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): tablet 982b09b6d3b34920ac161f2649012c72 (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
I20260812 19:22:13.331900  6040 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet e47beaf4e3f74103977b8ba04492ff79 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 19:22:13.342844  6054 catalog_manager.cc:5495] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New cstate: current_term: 1 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:13.358812  6452 tablet_service.cc:1514] Processing DeleteTablet for tablet e47beaf4e3f74103977b8ba04492ff79 with delete_type TABLET_DATA_TOMBSTONED (TS bdfa5579d4534c618c00db6b4a841c81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38134
I20260812 19:22:13.360196  8330 tablet_replica.cc:330] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:22:13.361441  8330 raft_consensus.cc:2229] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:22:13.362407  8330 raft_consensus.cc:2258] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:22:13.366844  6242 raft_consensus.cc:2932] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:13.369552  8330 ts_tablet_manager.cc:1905] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 19:22:13.414547  8330 ts_tablet_manager.cc:1918] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 19:22:13.415199  8330 log.cc:1196] T e47beaf4e3f74103977b8ba04492ff79 P bdfa5579d4534c618c00db6b4a841c81: Deleting WAL directory at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0/minicluster-data/ts-2-root/wals/e47beaf4e3f74103977b8ba04492ff79
I20260812 19:22:13.417254  6040 catalog_manager.cc:4841] TS bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): tablet e47beaf4e3f74103977b8ba04492ff79 (table test-workload [id=9f9bc8e8ec444a27a365c73c9999f64c]) successfully deleted
W20260812 19:22:15.037492  6298 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.004s	sys 0.014s
W20260812 19:22:15.097245  6298 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.011s	sys 0.014s
I20260812 19:22:15.097929  8336 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:15.081476  6295 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.014s	sys 0.010s
W20260812 19:22:15.114114  6295 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.019s	sys 0.011s
I20260812 19:22:15.098104  8295 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:22:15.212160  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.015s	sys 0.024s
W20260812 19:22:15.227190  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.020s	sys 0.025s
I20260812 19:22:15.218561  8205 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:15.236848  8376 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:22:15.221731  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 84768.4us
I20260812 19:22:15.300376  8348 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:15.214622  8334 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:15.319525  8350 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:22:15.212316  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 93353.5us
I20260812 19:22:15.321049  8327 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:22:15.183720  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 77908.2us
I20260812 19:22:15.317178  8389 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:15.233572  8281 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:15.303717  8368 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:15.361584  8340 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:15.511927  8358 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:15.113075  8336 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:15.692162  8379 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:22:15.688675  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 275030us
I20260812 19:22:15.545610  8327 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:15.193415  8295 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:15.658478  8296 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:15.644619  8368 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:15.304198  8205 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:15.500447  8389 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:15.683974  8333 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:15.647661  8348 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:15.517334  8350 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:15.598533  8281 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:15.699463  8382 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:15.626288  8334 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:16.107197  8289 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:16.108270  8367 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:16.111294  8346 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:16.032454  8385 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:16.115412  8351 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:16.119841  8344 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:15.958529  8296 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:16.174563  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1273) took 1268 ms. Trace:
I20260812 19:22:15.630095  8376 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:16.133128  8370 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:16.248829  8281 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:16.296953  6415 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.005s	sys 0.060s
I20260812 19:22:16.292205  6235 rpcz_store.cc:276] 0812 19:22:14.325251 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:14.353641 (+ 28390us) service_pool.cc:227] Handling call
0812 19:22:15.326366 (+972725us) spinlock_profiling.cc:243] Waited 9.67 ms on lock 0x7b5800001898. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:22:15.340883 (+ 14517us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:15.590972 (+250089us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:15.591273 (+   301us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:15.591578 (+   305us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:15.591683 (+   105us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:15.591927 (+   244us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:15.592444 (+   517us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":22244096}
I20260812 19:22:16.410768  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:22:16.285668  8374 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:15.664402  8358 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:15.727545  8340 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:16.316032  8289 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:15.888731  8379 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:15.925146  8372 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:16.388271  8296 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:16.527786  8394 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:16.284524  8344 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:16.532078  8395 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:16.252188  8333 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:16.302798  8351 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:16.577419  7554 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.111s	sys 0.299s
I20260812 19:22:16.372807  8382 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:16.798595  8327 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:16.804636  8334 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:16.809631  8358 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:16.528374  8372 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:16.682112  8374 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:16.315433  8385 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:16.314141  8370 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:16.802413  8382 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:16.668258  8394 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:16.859076  8280 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:16.860373  8280 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:16.814904  7554 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.265s	user 0.119s	sys 0.300s
I20260812 19:22:16.840435  8376 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:16.834086  8389 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:16.886060  8344 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:16.336548  8346 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:16.811005  8395 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:16.894145  6413 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.489s	user 0.005s	sys 0.051s
I20260812 19:22:16.896414  8280 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:16.391831  8367 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:16.925603  6413 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.533s	user 0.007s	sys 0.051s
I20260812 19:22:16.873804  8368 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:16.963980  8289 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:16.916287  8348 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:16.999389  8399 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:17.001032  8394 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:16.967957  8379 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:16.982614  8351 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:16.979439  8350 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:17.000924  8399 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:17.055891  8394 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:17.057106  8394 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:17.008205  8370 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:16.982869  8401 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:16.966590  8367 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:17.080637  8346 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:17.043828  8372 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:17.080664  8374 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:17.095952  8352 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:17.097515  8352 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:17.100348  8395 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:17.105772  8385 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:17.064450  8336 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:17.086164  8401 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:17.116801  8399 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:17.111532  8395 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:17.136448  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.336s	user 0.038s	sys 0.161s
W20260812 19:22:17.137187  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.378s	user 0.038s	sys 0.161s
I20260812 19:22:17.123713  8385 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:17.121984  8401 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:17.155646  6298 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.537s	user 0.076s	sys 0.231s
W20260812 19:22:17.153559  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.736s	user 0.010s	sys 0.015s
W20260812 19:22:17.162815  6298 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.620s	user 0.080s	sys 0.232s
I20260812 19:22:17.128046  8394 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:17.165962  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.748s	user 0.011s	sys 0.016s
I20260812 19:22:17.150058  8344 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:17.153231  8374 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:17.165419  8367 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:17.257208  8372 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:17.419461  8372 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:17.421139  8408 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:22:17.434373  6417 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.673s	user 0.005s	sys 0.031s
W20260812 19:22:17.645071  6417 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.208s	user 0.008s	sys 0.031s
W20260812 19:22:17.317960  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.913s	user 0.033s	sys 0.268s
W20260812 19:22:17.195700  7552 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.149s	user 0.014s	sys 0.032s
I20260812 19:22:17.144917  8399 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:17.415853  8404 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:17.169056  8401 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:17.169763  8378 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:17.371930  8295 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:17.204177  8410 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:17.607909  8412 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:17.157083  8395 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:17.284490  8351 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:18.064364  8404 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:17.547583  8344 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:18.068889  8378 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:17.531014  8367 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:18.073148  8378 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:17.605667  8418 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:17.203586  8385 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:18.075805  8395 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:18.076869  8395 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:17.605156  8432 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:18.078400  8432 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:18.078806  8351 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:17.604718  8384 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:18.083283  8384 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:17.716778  8372 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:18.089757  8351 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:17.296283  7551 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.802s	user 0.167s	sys 0.500s
W20260812 19:22:17.659621  7552 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.696s	user 0.027s	sys 0.051s
I20260812 19:22:18.191234  8432 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:18.845619  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 3.225s	user 0.010s	sys 0.038s
W20260812 19:22:17.272796  6295 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.946s	user 0.002s	sys 0.038s
W20260812 19:22:18.976657  6296 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.728s	user 0.004s	sys 0.020s
W20260812 19:22:18.992936  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 3.61141e+06us
I20260812 19:22:18.101850  8412 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:17.203218  8340 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:18.225286  8344 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:18.073148  8367 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:17.639828  8374 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.333834  8374 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:18.284583  8384 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:18.077616  8385 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:18.077723  8395 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.338546  8395 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:18.124815  8399 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.341354  8399 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:18.123147  8401 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.344414  8401 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:18.283618  8404 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:18.277869  8408 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.348187  8408 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:18.091871  8410 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:18.185115  8418 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.353365  8418 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:19.079474  8390 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.355659  8390 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.358525  8390 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:19.023627  8333 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:19.141615  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 912) took 2474 ms. Trace:
I20260812 19:22:19.360056  6482 rpcz_store.cc:276] 0812 19:22:16.667542 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:16.831965 (+164423us) service_pool.cc:227] Handling call
0812 19:22:16.880572 (+ 48607us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:16.898262 (+ 17690us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:16.898346 (+    84us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:16.898464 (+   118us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:16.898599 (+   135us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:19.140978 (+2242379us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5400271354. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:19.141051 (+    73us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:19.141267 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":28332416}
W20260812 19:22:19.142517  6417 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.475s	user 0.010s	sys 0.034s
W20260812 19:22:19.361759  6417 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.694s	user 0.010s	sys 0.034s
W20260812 19:22:19.362097  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 1.69861e+06us
W20260812 19:22:19.155683  6413 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.601s	user 0.020s	sys 0.011s
W20260812 19:22:19.157938  7551 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.841s	user 0.168s	sys 0.531s
W20260812 19:22:19.363392  6413 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.822s	user 0.021s	sys 0.012s
W20260812 19:22:19.206238  7554 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.887s	user 0.014s	sys 0.017s
I20260812 19:22:19.227547  8352 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:19.366441  7554 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.062s	user 0.014s	sys 0.018s
I20260812 19:22:19.366840  8399 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:19.367552  8399 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.369856  8399 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:19.369423  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:19.370555  8395 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.370617  7603 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:19.371357  8395 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.373690  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:22:19.236094  6416 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.1:46707 timed out after 1.599s (SENT) [suppressed 8 similar messages]
I20260812 19:22:19.236447  8230 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:19.374508  7600 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:19.376004  8230 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.377266  8401 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.377897  8401 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.374861  8385 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.380317  8401 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:19.380095  8385 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.380934  8401 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.381572  8401 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.081444  8387 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:22:19.303464  6295 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.977s	user 0.032s	sys 0.068s
I20260812 19:22:19.382993  8387 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.384749  8446 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.385450  8387 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:19.245328  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 4.024s	user 0.048s	sys 0.283s
I20260812 19:22:19.385608  8446 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.390877  8340 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.391470  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:19.391625  8340 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.392271  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:19.392848  8385 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.392982  6230 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 3.
I20260812 19:22:19.393989  8340 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.394310  8446 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.394609  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:19.395876  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:19.396571  6242 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 1.
I20260812 19:22:19.391320  8230 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:19.303980  6296 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.866s	user 0.025s	sys 0.041s
W20260812 19:22:19.243209  6172 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 3.650s	user 0.022s	sys 0.035s
W20260812 19:22:19.398478  6172 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.806s	user 0.022s	sys 0.044s
I20260812 19:22:19.399672  8413 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:22:19.292799  6175 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.596s	user 0.014s	sys 0.072s
W20260812 19:22:19.400563  6175 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.868s	user 0.024s	sys 0.089s
I20260812 19:22:19.400490  8445 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.400358  8413 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.401361  8445 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.305572  8358 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.402822  8346 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.403070  8358 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.403483  8346 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.405759  8358 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:19.405864  8346 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.306231  8350 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.307770  8334 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.307870  8370 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:22:19.304940  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.685s	user 0.014s	sys 0.040s
W20260812 19:22:19.411438  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 3.91457e+06us
I20260812 19:22:19.241888  8440 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:19.278553  8345 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:19.298139  8415 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.298010  8205 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.313885  8432 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.324921  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 908) took 3357 ms. Trace:
I20260812 19:22:19.330399  8412 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.367007  8352 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.376695  8404 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.239985  8439 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.240856  8444 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.397882  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:19.374244  8395 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:19.410137  6229 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 1.
I20260812 19:22:19.410385  8429 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.391683  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:19.416527  8427 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.406302  8354 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:19.424983  8350 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.421115  6474 rpcz_store.cc:276] 0812 19:22:15.968469 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:15.969827 (+  1358us) service_pool.cc:227] Handling call
0812 19:22:15.973017 (+  3190us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:16.369068 (+396051us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:16.369213 (+   145us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:16.446824 (+ 77611us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:16.447105 (+   281us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:19.324556 (+2877451us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400000d54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:19.324600 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:19.324745 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":470730624}
I20260812 19:22:19.406399  8358 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.411249  8336 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.433171  8390 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.433070  8439 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.415433  8340 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.412146  8367 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.403463  8413 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:19.436048  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 200035us
I20260812 19:22:19.425156  8334 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.446897  6235 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 1.
I20260812 19:22:19.449832  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.457726  6474 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:19.432776  8446 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:19.436632  8432 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:19.470726  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55377.5us
I20260812 19:22:19.467284  6179 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:19.431911  8352 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.455295  8395 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.437696  8370 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.437899  8404 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.460947  8410 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.496989  6179 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:19.464990  8354 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.460465  8429 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.500059  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:19.457129  8340 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.480167  8413 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:19.466130  8367 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:19.457068  8358 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.455587  8336 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.487284  8427 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.426208  8345 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.467222  8390 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.522949  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:19.519136  6228 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 1.
I20260812 19:22:19.527514  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.527408  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.429750  8415 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.507819  8395 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.530642  6352 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:19.480046  8446 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.536221  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.512692  8413 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.538981  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:19.542886  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:19.544513  6235 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 1.
I20260812 19:22:19.532610  8205 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:19.528836  8346 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.471351  8440 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.541086  8413 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:19.564462  8362 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.569687  8346 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.566062  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.449535  8444 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.551622  8205 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.571288  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.670883  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:19.570302  8362 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.679234  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.671938  7600 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:19.678802  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:19.694123  7606 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:19.566495  8352 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:19.704879  8362 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.603088  8432 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.673687  8205 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:19.707816  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.707973  8455 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.708212  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.708877  6470 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:19.709715  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.624439  8350 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.602161  8336 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.583847  8401 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:19.669451  8354 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.733117  8429 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.706516  8334 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:19.748824  8459 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.741600  8340 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:19.726888  8445 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.636281  8454 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.766228  8334 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.708889  8455 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.766921  8334 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.717387  8439 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.738521  8404 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.742422  8336 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.765542  8473 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.771168  8340 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:19.771337  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.787684  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:19.757330  8370 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:19.741786  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:19.791587  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:19.792029  7606 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:19.788949  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.749835  8459 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:19.801503  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.800498  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.803323  6475 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:19.804184  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:19.787748  8446 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.806284  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.809338  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.791694  8358 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.805122  8340 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.818145  8444 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.810081  6354 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:19.791455  8395 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.804301  8462 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:19.796226  8367 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:19.820624  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.790490  8362 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.823442  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.797106  8346 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.825654  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:19.829579  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:19.777654  8440 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.833577  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.835763  7600 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:19.837493  6481 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:19.801972  8439 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:19.804867  8453 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.766567  8454 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.864809  8455 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.882022  8460 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:19.882954  8460 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.818856  7599 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:19.799765  8461 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.799655  8458 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:19.818887  8445 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:19.805680  8336 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.901715  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.867046  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.832522  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.883215  8453 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.836464  7606 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:19.810096  8473 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.911202  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.837352  8362 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.885963  8461 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.924501  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.923755  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:19.915002  8334 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.902902  8445 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.879339  8462 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.920588  8390 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:19.900898  8458 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.919559  8455 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.917601  8346 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:19.900346  8439 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:19.929932  8408 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:19.934300  8473 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.925809  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.935297  8362 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:19.933410  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.919837  8427 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.921651  8454 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.921317  8460 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.937881  8461 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:19.985289  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:19.985797  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:19.986563  7607 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:19.957012  8346 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.988020  8439 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:19.940438  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.989390  8415 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:19.944257  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.955348  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.951408  8408 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:19.946178  8345 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:19.949947  8455 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.001238  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.001960  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.954538  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.980953  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:19.981172  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.981423  8459 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.941864  8336 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.982622  8445 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.939743  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.016280  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:19.989339  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.942891  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.057648  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.052860  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:19.991102  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.058691  6354 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 1.
I20260812 19:22:19.990768  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:19.991120  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.052577  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.018631  6344 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 1.
I20260812 19:22:20.060093  6230 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 1.
I20260812 19:22:20.060286  6352 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:19.943022  8453 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:19.989782  8346 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.053325  6235 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.021998  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.053521  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.065191  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.065711  6236 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.054447  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.066370  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.066557  6232 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.067503  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.055771  8205 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.056679  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.056912  8455 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:19.985863  8413 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.058362  6474 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.003796  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.078227  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.080268  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.081136  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.081643  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.061146  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.082687  8408 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:19.995785  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.022200  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.085433  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:20.086719  7643 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2060 after lost signal to thread 4090
W20260812 19:22:20.087843  7643 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2740 after lost signal to thread 6116
I20260812 19:22:20.088133  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:20.088577  8462 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:20.089092  7643 debug-util.cc:398] Leaking SignalData structure 0x7b0800333180 after lost signal to thread 6272
I20260812 19:22:20.089016  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.046912  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.089442  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:20.089820  6347 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:20.068292  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.055845  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.090116  7600 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:20.091255  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.091559  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.091907  6242 raft_consensus.cc:2379] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 2: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:20.092226  6238 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.092918  8413 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:20.093178  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.094456  6229 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:20.094762  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.075268  6241 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.075910  6232 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:20.076681  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.103334  6235 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.068552  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.081136  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.104254  6483 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.105443  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.105543  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.106125  6483 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:20.106268  6464 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.077484  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.059772  6224 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 1.
I20260812 19:22:20.114513  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:20.091915  6236 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.110203  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.116176  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:20.113621  6417 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:20.061444  6228 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:19.997779  8340 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.099973  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.123096  6230 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 1.
I20260812 19:22:20.113852  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:20.101763  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.076620  8205 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:20.101966  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.106639  6179 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:20.106868  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:20.089484  7643 debug-util.cc:398] Leaking SignalData structure 0x7b08003330e0 after lost signal to thread 6273
I20260812 19:22:20.127691  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.107183  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.076968  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.129468  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.022428  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.108119  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.132910  6473 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.134225  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.135555  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.108695  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.109440  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.120613  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.118930  6417 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:20.122248  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:19.997618  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:20.126112  8404 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.128654  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.132799  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.155848  6235 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.147660  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:20.138352  6417 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:20.123808  8395 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:20.161329  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.161602  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.162011  6238 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.149137  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.162954  6230 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.150539  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.162560  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.151217  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:20.153293  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.130429  8336 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.164618  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.153437  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.153615  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.154419  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.119609  8458 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.134049  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.181260  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.182297  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:20.124348  8352 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260812 19:22:20.182849  7643 debug-util.cc:398] Leaking SignalData structure 0x7b080033f620 after lost signal to thread 6399
I20260812 19:22:20.183074  8352 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:20.183682  8352 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:22:20.184010  7643 debug-util.cc:398] Leaking SignalData structure 0x7b08000f9e60 after lost signal to thread 6521
I20260812 19:22:20.147723  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.156617  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.185801  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:20.157287  6352 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:20.158730  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.160053  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.160638  8345 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.160555  6417 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:20.163455  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.190081  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.165490  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:20.160658  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.161263  8395 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:20.168491  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.190764  6224 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.191051  6236 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.170113  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.171610  8432 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.195592  8432 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:20.195812  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.196149  8415 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.196195  8432 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.196630  6349 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:20.155038  8401 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.136665  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.198199  8401 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:20.197705  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.198834  8401 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.156948  8404 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:20.175575  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.209726  6474 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:20.178076  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.179366  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.154009  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.187104  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.187834  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.216398  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.216557  8390 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260812 19:22:20.188438  7643 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4aa0 after lost signal to thread 7647
I20260812 19:22:20.149696  6483 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:20.191919  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.148929  8462 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.231775  8462 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:20.210779  8395 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:20.232316  8462 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.152354  8408 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.173091  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.212553  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:20.214087  8455 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.214584  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.215220  8404 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.238777  8408 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:20.242960  8455 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:20.243196  8408 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.243429  8455 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.174996  8336 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:20.217044  8390 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:20.247328  8390 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.196661  8415 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:20.248050  8415 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.200383  8345 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:20.231986  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.204219  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.198557  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:20.253759  8345 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.254120  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.234505  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.200037  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.242115  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.239692  6481 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 1.
I20260812 19:22:20.244349  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.245730  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.258366  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.262795  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.248842  8336 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.225543  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.279785  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.254508  8413 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.290932  8413 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:20.296815  8413 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.312101  8482 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.313351  8482 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:20.313736  8482 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.305787  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:20.318830  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 153384us
I20260812 19:22:20.319798  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:20.320013  8345 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.323908  8432 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.263003  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:20.326185  8345 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:20.215296  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:20.328778  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 130287us
I20260812 19:22:20.328860  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.331511  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.335335  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.336562  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.344527  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.214826  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:20.346616  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 186152us
I20260812 19:22:20.347164  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:20.345470  6236 consensus_queue.cc:237] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:20.366478  8459 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.399971  8455 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:20.420817  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:20.430222  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.355298  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:20.432714  8458 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.431201  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.432053  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.432164  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:20.432571  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.398435  8352 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.429831  8459 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:20.425827  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.433970  8455 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.434355  8458 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.377740  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.418242  8462 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:20.436882  8458 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:20.425328  8336 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.438597  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.406193  8390 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.440819  8390 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:20.379118  8408 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.443100  8432 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.435470  6178 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:20.445688  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.337364  8439 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.444914  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.444133  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:20.447976  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.443797  8408 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:20.451712  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.435772  8459 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.453052  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:20.445735  8458 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.452080  8340 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.443852  8432 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.436213  8352 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:20.456825  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.453634  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.462275  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:20.446973  8439 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:20.470940  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.470548  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:20.470225  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:20.467815  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:20.476708  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.473182  6178 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:20.377544  8415 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:20.479313  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.476821  8484 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.453835  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.402313  8413 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:20.478349  8439 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.459674  8340 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:20.459913  8432 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:20.465229  8445 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.496866  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.464964  8346 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.479707  8205 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.499431  6482 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:20.484215  8474 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.479650  8461 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.508229  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:20.508975  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 153776us
I20260812 19:22:20.511447  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.493991  8484 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:20.509528  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.494845  8336 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:20.504284  8340 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.513486  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.484838  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.523176  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:20.508133  8432 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.520637  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.540258  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:20.468092  8455 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.485874  8482 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.509552  8205 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:20.508459  8445 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:20.548785  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.518771  8461 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:20.558214  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.538600  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:20.555408  8205 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.523758  8484 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:22:20.563588  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 75903.7us
W20260812 19:22:20.565837  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 69926.1us
I20260812 19:22:20.572986  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:20.573985  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:20.583854  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:20.585238  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:20.585961  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:20.587865  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:20.588066  6298 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:20.552651  8462 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.556172  6464 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:20.555941  8445 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.559187  8461 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.555436  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.595347  8415 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.595798  8499 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.597896  6298 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.606122  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:20.607738  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:20.612212  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:20.616211  6179 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6454eb944afe4306b52388febd0f82bb. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:22:20.619215  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:20.601564  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:20.622272  8413 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.556342  8486 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.624500  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:20.624722  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:20.628190  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:20.630235  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.631994  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.632496  7603 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:20.633189  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.622553  8488 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.635411  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.639289  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.642246  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.603061  8499 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:20.645527  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:20.647477  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.648404  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.640380  8491 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.624387  8486 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:20.661062  8486 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.653956  6416 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:20.655095  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.638640  8413 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.644446  8358 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.638531  8346 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.658761  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:20.655306  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 57546us
I20260812 19:22:20.666812  8408 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.667176  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.646953  8499 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.639297  8488 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:20.688809  8482 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:20.689179  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:20.676522  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.689579  8482 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.692826  8482 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260812 19:22:20.693768  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 51820.5us
I20260812 19:22:20.652751  8345 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.674417  8494 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.699123  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:20.653532  8404 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.700877  8459 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:20.701467  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.701607  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:20.700762  8401 consensus_meta.cc:287] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.501s	user 0.019s	sys 0.001s
I20260812 19:22:20.719658  8401 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.683522  8488 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.717557  8458 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:20.720247  8453 consensus_queue.cc:1046] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:22:20.668273  8500 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.664172  8505 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260812 19:22:20.729161  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 81897.6us
I20260812 19:22:20.731974  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.733145  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.736688  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:20.704519  8494 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:20.739398  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.742087  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.742141  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.696758  8395 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.765748  8404 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:20.766475  8404 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.766680  8458 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.766957  8404 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:20.767468  8404 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.736050  8505 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:20.770267  8459 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.779655  8401 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.780376  8401 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:20.780762  8401 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:20.780871  8460 raft_consensus.cc:3032] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:20.781221  8401 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.781440  8460 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:22:20.782979  8502 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.115s	user 0.002s	sys 0.000s
I20260812 19:22:20.784150  8505 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.785037  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.743614  7599 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:20.743446  8494 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.785362  8432 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.741148  8482 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.736994  8507 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.782552  8460 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.802248  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.801054  7598 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:20.805382  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:20.736308  8444 consensus_queue.cc:1046] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260812 19:22:20.806330  6345 raft_consensus.cc:595] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:20.809329  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:20.810405  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:20.811966  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:20.815209  8460 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.815750  8395 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:20.817227  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 176174us
I20260812 19:22:20.817956  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.823572  8461 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:20.832608  8439 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:20.826354  8432 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.822599  8458 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.825929  8486 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.827112  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.835920  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:20.829593  8404 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.831848  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:20.832381  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.836474  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.828619  8205 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:20.838320  6345 raft_consensus.cc:595] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Received request to transfer leadership to TS f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:20.839805  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.844129  8345 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.845201  8461 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.849819  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.851197  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.851385  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:20.855896  6416 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:20.855986  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:22:20.858242  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 118912us
I20260812 19:22:20.859469  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.859669  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.860038  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.858281  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:20.840808  8439 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.836328  8488 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:20.869289  7597 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:20.868814  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:20.862249  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.871785  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.868666  8432 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.876824  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:20.874229  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.860391  8352 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.875850  8514 raft_consensus.cc:3032] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:20.874182  8395 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.876634  8445 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:20.872027  7607 raft_consensus.cc:2379] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:20.873911  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.856015  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:20.913756  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.916302  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:20.918776  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.919591  8486 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:20.920751  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:20.922220  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:20.922863  8404 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:20.923714  8499 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.924289  8205 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.880784  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.866292  8358 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 19:22:20.928824  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 167794us
I20260812 19:22:20.939730  7603 raft_consensus.cc:1226] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:20.929558  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:20.942190  6228 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 2: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:20.931097  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:20.873085  8474 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.931921  8461 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:22:20.933413  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:20.942067  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 84521.8us
I20260812 19:22:20.931568  8484 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.874440  8507 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.876658  8488 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:20.956023  8445 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.956626  8461 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:20.957647  8352 consensus_queue.cc:1046] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:22:20.981398  8340 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:20.982245  8518 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:20.958959  7599 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:20.982896  8518 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:20.959096  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:20.959640  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.985520  8518 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.985836  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:20.960209  6473 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:20.987058  7607 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:20.960654  7600 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:20.957324  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:20.960963  8505 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.988552  6475 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.954411  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.989966  8505 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.991151  8490 consensus_queue.cc:1046] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:22:20.992985  8490 consensus_queue.cc:1046] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:22:20.993901  8390 raft_consensus.cc:3032] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:20.994071  8490 raft_consensus.cc:3032] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:20.994302  8390 raft_consensus.cc:729] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:20.995652  8518 raft_consensus.cc:979] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:22:20.995386  8390 consensus_queue.cc:260] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.955814  8205 consensus_queue.cc:1046] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260812 19:22:20.925369  8432 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.996132  8460 raft_consensus.cc:1067] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:22:20.995380  8488 raft_consensus.cc:3032] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:20.964093  8484 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.964794  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:20.960825  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:20.966475  7597 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:20.954437  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.996783  8390 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.967628  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:20.968351  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:20.965474  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:20.996779  8488 raft_consensus.cc:729] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:20.954782  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.997745  6477 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.000015  8488 consensus_queue.cc:260] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.001376  8488 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:20.971174  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:20.972007  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:20.997666  8205 raft_consensus.cc:3032] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:20.972599  7606 raft_consensus.cc:1226] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.003883  8205 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:20.974282  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.004879  8205 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.006088  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.007431  8462 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:21.007571  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.997404  6482 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.008545  8445 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:21.009029  8445 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:21.009186  6475 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
W20260812 19:22:20.975135  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 94475.6us
I20260812 19:22:21.011055  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.011847  8358 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.012491  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.013451  8358 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.013705  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:20.980352  8461 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:20.980872  8474 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.994544  8490 raft_consensus.cc:729] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:20.912950  8514 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:20.981659  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:20.948256  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:20.987479  8395 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:20.955596  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.995810  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:20.967090  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:20.970919  8499 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:20.969336  8494 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.021243  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:21.022922  6359 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.023612  8494 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:21.009485  8445 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.014864  8461 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.021301  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.025338  8461 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.029693  8514 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.030975  8514 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.013362  8401 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:20.974995  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.032852  8490 consensus_queue.cc:260] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.034031  6228 raft_consensus.cc:2379] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 2: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:21.034304  8490 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.035131  7603 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.007332  8205 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.016430  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.035692  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:21.017273  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 69094.4us
I20260812 19:22:21.018949  8462 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:21.037477  8462 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.020095  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.020691  8455 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.021230  6464 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.032087  6477 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:20.983758  8340 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:21.035626  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55785.3us
I20260812 19:22:21.042500  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.043170  8516 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.047358  8455 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.047753  8483 consensus_queue.cc:1046] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:22:21.042611  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.043181  8518 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:21.048949  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.049094  8483 raft_consensus.cc:3032] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.049211  8518 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:21.049556  8483 raft_consensus.cc:729] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:21.049744  8518 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.049801  8508 consensus_queue.cc:1046] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:22:21.018996  8484 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.047843  8439 consensus_queue.cc:1046] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:22:21.055792  8439 raft_consensus.cc:3032] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.056064  8455 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.056212  8439 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:21.057338  8439 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.059006  8439 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.053783  8515 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.060364  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.060529  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.062208  8444 raft_consensus.cc:3032] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.044845  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.062639  8444 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:21.063230  8401 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.050511  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.064699  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.065013  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.065827  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.051623  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.066243  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.067065  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.067562  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.068164  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:21.065129  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:21.068096  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.053339  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.052794  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.071669  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.071669  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.063659  8444 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.073220  8340 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:21.073597  8444 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.070361  8483 consensus_queue.cc:260] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.070202  8516 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.072646  8458 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.054291  8460 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260812 19:22:21.077203  8336 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.073643  8340 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:21.074887  8401 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.075467  8474 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.070214  8455 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.075676  8508 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:21.080273  8460 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:21.083269  8460 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:21.083455  6350 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:21.078504  8499 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.075228  8408 consensus_queue.cc:1046] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260812 19:22:21.075307  8484 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.080257  8340 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.088234  8408 raft_consensus.cc:3032] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.088660  8408 raft_consensus.cc:729] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:21.084183  8460 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.082343  8508 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:21.075050  8358 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.090550  8508 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.078683  8483 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.076473  8395 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.075827  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.078070  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.076089  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.095530  8358 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.096975  8494 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:21.097529  8494 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:21.097923  8494 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.099110  8462 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.101235  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.102473  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:21.103439  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.105952  8395 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:21.106776  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:21.106696  8358 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.107797  8455 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.108158  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.108999  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:21.112363  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.107997  8515 consensus_queue.cc:1046] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260812 19:22:21.113608  8509 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:21.113804  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:21.114069  8515 raft_consensus.cc:3032] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.114113  8509 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:21.114583  8515 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:21.114897  8509 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.116998  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.118687  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:21.120193  8489 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:21.120297  6347 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.120744  8489 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:21.121253  8489 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.112144  8455 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.120206  6354 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.122290  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.118688  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.124186  8499 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.124488  6344 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.089783  8408 consensus_queue.cc:260] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.126796  8408 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.122260  8484 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.106938  8205 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.109892  8395 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.120769  8352 consensus_queue.cc:1046] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260812 19:22:21.122435  8460 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:21.130795  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.127911  8515 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.133172  8401 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.135601  8515 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.134822  7606 raft_consensus.cc:1226] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.133761  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:21.129026  8493 consensus_queue.cc:1159] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a1541d11be514114966dc1e92a345298" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260812 19:22:21.139037  8494 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.144539  8455 consensus_queue.cc:1046] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:22:21.145670  8346 raft_consensus.cc:3032] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.107060  8445 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.143530  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.146299  8458 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.129029  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:21.132520  8499 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:21.143625  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.146039  8346 raft_consensus.cc:729] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:21.157130  8462 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.157774  8346 consensus_queue.cc:260] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.155963  8508 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.159761  8346 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.161459  8508 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.161998  6344 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.154748  8499 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.169256  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.173296  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:21.128756  8518 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.178702  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.179471  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:21.155055  8474 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.182780  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.188444  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.181990  8508 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:21.175269  8514 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:21.192584  6228 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.180167  8458 consensus_queue.cc:1046] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260812 19:22:21.196254  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.198900  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.180925  8499 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:21.202698  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.206820  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.166574  8509 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.211514  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.211506  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.189872  8401 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.214039  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.191036  8459 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:21.191241  8508 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:21.195485  8514 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:21.186491  8205 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260812 19:22:21.228674  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:21.229069  6353 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.229671  8205 raft_consensus.cc:3032] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.230891  8518 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.231282  8509 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.190125  8455 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260812 19:22:21.230310  8205 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:22:21.238514  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 50126.2us
I20260812 19:22:21.218554  8459 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:21.225741  8508 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.225237  8514 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.245548  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.191428  8516 consensus_queue.cc:1046] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260812 19:22:21.250384  8494 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.251564  8496 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:21.236522  8461 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:21.252061  8496 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:21.252363  8461 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:21.252578  8496 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.252892  8461 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.247656  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:21.258864  8493 raft_consensus.cc:3032] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.259476  8493 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:21.260607  8493 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.262272  8493 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.262760  8516 raft_consensus.cc:3032] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.263659  8516 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:21.264680  8516 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.266160  8461 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:21.263183  8336 raft_consensus.cc:3032] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.268277  8336 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:21.268409  8461 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.272219  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.266346  8516 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.245750  8459 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.300027  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.297968  8509 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.303011  8453 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.320950  8528 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.318843  8455 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260812 19:22:21.337123  8455 raft_consensus.cc:3032] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.337700  8455 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:22:21.340994  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 212913us
I20260812 19:22:21.303699  8445 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.311184  8458 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.344583  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.350101  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.304580  8336 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:21.360167  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.363404  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.364424  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.365628  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.344558  8458 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:21.347468  8445 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.371393  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.315675  8205 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.375486  8460 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.376698  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.377238  8345 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.379446  8534 ts_tablet_manager.cc:927] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707)
I20260812 19:22:21.375303  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.383440  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.385412  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.385530  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.386863  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.391271  6344 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.392027  8501 consensus_queue.cc:1046] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:22:21.392443  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:21.393303  8453 consensus_queue.cc:1046] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:22:21.393527  8445 raft_consensus.cc:3032] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.393829  8500 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:21.394222  8445 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:21.394572  8453 raft_consensus.cc:3032] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.396622  8453 raft_consensus.cc:729] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:21.396605  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.397784  6232 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:53178
I20260812 19:22:21.398188  8453 consensus_queue.cc:260] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.398977  6232 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:22:21.400249  8460 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.399940  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.400856  6232 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:21.401572  8453 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.399690  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.399801  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.403772  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.394572  8500 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:21.405133  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.399658  6228 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.405632  8500 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.407871  6242 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.401907  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.399581  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.408679  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.410754  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:21.411779  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.414026  8458 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.418934  8346 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:21.419510  8524 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.416922  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.376765  8205 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.423935  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.428476  6236 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.384780  8483 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.418346  8460 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:21.416143  8501 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:21.416276  8462 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.427944  8336 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.436535  8490 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.448552  8532 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.450834  8514 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.453321  8514 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.452986  8489 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.416575  8340 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.466733  8542 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.467415  8542 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:21.461694  8458 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.468959  8542 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.486999  6481 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.368335  8455 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.457094  8340 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.470527  8542 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.398317  8445 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:21.506868  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 62548.1us
I20260812 19:22:21.511965  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.513269  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.515781  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.521505  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.506470  8460 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:21.526580  8559 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.526187  8489 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.490756  8459 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.519901  8496 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.488888  6232 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.558751  6232 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.560138  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:21.561017  6353 raft_consensus.cc:3032] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.561519  6353 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:21.524139  8501 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.558250  8496 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.524840  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.543193  6465 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 2.
I20260812 19:22:21.522933  8518 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.520154  8340 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.523079  8455 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.550011  8508 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.536757  8445 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.555437  8461 raft_consensus.cc:979] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower f4ef77b3328a44e8a21dd902b370e25a to start an election
I20260812 19:22:21.559527  6236 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 3. Ops: []
I20260812 19:22:21.521142  8534 tablet_copy_client.cc:316] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.1:46707
I20260812 19:22:21.573570  6353 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.578101  6353 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:21.570353  8460 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.566900  6475 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:21.569577  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:21.573421  8496 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.582165  8499 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:21.582825  6254 tablet_copy_service.cc:140] P a1541d11be514114966dc1e92a345298: Received BeginTabletCopySession request for tablet 6454eb944afe4306b52388febd0f82bb from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:56292)
I20260812 19:22:21.582938  8499 raft_consensus.cc:686] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:21.583746  6254 tablet_copy_service.cc:161] P a1541d11be514114966dc1e92a345298: Beginning new tablet copy session on tablet 6454eb944afe4306b52388febd0f82bb from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:56292: session id = f4ef77b3328a44e8a21dd902b370e25a-6454eb944afe4306b52388febd0f82bb
I20260812 19:22:21.584460  8542 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:21.584611  8499 consensus_queue.cc:237] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.585129  8542 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.592320  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:21.593286  6344 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:21.573307  8459 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.594988  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:21.571798  8508 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.596917  8458 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:21.597410  8458 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:21.597458  8542 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:21.598091  8458 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:21.599050  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:21.600185  7606 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:21.602978  6236 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224"
dest_uuid: "a1541d11be514114966dc1e92a345298"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:35414
I20260812 19:22:21.603653  6236 raft_consensus.cc:595] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:21.605866  6353 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:21.608503  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:21.611752  8461 raft_consensus.cc:1067] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Signalling peer f4ef77b3328a44e8a21dd902b370e25a to start an election
I20260812 19:22:21.614239  7606 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:60748
I20260812 19:22:21.614933  7606 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:22:21.615365  7606 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.614017  8461 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:21.624183  6060 catalog_manager.cc:5495] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 1 to 2, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 2 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:21.627990  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.630003  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.610311  8551 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:21.641898  8461 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:21.644070  8496 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.644655  8496 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:21.645651  6254 tablet_copy_source_session.cc:205] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:22:21.645700  8496 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.647009  8459 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.647428  8459 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:21.655186  6236 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.658003  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.659785  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.638593  8518 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.667548  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.668834  8496 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.669435  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.648501  8459 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.672313  8459 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.672518  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.639809  8551 raft_consensus.cc:686] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:21.675448  8551 consensus_queue.cc:237] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.640573  8508 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.638818  8501 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260812 19:22:21.680894  8501 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.681392  8501 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:21.684623  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.694069  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.697234  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:22:21.699018  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 267606us
I20260812 19:22:21.700784  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.701819  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:21.703368  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.701895  7606 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.707268  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:21.711061  6353 raft_consensus.cc:3032] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.711396  6353 raft_consensus.cc:729] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:21.712236  6353 consensus_queue.cc:260] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.712070  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.707448  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.714861  6353 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.716266  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:21.716365  7606 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:21.710331  8460 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:21.713937  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:21.705435  8562 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.726737  8345 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.716900  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.728082  6475 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.720108  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.727777  8445 consensus_queue.cc:1046] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:21.730862  8460 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:21.733232  8534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6454eb944afe4306b52388febd0f82bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:22:21.734388  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.736279  8460 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.730886  8508 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.740398  8445 raft_consensus.cc:3032] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.741009  8445 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:21.741066  6475 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 2.
I20260812 19:22:21.742777  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:21.743810  8499 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:21.744627  8499 raft_consensus.cc:686] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:21.682507  8501 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.746059  8501 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.717360  8524 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.745497  6058 catalog_manager.cc:5495] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 2, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:22:21.750771  8518 consensus_queue.cc:1159] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdfa5579d4534c618c00db6b4a841c81" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260812 19:22:21.742486  8445 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.754253  8445 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.756194  8508 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.756728  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.746133  8499 consensus_queue.cc:237] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.750702  6058 catalog_manager.cc:5495] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 2, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:21.757973  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.758744  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.711731  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.761679  8461 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.761758  8524 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.758860  8518 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.763897  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.760890  6353 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 2.
I20260812 19:22:21.768339  8455 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:21.769201  8455 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.773370  8455 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:21.765093  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.774574  8461 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.777050  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.777390  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:21.780189  7603 raft_consensus.cc:2379] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:21.781636  8524 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.783588  8461 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.785431  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.786608  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.789364  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.791510  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.791419  8562 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.791425  8493 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.793566  8488 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.796985  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.798734  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.790903  8524 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.800755  8488 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.802614  8493 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.805863  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.800992  8524 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:21.807623  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.809101  8390 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.809893  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.811057  8390 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.811515  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.806895  8493 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.812572  8493 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.812912  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.815742  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:21.816524  8562 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.814890  8493 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.818614  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:21.804005  8458 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.819739  8493 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:21.823727  6344 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.827991  6359 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.820492  8493 raft_consensus.cc:686] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:21.829885  6354 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.830989  6349 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.830605  8493 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.832029  6350 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.829882  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:21.835165  6347 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.836018  6353 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.841158  6464 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:22:21.842625  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.845009  6232 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:21.845620  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.846586  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.847311  6477 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.846669  8460 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:21.861392  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:21.861621  8458 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:21.867247  6353 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:21.867743  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:21.869187  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:21.869740  7603 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:21.870587  8542 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election won for term 4
W20260812 19:22:21.875524  8570 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.080s	user 0.003s	sys 0.002s
I20260812 19:22:21.876729  6464 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.871469  8542 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:21.879978  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:21.881168  6353 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.896051  6482 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:21.881212  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:21.882491  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.897122  6477 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:21.884495  6344 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:21.896745  8542 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:21.898070  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.815233  8524 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.891390  8345 consensus_queue.cc:1046] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:21.899636  8345 raft_consensus.cc:3032] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.899751  8516 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.900139  8540 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.900738  8516 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:21.900149  8345 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:21.901968  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:21.902222  8516 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.902974  8540 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:21.893239  8488 consensus_queue.cc:1046] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:21.905057  8488 raft_consensus.cc:3032] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.902877  8345 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.903548  8516 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:21.905596  8488 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:21.907421  8516 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.907928  8488 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.909238  8516 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.909740  8488 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.910861  8345 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:21.912391  6482 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:21.917691  8562 consensus_queue.cc:1046] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:21.919415  8408 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:21.919889  8408 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:21.922608  8408 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:21.995312  6475 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:22:21.920841  8562 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260812 19:22:22.003722  6475 raft_consensus.cc:595] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:22.032907  8408 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.035439  6238 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:22.048898  8459 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:22.060787  8524 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:22.014981  8493 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
W20260812 19:22:22.035709  8575 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260812 19:22:22.076294  6475 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:22.081079  6475 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:22.073388  8345 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:22.082682  8445 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260812 19:22:22.091487  8524 raft_consensus.cc:3032] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:22.091936  8524 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:22.092224  8551 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:22.092813  8551 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.094308  8524 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.095137  8460 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:22.095942  8524 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.087595  8345 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:22.131377  6242 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.134526  6344 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260812 19:22:22.137054  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 214694us
I20260812 19:22:22.149263  8493 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:22.147830  8488 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:22.144398  8562 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260812 19:22:22.140548  8551 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.140415  8516 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:22.168018  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:22.175597  7603 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 19:22:22.144914  8390 consensus_queue.cc:1046] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260812 19:22:22.180703  8496 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:22:22.144738  8474 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260812 19:22:22.199709  8493 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.200516  8493 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:22.193971  8577 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.183s	user 0.000s	sys 0.002s
I20260812 19:22:22.167896  8516 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.162973  8345 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.207562  6242 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 19:22:22.201532  8408 raft_consensus.cc:3032] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:22.208171  8488 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:22.202566  8534 tablet_copy_client.cc:791] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:22:22.215276  8408 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:22.213379  8401 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260812 19:22:22.216590  8488 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:22.229480  6353 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:22.230314  6353 raft_consensus.cc:595] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Received request to transfer leadership to TS f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:22.230784  6353 raft_consensus.cc:603] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:22.223433  8345 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.245906  6477 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 19:22:22.241103  8534 tablet_copy_client.cc:655] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:22:22.251736  6353 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:22.254976  6353 raft_consensus.cc:595] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Received request to transfer leadership to TS f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:22.255349  6353 raft_consensus.cc:603] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:22.250195  8499 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260812 19:22:22.269129  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 93957.6us
I20260812 19:22:22.265666  8493 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.292960  6353 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:22.293593  6353 raft_consensus.cc:595] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Received request to transfer leadership to TS f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:22.293907  6353 raft_consensus.cc:603] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:22.265949  8516 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.268884  8600 raft_consensus.cc:3032] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:22.288130  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:22.296355  7606 raft_consensus.cc:2379] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:22.296535  6475 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 19:22:22.249783  8408 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.285950  6054 catalog_manager.cc:5495] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 1 to 2, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260812 19:22:22.332072  8596 consensus_queue.cc:1159] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a1541d11be514114966dc1e92a345298" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260812 19:22:22.295058  8600 raft_consensus.cc:729] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:22.333757  8542 raft_consensus.cc:979] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: : Instructing follower 54f83319db6b49929cc8f18a66a66975 to start an election
I20260812 19:22:22.334499  8474 raft_consensus.cc:1067] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Signalling peer 54f83319db6b49929cc8f18a66a66975 to start an election
I20260812 19:22:22.335017  8586 raft_consensus.cc:3032] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:22.335419  8586 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:22.333827  8600 consensus_queue.cc:260] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.336566  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:22.336287  8586 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.336799  8600 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.300483  8594 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.337848  8586 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.325510  8401 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260812 19:22:22.339869  8390 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:22.329229  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260812 19:22:22.341717  6353 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 19:22:22.345914  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:22.346980  6347 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:22.347745  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:22.349829  6353 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:22.352087  6353 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:45970
I20260812 19:22:22.352807  6353 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:22:22.348551  6242 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:22.353677  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:22.354331  6238 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:22.353843  6342 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:22.355526  6354 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:22.341894  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:22:22.358985  6353 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.325095  8516 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:22.361577  6347 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:22.338236  8594 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:22.371985  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 90229.9us
I20260812 19:22:22.360641  8408 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.391518  8488 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:22.393153  8488 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.394376  8534 tablet_copy_client.cc:531] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:22:22.375945  6353 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.363199  8516 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.374264  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:22.399441  6353 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:22.370714  8608 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.404702  8608 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.406939  8608 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.356727  8401 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260812 19:22:22.410036  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:22.417727  7606 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:22.421392  6417 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:22.408308  8545 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:22.430514  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:22.436688  6242 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:22.425894  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:22.438234  7600 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:22.439684  6417 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:22:22.441586  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 58274.4us
I20260812 19:22:22.442986  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:22.443768  6354 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260812 19:22:22.425422  8619 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.053s	user 0.001s	sys 0.001s
I20260812 19:22:22.448153  7598 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.444940  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:22.437706  8545 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:22.441339  8493 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:22.458592  8586 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:22.459184  6465 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:22.463850  8493 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:22.464051  8586 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:22.446508  8345 consensus_queue.cc:1046] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260812 19:22:22.472550  8493 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:22.463564  8545 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.486017  7603 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:22:22.488550  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:22.489188  7603 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:22.490593  6417 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:22.482322  8586 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:22.471768  8608 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260812 19:22:22.493940  8524 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:22.494313  8524 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:22.495679  8608 raft_consensus.cc:3032] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:22.496130  8608 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:22.497056  8608 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.494608  8524 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:22.469441  8600 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260812 19:22:22.498404  8608 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.504578  6344 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:22:22.505455  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:22.506708  6353 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:22.489562  8594 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.508944  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:22:22.509785  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60987.9us
I20260812 19:22:22.464735  8620 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260812 19:22:22.511178  8455 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:22:22.512979  8602 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.526666  8516 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:22.522342  8458 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:22:22.507556  8345 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260812 19:22:22.528802  8455 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.523162  8488 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:22.529336  8488 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:22.525295  8408 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:22.529942  8408 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:22.530283  8408 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.530174  8488 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.529349  8455 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.530825  8602 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.535483  8455 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.535722  8602 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.537499  7598 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 19:22:22.540498  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:22.550686  6353 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:22.552465  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:22.551587  8589 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.554746  8589 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.556749  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:22.557693  7600 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:22.558892  8589 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.538089  8493 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.525362  8596 raft_consensus.cc:3032] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:22.575124  6481 raft_consensus.cc:2354] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:22.574919  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:22.568352  8629 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.578313  8633 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.583652  8542 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.584133  8493 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.584504  8542 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.586979  8629 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.589000  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:22.589243  8629 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:22.589674  6344 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:22.588369  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:22:22.589831  8629 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:22.578198  8524 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.593405  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:22.554759  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:22.571792  8474 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:22.607398  8501 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.580186  8596 raft_consensus.cc:729] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:22.592535  8609 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:22.623950  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:22.581748  8455 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:22.610553  8458 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:22.622262  6464 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 19:22:22.634106  8596 consensus_queue.cc:260] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.604823  8633 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.624658  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:22.610244  8474 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:22.630928  8461 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.590579  8629 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.658907  8455 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.676797  8629 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:22.617801  8501 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.681936  8488 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.604969  8542 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:22.606259  8620 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260812 19:22:22.635213  6224 raft_consensus.cc:3032] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:22.638907  8596 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.638491  8524 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.625854  8609 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:22.671813  8205 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.689582  6224 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:22.691296  8205 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:22.611020  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 71166.9us
I20260812 19:22:22.693445  8205 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:22.671950  6465 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.672202  8474 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:22.686230  8633 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.683544  8445 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260812 19:22:22.673278  8461 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.699922  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:22.701400  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:22.700932  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:22.702680  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:22.711001  6236 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:22.711177  6347 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:22.694384  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:22.711905  6344 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:22.715216  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:22.711349  6482 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:22.659860  8458 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:22.691992  6224 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.719451  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:22.727491  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:22.728294  6230 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:22.730921  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:22.735512  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:22.735924  6416 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:22.683207  8501 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.718240  8633 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.747649  8205 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:22.748071  8205 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:22.748526  8205 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:22.729467  8458 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:22.709932  8408 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.738555  8459 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:22.682555  8586 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.743184  8496 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:22.778004  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:22.738245  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:22.744750  8345 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:22.812834  8345 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:22.813489  8345 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:22.815138  6342 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:22.816412  6224 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:22.776201  8501 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.816517  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:22.818321  8534 tablet_bootstrap.cc:492] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:22:22.817057  8501 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.777141  8205 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.766553  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:22.766782  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:22.781348  8459 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:22:22.809248  8575 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260812 19:22:22.797755  8573 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260812 19:22:22.794993  8496 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:22.837858  8622 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:22.837266  8501 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.858258  6224 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:22.767719  8633 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.862040  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:22.863049  6241 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:22.851557  8622 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:22.866783  8622 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:22.830566  8540 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.881238  8540 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.833220  8205 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:22.883553  8461 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.885403  8345 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.888662  8345 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.888993  8408 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:22.840969  6229 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:22.911501  8622 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.847965  6473 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:22.855527  8455 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:22.879535  8586 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.892875  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:22.922334  6344 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:22.841655  8459 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:22.839392  8609 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:22.894272  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:22.833022  6055 catalog_manager.cc:5495] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 1 to 3, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 3 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:22.897706  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:22.897832  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:22.900174  8633 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:22.885244  6465 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:22.859253  8401 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.939900  6464 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:22.852072  8496 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:22.931794  6055 catalog_manager.cc:5495] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 3 to 4, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 4 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:22.942191  6241 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:22.942325  6342 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:22.870472  8501 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:22.940208  8401 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.928741  8545 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.988824  6224 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:22.990579  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:22.996810  8408 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:22.997603  8408 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:22.948534  8540 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:23.013557  8545 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:23.014817  6229 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:23.016438  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:23.017195  8589 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:23.017992  8589 raft_consensus.cc:686] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:23.019402  8589 consensus_queue.cc:237] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:23.022157  8509 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.022917  8509 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.025676  8509 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.036507  8401 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:22.998435  8614 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.039057  8614 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.041591  8496 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:22.983902  8501 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.051378  8501 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.053129  6241 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:23.054837  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:23.056099  8606 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:23.056809  8606 raft_consensus.cc:686] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:23.057180  8408 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.037848  8401 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.058164  8606 consensus_queue.cc:237] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:23.017484  6342 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:23.079113  8614 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.065032  8609 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:23.099695  6416 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:23.105520  8474 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:23.076097  8401 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:23.050474  8458 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.094370  8540 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.119163  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:23.109208  8620 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:23.113727  8622 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:23.125831  6342 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:23.134442  8474 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:23.148399  7606 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.021s	sys 0.024s
W20260812 19:22:23.150923  7606 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.022s	sys 0.024s
W20260812 19:22:23.151381  6475 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.026s	sys 0.032s
I20260812 19:22:23.133095  8620 raft_consensus.cc:686] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:22:23.151643  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.005s	sys 0.022s
W20260812 19:22:23.153744  6475 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.026s	sys 0.032s
W20260812 19:22:23.154486  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.005s	sys 0.022s
W20260812 19:22:23.158118  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 575815us
W20260812 19:22:23.166492  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 313098us
I20260812 19:22:23.123844  8540 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:23.147058  8496 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:23.171131  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:23.179261  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:23.188102  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:23.157347  7554 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.014s	sys 0.068s
W20260812 19:22:23.204493  6238 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.015s	sys 0.014s
I20260812 19:22:23.208688  6473 raft_consensus.cc:2379] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 2: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:23.208720  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:23.211390  6238 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.016s	sys 0.014s
I20260812 19:22:23.214689  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:23.215304  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:23.211621  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:23.215518  6224 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:23.215968  6228 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
W20260812 19:22:23.212385  6354 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.016s	sys 0.047s
W20260812 19:22:23.216935  6354 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.017s	sys 0.047s
W20260812 19:22:23.211915  7554 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.014s	sys 0.069s
I20260812 19:22:23.154201  8640 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.219185  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:23.219293  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:23.222453  8496 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:23.224210  6242 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.015s	sys 0.026s
W20260812 19:22:23.224824  8629 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.009s	sys 0.029s
I20260812 19:22:23.225481  8641 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:23.229149  8622 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:23.181509  8586 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:23.212918  6483 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.004s	sys 0.033s
W20260812 19:22:23.235004  8582 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.020s	sys 0.015s
I20260812 19:22:23.244544  6241 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:23.244676  6470 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
W20260812 19:22:23.469827  8629 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.019s	sys 0.048s
I20260812 19:22:23.453003  8524 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.264118  8640 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:23.297638  8496 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.276962  8665 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:23.454890  8589 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:23.455094  8614 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.213965  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:23.455994  8545 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.455502  8458 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.456547  8633 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:23.404965  8663 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260812 19:22:23.248839  6242 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.015s	sys 0.026s
I20260812 19:22:23.457283  8551 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.457223  8516 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:23.297812  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:23.297147  6353 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.008s	sys 0.050s
W20260812 19:22:23.538369  6353 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.009s	sys 0.050s
W20260812 19:22:23.399147  6296 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.017s	sys 0.024s
W20260812 19:22:23.539319  6296 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.017s	sys 0.024s
I20260812 19:22:23.454504  8408 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:22:23.450815  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.017s	sys 0.027s
I20260812 19:22:23.451996  8460 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.460248  8608 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:23.461107  8660 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:23.461725  8659 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:23.168398  8459 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:23.463869  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:23.469485  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:23.552372  7603 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
W20260812 19:22:23.473100  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 148425us
I20260812 19:22:23.471791  6228 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:23.463177  8661 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:23.259246  8620 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:23.497872  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:23.498556  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:23.556509  6230 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:23.467192  8509 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.463150  8401 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:23.479209  6483 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.004s	sys 0.033s
W20260812 19:22:23.496917  8582 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.020s	sys 0.016s
I20260812 19:22:23.507817  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:23.507941  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:23.509356  8640 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:23.509963  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:23.554806  8445 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.475764  8648 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:23.513356  8493 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.513598  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:23.510839  8664 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.511245  8499 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.530407  6229 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
W20260812 19:22:23.540565  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.017s	sys 0.031s
W20260812 19:22:23.621022  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 906325us
I20260812 19:22:23.495514  8586 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.495406  8622 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.526564  8665 raft_consensus.cc:686] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:23.555672  6238 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 1.
I20260812 19:22:23.496999  8641 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:23.558398  8659 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.513082  8524 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.538633  8670 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.537945  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:23.525710  8614 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.587152  7600 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:23.552373  8615 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.588382  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:23.524564  8589 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.467783  8542 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:23.533946  8633 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.612272  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:23.541751  8551 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.531931  8545 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
W20260812 19:22:23.616029  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 61076.3us
I20260812 19:22:23.560489  8540 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:23.555387  6232 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:23.672396  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:23.566144  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:23.547391  8516 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.546962  8408 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.555083  8460 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.558499  8608 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.623400  8499 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:23.613658  8648 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:23.611932  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:23.700462  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 78611.5us
I20260812 19:22:23.564016  8509 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.647539  6474 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:23.646401  7594 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:23.628427  8664 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.702867  6178 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:23.648831  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:23.620888  7598 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
W20260812 19:22:23.655400  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 88849us
I20260812 19:22:23.560297  8661 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.710762  8661 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.609777  8445 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.713196  8445 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.662514  6241 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 2.
I20260812 19:22:23.647507  8496 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.663302  8542 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.663905  6230 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 2.
W20260812 19:22:23.664476  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 96762.2us
I20260812 19:22:23.695250  7591 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:23.616324  8493 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:23.718859  6347 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:23.718935  8459 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:23.719163  8661 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:23.686364  7600 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:23.534157  8458 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:22:23.672680  8609 consensus_meta.cc:287] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.577s	user 0.015s	sys 0.001s
W20260812 19:22:23.671605  6342 consensus_meta.cc:287] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.529s	user 0.016s	sys 0.000s
I20260812 19:22:23.627781  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:22:23.735626  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 107931us
I20260812 19:22:23.737206  6298 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:23.696857  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:23.684697  8640 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.696437  8596 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.565004  8660 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.722252  6179 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:23.724546  8705 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260812 19:22:23.724957  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:23.725386  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:23.725878  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:23.726207  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:23.726521  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:23.728861  8622 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:23.738080  6298 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:23.739328  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:23.706583  8680 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.735373  8614 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.744859  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:23.723327  7597 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:23.750563  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:23.751499  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:23.769155  6353 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:23.769380  7600 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:23.745882  8445 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.743232  8496 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:23.742870  8459 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:23.740733  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:23.793992  6230 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 2: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:22:23.760571  8686 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260812 19:22:23.760685  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:23.761559  7603 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:23.803565  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:23.804152  7603 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:23.745390  8629 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:23.804744  8629 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:23.805143  8629 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:23.707800  6473 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 1.
I20260812 19:22:23.647163  8670 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:23.771895  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:22:23.772825  8645 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.243s	user 0.000s	sys 0.002s
I20260812 19:22:23.735245  6342 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:23.809243  6241 raft_consensus.cc:2379] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 2: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:23.662717  8615 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.757938  7607 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:23.815276  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:23.816131  6241 raft_consensus.cc:2354] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:23.804216  6349 raft_consensus.cc:2354] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 2. Current term is 3.
I20260812 19:22:23.716956  8665 consensus_queue.cc:237] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.754314  8609 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260812 19:22:23.812599  8509 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.761860  6350 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 2.
I20260812 19:22:23.792326  8496 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:23.792160  8445 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:23.811970  6179 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:23.831353  6416 leader_election.cc:398] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:23.813237  8633 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.738209  8458 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.746779  8640 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:23.790048  8614 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:23.749212  8596 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.813031  8659 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:23.808465  8667 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260812 19:22:23.792686  8459 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:23.801771  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:22:23.818267  8674 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260812 19:22:23.823693  8677 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:23.839084  8551 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.789330  8542 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.824527  7606 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:23.760360  8680 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.829677  8691 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:23.830557  8687 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:23.831688  6416 leader_election.cc:401] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:22:23.831707  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:23.808558  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:23.836189  8707 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.812007  8524 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:23.835477  8589 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:23.815497  8690 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.840214  8615 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.823746  8516 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.831108  8496 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:23.817819  8693 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.832798  8586 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:23.863158  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1046) took 1263 ms. Trace:
I20260812 19:22:23.837431  8408 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:23.825207  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:23.839114  8614 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:23.882113  7603 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:23.892676  8688 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.845403  8705 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260812 19:22:23.921924  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 104334us
I20260812 19:22:23.841126  8545 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.841238  8460 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.853822  8622 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.881932  7598 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:23.891185  7599 raft_consensus.cc:2379] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:23.840588  8641 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.856000  8499 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:23.854302  8459 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:23.883939  8648 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.890583  8677 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:23.910492  8493 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:23.983973  8680 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:23.965083  8408 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:23.919621  8614 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
W20260812 19:22:24.004724  8683 log.cc:924] Time spent T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260812 19:22:23.984880  8660 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:23.916348  8698 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:23.930729  8705 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:23.983801  8596 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:23.916633  8724 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:23.976229  8586 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:23.983076  8622 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:23.929188  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 224922us
I20260812 19:22:23.927469  6228 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:24.052397  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.130481  6230 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:23.903735  6232 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:23.902419  6241 raft_consensus.cc:2354] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
W20260812 19:22:23.882441  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 124498us
I20260812 19:22:23.983680  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.136972  6349 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:23.972321  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:23.926139  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.058632  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1266) took 1425 ms. Trace:
I20260812 19:22:23.917189  6354 rpcz_store.cc:276] 0812 19:22:22.588198 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:22.590756 (+  2558us) service_pool.cc:227] Handling call
0812 19:22:22.591224 (+   468us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:22.591610 (+   386us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:22.591642 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:22.592216 (+   574us) log.cc:842] Serialized 26 byte log entry
0812 19:22:23.217640 (+625424us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:23.217713 (+    73us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:23.219704 (+  1991us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:23.772012 (+552308us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:22:23.845593 (+ 73581us) raft_consensus.cc:1671] finished
0812 19:22:23.845613 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:23.851613 (+  6000us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":124,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":218,"spinlock_wait_cycles":5296000,"thread_start_us":624874,"threads_started":1,"wal-append.queue_time_us":878375}
I20260812 19:22:24.139484  6347 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.060153  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:23.909250  7594 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:23.992524  7600 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:24.080379  8345 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:24.080796  8445 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.148757  8345 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.982813  8664 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.006408  8670 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.001451  8677 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:24.141237  6342 raft_consensus.cc:2379] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.151831  7606 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:23.985239  8688 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.920680  8690 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.909010  8691 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.007337  8698 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:23.990604  8699 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:24.011369  8705 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:23.912160  8707 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.088847  8586 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.016353  8640 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.089946  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:24.093668  8608 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.096674  7591 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:24.100863  8589 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:24.102703  8474 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.008s	sys 0.004s
W20260812 19:22:24.021854  8709 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260812 19:22:24.178095  8633 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:24.166074  8699 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.178969  8633 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:23.932278  8693 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.018990  8724 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.113343  8665 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:24.100385  8648 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:24.103693  8660 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:24.104945  8695 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:24.115300  8596 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:24.116397  8728 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:24.120970  8620 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:24.121254  8499 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:24.122092  8680 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:24.201594  8680 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.203629  8499 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.205034  8680 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.123993  8692 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:24.135623  8718 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:24.179504  8589 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:24.206782  6179 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:24.138815  6483 rpcz_store.cc:276] 0812 19:22:22.632580 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:22.632718 (+   138us) service_pool.cc:227] Handling call
0812 19:22:22.633264 (+   546us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:22.633552 (+   288us) raft_consensus.cc:1520] Early marking committed up to index 2
0812 19:22:23.593599 (+960047us) log.cc:842] Serialized 14 byte log entry
0812 19:22:24.057078 (+463479us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:24.057283 (+   205us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:24.057530 (+   247us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:24.057745 (+   215us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:24.058182 (+   437us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":594366,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":99,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5665,"thread_start_us":1302948,"threads_started":2,"wal-append.queue_time_us":417558}
I20260812 19:22:24.206941  8648 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.004302  8458 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.208987  8589 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.209318  8458 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:24.209867  8648 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.210044  8458 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:24.210676  8660 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:24.211917  8345 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.211594  8458 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.212196  8496 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.213374  8660 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.214148  6359 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.214457  8665 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.215611  8408 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:24.100417  8493 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:24.176215  8690 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.163759  8698 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.169512  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:24.177798  8474 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.008s	sys 0.004s
I20260812 19:22:24.177970  8586 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.179194  7603 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.170740  8687 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.184584  8633 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.170970  8524 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:24.187793  8724 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.188720  6353 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:24.166270  8459 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.179174  8691 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:24.158874  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 418471us
W20260812 19:22:24.207806  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 52435.9us
I20260812 19:22:24.189687  8695 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.198324  8728 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.206120  8692 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.227941  8499 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.232470  8687 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.220661  8493 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.248535  8493 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.232470  8524 raft_consensus.cc:686] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:22:24.253669  6417 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.667s (SENT) [suppressed 20 similar messages]
I20260812 19:22:24.236007  8661 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:24.249416  8408 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:24.251292  8693 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.251387  8688 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:24.244853  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 200004us
I20260812 19:22:24.253710  8524 consensus_queue.cc:237] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.258313  8728 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.203146  8620 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.234876  8609 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:24.207168  8718 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.244258  8596 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.255106  8345 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:24.274364  7603 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:24.268177  8633 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:24.263717  8699 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.287266  8633 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.289458  8633 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.290128  8661 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.291693  8692 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.292533  8661 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:24.290795  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 140419us
I20260812 19:22:24.293632  7598 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
W20260812 19:22:24.279770  8736 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.171s	user 0.002s	sys 0.000s
I20260812 19:22:24.287604  6178 leader_election.cc:398] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:24.269398  8695 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.271908  8690 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:24.270840  8609 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.299249  6178 leader_election.cc:401] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:22:24.283547  8496 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:24.282814  8665 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:24.299090  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 45629.6us
I20260812 19:22:24.306738  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.307108  8614 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.308091  6241 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:24.319104  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:24.320679  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.321854  6241 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
W20260812 19:22:24.323477  8629 consensus_meta.cc:287] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.518s	user 0.012s	sys 0.007s
I20260812 19:22:24.323984  8629 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.324684  6055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 188) took 1992 ms. Trace:
I20260812 19:22:24.333660  8622 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.325129  8493 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:24.327543  6232 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:24.327913  6241 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:24.328348  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.329177  8606 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:24.344233  6230 raft_consensus.cc:2396] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:24.344220  8606 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.346010  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:24.347434  8606 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.347541  8688 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:24.330183  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.330475  8620 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.330595  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.332261  8609 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.332504  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.311307  8345 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.331720  6054 catalog_manager.cc:5495] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 1 to 2, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 2 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:24.340057  8690 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.340379  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.340508  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:24.353983  7607 consensus_meta.cc:287] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.011s
I20260812 19:22:24.341135  8692 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:24.341238  8493 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.343439  8665 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:24.349933  6353 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:24.355192  8665 raft_consensus.cc:686] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:24.355051  8692 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.338639  8459 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.311163  8614 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:24.360213  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.361186  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.361855  6345 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:24.362001  6354 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:24.348011  8688 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.362888  8688 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.363009  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.348678  8629 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.349920  6359 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:24.350785  6229 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:24.302532  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:24.354544  7607 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:24.357657  6342 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.357614  8665 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.358892  8609 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:24.359303  8692 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.359450  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.359421  8493 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.300028  8408 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.364400  8620 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:24.361250  8707 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.364949  8606 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:24.333384  6055 rpcz_store.cc:276] 0812 19:22:22.332332 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:22.332838 (+   506us) service_pool.cc:227] Handling call
0812 19:22:22.488791 (+155953us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400002dd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fdaf0 00007f98f7780f2a 00007f98fd6d2d6c 00007f98fd7ccc3e 00007f98fbadefb4 00007f98fbadef42 00007f98fbadee71 00007f98fbadedec 00007f98fbade0a2 00007f98f5bae94c 00007f98f5badd86
0812 19:22:24.324391 (+1835600us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:22:22.998476 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:22:23.023588 (+ 25112us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:22:23.023647 (+    59us) write_op.cc:435] Acquired schema lock
0812 19:22:23.023676 (+    29us) tablet.cc:660] Decoding operations
0812 19:22:23.024259 (+   583us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:22:23.024352 (+    93us) write_op.cc:641] Partition lock acquired for write op
0812 19:22:23.024404 (+    52us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:22:23.024914 (+   510us) tablet.cc:699] Row locks acquired
0812 19:22:23.024935 (+    21us) write_op.cc:260] PREPARE: finished
0812 19:22:23.025150 (+   215us) write_op.cc:270] Start()
0812 19:22:23.025305 (+   155us) write_op.cc:276] Timestamp: P: 1786562543025091 usec, L: 0
0812 19:22:23.025329 (+    24us) op_driver.cc:331] REPLICATION: starting
0812 19:22:23.660352 (+635023us) log.cc:842] Serialized 911 byte log entry
0812 19:22:23.828086 (+167734us) op_driver.cc:444] REPLICATION: finished
0812 19:22:24.024970 (+196884us) write_op.cc:301] APPLY: starting
0812 19:22:24.126104 (+101134us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b5400002dd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7774198 00007f98fb187ade 00007f98fb1872b8 00007f98fb18bba1 00007f98fb18bb59 00007f98fb18bae9 00007f98fb18bab1 00007f98fb18adad 00007f98fdab4204 00007f98fdab4039
0812 19:22:24.160052 (+ 33948us) tablet.cc:1365] starting BulkCheckPresence
0812 19:22:24.162192 (+  2140us) tablet.cc:1368] finished BulkCheckPresence
0812 19:22:24.162248 (+    56us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:22:24.220096 (+ 57848us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:22:24.249458 (+ 29362us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:22:24.251474 (+  2016us) write_op.cc:312] APPLY: finished
0812 19:22:24.252623 (+  1149us) log.cc:842] Serialized 28 byte log entry
0812 19:22:24.254430 (+  1807us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:24.261098 (+  6668us) write_op.cc:454] Released schema lock
0812 19:22:24.261167 (+    69us) write_op.cc:341] FINISH: Updating metrics
0812 19:22:24.274975 (+ 13808us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:24.276276 (+  1301us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":265101568,"child_traces":[["op",{"apply.queue_time_us":191247,"apply.run_cpu_time_us":5534,"apply.run_wall_time_us":269989,"num_ops":2,"prepare.queue_time_us":764,"prepare.run_cpu_time_us":13695,"prepare.run_wall_time_us":1137627,"replication_time_us":796120,"spinlock_wait_cycles":1332130048,"thread_start_us":263727,"threads_started":1}]]}
I20260812 19:22:24.365345  6353 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:24.366004  6054 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 1 to 2, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:24.367084  8690 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.350245  8718 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.367854  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:24.368371  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 205128us
I20260812 19:22:24.324007  8596 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.367874  8534 tablet_bootstrap.cc:492] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 19:22:24.348526  8458 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:24.401715  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.425315  6238 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:24.368516  8345 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.401799  6347 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:24.406205  6354 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:24.406894  8620 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.427184  8534 tablet_bootstrap.cc:492] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:22:24.409448  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.428035  6474 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:24.406558  8586 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260812 19:22:24.429145  8620 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.430222  8629 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:24.430696  8629 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.431072  8629 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.434118  8534 ts_tablet_manager.cc:1397] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 1.616s	user 0.059s	sys 0.043s
I20260812 19:22:24.413146  8606 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.436183  6054 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 103) took 1139 ms. Trace:
I20260812 19:22:24.436312  8606 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.381038  8705 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.414841  8690 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:24.370160  8622 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:24.440554  8622 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.441385  8705 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:24.400527  8609 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.444478  8609 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.444779  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:24.445914  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:24.445886  8690 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.447487  7598 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.449219  8690 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.449846  8690 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:24.450214  8690 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:24.450634  8690 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:24.451520  8622 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.421563  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:24.421957  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 138620us
I20260812 19:22:24.399741  8688 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.423676  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.452418  6464 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:24.452741  6465 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:24.453753  8688 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.454831  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:24.457510  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.458376  6354 raft_consensus.cc:2354] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 2. Current term is 3.
I20260812 19:22:24.413901  8687 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.459512  8690 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.460582  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.409448  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:24.405063  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:24.461783  6470 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.460667  7598 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
W20260812 19:22:24.461985  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 62226.9us
I20260812 19:22:24.462788  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:24.462934  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.463923  6241 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 2: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:24.436669  6054 rpcz_store.cc:276] 0812 19:22:23.464150 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:23.464735 (+   585us) service_pool.cc:227] Handling call
0812 19:22:23.629744 (+165009us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400002dd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fdaf0 00007f98f7780f2a 00007f98fd6d2d6c 00007f98fd7ccc3e 00007f98fbadefb4 00007f98fbadef42 00007f98fbadee71 00007f98fbadedec 00007f98fbade0a2 00007f98f5bae94c 00007f98f5badd86
0812 19:22:24.436084 (+806340us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:22:24.410722 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:22:24.413207 (+  2485us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:22:24.413260 (+    53us) write_op.cc:435] Acquired schema lock
0812 19:22:24.413279 (+    19us) tablet.cc:660] Decoding operations
0812 19:22:24.413791 (+   512us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:22:24.413902 (+   111us) write_op.cc:641] Partition lock acquired for write op
0812 19:22:24.413945 (+    43us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:22:24.414378 (+   433us) tablet.cc:699] Row locks acquired
0812 19:22:24.414414 (+    36us) write_op.cc:260] PREPARE: finished
0812 19:22:24.414574 (+   160us) write_op.cc:270] Start()
0812 19:22:24.414756 (+   182us) write_op.cc:276] Timestamp: P: 1786562544414507 usec, L: 0
0812 19:22:24.414772 (+    16us) op_driver.cc:331] REPLICATION: starting
0812 19:22:24.415496 (+   724us) log.cc:842] Serialized 906 byte log entry
0812 19:22:24.417779 (+  2283us) op_driver.cc:444] REPLICATION: finished
0812 19:22:24.418389 (+   610us) write_op.cc:301] APPLY: starting
0812 19:22:24.418468 (+    79us) tablet.cc:1365] starting BulkCheckPresence
0812 19:22:24.418593 (+   125us) tablet.cc:1368] finished BulkCheckPresence
0812 19:22:24.418724 (+   131us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:22:24.419156 (+   432us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:22:24.419321 (+   165us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:22:24.419373 (+    52us) write_op.cc:312] APPLY: finished
0812 19:22:24.419576 (+   203us) log.cc:842] Serialized 28 byte log entry
0812 19:22:24.419736 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:24.419839 (+   103us) write_op.cc:454] Released schema lock
0812 19:22:24.419875 (+    36us) write_op.cc:341] FINISH: Updating metrics
0812 19:22:24.420161 (+   286us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:24.420191 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":298295040,"child_traces":[["op",{"apply.queue_time_us":359,"apply.run_cpu_time_us":2054,"apply.run_wall_time_us":2054,"num_ops":2,"prepare.queue_time_us":251,"prepare.run_cpu_time_us":3514,"prepare.run_wall_time_us":10028,"replication_time_us":2899}]]}
I20260812 19:22:24.424007  8408 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:24.467463  6179 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:24.465350  6238 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 2.
I20260812 19:22:24.463946  6416 leader_election.cc:398] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:24.471410  6416 leader_election.cc:401] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:22:24.379066  8698 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.464659  8609 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:24.467199  8699 raft_consensus.cc:2741] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260812 19:22:24.461791  8687 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:24.477371  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:24.477581  8408 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.477936  8609 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.482430  8606 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:24.485391  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.492019  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.491881  8606 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.490383  8609 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.479887  8690 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.492211  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.459563  8677 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.481175  8695 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:24.477176  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.479569  8622 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:24.494256  6470 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:24.498401  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.500972  8606 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.501184  8586 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:24.501853  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.495729  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.503153  6238 raft_consensus.cc:2379] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.504367  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.505293  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:24.483687  8629 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.507853  6241 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 2.
I20260812 19:22:24.522022  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.522984  8698 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:24.501906  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.524411  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.525031  6232 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:24.525143  6224 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:24.522863  6474 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:24.522717  6347 raft_consensus.cc:2379] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.527992  6354 raft_consensus.cc:2354] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 2. Current term is 3.
I20260812 19:22:24.523877  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.528987  6470 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:24.523411  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.506479  8622 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.533996  8622 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.529572  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.536679  6298 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:24.536891  6473 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:24.531373  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.538971  6228 raft_consensus.cc:2396] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:24.520082  6229 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:24.541824  8620 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:22:24.542894  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.543777  6230 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:24.544790  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.545636  6473 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:24.522111  8633 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.538127  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:24.548487  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.548875  8633 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.549226  8620 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:24.549461  6347 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.549643  8596 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:22:24.542395  8345 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260812 19:22:24.531929  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.552659  6242 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:24.553891  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:24.520289  8695 raft_consensus.cc:686] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:24.554591  6354 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.555524  8695 consensus_queue.cc:237] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.556725  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:24.557374  6359 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.557260  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:24.558140  7599 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:24.532771  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.533452  8629 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.532076  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.562027  8408 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:24.549614  8620 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.566937  8620 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.567639  6354 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:24.570514  8622 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.571211  8687 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:24.572688  8687 raft_consensus.cc:686] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:24.574708  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:24.575507  6238 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.574803  8687 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.576171  8622 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.579448  8606 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:24.580029  8606 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.580487  8606 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.584316  6417 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:24.586934  8408 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:24.588917  8408 raft_consensus.cc:686] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:24.590379  8408 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.548965  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:24.592159  8596 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:24.592563  8596 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.592957  8596 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.593494  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:24.598003  8345 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:24.598423  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.598882  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.598462  8345 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:24.599903  8345 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:24.601920  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.605602  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:24.606972  6342 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.552677  8534 raft_consensus.cc:348] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.522181  8586 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.611228  8586 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.623754  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.626432  6230 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:24.627720  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.628074  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.628651  6349 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.628722  6242 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:24.632654  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.637576  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.638785  6345 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.636828  6359 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:24.632835  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.641553  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.638692  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:24.644140  6353 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:24.644196  6347 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.647256  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.647929  6342 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:24.648207  6349 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.648330  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:24.647286  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.649197  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.649860  8699 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:24.649221  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.650949  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.651448  6242 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:24.649502  6350 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.652523  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:24.662482  6347 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:24.663113  7553 leader_election.cc:398] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 2. Current term is 3.
I20260812 19:22:24.663475  7553 leader_election.cc:401] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:22:24.664706  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:24.665843  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.666914  6353 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:22:24.667371  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 83168.8us
I20260812 19:22:24.670506  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.672361  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.673275  6230 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:24.676034  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.676062  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.676879  6354 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.677366  6238 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 3.
I20260812 19:22:24.678534  6347 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.679452  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.665793  8608 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:24.681455  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.682476  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.684177  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.687171  6474 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:24.671480  8534 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:22:24.688455  7553 leader_election.cc:398] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 2. Current term is 3.
I20260812 19:22:24.689005  7553 leader_election.cc:401] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:22:24.688413  8534 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:24.676018  8524 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:24.687376  8677 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.690838  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:24.649868  8596 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:24.692502  6353 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.693893  6238 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:24.694548  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.694914  8629 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 2. Current term is 3.
I20260812 19:22:24.695042  8735 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:24.693136  8499 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 2. Current term is 3.
I20260812 19:22:24.684001  8608 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.708760  8735 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.703284  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.696496  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.709277  8608 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.710822  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:24.710307  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:24.715356  6242 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:24.705941  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.707192  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.712934  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:24.715976  6483 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:24.715929  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:24.698593  8524 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:24.717083  8524 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:24.698203  8458 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:24.717916  6238 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.715330  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.718911  6354 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.717906  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.722884  8516 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:24.723078  8677 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:24.723160  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.723479  8516 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.724078  6349 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:24.725373  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.725878  8516 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.726311  6342 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:24.727046  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.728492  6345 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:24.717959  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.717301  6350 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:24.712231  8680 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:24.724551  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.730365  6474 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:24.727713  6344 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
W20260812 19:22:24.733546  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 45284.8us
I20260812 19:22:24.711088  6473 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:24.737826  7553 leader_election.cc:398] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 2. Current term is 3.
I20260812 19:22:24.738131  7553 leader_election.cc:401] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:22:24.739341  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:24.735759  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.723505  8677 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:24.741022  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:24.742872  6242 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.738302  6230 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:24.745375  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.746166  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:24.742291  8677 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:24.735514  8724 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:24.753747  8687 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:24.754134  8596 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.754238  8687 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.754853  8724 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.737277  8458 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.755229  8724 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.753630  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:24.755463  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.762604  8458 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.739357  6465 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:24.763113  6352 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:24.758265  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.751102  8691 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:24.744565  8474 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:24.764171  6473 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:24.756215  6228 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:24.764186  8691 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.764657  8474 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.765259  8687 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.765388  8691 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.742457  8499 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 2. Current term is 3.
I20260812 19:22:24.767622  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.763190  8676 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:24.769191  8676 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.769289  7599 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:24.770298  8534 ts_tablet_manager.cc:1428] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.295s	user 0.005s	sys 0.005s
I20260812 19:22:24.771539  8735 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.772166  8660 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:22:24.750898  6058 catalog_manager.cc:5495] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 2, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:24.775121  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:24.780308  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.776096  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:24.755352  8345 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.775497  6058 catalog_manager.cc:5495] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 2, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:22:24.784039  8676 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.785817  8596 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:24.786441  8596 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.786032  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.787885  6229 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:24.788929  8596 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:24.789148  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:24.789361  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:24.790118  6465 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.790512  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.791230  8735 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:24.790759  8661 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:24.791754  8735 raft_consensus.cc:686] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:24.792755  8735 consensus_queue.cc:237] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.785974  8474 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.791767  8661 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.795220  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:24.795337  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:24.795296  8661 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.796613  8606 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.797456  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:24.798307  7607 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:24.798592  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.789970  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.788980  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.796060  6474 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
W20260812 19:22:24.806480  8760 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260812 19:22:24.790390  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:24.732805  8609 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.852917  8633 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:24.807408  8620 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.776317  8660 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:24.856017  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.855460  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.828521  6058 catalog_manager.cc:5495] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:24.850878  8606 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.856657  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.856505  6470 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:22:24.876976  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 86682us
I20260812 19:22:24.795208  8345 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.858852  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.859654  6242 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:24.859601  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.879838  8633 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.881181  8620 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.881737  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.860502  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.860855  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.882779  6241 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:24.882972  6230 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:24.881183  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.883721  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.883908  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.884320  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.884575  6230 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:24.885138  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.885543  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.885792  6241 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:24.886147  6230 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:24.861297  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.886351  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:24.863729  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:24.864049  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:24.864418  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.867693  6238 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:24.854475  8586 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.875507  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:24.879220  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.883440  7603 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:24.862277  8676 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:24.876353  6344 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:24.877893  6224 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:24.861101  8524 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.886163  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:24.882427  8633 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:24.882462  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:24.908617  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:24.905170  6473 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:24.876760  8660 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:24.872867  8724 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.871083  8608 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:24.883972  6232 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
W20260812 19:22:24.943405  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 79458.9us
W20260812 19:22:25.065596  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 163081us
I20260812 19:22:25.067574  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:25.006678  7606 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:24.945912  6238 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.078135  6345 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:24.919026  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:24.986605  6464 raft_consensus.cc:2379] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:25.007731  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:25.096495  6342 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:24.972325  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:25.098177  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:24.907332  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:25.099473  8680 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:24.909427  6229 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:24.968434  8688 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:25.107372  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.108184  6483 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:25.107678  8688 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:25.109330  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:25.074596  8660 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.090955  8516 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:25.110232  6342 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:25.110301  8516 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:25.112972  8516 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:25.115178  6254 tablet_copy_service.cc:342] P a1541d11be514114966dc1e92a345298: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-6454eb944afe4306b52388febd0f82bb received from {username='slave'} at 127.0.0.1:56292
I20260812 19:22:25.091774  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:25.092288  6465 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:24.922461  8676 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:24.998620  8687 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:25.098380  6475 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.102881  7594 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:24.943894  7607 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.103228  8661 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:25.121848  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:25.122550  8661 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:25.106029  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:25.106206  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:25.123428  6228 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 3: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:24.973177  7598 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:25.090865  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:25.087710  8609 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:25.125303  6347 raft_consensus.cc:2379] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:25.115734  6254 tablet_copy_service.cc:433] P a1541d11be514114966dc1e92a345298: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-6454eb944afe4306b52388febd0f82bb on tablet 6454eb944afe4306b52388febd0f82bb with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:25.129529  8690 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:22:25.133735  7607 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:25.134740  8606 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:25.135293  6353 raft_consensus.cc:2354] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:25.109493  8688 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
W20260812 19:22:25.119052  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 43569.8us
I20260812 19:22:25.120781  6350 raft_consensus.cc:2354] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:25.122725  7594 raft_consensus.cc:2354] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:25.123350  7597 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.129799  8524 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:24.917377  8695 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:25.007424  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:25.106863  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:25.118160  6474 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:25.136415  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.115674  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:25.100090  6238 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:24.996767  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:25.011345  8345 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:25.009042  8586 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:25.167582  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 52014.1us
I20260812 19:22:24.998487  8677 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:25.168535  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:25.151779  6482 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:25.166939  8629 raft_consensus.cc:2741] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260812 19:22:25.166770  6060 catalog_manager.cc:5495] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:25.171921  8345 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:25.173852  8345 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:25.174974  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:25.175812  6473 raft_consensus.cc:2354] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:25.176162  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:25.176810  7606 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:25.139679  8676 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:25.004784  8691 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:25.182399  6179 leader_election.cc:398] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:25.186903  6179 leader_election.cc:401] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:22:25.184988  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:25.191759  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:25.192718  6353 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:25.195636  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:25.198869  8705 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.199041  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:25.202993  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:25.203172  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:25.203742  6342 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:25.168023  8718 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260812 19:22:25.206569  8705 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:25.207010  8677 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:25.198508  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 62501.7us
I20260812 19:22:25.207043  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:25.210423  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:25.226359  6178 leader_election.cc:398] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:25.227015  6178 leader_election.cc:401] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260812 19:22:25.143096  8609 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260812 19:22:25.178735  8695 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:25.194986  6179 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:22:25.273185  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 78323.1us
I20260812 19:22:25.271389  6344 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:25.271811  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:22:25.270569  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 85736.4us
I20260812 19:22:25.277416  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:25.190169  8516 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:25.283210  6353 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:25.275460  6477 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
W20260812 19:22:25.280187  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 54057.9us
I20260812 19:22:25.290874  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:25.294378  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:25.169417  8606 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:25.302204  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.302788  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.303164  6482 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:25.303624  6465 raft_consensus.cc:2354] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:25.304271  8606 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:25.304656  8474 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:25.305310  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.297406  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:25.307045  6352 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:25.300675  8516 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:25.308872  6235 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:25.310290  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:25.313129  6470 raft_consensus.cc:2354] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:25.259760  8633 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:25.315634  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.318962  6477 raft_consensus.cc:2354] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:25.327627  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:25.329025  6242 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 2: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:25.306852  8728 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.311548  8499 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.307116  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:25.326421  6473 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:25.300750  7597 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:25.317874  8474 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:25.351958  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.353093  6477 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:25.337347  8698 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:25.347986  8474 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:25.371807  8401 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:25.372095  8608 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:25.375723  8735 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:25.376583  8665 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:25.336478  8458 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260812 19:22:25.346992  8629 raft_consensus.cc:2741] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260812 19:22:25.351794  6229 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.324267  8633 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:25.396205  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.381619  8474 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.376986  8695 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:25.377970  8698 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:25.508105  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 295459us
I20260812 19:22:25.460129  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.452881  6232 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260812 19:22:25.470216  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 188760us
I20260812 19:22:25.463702  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.463160  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.386734  8687 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:25.385453  8691 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:25.397318  8724 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:25.569358  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 227014us
I20260812 19:22:25.436264  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:25.583150  6481 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:25.410940  6477 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:25.578884  6482 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:25.467115  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.570552  6475 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:25.578941  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:25.592918  6483 raft_consensus.cc:2354] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:25.583612  6470 raft_consensus.cc:2354] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:25.582201  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:25.394081  8665 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:25.596808  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.460745  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.446187  8735 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:25.443075  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.610383  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:25.577694  8458 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:25.625869  6475 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.625721  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:25.597600  8665 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.631269  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.631400  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.631502  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.632169  6477 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:25.632424  6470 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:25.627859  6474 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
W20260812 19:22:25.634115  6345 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.002s
I20260812 19:22:25.597090  8687 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:25.637109  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:22:25.605793  8516 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:25.635109  6345 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:25.635335  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:25.633752  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:25.621326  8691 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:25.642758  6352 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:25.639087  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:25.623214  8735 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:25.625238  8629 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:25.647814  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.632707  6473 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:25.648521  6482 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:25.623894  6464 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:25.651697  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:25.653033  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.644538  8691 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:25.654850  8788 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:25.656872  6477 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
W20260812 19:22:25.650326  8570 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260812 19:22:25.663034  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:25.675505  6475 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:25.683987  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:25.680429  8401 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:25.644716  8687 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:25.662024  8691 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.691845  6298 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:25.656872  8629 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 3 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:25.661726  8788 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:25.645030  8458 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:25.683986  8783 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260812 19:22:25.708312  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 195100us
I20260812 19:22:25.676275  8633 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:25.702196  8724 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:25.706461  8788 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.750550  6417 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:25.716564  8797 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:25.755347  8687 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:25.756385  8609 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:25.757067  8609 raft_consensus.cc:686] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:25.757934  8499 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:25.758261  8609 consensus_queue.cc:237] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:25.759976  8629 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:25.760663  8728 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
W20260812 19:22:25.763290  8800 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260812 19:22:25.726872  8633 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:25.748034  8724 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:25.764204  8633 raft_consensus.cc:686] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:25.764619  8724 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.765233  8633 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:25.768038  8458 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:25.772104  7597 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:25.776122  8724 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:25.778684  8724 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:25.784860  8660 consensus_meta.cc:287] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.000s
I20260812 19:22:25.785322  8660 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:25.811847  8688 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.002s
I20260812 19:22:25.812367  8688 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:25.815604  8688 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:25.828421  6229 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:25.829586  8792 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:25.830179  8792 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:25.832319  8792 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:25.836223  8779 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.273s	user 0.000s	sys 0.004s
I20260812 19:22:25.837419  8688 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:25.838567  8688 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:25.820514  6483 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:25.843912  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.853933  7603 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:25.837608  8665 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:25.857954  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:25.834223  8788 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:25.869902  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.877250  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:25.851432  8688 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:25.879761  8687 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:25.898150  8687 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:25.900235  8687 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:25.900015  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:25.901774  8665 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:25.902329  8772 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:25.902556  6179 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:25.902928  8772 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:25.903656  8691 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:25.904241  8690 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:25.905117  8772 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:25.906551  8691 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:25.893164  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:25.908151  6352 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:25.907346  7600 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:25.914444  8660 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:25.914337  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:25.915439  6352 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:25.917469  8788 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:25.929531  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:25.883924  8808 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:25.883514  8724 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:25.932821  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:25.933591  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.935009  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:25.938684  6352 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:25.938552  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:25.945077  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:25.934517  8792 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:25.932457  8608 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260812 19:22:25.945995  7600 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:25.940270  8458 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:25.881075  8735 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:25.947443  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 253577us
I20260812 19:22:25.953115  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:25.953501  6475 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:25.953977  6483 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.940008  8724 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:25.960507  8724 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:25.947953  8792 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:25.960844  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:25.961396  8792 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:25.964789  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:25.968247  6298 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:25.950511  8458 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:25.984035  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:25.946642  8609 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
W20260812 19:22:25.993476  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 53266.2us
I20260812 19:22:25.991293  8724 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:26.004415  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:26.008006  8688 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:26.008414  8688 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:26.008746  8688 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.010015  8810 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:26.014338  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:26.001094  8724 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:26.017524  6352 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:25.992116  8458 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:25.992676  8633 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:26.015594  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:26.022209  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:26.049238  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:26.124871  6477 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.051466  6475 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:26.126009  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:26.126411  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.126909  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:26.127249  6232 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.127748  6344 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:26.053241  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.052301  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:26.130322  6345 raft_consensus.cc:2354] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:26.051252  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.131600  6236 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.123898  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:26.147380  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:22:26.142807  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 120673us
I20260812 19:22:26.187604  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.194585  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:26.162050  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.195537  6242 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.196382  6483 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:26.196249  6236 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:26.022117  8724 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:26.147997  8771 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.586s	user 0.003s	sys 0.000s
I20260812 19:22:26.023288  8810 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:26.234978  8810 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:26.235092  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:26.021730  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:26.235562  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:26.235913  6238 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:26.211602  6230 raft_consensus.cc:2354] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:26.236954  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1398) took 1358 ms. Trace:
I20260812 19:22:26.051705  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:26.237048  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:26.237344  6241 rpcz_store.cc:276] 0812 19:22:24.878791 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:24.886383 (+  7592us) service_pool.cc:227] Handling call
0812 19:22:24.893381 (+  6998us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:24.983851 (+ 90470us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:24.983889 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:25.090788 (+106899us) log.cc:842] Serialized 26 byte log entry
0812 19:22:25.346874 (+256086us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:22:25.346913 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:25.346983 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:26.147218 (+800235us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:22:26.236671 (+ 89453us) raft_consensus.cc:1671] finished
0812 19:22:26.236689 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:26.236879 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":171951,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":16573,"spinlock_wait_cycles":23044480,"thread_start_us":250769,"threads_started":1,"wal-append.queue_time_us":409667}
I20260812 19:22:26.218515  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.209872  8691 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:26.224233  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:26.126421  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:26.247601  6224 raft_consensus.cc:2354] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:26.158946  6229 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.225934  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:26.249861  6354 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
W20260812 19:22:26.227192  8822 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
W20260812 19:22:26.223560  8781 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.468s	user 0.002s	sys 0.000s
I20260812 19:22:26.154875  8705 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:26.136293  8792 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.121913  8688 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.129545  8633 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:26.049717  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:26.229911  8458 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.021991  8474 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.230790  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:26.235718  8810 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.138409  8687 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:26.223541  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.235013  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:26.281589  6235 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.240809  6477 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:26.051705  8608 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:26.287202  8608 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.287664  6236 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:26.288581  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:26.289330  8608 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:26.209934  6465 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:26.057044  8735 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:26.225109  8788 raft_consensus.cc:2741] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260812 19:22:26.089486  8698 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.200289  8791 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260812 19:22:26.250041  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:26.252527  6242 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:26.255046  6228 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:26.255514  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.295838  6224 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.261035  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:26.263698  6350 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:26.264669  6352 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:26.272325  8792 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.275593  6230 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:26.270290  8688 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:26.304929  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 180163us
I20260812 19:22:26.305585  6354 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:26.283758  8838 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:26.285269  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 128716us
I20260812 19:22:26.285835  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:26.287634  8724 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:26.246795  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:26.260254  8665 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:26.260429  8633 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.302199  6359 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:22:26.303191  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 53262.9us
I20260812 19:22:26.303309  6242 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:26.251997  8691 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.316790  8608 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:26.312352  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:26.315554  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:26.316041  6344 raft_consensus.cc:2354] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:26.317476  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:26.261111  8705 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.327734  6347 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:26.309612  8788 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:26.335696  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:26.342275  6178 leader_election.cc:398] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:26.322950  8691 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.323052  8608 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:26.345765  6178 leader_election.cc:401] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260812 19:22:26.309478  8808 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260812 19:22:26.331348  8665 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:26.333979  8788 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:26.349116  8688 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:26.340139  8516 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:26.340173  7591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 251) took 1230 ms. Trace:
I20260812 19:22:26.351428  8608 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.344480  6232 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:26.336884  8841 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:26.361941  8516 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:26.380585  8841 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:26.312135  8838 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.380702  8516 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:26.381120  8841 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.359412  6229 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:26.383687  8838 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:26.388809  8841 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.389755  8516 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.391328  8841 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:26.393179  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 51107.2us
I20260812 19:22:26.394209  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:26.395067  6224 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:26.357911  8788 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.357061  8609 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260812 19:22:26.425212  6178 leader_election.cc:398] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:26.425855  6178 leader_election.cc:401] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:22:26.361980  7591 rpcz_store.cc:276] 0812 19:22:25.100448 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:25.100600 (+   152us) service_pool.cc:227] Handling call
0812 19:22:25.100980 (+   380us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:25.101441 (+   461us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:25.101496 (+    55us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:25.102029 (+   533us) log.cc:842] Serialized 26 byte log entry
0812 19:22:25.561566 (+459537us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:22:25.563530 (+  1964us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:25.575396 (+ 11866us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:26.122288 (+546892us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:22:26.267937 (+145649us) raft_consensus.cc:1671] finished
0812 19:22:26.267981 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:26.330638 (+ 62657us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1392,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":12581248,"thread_start_us":451433,"threads_started":1,"wal-append.queue_time_us":591848}
I20260812 19:22:26.403393  8458 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.435863  8665 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.359321  8827 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260812 19:22:26.404462  8661 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:26.402997  8516 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.429073  8474 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.454857  6178 leader_election.cc:398] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:26.455235  6178 leader_election.cc:401] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:22:26.443710  8695 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:26.425951  8791 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260812 19:22:26.460953  7597 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:26.466562  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:26.470295  8724 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:26.470795  8839 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260812 19:22:26.448092  8661 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:26.475042  6347 raft_consensus.cc:595] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Received request to transfer leadership to TS f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:26.478271  6347 raft_consensus.cc:603] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:26.477361  6235 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:26.491956  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:26.494681  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 165432us
I20260812 19:22:26.496739  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:26.499277  8695 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:26.500376  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:26.501235  6178 leader_election.cc:398] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:26.501653  6178 leader_election.cc:401] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:22:26.502310  8695 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:26.502903  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:26.503917  8695 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:26.504436  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:26.494973  8735 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260812 19:22:26.506681  8735 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:26.507035  8735 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:26.507460  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:26.507814  6477 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:22:26.507927  8735 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.508615  6477 raft_consensus.cc:595] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:26.508785  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:26.509110  6477 raft_consensus.cc:603] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:26.509366  8735 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:26.488559  8698 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:26.509666  8792 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:26.480161  8661 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:26.512110  8772 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:26.512380  8633 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:26.512974  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:26.515069  8847 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:22:26.529107  6345 raft_consensus.cc:595] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Received request to transfer leadership to TS f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:26.505393  8695 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:26.517807  8810 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.474547  8705 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.488087  8516 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:26.549074  6342 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:26.522467  8856 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:26.549886  8856 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:26.550402  8856 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.514298  8788 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.530669  6345 raft_consensus.cc:603] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:26.515131  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:26.529749  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:26.529606  8850 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:26.548174  8810 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.554593  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:22:26.555035  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 156937us
I20260812 19:22:26.555471  8516 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:26.554905  8705 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:26.555946  8516 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:26.556671  8516 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:26.557085  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:26.558074  8772 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:26.558617  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:26.561678  8458 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:26.556245  8705 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:26.562525  8705 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:26.563532  8772 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260812 19:22:26.568531  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 68216.8us
I20260812 19:22:26.571183  8705 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.555943  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:26.573459  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:26.535813  8695 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:26.575078  8695 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.575932  8810 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:26.576429  8810 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:26.577303  8810 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.525946  8792 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:26.578866  8792 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.580118  8516 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.581416  6235 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0"
dest_uuid: "a1541d11be514114966dc1e92a345298"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:35414
I20260812 19:22:26.585822  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:26.586979  6224 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:26.590607  6232 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:26.590876  6465 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:26.591945  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:26.592736  6473 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:26.593540  8608 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.594753  8458 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:26.586266  6235 raft_consensus.cc:595] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:26.599547  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:26.618430  6345 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:26.606160  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.637054  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:26.637635  6224 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:26.638201  6483 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:26.641556  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:26.642695  6483 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:26.583388  8850 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:26.653769  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:26.665377  6347 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.650436  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.619210  8608 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:26.677038  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:26.677799  6483 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.666196  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:22:26.665786  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 98428us
I20260812 19:22:26.619573  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.680145  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.680771  6230 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.683120  6345 raft_consensus.cc:2354] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:26.688328  6224 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:26.689702  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.691128  6224 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:26.692677  6230 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:26.624636  8852 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:26.623662  8705 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.621073  8856 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.619179  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.647608  8850 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.703238  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:26.724599  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:26.654825  8516 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.754609  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:26.755108  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:26.756510  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 74374.1us
I20260812 19:22:26.751168  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.654062  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:26.727445  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:26.730180  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 131531us
I20260812 19:22:26.727806  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:26.787658  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:26.727065  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:26.727115  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:26.779800  6236 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:26.786031  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:26.760203  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.791867  6481 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:26.792147  6482 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:26.792413  6238 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:26.793233  6483 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:26.686890  8474 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:26.793428  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.795360  6224 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.751236  8847 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:26.665910  8792 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.727542  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:26.724278  8788 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.857930  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:26.858583  6483 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
W20260812 19:22:26.849951  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 58963.1us
I20260812 19:22:26.724730  8808 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:26.850835  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:26.727327  8633 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.724258  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:26.850935  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:26.849557  6416 leader_election.cc:398] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:26.750711  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:26.755445  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:26.853328  6229 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:26.864851  6230 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.865916  6228 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:26.865113  6347 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:26.870440  6483 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:26.871613  6416 leader_election.cc:401] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260812 19:22:26.727345  8695 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.853615  8847 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:26.865267  8788 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:26.873594  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:26.856474  8852 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:26.883798  8852 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:26.884289  8852 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.881677  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:26.851369  8841 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:26.883633  6475 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:26.863580  8846 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:26.875355  6236 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:26.896571  8841 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.898765  6465 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:26.907577  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:22:26.912225  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 62766.3us
I20260812 19:22:26.913477  6224 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:26.914042  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:26.915390  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:26.916018  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:26.916191  8633 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:26.916383  6481 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:26.916623  8633 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:26.917092  8633 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:26.885733  8847 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.918846  8810 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:26.899904  8608 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:26.919260  8810 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:26.919741  8810 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:26.923424  8856 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:26.923839  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:26.914676  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:26.924619  8691 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:26.926261  6349 raft_consensus.cc:2354] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:26.931648  8695 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.931891  8691 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:26.889488  8788 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:26.932924  8691 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.934605  8810 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.936259  8792 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.936784  8810 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.877070  8808 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:26.937638  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:26.938737  8688 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:26.939188  8688 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:26.939304  8808 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.939567  8688 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.941018  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:26.941754  6465 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 3.
I20260812 19:22:26.938431  8687 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:26.944320  8841 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:26.944346  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:26.945358  6349 raft_consensus.cc:2354] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:26.945701  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:26.947134  8789 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:26.947068  8661 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.947049  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:26.860989  8474 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.942044  8633 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.955459  6230 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:26.947738  8846 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:26.904394  8864 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:26.961431  6416 leader_election.cc:398] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:26.969461  6416 leader_election.cc:401] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260812 19:22:26.963356  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:26.947736  8789 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:26.968333  6241 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:26.934494  8788 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:26.975960  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:26.916002  8879 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:26.980908  6178 leader_election.cc:398] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:26.982488  6178 leader_election.cc:401] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260812 19:22:26.983415  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:26.978150  8867 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:26.978087  8789 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:26.989931  6178 leader_election.cc:398] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:26.965441  8792 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260812 19:22:26.985419  8691 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:26.980779  8856 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:27.021549  6178 leader_election.cc:401] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260812 19:22:26.987224  8698 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:27.028460  6178 leader_election.cc:398] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:27.029007  6178 leader_election.cc:401] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260812 19:22:27.030982  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:27.032347  8474 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.969058  8864 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.033005  8661 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:26.991052  8735 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:27.034586  8864 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:27.035535  8458 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:27.025765  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:27.042341  8735 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:27.054585  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:27.054942  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:22:27.056288  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 93005.2us
I20260812 19:22:27.056504  6345 raft_consensus.cc:2354] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:27.057412  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:27.058918  6241 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:27.062922  6178 leader_election.cc:398] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:27.063392  6178 leader_election.cc:401] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260812 19:22:27.064749  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 97788.9us
I20260812 19:22:27.065229  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:27.079532  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 92538.3us
I20260812 19:22:27.046331  8516 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:27.081278  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:27.063938  8882 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:27.151288  8633 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:27.151503  6416 leader_election.cc:398] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:27.152036  6416 leader_election.cc:401] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260812 19:22:27.152770  8828 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:27.153163  8890 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:27.083361  6232 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:27.155211  8735 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.159582  8846 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:27.163913  8892 consensus_queue.cc:1046] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260812 19:22:27.165087  8609 raft_consensus.cc:3032] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:27.165438  8609 raft_consensus.cc:729] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:27.166276  8609 consensus_queue.cc:260] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:27.167357  8609 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:27.175704  8688 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.179731  8688 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:27.157186  8890 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:27.159607  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:27.192354  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:27.195497  8458 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:27.179654  8850 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.197855  6470 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:27.200024  6344 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:49464
W20260812 19:22:27.200412  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 135256us
I20260812 19:22:27.201177  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:27.183053  8691 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:27.205138  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:27.175088  8879 raft_consensus.cc:686] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:27.214720  6058 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38512 (request call id 225) took 2559 ms. Trace:
I20260812 19:22:27.206162  8850 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:27.219679  6344 raft_consensus.cc:595] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Received request to transfer leadership to TS f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:27.219396  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:27.204898  8892 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:27.223181  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:27.223002  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:27.214977  8810 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:27.227102  8891 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:27.227473  8687 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:27.227632  8891 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:27.227995  8891 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:27.228035  8687 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:27.229085  8687 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.231501  8691 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.183046  8890 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.183702  8847 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.238188  8705 raft_consensus.cc:979] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: : Instructing follower 54f83319db6b49929cc8f18a66a66975 to start an election
I20260812 19:22:27.239029  6477 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:27.240767  6347 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:27.239662  8847 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:27.244163  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:27.220754  8828 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:27.227174  8861 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:27.215168  6058 rpcz_store.cc:276] 0812 19:22:24.651430 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:24.655504 (+  4074us) service_pool.cc:227] Handling call
0812 19:22:27.210717 (+2555213us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:22:25.339721 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:22:25.372635 (+ 32914us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:22:25.372676 (+    41us) write_op.cc:435] Acquired schema lock
0812 19:22:25.372702 (+    26us) tablet.cc:660] Decoding operations
0812 19:22:25.373314 (+   612us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:22:25.373368 (+    54us) write_op.cc:641] Partition lock acquired for write op
0812 19:22:25.373393 (+    25us) tablet.cc:683] Acquiring locks for 3 operations
0812 19:22:25.373759 (+   366us) tablet.cc:699] Row locks acquired
0812 19:22:25.373783 (+    24us) write_op.cc:260] PREPARE: finished
0812 19:22:25.373967 (+   184us) write_op.cc:270] Start()
0812 19:22:25.374075 (+   108us) write_op.cc:276] Timestamp: P: 1786562545373924 usec, L: 0
0812 19:22:25.374102 (+    27us) op_driver.cc:331] REPLICATION: starting
0812 19:22:25.386258 (+ 12156us) log.cc:842] Serialized 1293 byte log entry
0812 19:22:25.963595 (+577337us) op_driver.cc:444] REPLICATION: finished
0812 19:22:26.263773 (+300178us) write_op.cc:301] APPLY: starting
0812 19:22:26.263893 (+   120us) tablet.cc:1365] starting BulkCheckPresence
0812 19:22:26.264056 (+   163us) tablet.cc:1368] finished BulkCheckPresence
0812 19:22:26.325776 (+ 61720us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:22:26.379867 (+ 54091us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:22:26.403288 (+ 23421us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0812 19:22:26.427151 (+ 23863us) write_op.cc:312] APPLY: finished
0812 19:22:26.446953 (+ 19802us) log.cc:842] Serialized 34 byte log entry
0812 19:22:26.458055 (+ 11102us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:26.460784 (+  2729us) write_op.cc:454] Released schema lock
0812 19:22:26.460841 (+    57us) write_op.cc:341] FINISH: Updating metrics
0812 19:22:26.461130 (+   289us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:26.461161 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1322,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":299901,"apply.run_cpu_time_us":3533,"apply.run_wall_time_us":197680,"num_ops":3,"prepare.queue_time_us":325788,"prepare.run_cpu_time_us":3503,"prepare.run_wall_time_us":95547,"replication_time_us":589387,"thread_start_us":457112,"threads_started":2}]]}
I20260812 19:22:27.246141  8665 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:27.262356  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:27.262491  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:27.238638  8705 raft_consensus.cc:1067] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Signalling peer 54f83319db6b49929cc8f18a66a66975 to start an election
I20260812 19:22:27.250895  8861 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:27.243135  8879 consensus_queue.cc:237] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.266438  8861 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:27.271070  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:27.274911  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:27.276437  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:27.278435  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:27.279572  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.281109  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:27.281437  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:27.281772  6242 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:27.283768  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:27.278311  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.284560  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:27.284597  6482 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:27.285058  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:27.286537  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:27.287094  8847 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:27.287223  6352 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:27.287528  8847 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:27.287922  8847 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:27.288003  8810 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260812 19:22:27.289050  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:27.290745  6464 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:27.290961  8688 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:27.291744  8788 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:27.292011  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.292407  8788 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:27.292564  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:27.292879  6465 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:27.293555  8887 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:27.293326  8788 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.294025  6473 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:27.295449  6232 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260812 19:22:27.296234  8878 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.152s	user 0.007s	sys 0.001s
I20260812 19:22:27.293368  6236 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:27.277066  8665 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:27.297674  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.298448  6470 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:27.299083  8889 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:27.250294  8850 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:27.279636  8724 raft_consensus.cc:979] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: : Instructing follower f4ef77b3328a44e8a21dd902b370e25a to start an election
I20260812 19:22:27.305025  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:27.291811  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.346679  6481 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:27.303956  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:27.347729  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 43908.8us
I20260812 19:22:27.348475  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:27.348839  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:27.349388  8888 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:27.349556  8724 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:27.349630  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:27.350581  8850 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:27.351019  8850 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:27.351361  8665 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:27.352589  8735 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:27.353150  8735 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:27.354677  8665 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:22:27.355919  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:27.356632  8887 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:27.357013  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:27.351464  8850 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:27.346614  8810 raft_consensus.cc:1067] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Signalling peer f4ef77b3328a44e8a21dd902b370e25a to start an election
I20260812 19:22:27.290751  8633 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:27.357491  8888 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:27.357739  8887 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:27.359403  8887 raft_consensus.cc:686] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:27.360292  8887 consensus_queue.cc:237] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.360419  6481 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:27.308063  8609 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:27.363071  8789 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:27.365180  6060 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 189) took 2616 ms. Trace:
I20260812 19:22:27.367395  6235 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:27.368640  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:27.369436  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:27.370167  6349 raft_consensus.cc:595] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:27.369282  6236 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:27.369325  6054 catalog_manager.cc:5495] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:27.371917  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:27.308504  6477 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:27.369892  8735 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:27.381647  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:27.385591  6054 catalog_manager.cc:5495] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:27.388629  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:27.365610  6060 rpcz_store.cc:276] 0812 19:22:24.756040 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:24.758019 (+  1979us) service_pool.cc:227] Handling call
0812 19:22:27.365101 (+2607082us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:22:25.465582 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:22:25.466263 (+   681us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:22:25.466307 (+    44us) write_op.cc:435] Acquired schema lock
0812 19:22:25.466333 (+    26us) tablet.cc:660] Decoding operations
0812 19:22:25.466789 (+   456us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:22:25.466850 (+    61us) write_op.cc:641] Partition lock acquired for write op
0812 19:22:25.466889 (+    39us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:22:25.467106 (+   217us) tablet.cc:699] Row locks acquired
0812 19:22:25.467130 (+    24us) write_op.cc:260] PREPARE: finished
0812 19:22:25.467301 (+   171us) write_op.cc:270] Start()
0812 19:22:25.467449 (+   148us) write_op.cc:276] Timestamp: P: 1786562545467251 usec, L: 0
0812 19:22:25.467477 (+    28us) op_driver.cc:331] REPLICATION: starting
0812 19:22:25.468247 (+   770us) log.cc:842] Serialized 529 byte log entry
0812 19:22:26.255819 (+787572us) op_driver.cc:444] REPLICATION: finished
0812 19:22:26.367134 (+111315us) write_op.cc:301] APPLY: starting
0812 19:22:26.367229 (+    95us) tablet.cc:1365] starting BulkCheckPresence
0812 19:22:26.367328 (+    99us) tablet.cc:1368] finished BulkCheckPresence
0812 19:22:26.404581 (+ 37253us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:22:26.443400 (+ 38819us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:22:26.457259 (+ 13859us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:22:26.459504 (+  2245us) write_op.cc:312] APPLY: finished
0812 19:22:26.463873 (+  4369us) log.cc:842] Serialized 22 byte log entry
0812 19:22:26.464042 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:26.464126 (+    84us) write_op.cc:454] Released schema lock
0812 19:22:26.464172 (+    46us) write_op.cc:341] FINISH: Updating metrics
0812 19:22:26.464443 (+   271us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:26.464471 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":479037,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":111028,"apply.run_cpu_time_us":2739,"apply.run_wall_time_us":97609,"num_ops":1,"prepare.queue_time_us":292064,"prepare.run_cpu_time_us":2969,"prepare.run_wall_time_us":2968,"replication_time_us":788218,"thread_start_us":91108,"threads_started":1}]]}
I20260812 19:22:27.345229  8889 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:27.391718  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:27.393276  8688 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:27.393461  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:27.403033  8688 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:27.388048  8665 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:27.263491  8695 consensus_queue.cc:1046] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.118s
W20260812 19:22:27.396313  8852 consensus_meta.cc:287] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.006s
W20260812 19:22:27.397080  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 77880.3us
I20260812 19:22:27.414486  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:27.405036  8889 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:27.428388  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:27.398217  6241 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:27.403506  8688 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:27.368383  7594 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
W20260812 19:22:27.405093  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 104301us
I20260812 19:22:27.395357  6232 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:27.370767  8633 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260812 19:22:27.408550  6482 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:27.368112  8891 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.400295  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:27.418311  7591 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:60748
I20260812 19:22:27.405258  8856 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:27.398361  6054 catalog_manager.cc:5495] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 1 to 3, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 3 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:27.449856  7591 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:22:27.482585  6475 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:27.410380  8665 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:22:27.445669  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 45465.7us
I20260812 19:22:27.443975  6342 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:45970
I20260812 19:22:27.447448  8867 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:27.446216  8810 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260812 19:22:27.483824  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:27.483901  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.409301  8724 consensus_queue.cc:1046] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260812 19:22:27.442968  8886 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:27.496919  6416 leader_election.cc:398] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:27.457787  7607 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:27.469497  6054 catalog_manager.cc:5495] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:27.436565  6236 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:27.456657  8705 raft_consensus.cc:3032] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:27.505281  8705 raft_consensus.cc:729] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:27.506500  8705 consensus_queue.cc:260] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.507834  8705 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:27.453588  8789 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:27.429718  8687 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:27.414450  8791 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260812 19:22:27.410939  8852 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.484505  6482 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:27.495188  8458 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:27.444562  8902 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:27.515019  6054 catalog_manager.cc:5495] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 1 to 3, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 3 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:27.442745  8735 consensus_queue.cc:1046] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260812 19:22:27.494568  7591 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:27.497828  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:27.512306  6342 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:22:27.484715  8856 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:27.534857  8665 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.532099  6482 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
W20260812 19:22:27.549290  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 108056us
I20260812 19:22:27.512850  8881 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:27.443145  8860 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
W20260812 19:22:27.562899  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 65145.2us
I20260812 19:22:27.571120  6416 leader_election.cc:398] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3.
I20260812 19:22:27.563946  6483 raft_consensus.cc:2379] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:27.568056  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:27.574302  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:27.550488  8846 consensus_queue.cc:1046] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260812 19:22:27.564949  6342 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:27.565344  8838 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:27.582985  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:27.587348  8850 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.580410  8687 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:27.588665  8609 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:27.583848  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:27.567214  8881 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:27.608453  8881 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:27.608773  8850 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:27.545439  8458 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:27.601084  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:27.598428  8828 consensus_queue.cc:1046] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260812 19:22:27.606464  6482 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:27.579506  8633 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:27.618201  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:27.588836  8879 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:22:27.566085  8691 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260812 19:22:27.570066  8788 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260812 19:22:27.633687  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 69218.5us
I20260812 19:22:27.635138  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:27.616220  8458 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:27.627058  8892 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:27.650104  8846 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:27.651180  8924 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:27.651736  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:27.651324  8861 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.654644  8838 raft_consensus.cc:3032] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
W20260812 19:22:27.656066  8917 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260812 19:22:27.655577  8688 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.699173  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:27.660617  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:27.642776  8609 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:27.668705  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:27.703436  6224 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:27.660167  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:27.663125  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:27.704849  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:27.728489  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:27.737893  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:27.789397  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60978.3us
I20260812 19:22:27.737455  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:27.742408  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:27.768971  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:27.791085  6347 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 3: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:27.791292  6230 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:27.726358  8902 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:27.739668  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.738943  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:27.647882  8850 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:27.776649  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:27.781349  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 180329us
I20260812 19:22:27.627990  8930 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260812 19:22:27.642422  8891 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:27.660355  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:27.816550  6228 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:27.651414  8886 raft_consensus.cc:3032] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:27.790244  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:27.770035  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:27.804719  8919 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260812 19:22:27.783448  6242 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:27.825147  6481 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:27.825927  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:27.829326  6347 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:27.830812  6483 raft_consensus.cc:2354] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:27.771766  8924 raft_consensus.cc:686] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:27.768533  8892 raft_consensus.cc:686] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:27.779417  8838 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:27.783610  8852 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:27.839103  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:27.809222  8862 raft_consensus.cc:3032] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:27.840468  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:27.869526  6230 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:27.841349  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:27.851521  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:27.786381  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:27.857554  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:27.791024  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:27.641247  8856 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:27.824770  8687 raft_consensus.cc:686] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:27.792500  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:27.793303  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:27.874768  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.889304  6470 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:27.890108  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.870677  6474 raft_consensus.cc:2362] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3. Re-sending same reply.
I20260812 19:22:27.890722  6483 raft_consensus.cc:2362] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3. Re-sending same reply.
I20260812 19:22:27.783077  8474 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260812 19:22:27.880609  6354 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:27.827481  8886 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:27.857125  8458 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:27.891140  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.898099  6475 raft_consensus.cc:2362] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3. Re-sending same reply.
I20260812 19:22:27.891593  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.857738  8850 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:27.888175  8633 raft_consensus.cc:686] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:27.900208  6483 raft_consensus.cc:2354] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:27.901616  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:27.868438  8862 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:27.904019  6475 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:27.907651  6230 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:27.906837  8458 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:27.912070  8886 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:27.914137  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260812 19:22:27.916232  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:22:27.916529  8661 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:27.917137  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:22:27.919765  8850 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.920974  8688 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:27.921294  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:27.920789  8687 consensus_queue.cc:237] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.923489  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.923869  6465 raft_consensus.cc:2354] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:27.925209  6465 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:27.925598  6481 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:27.925138  8633 consensus_queue.cc:237] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.922859  8882 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:27.928580  8882 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.930599  8516 raft_consensus.cc:3032] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:27.931074  8516 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:27.931370  8882 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:27.880726  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:27.888850  8792 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:27.832928  8902 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:27.939730  8516 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.937640  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:27.940876  8924 consensus_queue.cc:237] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.887422  8846 raft_consensus.cc:686] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:22:27.908511  8932 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.275s	user 0.000s	sys 0.002s
I20260812 19:22:27.946317  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.899781  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:27.949034  8942 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:27.949867  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:27.950009  8892 consensus_queue.cc:237] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.953056  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:27.954198  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.954331  8861 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:27.945133  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.914448  8458 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:27.959163  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:27.960587  6229 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:27.964910  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:27.975617  6483 raft_consensus.cc:2362] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3. Re-sending same reply.
I20260812 19:22:27.902778  7607 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:27.968070  6464 raft_consensus.cc:2362] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3. Re-sending same reply.
I20260812 19:22:27.957242  6342 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.979533  8862 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.958400  8792 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:27.982251  6342 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:27.946475  8889 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.982458  8792 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.988451  6344 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: []
W20260812 19:22:27.986205  8847 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.698s	user 0.005s	sys 0.007s
I20260812 19:22:27.963831  8881 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:27.942173  8838 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:28.024860  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:28.026106  6229 raft_consensus.cc:2379] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:28.015180  6465 raft_consensus.cc:2354] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:28.018620  6473 raft_consensus.cc:2354] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:27.962291  7591 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:28.097990  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:28.099164  6242 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 3: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:22:28.099885  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 309708us
I20260812 19:22:28.109205  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:28.125451  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:28.126344  6481 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:28.126959  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:28.128134  6242 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: []
W20260812 19:22:28.127794  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 302150us
I20260812 19:22:28.131544  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:28.005736  8847 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:28.033056  8902 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:28.018898  8852 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260812 19:22:28.138607  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:28.155963  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:28.172508  6477 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:28.129871  8882 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:28.135039  8938 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:28.195894  6179 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:22:28.211169  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 404272us
I20260812 19:22:28.218400  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:28.240022  8881 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:28.189589  6473 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:28.185776  8889 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:28.190354  7591 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:28.242928  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 111469us
I20260812 19:22:28.246168  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:28.185861  8952 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:28.135412  8846 consensus_queue.cc:237] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:28.248600  8954 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:28.249347  6178 leader_election.cc:398] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:28.247087  6229 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:28.227946  8808 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:28.242095  8705 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:28.324769  6178 leader_election.cc:401] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:22:28.341764  6345 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:28.216003  8882 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:28.357502  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 201648us
W20260812 19:22:28.368204  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 120504us
I20260812 19:22:28.371543  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:28.368048  8891 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:28.369036  8705 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:28.383220  6473 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:28.383396  8705 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:28.370977  8890 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.004s	sys 0.049s
W20260812 19:22:28.358434  8609 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.013s	sys 0.038s
W20260812 19:22:28.383561  6296 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.004s	sys 0.006s
W20260812 19:22:28.410384  6296 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.012s	sys 0.006s
W20260812 19:22:28.406227  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 64609.3us
I20260812 19:22:28.410295  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:28.403425  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:28.376878  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:28.375924  8954 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:28.415859  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46767.8us
I20260812 19:22:28.419143  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:28.421780  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:22:28.386956  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 191180us
I20260812 19:22:28.427060  6483 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260812 19:22:28.431222  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:28.432173  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:28.410120  8609 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.015s	sys 0.039s
I20260812 19:22:28.436599  6481 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:28.439850  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:28.440666  6345 raft_consensus.cc:3032] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:28.441071  6345 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:28.385512  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:28.401216  8458 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:28.436321  8609 raft_consensus.cc:686] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:28.450944  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:28.451846  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:28.453955  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:28.455456  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:22:28.457103  8661 consensus_meta.cc:287] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
I20260812 19:22:28.458248  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:28.461684  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:28.536134  6354 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
W20260812 19:22:28.542863  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 81260.9us
I20260812 19:22:28.543859  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:28.546634  8861 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:28.547456  8861 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:28.548134  8861 consensus_queue.cc:1046] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260812 19:22:28.397058  8890 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.005s	sys 0.050s
I20260812 19:22:28.549685  8890 raft_consensus.cc:3032] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:28.550144  8890 raft_consensus.cc:729] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:28.551153  8890 consensus_queue.cc:260] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:28.459126  8944 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
W20260812 19:22:28.553603  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 139210us
I20260812 19:22:28.447679  6345 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:28.383306  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:28.371696  8808 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:28.438222  8954 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:28.536865  6228 raft_consensus.cc:3032] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:28.561079  8808 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:28.561241  6228 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:28.562180  6228 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:28.563298  6228 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:28.538909  6238 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:28.540683  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:28.565848  6230 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:28.567106  8968 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:28.567591  8947 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:28.567830  8968 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:28.568142  8947 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:28.513284  8852 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260812 19:22:28.573414  6235 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:28.519176  8847 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:28.537854  8891 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260812 19:22:28.571859  8975 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260812 19:22:28.536212  8889 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:28.471482  8962 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:28.565106  6465 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:28.565914  8458 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:22:28.571465  8971 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260812 19:22:28.574091  8661 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:28.573382  6473 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:28.561079  8954 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:28.571638  8952 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:28.571031  8959 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:28.570585  8947 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:28.622771  8950 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.239s
I20260812 19:22:28.624861  8954 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:28.620064  8980 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260812 19:22:28.615612  8889 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:28.620916  8882 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:28.595645  8791 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:28.619046  8962 raft_consensus.cc:686] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:28.606354  8891 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:28.594995  8808 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:28.625340  8954 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:28.629115  8458 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:28.599349  8968 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:28.639082  6342 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:28.646436  8609 consensus_queue.cc:237] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:28.648540  6350 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:28.684392  8458 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:28.643180  8808 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:28.639966  8891 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:28.687592  8808 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:28.688454  8808 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:28.689066  8808 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:28.651633  8962 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:28.654248  8954 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:28.655831  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:28.683887  8968 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:28.639186  8791 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:28.692786  8968 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:28.700407  8791 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:28.702802  8808 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:28.703997  8458 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:28.683674  8889 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:28.702535  8705 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:28.660300  6228 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:28.668375  8892 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:28.720050  8892 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:28.676760  6465 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:28.721601  6230 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
W20260812 19:22:28.752115  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 206614us
I20260812 19:22:28.753175  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:28.759719  8964 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:22:28.779599  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:28.739112  8947 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:28.788120  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:28.789516  6230 raft_consensus.cc:2379] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:28.794158  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:28.772149  8705 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:28.803747  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:28.805846  8964 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:28.807675  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1039) took 1106 ms. Trace:
I20260812 19:22:28.808279  6464 rpcz_store.cc:276] 0812 19:22:27.701018 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:27.704971 (+  3953us) service_pool.cc:227] Handling call
0812 19:22:28.807324 (+1102353us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b540003bbd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:28.807542 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":188204800}
I20260812 19:22:28.801836  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:28.811436  7598 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:28.814796  8902 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:28.783499  8792 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:28.801529  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 362788us
I20260812 19:22:28.783625  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:28.828377  6178 leader_election.cc:398] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:28.815513  8902 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:28.832736  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:28.818593  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:28.796195  8947 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:28.845806  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:28.859457  8864 raft_consensus.cc:3032] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:28.860140  8864 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:28.861511  7598 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:28.862910  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:28.872301  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:28.843623  8665 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:22:28.882010  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 54191.3us
I20260812 19:22:28.876564  6178 leader_election.cc:398] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:28.843454  8458 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:28.820489  8792 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:28.883090  6178 leader_election.cc:401] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:22:28.821221  8964 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260812 19:22:28.907171  6179 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:28.881484  8788 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:28.896725  8808 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:28.868786  8847 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260812 19:22:28.895503  8661 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:28.899487  8791 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:28.893105  8954 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:28.892432  9012 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:28.899586  8458 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:28.896540  8665 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:28.998917  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:29.328195  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:29.329468  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:29.330265  7593 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:29.066942  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1382) took 1307 ms. Trace:
W20260812 19:22:29.026607  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 201562us
I20260812 19:22:29.330976  6347 rpcz_store.cc:276] 0812 19:22:27.738435 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:27.791719 (+ 53284us) service_pool.cc:227] Handling call
0812 19:22:27.792097 (+   378us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:27.834233 (+ 42136us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:29.045267 (+1211034us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b540003f7d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:29.045559 (+   292us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":85173504}
W20260812 19:22:29.324934  9011 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.278s	user 0.002s	sys 0.000s
I20260812 19:22:28.945029  8474 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:29.338900  8791 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:29.357197  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:29.358004  6228 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:29.347174  8888 raft_consensus.cc:3032] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Stepping down as leader of term 2
W20260812 19:22:29.256889  6473 consensus_meta.cc:287] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.004s
I20260812 19:22:28.961620  8892 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:29.142637  8994 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
W20260812 19:22:29.112354  8984 log.cc:924] Time spent T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260812 19:22:29.114925  8941 log.cc:924] Time spent T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.923s	user 0.007s	sys 0.004s
W20260812 19:22:29.262341  8891 consensus_meta.cc:287] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.575s	user 0.013s	sys 0.000s
I20260812 19:22:29.327646  8609 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:29.366961  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:29.438060  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:28.978365  8983 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:29.439718  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 79516.3us
I20260812 19:22:29.469625  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:29.144054  8792 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:29.446973  8996 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:28.982812  8808 raft_consensus.cc:686] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:28.981781  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:29.449393  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:29.468474  6235 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:29.331202  8902 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:28.959390  8788 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:29.437935  8888 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:29.111340  9002 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.556s
I20260812 19:22:29.339634  8954 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:29.473949  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:22:29.664840  6417 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.632s (SENT) [suppressed 9 similar messages]
I20260812 19:22:29.663090  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:29.443697  6473 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:29.448930  8474 raft_consensus.cc:686] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:29.464926  8828 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:29.614436  8792 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:29.732124  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:29.716048  6228 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:29.748522  8661 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:29.660646  9019 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:22:29.636896  9014 log.cc:924] Time spent T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.236s	user 0.001s	sys 0.001s
W20260812 19:22:29.749284  9024 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
I20260812 19:22:29.499768  8983 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:29.652179  8947 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:29.497856  8988 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:29.470715  8892 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:29.637763  9022 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:29.469300  8891 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:29.766592  8661 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:29.768251  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:22:29.663605  8791 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:29.770634  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:29.844089  6235 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:29.844538  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:29.774608  6230 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 3: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:22:29.779294  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.020s	sys 0.028s
W20260812 19:22:29.845685  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.020s	sys 0.029s
W20260812 19:22:29.846069  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 933848us
I20260812 19:22:29.730441  8998 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:29.781138  6228 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260812 19:22:29.790088  7551 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.009s	sys 0.039s
I20260812 19:22:29.734751  8458 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:29.473824  8609 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:29.809147  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1302) took 1369 ms. Trace:
I20260812 19:22:29.755165  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1351) took 1324 ms. Trace:
W20260812 19:22:29.821664  6298 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.020s	sys 0.023s
I20260812 19:22:29.748129  6349 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 3.
I20260812 19:22:29.856359  6347 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:29.856562  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:29.734375  8996 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:29.862268  6298 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.021s	sys 0.024s
I20260812 19:22:29.858788  6224 rpcz_store.cc:276] 0812 19:22:28.440090 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.442023 (+  1933us) service_pool.cc:227] Handling call
0812 19:22:28.442477 (+   454us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:28.792921 (+350444us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:28.792963 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:28.798599 (+  5636us) log.cc:842] Serialized 26 byte log entry
0812 19:22:29.314885 (+516286us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:29.314932 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:29.315020 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:29.808811 (+493791us) raft_consensus.cc:1671] finished
0812 19:22:29.808841 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:29.809056 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":128472,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":87,"thread_start_us":799800,"threads_started":2,"wal-append.queue_time_us":618209}
W20260812 19:22:29.855268  7551 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.010s	sys 0.039s
I20260812 19:22:29.830452  8892 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:29.858259  8860 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260812 19:22:29.763278  8828 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:29.890547  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1136) took 2408 ms. Trace:
I20260812 19:22:29.892617  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1141) took 1447 ms. Trace:
W20260812 19:22:29.896526  6475 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.003s	sys 0.018s
I20260812 19:22:29.902900  6344 rpcz_store.cc:276] 0812 19:22:27.481658 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:27.482089 (+   431us) service_pool.cc:227] Handling call
0812 19:22:27.482432 (+   343us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:28.000634 (+518202us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:29.890132 (+1889498us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54001cd9d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:29.890404 (+   272us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1163185408}
W20260812 19:22:29.913183  6475 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.004s	sys 0.018s
I20260812 19:22:29.894945  8838 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:29.844317  8888 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:29.922042  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.015s	sys 0.028s
I20260812 19:22:29.926855  6347 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:29.885095  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 82) took 1052 ms. Trace:
I20260812 19:22:29.848861  9019 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:29.900765  8724 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:29.862109  6473 rpcz_store.cc:276] 0812 19:22:28.431055 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.435799 (+  4744us) service_pool.cc:227] Handling call
0812 19:22:29.754938 (+1319139us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:22:29.932768  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.015s	sys 0.028s
I20260812 19:22:29.911919  8458 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:29.860601  8808 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:29.911742  6342 rpcz_store.cc:276] 0812 19:22:28.445283 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.457943 (+ 12660us) service_pool.cc:227] Handling call
0812 19:22:29.892281 (+1434338us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b540009e7d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:29.892462 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":158691200}
I20260812 19:22:29.936426  8792 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:29.849565  8988 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:29.869029  8998 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:29.857270  9022 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:30.000558  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.020s	sys 0.036s
I20260812 19:22:29.936786  9032 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:30.001089  6224 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:29.876591  8474 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:30.006536  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 341705us
I20260812 19:22:29.951412  9029 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:29.933005  6349 rpcz_store.cc:276] 0812 19:22:28.824699 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.896143 (+ 71444us) service_pool.cc:227] Handling call
0812 19:22:29.877406 (+981263us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:22:30.009116  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.016s	sys 0.032s
W20260812 19:22:30.002470  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.020s	sys 0.037s
W20260812 19:22:30.016249  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.016s	sys 0.033s
W20260812 19:22:30.017486  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 547896us
I20260812 19:22:30.018139  8902 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:30.018149  9033 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:30.018281  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:30.018962  8902 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:29.957840  8458 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:30.002586  8788 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:30.005065  9018 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.255s	user 0.000s	sys 0.002s
I20260812 19:22:30.045957  8930 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Stepping down as leader of term 2
W20260812 19:22:30.047294  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.017s	sys 0.035s
I20260812 19:22:30.002909  8954 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:30.146420  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.017s	sys 0.035s
W20260812 19:22:30.146883  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 818569us
I20260812 19:22:30.220439  9034 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:30.220659  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:30.139456  8788 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:30.005066  9041 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:30.019397  9033 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:30.236524  6295 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.015s	sys 0.017s
W20260812 19:22:30.250671  6295 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.016s	sys 0.018s
I20260812 19:22:30.004664  8792 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:30.016434  9029 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:30.146297  8930 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:30.272152  8930 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:30.102815  8724 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:22:30.209327  8966 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.015s	sys 0.016s
I20260812 19:22:30.053149  8891 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:30.319422  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 307989us
I20260812 19:22:30.221328  9034 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:30.323333  9064 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:30.327354  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:30.323357  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 304740us
I20260812 19:22:30.346110  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:30.140898  8661 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.221833  8788 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:30.333278  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 185006us
I20260812 19:22:30.348186  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:30.342224  8724 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:30.310546  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:30.352586  9044 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:22:30.369196  6413 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.018s	sys 0.021s
W20260812 19:22:30.375778  6413 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.019s	sys 0.022s
I20260812 19:22:30.356889  8788 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.339808  9022 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:30.339155  8983 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:30.349172  8930 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:30.385257  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:30.358110  8998 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.391930  9053 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:30.408548  6470 raft_consensus.cc:2354] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
I20260812 19:22:30.360430  8891 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:30.008929  9032 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:30.370857  8828 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:30.412014  6470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1047) took 2700 ms (client timeout 3308 ms). Trace:
I20260812 19:22:30.365818  9044 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:30.278725  9041 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:30.387586  8996 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.367707  7593 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:30.390256  8902 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:30.417196  6470 rpcz_store.cc:269] 0812 19:22:27.711486 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:30.371394 (+2659908us) service_pool.cc:227] Handling call
0812 19:22:30.411931 (+ 40537us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:30.374245  7607 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:30.391412  8661 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:30.418026  8788 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:30.348635  9064 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:30.391258  8988 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.392902  9033 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:30.417167  9025 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.450s	user 0.001s	sys 0.001s
W20260812 19:22:30.442396  8981 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.293s	user 0.001s	sys 0.001s
I20260812 19:22:30.424831  8828 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:30.448786  8902 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:30.421545  9019 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:30.413741  8998 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:30.476990  8887 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:30.462169  8789 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:30.419750  9039 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:30.478931  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:30.479630  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1339) took 3096 ms. Trace:
I20260812 19:22:30.479996  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1297) took 2051 ms. Trace:
I20260812 19:22:30.481252  8886 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:30.444311  8996 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:30.458375  8788 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:30.485122  8458 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.485113  9082 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:30.488503  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1446) took 1133 ms. Trace:
I20260812 19:22:30.417399  8891 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:30.496178  6477 rpcz_store.cc:276] 0812 19:22:27.384395 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:27.384777 (+   382us) service_pool.cc:227] Handling call
0812 19:22:27.385149 (+   372us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:28.174523 (+789374us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:30.479243 (+2304720us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b5400272254. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:30.479475 (+   232us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1810162048}
I20260812 19:22:30.506281  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:30.536516  6482 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:30.497309  6238 rpcz_store.cc:276] 0812 19:22:28.428205 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.428979 (+   774us) service_pool.cc:227] Handling call
0812 19:22:28.454917 (+ 25938us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:28.565280 (+110363us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:30.479702 (+1914422us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b5400179654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:30.479921 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":192094464}
I20260812 19:22:30.500135  8887 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:30.499341  8998 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:30.516366  6352 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1383) took 2720 ms (client timeout 1748 ms). Trace:
I20260812 19:22:30.428617  9071 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:30.530814  6228 rpcz_store.cc:276] 0812 19:22:29.355054 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:29.859515 (+504461us) service_pool.cc:227] Handling call
0812 19:22:29.859778 (+   263us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:29.860036 (+   258us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:29.860065 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:29.866474 (+  6409us) log.cc:842] Serialized 26 byte log entry
0812 19:22:30.017627 (+151153us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:30.017668 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:30.017736 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:30.488292 (+470556us) raft_consensus.cc:1671] finished
0812 19:22:30.488311 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:30.488447 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3379,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":20413,"thread_start_us":106962,"threads_started":1,"wal-append.queue_time_us":490348}
W20260812 19:22:30.538549  6482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1058) took 2601 ms (client timeout 1822 ms). Trace:
I20260812 19:22:30.536679  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1303) took 2095 ms. Trace:
I20260812 19:22:30.552498  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:30.539283  9082 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:30.499650  9029 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.552922  6236 rpcz_store.cc:276] 0812 19:22:28.441010 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.441176 (+   166us) service_pool.cc:227] Handling call
0812 19:22:28.514340 (+ 73164us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:28.560217 (+ 45877us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:28.560277 (+    60us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:28.560331 (+    54us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:28.560378 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:30.536418 (+1976040us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b5400179154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:30.536470 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:30.536617 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":104768256}
W20260812 19:22:30.513967  8838 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.007s
W20260812 19:22:30.551211  6352 rpcz_store.cc:269] 0812 19:22:27.782470 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:27.787195 (+  4725us) service_pool.cc:227] Handling call
0812 19:22:30.478725 (+2691530us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b5800004598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:30.502795 (+ 24070us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17367424}
W20260812 19:22:30.552078  6482 rpcz_store.cc:269] 0812 19:22:27.935859 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:27.936026 (+   167us) service_pool.cc:227] Handling call
0812 19:22:30.506069 (+2570043us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:30.536967 (+ 30898us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":15579008}
I20260812 19:22:30.525957  8609 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:30.504105  8789 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:30.561064  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:30.585246  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1299) took 2145 ms. Trace:
I20260812 19:22:30.581693  6236 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:30.562520  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:30.592927  6242 rpcz_store.cc:276] 0812 19:22:28.429209 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.429758 (+   549us) service_pool.cc:227] Handling call
0812 19:22:28.430152 (+   394us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:28.827048 (+396896us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:28.827076 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:28.827541 (+   465us) log.cc:842] Serialized 26 byte log entry
0812 19:22:29.337828 (+510287us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:29.337878 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:29.346095 (+  8217us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:30.574468 (+1228373us) raft_consensus.cc:1671] finished
0812 19:22:30.574511 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:30.574773 (+   262us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":140495,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"thread_start_us":864867,"threads_started":2,"wal-append.queue_time_us":1011837}
I20260812 19:22:30.588128  8847 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:30.610414  8847 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:30.611503  8890 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:30.513455  9072 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:30.588861  9063 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.112s	user 0.002s	sys 0.000s
I20260812 19:22:30.441009  9053 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:30.555117  8792 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.618777  6236 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:30.622045  6236 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:30.582353  9044 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.619067  8968 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.536123  9039 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:30.579928  9071 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:30.642577  8891 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:30.656329  6238 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:30.671914  8887 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.673573  8789 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.657845  9034 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:30.653158  9080 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:30.658156  9064 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.685074  8998 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:30.636837  9072 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:30.715372  9072 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.716771  7598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 303) took 1816 ms. Trace:
I20260812 19:22:30.718886  9082 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:30.703716  8728 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:30.696236  8788 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:30.724000  8945 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:30.708715  8789 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:30.728091  8728 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:30.709215  9041 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:30.710795  9032 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.737442  8847 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:30.725683  8945 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:30.741187  8728 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.744952  9039 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:30.718272  9080 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:30.720232  7598 rpcz_store.cc:276] 0812 19:22:28.900264 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:29.329704 (+429440us) service_pool.cc:227] Handling call
0812 19:22:29.330222 (+   518us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:29.846682 (+516460us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:29.853505 (+  6823us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:29.872096 (+ 18591us) log.cc:842] Serialized 26 byte log entry
0812 19:22:30.047019 (+174923us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:22:30.047069 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:30.047159 (+    90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:30.710714 (+663555us) raft_consensus.cc:1671] finished
0812 19:22:30.716396 (+  5682us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:30.716682 (+   286us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":566207,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":15825,"thread_start_us":636504,"threads_started":2,"wal-append.queue_time_us":536679}
I20260812 19:22:30.742872  8789 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:30.794435  7591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 284) took 2061 ms. Trace:
I20260812 19:22:30.776948  8945 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:30.837458  8945 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:30.763464  9053 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.779371  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1296) took 2353 ms. Trace:
I20260812 19:22:30.851398  8888 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:30.856787  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1050) took 3130 ms. Trace:
W20260812 19:22:30.858892  6230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1440) took 1505 ms (client timeout 1702 ms). Trace:
I20260812 19:22:30.822678  9071 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.928799  6475 rpcz_store.cc:276] 0812 19:22:27.726552 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:27.910997 (+184445us) service_pool.cc:227] Handling call
0812 19:22:28.807531 (+896534us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:28.807990 (+   459us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:28.808032 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:28.808635 (+   603us) log.cc:842] Serialized 26 byte log entry
0812 19:22:28.901138 (+ 92503us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:29.913786 (+1012648us) log.cc:842] Serialized 14 byte log entry
0812 19:22:29.914089 (+   303us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:29.914193 (+   104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:30.348663 (+434470us) raft_consensus.cc:1671] finished
0812 19:22:30.348685 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:30.856519 (+507834us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b540003bbd0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:30.856698 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":237382,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":59,"raft.queue_time_us":4088,"raft.run_cpu_time_us":448,"raft.run_wall_time_us":447,"spinlock_wait_cycles":2060899712,"thread_start_us":1060215,"threads_started":2,"wal-append.queue_time_us":940959}
I20260812 19:22:30.893493  9080 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:30.930239  6230 rpcz_store.cc:269] 0812 19:22:29.353167 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:29.353318 (+   151us) service_pool.cc:227] Handling call
0812 19:22:30.858479 (+1505161us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b5400163ad4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:30.858714 (+   235us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":144038272}
W20260812 19:22:30.946866  8930 consensus_meta.cc:287] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.537s	user 0.005s	sys 0.009s
I20260812 19:22:30.824896  7591 rpcz_store.cc:276] 0812 19:22:28.732659 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.739542 (+  6883us) service_pool.cc:227] Handling call
0812 19:22:30.778581 (+2039039us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b5800005498. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:22:30.781664 (+  3083us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:30.782090 (+   426us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:30.782139 (+    49us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:30.782209 (+    70us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:30.787494 (+  5285us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:30.793963 (+  6469us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:30.794309 (+   346us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":68206976}
I20260812 19:22:30.927234  6229 rpcz_store.cc:276] 0812 19:22:28.426196 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.426389 (+   193us) service_pool.cc:227] Handling call
0812 19:22:28.450617 (+ 24228us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:28.634351 (+183734us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:28.634395 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:28.634452 (+    57us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:28.634499 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:30.778984 (+2144485us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540013ef54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:30.779063 (+    79us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:30.779284 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":392379136}
I20260812 19:22:30.961282  8789 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.964387  7606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 288) took 2186 ms. Trace:
I20260812 19:22:30.964947  7606 rpcz_store.cc:276] 0812 19:22:28.777515 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.777711 (+   196us) service_pool.cc:227] Handling call
0812 19:22:30.963379 (+2185668us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b5800005498. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:22:30.963693 (+   314us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:30.963892 (+   199us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:30.963917 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:30.963957 (+    40us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:30.963986 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:30.964072 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:30.964233 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5993728}
I20260812 19:22:30.965987  6483 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:30.968247  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1435) took 2880 ms. Trace:
I20260812 19:22:30.968703  6241 rpcz_store.cc:276] 0812 19:22:28.088294 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.088493 (+   199us) service_pool.cc:227] Handling call
0812 19:22:28.130295 (+ 41802us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:28.385109 (+254814us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:28.385147 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:28.385191 (+    44us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:28.385217 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:30.967929 (+2582712us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540001d954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:30.967989 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:30.968166 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":585510784}
I20260812 19:22:30.978844  8665 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:30.980749  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1142) took 2531 ms. Trace:
I20260812 19:22:30.981359  6354 rpcz_store.cc:276] 0812 19:22:28.449329 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.581841 (+132512us) service_pool.cc:227] Handling call
0812 19:22:28.613848 (+ 32007us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:28.696521 (+ 82673us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:28.696559 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:28.696606 (+    47us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:22:28.696635 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:30.980430 (+2283795us) spinlock_profiling.cc:243] Waited 82.4 ms on lock 0x7b54004083d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:30.980499 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:30.980674 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":189619968}
I20260812 19:22:30.984025  8864 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:30.990226  8862 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:30.998720  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1306) took 1118 ms. Trace:
I20260812 19:22:30.999315  6224 rpcz_store.cc:276] 0812 19:22:29.879868 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:29.881417 (+  1549us) service_pool.cc:227] Handling call
0812 19:22:29.881782 (+   365us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:30.005415 (+123633us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:30.998339 (+992924us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540027c4d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:30.998617 (+   278us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":273300736}
I20260812 19:22:31.001180  6345 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:30.986344  8864 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
W20260812 19:22:31.022104  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.016s	sys 0.024s
W20260812 19:22:31.022678  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.016s	sys 0.024s
W20260812 19:22:31.023439  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 675306us
I20260812 19:22:31.024456  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:31.027341  7553 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.025s	sys 0.063s
W20260812 19:22:31.027743  7553 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.025s	sys 0.063s
W20260812 19:22:31.028055  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 715107us
W20260812 19:22:31.031080  6413 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.034s	sys 0.054s
W20260812 19:22:31.031487  6413 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.034s	sys 0.054s
W20260812 19:22:31.038165  6295 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.025s	sys 0.030s
W20260812 19:22:31.040162  6295 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.025s	sys 0.030s
I20260812 19:22:31.063721  6345 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
W20260812 19:22:31.065318  6359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1378) took 3402 ms (client timeout 1964 ms). Trace:
W20260812 19:22:31.065881  6359 rpcz_store.cc:269] 0812 19:22:27.662624 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:27.663281 (+   657us) service_pool.cc:227] Handling call
0812 19:22:31.065048 (+3401767us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b540009f1d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:31.065232 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1311554432}
I20260812 19:22:31.069670  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:31.070868  6345 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 79) took 2632 ms (client timeout 1511 ms). Trace:
W20260812 19:22:31.071437  6345 rpcz_store.cc:269] 0812 19:22:28.438585 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.439528 (+   943us) service_pool.cc:227] Handling call
0812 19:22:30.954318 (+2514790us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b1800179880. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f77b3856 00007f98f7705f7e 00007f98f776f367 00007f98f7770b4e 00007f98f777c228 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c
0812 19:22:31.000856 (+ 46538us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b58004fb8b0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f76f3f63 00007f98f7757aba 00007f98f776f3af 00007f98f7770b4e 00007f98f777c228 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c
0812 19:22:31.070758 (+ 69902us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4592210048}
W20260812 19:22:31.078856  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.016s	sys 0.029s
W20260812 19:22:31.079345  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.016s	sys 0.029s
I20260812 19:22:31.064464  8691 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:31.081792  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.084106  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.089649  6352 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 4: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:31.073700  8810 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:31.091144  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.091647  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:31.084422  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 60092.8us
W20260812 19:22:31.080849  8966 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.012s	sys 0.027s
I20260812 19:22:31.103440  8861 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:31.089811  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:31.105916  8879 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:31.106165  8861 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:31.106839  7594 raft_consensus.cc:2396] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260812 19:22:31.086125  8852 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:31.099908  8899 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:31.111845  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:31.082027  8940 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:31.109845  6477 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:31.105150  8886 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:31.099716  8966 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.012s	sys 0.027s
I20260812 19:22:31.093163  8890 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:31.144042  6175 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.039s	sys 0.049s
W20260812 19:22:31.171005  6175 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.040s	sys 0.049s
I20260812 19:22:31.171860  6477 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260812 19:22:31.154014  8856 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.004s	sys 0.011s
W20260812 19:22:31.142347  6481 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.004s	sys 0.012s
I20260812 19:22:31.151132  6470 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:31.109896  6482 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:31.156080  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:31.103741  8955 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:31.159240  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 47514.5us
I20260812 19:22:31.154723  8970 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:31.166468  8852 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:31.114578  9081 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:31.158380  9054 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.021s	sys 0.028s
I20260812 19:22:31.106510  8879 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:31.141796  6242 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.012s	sys 0.002s
W20260812 19:22:31.140511  7552 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.014s	sys 0.023s
W20260812 19:22:31.176623  8856 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.004s	sys 0.012s
I20260812 19:22:31.178164  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:31.167475  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1433) took 3140 ms. Trace:
I20260812 19:22:31.181212  6474 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:31.096838  8810 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:31.091897  8691 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:31.184151  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 114610us
I20260812 19:22:31.189277  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:22:31.234081  7552 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.015s	sys 0.024s
I20260812 19:22:31.233300  6470 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260812 19:22:31.237908  6483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33386 (request call id 68) took 2459 ms (client timeout 1549 ms). Trace:
W20260812 19:22:31.242897  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 64842.8us
W20260812 19:22:31.276857  6483 rpcz_store.cc:269] 0812 19:22:28.778978 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.779188 (+   210us) service_pool.cc:227] Handling call
0812 19:22:31.237637 (+2458449us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b54001036d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:31.237813 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5025720192}
W20260812 19:22:31.247527  6242 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.013s	sys 0.003s
W20260812 19:22:31.264955  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 75772.8us
W20260812 19:22:31.177897  6481 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.004s	sys 0.012s
I20260812 19:22:31.271456  6477 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:31.187441  9053 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:31.234619  9012 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:31.192212  8665 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:31.302333  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.310549  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.154927  8899 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:31.313879  8887 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:31.315342  8899 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:31.316430  8887 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:31.317795  6482 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:31.318559  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:31.320392  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:31.157691  8881 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260812 19:22:31.173282  8886 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:31.328752  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.033s	sys 0.036s
W20260812 19:22:31.329334  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.033s	sys 0.036s
W20260812 19:22:31.330137  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 984191us
I20260812 19:22:31.331138  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:31.333173  6178 leader_election.cc:398] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
W20260812 19:22:31.288789  9054 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 1.238s	user 0.023s	sys 0.036s
I20260812 19:22:31.339674  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:31.340483  6345 raft_consensus.cc:2362] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4. Re-sending same reply.
I20260812 19:22:31.334524  6178 leader_election.cc:398] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
W20260812 19:22:31.334805  6298 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.000s	sys 0.043s
I20260812 19:22:31.339282  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:31.342851  6298 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.001s	sys 0.043s
I20260812 19:22:31.343412  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:31.344733  6178 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:31.235600  8687 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
I20260812 19:22:31.353538  6298 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:31.300169  8889 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:31.289530  9060 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:31.359761  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:31.328758  8474 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.044s	sys 0.082s
I20260812 19:22:31.313907  8966 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260812 19:22:31.341420  9080 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:31.191181  8970 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:31.368307  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.339207  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.242871  9081 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:31.354573  9071 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:31.400887  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.184705  8890 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:31.384486  8474 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.045s	sys 0.083s
W20260812 19:22:31.456139  6178 connection.cc:232] RPC call timeout handler was delayed by -2.7405337539967149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260812 19:22:31.465969  6178 connection.cc:232] RPC call timeout handler was delayed by -1.8295949420426041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3308s for a response
W20260812 19:22:31.466280  6178 connection.cc:232] RPC call timeout handler was delayed by -1.360243353061378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
I20260812 19:22:31.466506  8474 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:31.467098  8474 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:31.299242  8947 consensus_queue.cc:1046] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260812 19:22:31.370134  8943 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:31.162472  8940 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:31.377686  9097 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:31.333894  8850 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260812 19:22:31.378077  8861 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:31.341265  8791 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260812 19:22:31.417848  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:31.419566  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.506178  6475 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:31.350116  8665 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260812 19:22:31.428692  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.336905  8899 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:31.328054  9012 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:31.384575  9055 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260812 19:22:31.432870  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.436451  6470 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:31.423956  9096 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:31.420549  9094 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:22:31.436183  6417 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.078s	user 0.026s	sys 0.056s
W20260812 19:22:31.436369  8808 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.020s	sys 0.036s
I20260812 19:22:31.433913  8930 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:31.396309  9060 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:31.437157  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.101s	user 0.083s	sys 0.152s
W20260812 19:22:31.563519  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.228s	user 0.084s	sys 0.152s
I20260812 19:22:31.188066  8955 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:31.463416  9071 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:22:31.533344  8962 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.038s	sys 0.052s
I20260812 19:22:31.477485  8879 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:31.531627  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 113866us
W20260812 19:22:31.641635  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 321346us
I20260812 19:22:31.642273  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:31.642493  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 326515us
W20260812 19:22:31.543677  8808 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.020s	sys 0.036s
I20260812 19:22:31.533771  9105 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:31.644279  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:31.551422  9106 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260812 19:22:31.534642  9053 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:31.573347  9071 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
W20260812 19:22:31.573511  8962 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.038s	sys 0.053s
W20260812 19:22:31.603070  9113 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260812 19:22:31.603263  8892 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:31.603152  8955 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:31.609293  8691 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:31.435647  9101 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.129s
W20260812 19:22:31.615706  9131 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260812 19:22:31.248708  6232 rpcz_store.cc:276] 0812 19:22:28.027636 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.032711 (+  5075us) service_pool.cc:227] Handling call
0812 19:22:28.112047 (+ 79336us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:28.216291 (+104244us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:28.222401 (+  6110us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:28.371358 (+148957us) log.cc:842] Serialized 26 byte log entry
0812 19:22:28.802766 (+431408us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:28.947712 (+144946us) log.cc:842] Serialized 14 byte log entry
0812 19:22:29.327183 (+379471us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:29.327306 (+   123us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:31.101241 (+1773935us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b24002cd428. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f46b4cf4 00007f98f46b2dfb 00007f98f4741559 00007f98f47411e5 00007f98f4740740 00007f98f7427578 00007f98f7427cd8 00007f98f73ff6e8 00007f98f73faaea 00007f98f73f9f36
0812 19:22:31.167004 (+ 65763us) raft_consensus.cc:1671] finished
0812 19:22:31.167183 (+   179us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:31.167395 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":112564,"prepare.queue_time_us":524708,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":423862,"raft.run_cpu_time_us":463,"raft.run_wall_time_us":32887,"spinlock_wait_cycles":165766528,"thread_start_us":475827,"threads_started":2,"wal-append.queue_time_us":489258}
I20260812 19:22:31.623497  9081 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:31.625347  8940 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:31.627779  9012 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:31.629755  9126 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260812 19:22:31.544317  8886 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:31.632663  8945 consensus_meta.cc:287] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.795s	user 0.018s	sys 0.000s
W20260812 19:22:31.635951  8862 consensus_meta.cc:287] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.645s	user 0.009s	sys 0.007s
I20260812 19:22:31.670225  8474 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:31.649181  9105 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:31.049614  8992 consensus_queue.cc:1159] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdfa5579d4534c618c00db6b4a841c81" responder_term: 4 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:22:31.535923  6464 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 3.
I20260812 19:22:31.643814  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:31.709882  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 66126.4us
I20260812 19:22:31.710762  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:31.711779  9053 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:31.712960  9053 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:31.712885  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.713554  9053 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:31.714094  9053 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:31.715068  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.715288  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.715886  6232 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:31.717449  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.717696  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.674624  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.719197  6465 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:31.712399  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:31.647564  6241 raft_consensus.cc:1261] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:31.724524  6347 raft_consensus.cc:1261] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:31.724941  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.726154  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.727102  6241 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:31.727943  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.658857  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:31.659584  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.661128  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.729141  6470 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:31.729267  6359 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:31.728567  6241 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:31.669973  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:31.648898  9033 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:31.671324  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.673009  6352 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:31.731398  6354 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
W20260812 19:22:31.671721  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 318279us
I20260812 19:22:31.733966  6298 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:31.673952  6353 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.010s	sys 0.003s
I20260812 19:22:31.734455  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1313) took 1805 ms. Trace:
I20260812 19:22:31.637907  9109 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.088s
I20260812 19:22:31.683596  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:31.684266  9116 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
I20260812 19:22:31.684780  9090 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:31.680909  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.533289  6473 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:31.695817  8856 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:31.697657  9096 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:31.698619  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:31.700851  9133 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.235s	user 0.001s	sys 0.001s
W20260812 19:22:31.536432  6417 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.178s	user 0.026s	sys 0.056s
I20260812 19:22:31.694254  8890 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:31.533897  8810 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:31.550146  9094 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:31.721339  8966 raft_consensus.cc:3032] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:31.883944  8966 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:31.885190  9094 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:31.885107  8966 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:31.650758  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.726189  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.817471  8856 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:31.888218  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.889000  6347 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:31.662407  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.890009  8856 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:31.675401  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.735976  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.736830  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.893447  6470 raft_consensus.cc:2396] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260812 19:22:31.739560  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.894090  6359 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:31.895366  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.730250  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.739460  6242 rpcz_store.cc:276] 0812 19:22:29.929350 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:30.598321 (+668971us) service_pool.cc:227] Handling call
0812 19:22:30.598811 (+   490us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:30.599200 (+   389us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:22:31.280774 (+681574us) log.cc:842] Serialized 14 byte log entry
0812 19:22:31.734141 (+453367us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:31.734194 (+    53us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:31.734233 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:31.734298 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:31.734403 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":911675,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"thread_start_us":1112714,"threads_started":2}
I20260812 19:22:31.741570  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.745049  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.896852  6344 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:31.743362  6350 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:31.759684  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.817936  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.897997  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.898509  6236 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:31.818578  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.902042  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.902920  6344 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:31.708989  9105 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:31.825730  9096 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:31.755558  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.898412  6241 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:31.745337  8962 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:31.869309  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:31.912745  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:31.882473  8864 consensus_meta.cc:287] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.866s	user 0.010s	sys 0.005s
I20260812 19:22:31.878888  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1445) took 2524 ms. Trace:
I20260812 19:22:31.879979  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1350) took 3450 ms. Trace:
I20260812 19:22:31.882009  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.882697  8940 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:31.817788  9081 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:31.914460  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:31.890062  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.753366  6349 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:31.940553  6475 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:31.746287  8945 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:31.897423  6345 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:31.908241  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:31.828572  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 1.47016e+06us
I20260812 19:22:31.910178  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.911707  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.912117  6352 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
W20260812 19:22:31.913395  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44224.8us
I20260812 19:22:31.913532  6359 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:31.870417  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1381) took 4202 ms. Trace:
I20260812 19:22:31.746137  8889 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:31.750227  8970 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:31.747478  9026 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:31.745262  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.851343  8992 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:32.000278  9096 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:32.000568  8992 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:32.001488  8992 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.002982  8992 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:32.004822  9060 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:32.005443  9026 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:32.006265  8889 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.008910  8852 raft_consensus.cc:3032] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:31.917798  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.915875  6482 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:32.009289  8852 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:31.754391  9090 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:32.010210  8852 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.011288  8852 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:32.011472  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.011749  9090 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:31.944492  8847 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:32.012704  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.012614  8847 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.013739  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.942173  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.988286  8724 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:32.014971  6238 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:32.015218  8724 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.016024  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.817981  8892 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:31.858006  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.915562  8890 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:31.938525  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.026578  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.943632  9105 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:32.028699  6482 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:31.979020  6353 rpcz_store.cc:276] 0812 19:22:27.668982 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:27.676216 (+  7234us) service_pool.cc:227] Handling call
0812 19:22:27.771738 (+ 95522us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:27.880400 (+108662us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:27.880447 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:27.887295 (+  6848us) log.cc:842] Serialized 26 byte log entry
0812 19:22:30.731318 (+2844023us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b180022b7c0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:22:31.152452 (+421134us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:31.742142 (+589690us) log.cc:842] Serialized 14 byte log entry
0812 19:22:31.747345 (+  5203us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:31.747501 (+   156us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:31.747546 (+    45us) raft_consensus.cc:1671] finished
0812 19:22:31.870143 (+122597us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:31.870343 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":57392,"raft.queue_time_us":199113,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":64584,"spinlock_wait_cycles":5293312,"thread_start_us":1096967,"threads_started":3,"wal-append.queue_time_us":3556643}
I20260812 19:22:32.027669  8890 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:31.979863  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.980738  9071 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:31.937302  8691 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:31.982048  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:31.944160  8940 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:32.069525  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.072777  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:32.053567  9127 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.377s	user 0.000s	sys 0.001s
W20260812 19:22:32.084105  8930 consensus_meta.cc:287] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.003s
I20260812 19:22:32.085103  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.036746  9105 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:32.088197  8847 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:32.028288  8892 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.107800  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.111836  6474 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:32.117990  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:31.935555  6235 rpcz_store.cc:276] 0812 19:22:29.354642 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:29.852784 (+498142us) service_pool.cc:227] Handling call
0812 19:22:29.870603 (+ 17819us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:29.870900 (+   297us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:29.870938 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:30.951801 (+1080863us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b2c0006c608. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:22:30.952352 (+   551us) log.cc:842] Serialized 26 byte log entry
0812 19:22:31.159256 (+206904us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:31.159304 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:31.159404 (+   100us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:31.699753 (+540349us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:22:31.878515 (+178762us) raft_consensus.cc:1671] finished
0812 19:22:31.878543 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:31.878819 (+   276us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":20384256,"thread_start_us":206256,"threads_started":1,"wal-append.queue_time_us":512917}
I20260812 19:22:32.120916  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:32.121685  6235 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:32.084797  8930 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:32.123795  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.944622  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.984486  6417 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:31.945087  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:32.125190  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 140758us
I20260812 19:22:32.121603  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.126051  6417 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:31.986001  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:22:32.127271  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 141326us
I20260812 19:22:32.128171  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:31.986886  6470 raft_consensus.cc:2379] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:31.927196  8966 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:32.134459  6235 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:32.135639  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:32.136274  6235 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:31.987666  6241 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:32.140113  6241 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:31.989818  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.990396  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:32.145917  6242 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:32.147709  6242 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:31.893311  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:32.149879  6232 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 1.
I20260812 19:22:32.137156  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:31.979029  9081 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.154263  9081 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:32.155062  9081 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:31.982820  8955 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:32.156435  8955 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:31.992036  9001 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:31.991865  8665 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:31.992115  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:32.162307  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:31.993718  8846 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:31.995157  8791 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:31.996671  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:31.997344  8886 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:31.983259  8810 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260812 19:22:31.871412  9080 raft_consensus.cc:686] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:32.168644  9080 consensus_queue.cc:237] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
W20260812 19:22:31.982950  9120 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260812 19:22:32.170913  9071 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:31.912745  8962 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:22:32.034300  8887 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.011s	sys 0.011s
I20260812 19:22:32.054986  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.037746  8890 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:32.181300  8887 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.011s	sys 0.012s
W20260812 19:22:32.059348  6350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1397) took 2726 ms (client timeout 1702 ms). Trace:
I20260812 19:22:32.064447  8691 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:31.938714  6481 rpcz_store.cc:276] 0812 19:22:28.429711 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:28.443925 (+ 14214us) service_pool.cc:227] Handling call
0812 19:22:28.452288 (+  8363us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:28.541972 (+ 89684us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:28.542019 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:30.546531 (+2004512us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b2c000cda88. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:22:30.547132 (+   601us) log.cc:842] Serialized 26 byte log entry
0812 19:22:31.281477 (+734345us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:31.281515 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:31.281586 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:31.683614 (+402028us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:22:31.879735 (+196121us) raft_consensus.cc:1671] finished
0812 19:22:31.879766 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:31.879917 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":89169,"raft.queue_time_us":93594,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":159,"spinlock_wait_cycles":124873216,"thread_start_us":733859,"threads_started":1,"wal-append.queue_time_us":849528}
I20260812 19:22:31.898149  8860 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:32.194979  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.012s	sys 0.012s
I20260812 19:22:32.125264  6236 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:32.126497  6475 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:31.989228  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:32.196834  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:32.198052  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:32.200026  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.201229  6345 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
W20260812 19:22:32.201632  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 205044us
I20260812 19:22:32.074046  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.133451  9150 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260812 19:22:32.203148  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.012s	sys 0.012s
I20260812 19:22:32.132413  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.134312  8864 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260812 19:22:32.178089  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 52128.3us
I20260812 19:22:32.215785  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:31.915696  9131 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260812 19:22:32.181851  6482 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:32.175625  6477 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:32.185098  6241 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:32.172636  8962 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:32.069664  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:32.190605  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:32.119647  9105 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:32.192943  6178 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.015s	sys 0.008s
W20260812 19:22:32.227751  6178 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.015s	sys 0.008s
W20260812 19:22:32.228169  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 629382us
W20260812 19:22:32.186355  6350 rpcz_store.cc:269] 0812 19:22:29.332527 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:29.349515 (+ 16988us) service_pool.cc:227] Handling call
0812 19:22:32.059092 (+2709577us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b540034fb54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:32.059252 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4590131968}
I20260812 19:22:32.076973  6349 raft_consensus.cc:595] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
W20260812 19:22:32.202844  6224 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.030s	sys 0.075s
I20260812 19:22:32.111694  9053 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:32.197271  8847 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260812 19:22:32.186053  9060 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:32.238858  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.239615  6482 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:32.173882  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.212914  6465 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:32.200711  6481 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:32.186708  9022 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:32.246430  9053 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:32.246806  9022 raft_consensus.cc:686] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:32.247778  9022 consensus_queue.cc:237] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.207703  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:32.250051  8516 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:32.250815  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:32.251487  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:32.252285  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:32.252735  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:32.208244  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.253556  6475 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:32.254010  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:32.209669  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:22:32.256412  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 46803.1us
I20260812 19:22:32.257107  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:32.246440  6481 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:32.258178  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:32.217602  6464 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:32.261720  6470 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:32.235759  8955 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:32.223557  6353 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:32.268110  6344 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:32.193717  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.205217  9150 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:32.236573  8691 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:32.232611  6224 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.031s	sys 0.075s
I20260812 19:22:32.211594  8864 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:32.163985  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:32.199038  8860 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.244853  9096 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:32.252907  6345 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:32.216718  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:32.285386  6359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:32.288926  6359 raft_consensus.cc:595] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Received request to transfer leadership to TS f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:32.263579  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.264930  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:32.216425  6354 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 3.
I20260812 19:22:32.291018  6482 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:32.263016  9094 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:32.296887  6354 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:32.273344  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:32.274976  8791 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:32.277277  6353 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:32.270465  8940 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:32.277842  9144 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260812 19:22:32.238318  9060 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:32.208384  8888 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.011s	sys 0.018s
I20260812 19:22:32.267477  8846 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260812 19:22:32.268887  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.017s	sys 0.038s
W20260812 19:22:32.326719  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.018s	sys 0.038s
W20260812 19:22:32.327075  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 583093us
W20260812 19:22:32.329118  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55898.8us
I20260812 19:22:32.295603  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:32.334749  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:32.270345  8886 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:32.278935  8864 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:32.298681  6172 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.041s	sys 0.102s
W20260812 19:22:32.339775  6172 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.042s	sys 0.102s
I20260812 19:22:32.302948  8892 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:32.313827  8791 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:22:32.320974  8888 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.011s	sys 0.019s
I20260812 19:22:32.309078  6483 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:32.308933  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:32.312327  8698 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:32.275151  9150 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:32.254635  6349 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:32.281560  9096 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:32.349133  6345 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:32.306870  8810 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:32.319392  9060 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:32.369534  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:32.370723  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:32.339278  8886 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:32.371057  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:32.395092  6347 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:32.343304  8735 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:32.322288  8846 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:32.342152  8940 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:32.379034  9001 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260812 19:22:32.379815  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45178.2us
I20260812 19:22:32.306056  6359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:32.386694  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:32.406929  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.406378  6359 raft_consensus.cc:595] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Received request to transfer leadership to TS f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:32.388411  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:32.389170  7593 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:32.317138  9094 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.397209  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:32.397078  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:32.361060  8791 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:32.403753  8846 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:32.404985  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 74766.6us
I20260812 19:22:32.375228  7594 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:32.407877  6359 raft_consensus.cc:603] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260812 19:22:32.431629  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 58863.8us
I20260812 19:22:32.436545  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:22:32.469026  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 72040.3us
W20260812 19:22:32.460409  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 269864us
I20260812 19:22:32.471179  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:32.472666  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:32.474552  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:32.476156  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:32.495213  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:22:32.496301  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 272053us
I20260812 19:22:32.394296  9096 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:32.500356  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:32.390097  8665 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:32.393308  8691 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:32.497154  6417 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:32.390872  8698 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.436502  9162 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:32.402261  8886 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:32.493444  6474 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:32.398725  8735 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:32.408391  9001 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:32.503892  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:32.495064  8887 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:32.509116  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:32.427762  9147 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:32.408830  8940 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:32.460696  9081 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:32.518990  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.520731  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:32.514814  9154 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:32.443912  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:32.511933  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:32.559063  6228 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:32.497821  9090 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:32.567585  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:32.528273  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:32.504179  9109 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:32.531188  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:32.509074  8955 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:32.559489  6474 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:32.507512  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:32.560154  6359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c59df69987ce4bc38077cd7681552414"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:32.560256  6230 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:32.559142  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:32.494750  9164 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:32.526955  8847 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:32.568567  6235 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 3.
I20260812 19:22:32.527006  8735 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:32.527585  9001 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:32.583402  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 75959.4us
I20260812 19:22:32.548938  9155 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260812 19:22:32.585009  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 56816.5us
I20260812 19:22:32.511550  8728 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:32.560191  8940 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:32.588330  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:32.565435  9154 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:32.581595  6464 raft_consensus.cc:1261] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:32.594353  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:32.618382  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:32.567834  9090 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:32.609972  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:32.581838  9164 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:32.569077  9081 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.580300  9109 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:32.524067  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:32.560491  8930 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260812 19:22:32.591441  8847 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:32.590806  8892 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:32.620698  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:32.640455  6235 raft_consensus.cc:2379] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:32.615049  8862 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:32.612572  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:32.621738  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:32.591194  8952 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:32.586835  9178 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:32.436739  8938 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.182s
I20260812 19:22:32.593231  9155 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:32.559333  9147 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:32.599484  8728 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:32.616883  9154 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:32.639602  8847 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:32.624974  9090 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:32.627962  8943 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:32.628856  9164 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:32.634604  9109 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:32.686532  9204 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:32.689411  9204 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:22:32.689885  9167 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260812 19:22:32.687506  9165 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260812 19:22:32.626956  9156 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260812 19:22:32.689949  9204 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:32.526937  9162 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.648413  9178 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:32.647734  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:32.719295  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:32.667959  9002 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:32.671833  8728 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:32.676373  8516 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:32.644565  8952 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:32.644999  8862 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:32.663324  9105 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 19:22:32.664647  8966 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260812 19:22:32.623023  8890 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.687592  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1318) took 1038 ms. Trace:
I20260812 19:22:32.672292  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:32.642822  7599 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:32.636830  8888 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260812 19:22:32.737447  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:32.767915  6235 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 2: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:32.669479  9155 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:32.683647  9094 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:32.754575  6224 rpcz_store.cc:276] 0812 19:22:31.648950 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:31.649339 (+   389us) service_pool.cc:227] Handling call
0812 19:22:31.649800 (+   461us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:32.271381 (+621581us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:32.271433 (+    52us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:32.280605 (+  9172us) log.cc:842] Serialized 26 byte log entry
0812 19:22:32.509743 (+229138us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:32.509798 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:32.509913 (+   115us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:32.687241 (+177328us) raft_consensus.cc:1671] finished
0812 19:22:32.687290 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:32.687504 (+   214us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":77975,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":13899,"thread_start_us":831534,"threads_started":2,"wal-append.queue_time_us":325193}
I20260812 19:22:32.769985  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:32.775601  6230 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 3.
W20260812 19:22:32.778745  9184 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260812 19:22:32.783525  9191 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260812 19:22:32.784941  8892 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:32.785480  9026 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:32.742244  8862 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:32.786609  8992 consensus_meta.cc:287] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.783s	user 0.011s	sys 0.002s
I20260812 19:22:32.730448  9178 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:32.810104  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:32.731065  8943 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:32.734943  9002 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:32.789989  6179 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:32.742126  8952 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:22:32.816468  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 236430us
I20260812 19:22:32.838243  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:32.860011  7603 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260812 19:22:32.785473  8892 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:32.772778  6342 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:32.768174  9162 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:32.834584  9002 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:32.886834  6359 raft_consensus.cc:595] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:32.753459  8516 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.891829  6359 raft_consensus.cc:603] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:32.782378  8864 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.881523  8892 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:32.834172  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1356) took 1724 ms. Trace:
W20260812 19:22:32.914814  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 124930us
W20260812 19:22:32.888885  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 50768.3us
I20260812 19:22:32.921914  6475 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:32.895314  9012 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:32.905946  8930 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:32.920787  6179 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:32.924547  9081 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:32.935618  9162 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 19:22:32.938997  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 317334us
I20260812 19:22:32.943812  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:32.944631  6349 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
W20260812 19:22:32.951359  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 357173us
I20260812 19:22:32.954203  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:32.957860  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:32.959203  6230 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:32.963253  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:32.967768  6352 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260812 19:22:32.968024  9162 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:32.968765  9162 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:32.973603  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:32.974853  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1334) took 1230 ms. Trace:
I20260812 19:22:32.979785  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:32.975514  6236 rpcz_store.cc:276] 0812 19:22:31.744358 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.195773 (+451415us) service_pool.cc:227] Handling call
0812 19:22:32.207148 (+ 11375us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:32.207530 (+   382us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:32.207563 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:32.651158 (+443595us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b2c0006c608. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:22:32.668608 (+ 17450us) log.cc:842] Serialized 26 byte log entry
0812 19:22:32.951752 (+283144us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:32.951822 (+    70us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:32.951921 (+    99us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:32.952001 (+    80us) raft_consensus.cc:1671] finished
0812 19:22:32.952023 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:32.974774 (+ 22751us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3576,"spinlock_wait_cycles":57127552,"thread_start_us":252562,"threads_started":1,"wal-append.queue_time_us":273038}
I20260812 19:22:32.928545  8930 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:32.930227  9012 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:33.051791  9012 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:32.949836  9199 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:33.031111  6232 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.024s	sys 0.012s
W20260812 19:22:33.061642  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 81960.9us
W20260812 19:22:33.076092  6482 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.008s	sys 0.017s
I20260812 19:22:33.077329  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:33.087512  6482 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.008s	sys 0.018s
W20260812 19:22:33.082572  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.016s	sys 0.033s
W20260812 19:22:33.109449  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.016s	sys 0.033s
I20260812 19:22:33.054275  8930 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:32.990175  9207 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:33.051820  9081 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:33.075850  9080 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260812 19:22:33.125738  9223 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
W20260812 19:22:33.104645  6232 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.024s	sys 0.012s
I20260812 19:22:32.919528  6473 rpcz_store.cc:276] 0812 19:22:31.109656 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:31.110825 (+  1169us) service_pool.cc:227] Handling call
0812 19:22:31.170520 (+ 59695us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:31.751761 (+581241us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:32.809240 (+1057479us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54001310d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:32.821761 (+ 12521us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":693891840}
I20260812 19:22:33.099397  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:33.145730  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 633834us
I20260812 19:22:33.188867  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:33.190481  6230 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:33.070281  8966 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:32.928239  8943 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:33.136148  8890 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:33.194775  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:33.196962  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:33.139083  9080 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:33.135594  9207 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:33.137365  9081 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:33.194290  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 85712.8us
I20260812 19:22:33.213754  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1374) took 1443 ms. Trace:
W20260812 19:22:33.280797  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 92017.8us
I20260812 19:22:33.312837  6481 rpcz_store.cc:276] 0812 19:22:31.770362 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.259920 (+489558us) service_pool.cc:227] Handling call
0812 19:22:32.348545 (+ 88625us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:32.348836 (+   291us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:32.348881 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:32.348950 (+    69us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:32.348995 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:32.349086 (+    91us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:33.213525 (+864439us) spinlock_profiling.cc:243] Waited 87.8 ms on lock 0x7b54001040d0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:33.213669 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":201934208}
I20260812 19:22:33.321072  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:33.283407  6230 raft_consensus.cc:2396] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:33.211191  8966 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:33.428337  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:33.281438  8852 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:33.311252  9181 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.501s	user 0.000s	sys 0.002s
I20260812 19:22:33.319442  9080 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:33.348246  9081 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:22:33.289505  9194 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.341s	user 0.004s	sys 0.006s
I20260812 19:22:33.429853  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:22:33.596693  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 385891us
I20260812 19:22:33.822341  6230 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:33.306265  9147 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:33.646579  6483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1080) took 1888 ms (client timeout 1579 ms). Trace:
I20260812 19:22:33.440380  8966 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:33.433400  8864 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:33.699816  6353 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.021s	sys 0.059s
W20260812 19:22:33.844406  6353 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.021s	sys 0.059s
W20260812 19:22:33.798241  9197 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.903s	user 0.002s	sys 0.000s
I20260812 19:22:33.126392  9199 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:33.426141  8516 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:33.556483  8852 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:33.344437  8962 consensus_meta.cc:287] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 1.113s	user 0.009s	sys 0.026s
I20260812 19:22:33.435791  9220 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:33.833917  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1339) took 1941 ms. Trace:
W20260812 19:22:33.840628  6483 rpcz_store.cc:269] 0812 19:22:31.758422 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:31.938112 (+179690us) service_pool.cc:227] Handling call
0812 19:22:33.646260 (+1708148us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54003a8254. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:33.646468 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":650285440}
I20260812 19:22:33.899377  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:33.436582  6352 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:33.522673  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:33.860138  6224 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.059s	sys 0.091s
W20260812 19:22:33.904727  6224 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.060s	sys 0.091s
I20260812 19:22:33.799188  9162 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:33.861532  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 548296us
I20260812 19:22:33.317601  9207 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:33.909186  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:33.880923  6238 rpcz_store.cc:276] 0812 19:22:31.892039 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.015742 (+123703us) service_pool.cc:227] Handling call
0812 19:22:33.833559 (+1817817us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b5400120cd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:33.833809 (+   250us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2164199296}
W20260812 19:22:33.819149  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.013s	sys 0.003s
W20260812 19:22:33.937476  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.013s	sys 0.003s
W20260812 19:22:33.954246  6236 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.005s	sys 0.013s
W20260812 19:22:33.954793  6236 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.005s	sys 0.013s
W20260812 19:22:33.923580  9001 consensus_meta.cc:287] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.309s	user 0.023s	sys 0.011s
I20260812 19:22:33.959615  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:33.933609  9181 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260812 19:22:33.867384  8724 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:33.961449  6238 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
W20260812 19:22:33.941367  9155 consensus_meta.cc:287] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.127s	user 0.004s	sys 0.005s
W20260812 19:22:33.943878  9150 consensus_meta.cc:287] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.545s	user 0.015s	sys 0.015s
I20260812 19:22:33.950917  9214 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:33.976617  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:33.967504  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.009s	sys 0.013s
W20260812 19:22:33.983736  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.010s	sys 0.013s
I20260812 19:22:33.985718  6179 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:34.011081  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1384) took 1578 ms. Trace:
I20260812 19:22:34.011796  6470 rpcz_store.cc:276] 0812 19:22:32.432952 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.433177 (+   225us) service_pool.cc:227] Handling call
0812 19:22:32.433646 (+   469us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:32.499242 (+ 65596us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:32.499279 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:32.510121 (+ 10842us) log.cc:842] Serialized 26 byte log entry
0812 19:22:32.671330 (+161209us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:32.675614 (+  4284us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:32.675705 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:34.010734 (+1335029us) raft_consensus.cc:1671] finished
0812 19:22:34.010770 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:34.010997 (+   227us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":13721,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":34146,"thread_start_us":121236,"threads_started":1,"wal-append.queue_time_us":243412}
I20260812 19:22:34.013346  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:33.983299  8940 consensus_meta.cc:287] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.361s	user 0.010s	sys 0.017s
W20260812 19:22:34.020488  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.000s	sys 0.020s
I20260812 19:22:34.024061  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1459) took 2087 ms. Trace:
I20260812 19:22:34.028901  6241 rpcz_store.cc:276] 0812 19:22:31.936619 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.221322 (+284703us) service_pool.cc:227] Handling call
0812 19:22:32.221682 (+   360us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:32.222147 (+   465us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:32.222173 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:32.229974 (+  7801us) log.cc:842] Serialized 26 byte log entry
0812 19:22:32.445350 (+215376us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:32.603039 (+157689us) log.cc:842] Serialized 14 byte log entry
0812 19:22:32.603444 (+   405us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:32.603557 (+   113us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:34.023819 (+1420262us) raft_consensus.cc:1671] finished
0812 19:22:34.023846 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:34.024005 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":152173,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":228,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":11317,"spinlock_wait_cycles":15414016,"thread_start_us":276257,"threads_started":2,"wal-append.queue_time_us":444207}
I20260812 19:22:34.032243  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:34.027984  6470 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:34.034060  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:34.034926  6352 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
W20260812 19:22:33.983472  9002 consensus_meta.cc:287] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.075s	user 0.011s	sys 0.008s
W20260812 19:22:34.036104  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 791447us
I20260812 19:22:34.033399  6241 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:33.982705  9243 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:34.015106  9234 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.827s	user 0.000s	sys 0.001s
W20260812 19:22:34.036875  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.000s	sys 0.021s
I20260812 19:22:34.040872  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:33.933017  8962 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:33.987280  9214 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:33.968712  9001 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:34.022104  9205 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:34.023000  9090 consensus_meta.cc:287] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.301s	user 0.007s	sys 0.019s
I20260812 19:22:34.054586  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:34.049461  8846 consensus_meta.cc:287] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.547s	user 0.007s	sys 0.028s
I20260812 19:22:33.986637  8724 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
W20260812 19:22:34.080354  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 767933us
I20260812 19:22:34.085939  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:33.933671  9220 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:34.055162  9228 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.037s	sys 0.033s
I20260812 19:22:33.975272  9248 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260812 19:22:33.987643  9150 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:33.980114  9155 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:34.035676  8940 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:34.011837  9241 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.152s
I20260812 19:22:34.054476  9243 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:34.316562  8735 consensus_meta.cc:287] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.719s	user 0.012s	sys 0.026s
W20260812 19:22:34.922185  6483 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.004s	sys 0.044s
W20260812 19:22:34.922901  6483 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.004s	sys 0.045s
I20260812 19:22:34.923169  8810 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:34.922513  8735 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:34.924993  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1390) took 2423 ms. Trace:
I20260812 19:22:34.924690  8810 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:34.925529  6241 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:34.273005  8724 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:34.928118  8724 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:34.929661  8735 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:34.112836  7606 raft_consensus.cc:2396] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260812 19:22:34.167064  6352 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:34.084774  8846 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:34.116010  6345 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:34.164678  6230 raft_consensus.cc:2396] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260812 19:22:34.159330  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 235187us
W20260812 19:22:34.200309  6477 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.321s	user 0.011s	sys 0.010s
W20260812 19:22:34.931958  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.502s (SENT) [suppressed 9 similar messages]
I20260812 19:22:34.934626  8846 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:34.952366  9264 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:34.933132  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1430) took 1851 ms. Trace:
W20260812 19:22:34.912596  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 801320us
I20260812 19:22:34.930598  8724 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:34.943985  7554 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.035s	sys 0.050s
I20260812 19:22:34.931691  8735 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:22:34.754835  8952 consensus_meta.cc:287] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.893s	user 0.014s	sys 0.000s
I20260812 19:22:34.925624  6483 rpcz_store.cc:276] 0812 19:22:32.502007 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:33.949240 (+1447233us) service_pool.cc:227] Handling call
0812 19:22:33.949873 (+   633us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:33.950281 (+   408us) raft_consensus.cc:1520] Early marking committed up to index 2
0812 19:22:34.184512 (+234231us) log.cc:842] Serialized 14 byte log entry
0812 19:22:34.923963 (+739451us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:34.924119 (+   156us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:34.924302 (+   183us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:34.924491 (+   189us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:34.924852 (+   361us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":954037,"threads_started":2}
I20260812 19:22:35.038511  8952 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:34.183579  9096 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.667s	user 0.009s	sys 0.021s
W20260812 19:22:34.473080  9060 consensus_meta.cc:287] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 2.064s	user 0.030s	sys 0.015s
I20260812 19:22:34.074098  9214 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:35.032708  8955 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:35.041824  9096 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:34.124146  9251 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260812 19:22:34.498013  8992 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.051s	user 0.013s	sys 0.009s
I20260812 19:22:34.941910  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:22:34.352982  9204 consensus_meta.cc:287] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.661s	user 0.008s	sys 0.027s
I20260812 19:22:34.939474  8516 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:35.030463  9228 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.589s	user 0.048s	sys 0.043s
W20260812 19:22:34.384680  8791 consensus_meta.cc:287] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.884s	user 0.010s	sys 0.024s
W20260812 19:22:35.024187  8943 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.001s	sys 0.016s
I20260812 19:22:35.032840  9245 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20260812 19:22:34.472899  8892 consensus_meta.cc:287] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.548s	user 0.012s	sys 0.006s
W20260812 19:22:34.318280  9154 consensus_meta.cc:287] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.632s	user 0.006s	sys 0.014s
W20260812 19:22:34.749509  8886 consensus_meta.cc:287] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 2.199s	user 0.021s	sys 0.048s
W20260812 19:22:34.795507  9080 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.147s	user 0.011s	sys 0.009s
W20260812 19:22:34.471484  8862 consensus_meta.cc:287] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.684s	user 0.012s	sys 0.012s
W20260812 19:22:34.593618  9178 consensus_meta.cc:287] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.758s	user 0.009s	sys 0.012s
W20260812 19:22:35.036193  6342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1155) took 3208 ms (client timeout 1545 ms). Trace:
W20260812 19:22:34.731917  9081 consensus_meta.cc:287] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.923s	user 0.011s	sys 0.000s
I20260812 19:22:35.024436  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:35.040508  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1372) took 3270 ms. Trace:
W20260812 19:22:35.026753  6477 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.064s	user 0.024s	sys 0.018s
I20260812 19:22:35.038335  8735 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:34.975273  6352 rpcz_store.cc:276] 0812 19:22:33.081320 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:34.121379 (+1040059us) service_pool.cc:227] Handling call
0812 19:22:34.166807 (+ 45428us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:34.932516 (+765709us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:34.932876 (+   360us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:34.316706  9220 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:34.089046  9215 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.806s	user 0.001s	sys 0.001s
I20260812 19:22:35.032488  6349 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260812 19:22:34.939235  6230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1478) took 1725 ms (client timeout 1697 ms). Trace:
I20260812 19:22:35.032465  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1309) took 5122 ms. Trace:
W20260812 19:22:35.189065  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 134576us
I20260812 19:22:35.043619  9251 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:35.179724  6475 rpcz_store.cc:276] 0812 19:22:31.769695 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.255407 (+485712us) service_pool.cc:227] Handling call
0812 19:22:32.255669 (+   262us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:32.922426 (+666757us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.039777 (+2117351us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400213ed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:35.040213 (+   436us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1531707264}
I20260812 19:22:35.050314  6464 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:35.028107  8810 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:34.364127  7551 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.002s	sys 0.004s
W20260812 19:22:35.043717  8992 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.609s	user 0.017s	sys 0.019s
I20260812 19:22:35.048653  6465 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:35.202091  9105 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:35.222831  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1383) took 2809 ms. Trace:
I20260812 19:22:35.223207  8962 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:35.223343  9109 consensus_meta.cc:287] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 2.535s	user 0.020s	sys 0.022s
I20260812 19:22:35.222921  9105 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:35.052237  9096 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:34.735070  9207 consensus_meta.cc:287] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.779s	user 0.003s	sys 0.006s
W20260812 19:22:34.471961  9012 consensus_meta.cc:287] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.373s	user 0.013s	sys 0.000s
W20260812 19:22:34.747174  8847 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 2.052s	user 0.015s	sys 0.014s
I20260812 19:22:35.052033  8940 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:34.315949  9236 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.342s	user 0.001s	sys 0.001s
W20260812 19:22:34.352810  8930 consensus_meta.cc:287] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.214s	user 0.007s	sys 0.004s
I20260812 19:22:35.257908  9243 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:35.258085  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1170) took 3021 ms. Trace:
W20260812 19:22:35.045492  8943 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.001s	sys 0.018s
W20260812 19:22:34.365183  9153 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 2.243s	user 0.009s	sys 0.006s
W20260812 19:22:34.770035  8966 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.916s	user 0.011s	sys 0.000s
W20260812 19:22:34.590840  8728 consensus_meta.cc:287] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.836s	user 0.009s	sys 0.009s
I20260812 19:22:35.042644  8952 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.258607  6354 rpcz_store.cc:276] 0812 19:22:32.236179 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.293509 (+ 57330us) service_pool.cc:227] Handling call
0812 19:22:32.293745 (+   236us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:32.298836 (+  5091us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.257495 (+2958659us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400470a20. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7708730 00007f98f777bb42 00007f98f7777f26 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:22:35.257863 (+   368us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":243030400}
I20260812 19:22:35.276013  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1476) took 2062 ms. Trace:
W20260812 19:22:35.206581  6230 rpcz_store.cc:269] 0812 19:22:33.214083 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:33.429541 (+215458us) service_pool.cc:227] Handling call
0812 19:22:34.938940 (+1509399us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:35.045853  9264 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:34.330015  9237 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260812 19:22:34.323938  9272 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:34.303948  9001 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.283720  9155 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:34.324118  9273 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:35.282831  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:35.285117  9273 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.207345  6228 rpcz_store.cc:276] 0812 19:22:29.910220 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:30.591237 (+681017us) service_pool.cc:227] Handling call
0812 19:22:30.591646 (+   409us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:32.566095 (+1974449us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.031641 (+2465546us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b540035f054. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:35.032194 (+   553us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4523626240}
I20260812 19:22:35.286773  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1426) took 2208 ms. Trace:
I20260812 19:22:35.288451  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:35.289777  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1467) took 2099 ms. Trace:
I20260812 19:22:35.043285  8955 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.293567  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1393) took 2227 ms. Trace:
I20260812 19:22:35.293689  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1387) took 2834 ms. Trace:
I20260812 19:22:35.280614  8962 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:35.295594  8962 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:35.296034  8962 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:35.294116  6470 rpcz_store.cc:276] 0812 19:22:33.066044 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:34.034904 (+968860us) service_pool.cc:227] Handling call
0812 19:22:34.035264 (+   360us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:34.035753 (+   489us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:34.035860 (+   107us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:34.036396 (+   536us) log.cc:842] Serialized 26 byte log entry
0812 19:22:34.199563 (+163167us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:34.199610 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:34.199693 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:35.293050 (+1093357us) raft_consensus.cc:1671] finished
0812 19:22:35.293101 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:35.293352 (+   251us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":168,"raft.queue_time_us":166740,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":26031,"thread_start_us":162810,"threads_started":1,"wal-append.queue_time_us":1245054}
I20260812 19:22:35.294252  6481 rpcz_store.cc:276] 0812 19:22:32.459345 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:33.376974 (+917629us) service_pool.cc:227] Handling call
0812 19:22:33.438056 (+ 61082us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:33.635267 (+197211us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:33.635319 (+    52us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:33.636039 (+   720us) log.cc:842] Serialized 26 byte log entry
0812 19:22:34.188130 (+552091us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:34.188183 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:34.188287 (+   104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:35.293158 (+1104871us) raft_consensus.cc:1671] finished
0812 19:22:35.293200 (+    42us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:35.293461 (+   261us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":196300,"raft.queue_time_us":388607,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":12045,"thread_start_us":385200,"threads_started":1,"wal-append.queue_time_us":1489763}
I20260812 19:22:35.298009  6481 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260812 19:22:35.299295  9216 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.762s	user 0.000s	sys 0.014s
I20260812 19:22:35.047147  8892 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.249289  9081 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:35.299705  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.265s	user 0.005s	sys 0.028s
W20260812 19:22:35.300319  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.360s	user 0.005s	sys 0.028s
I20260812 19:22:35.249699  9012 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:35.300930  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 1.36061e+06us
I20260812 19:22:35.303010  9012 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:34.042975  9002 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.288065  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1437) took 1746 ms. Trace:
I20260812 19:22:35.305724  9002 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.223414  6465 rpcz_store.cc:276] 0812 19:22:32.413661 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.427362 (+ 13701us) service_pool.cc:227] Handling call
0812 19:22:35.047431 (+2620069us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824bce 000000000034aea9 00007f98fc644a30 00007f98fc70a7b4 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:22:35.047843 (+   412us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:35.222346 (+174503us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.222716 (+   370us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":18053376}
I20260812 19:22:35.308259  8728 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.309166  6238 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:35.251924  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1178) took 2290 ms. Trace:
I20260812 19:22:35.252539  9096 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:35.310586  6349 rpcz_store.cc:276] 0812 19:22:32.961394 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.961611 (+   217us) service_pool.cc:227] Handling call
0812 19:22:32.962119 (+   508us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:35.210906 (+2248787us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.251335 (+ 40429us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b540025ec54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:35.251813 (+   478us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4759573760}
W20260812 19:22:35.313448  6238 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1469) took 2122 ms (client timeout 1978 ms). Trace:
I20260812 19:22:35.253675  7600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 313) took 2864 ms. Trace:
I20260812 19:22:35.253479  9207 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:35.254333  9293 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:35.254906  9163 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:35.254842  8847 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.256197  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:34.261160  8852 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:35.219830  9251 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:35.048979  8862 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:35.052565  6342 rpcz_store.cc:269] 0812 19:22:31.827764 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:31.881599 (+ 53835us) service_pool.cc:227] Handling call
0812 19:22:35.035521 (+3153922us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b540009ecd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:35.035874 (+   353us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1894600448}
W20260812 19:22:35.265019  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 323524us
I20260812 19:22:34.083743  9090 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:34.084234  9205 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.267100  9302 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:35.267586  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:35.267985  9150 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:35.269531  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1332) took 3536 ms. Trace:
I20260812 19:22:35.269985  6475 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:35.213320  9060 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:35.270535  9105 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:35.044641  9204 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:35.270925  7551 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.422s	user 0.019s	sys 0.015s
I20260812 19:22:35.271538  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1182) took 2305 ms. Trace:
I20260812 19:22:35.272243  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1386) took 2829 ms. Trace:
W20260812 19:22:35.272390  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 975702us
W20260812 19:22:35.273291  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 249223us
I20260812 19:22:35.048226  8886 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.274489  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1341) took 2865 ms. Trace:
I20260812 19:22:35.047379  9154 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.224215  9109 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.258457  8930 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:35.044587  8516 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.277812  6241 rpcz_store.cc:276] 0812 19:22:33.213447 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:34.054292 (+840845us) service_pool.cc:227] Handling call
0812 19:22:35.275672 (+1221380us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b5400179154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:35.275939 (+   267us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1955369856}
I20260812 19:22:35.045492  8791 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.314265  8735 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:35.315748  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1397) took 1995 ms. Trace:
I20260812 19:22:35.441515  9204 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:35.442085  6347 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:35.442417  6345 rpcz_store.cc:276] 0812 19:22:32.966226 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.966470 (+   244us) service_pool.cc:227] Handling call
0812 19:22:32.966807 (+   337us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:34.937730 (+1970923us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.271055 (+333325us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540036db54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:35.271354 (+   299us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2642297600}
I20260812 19:22:35.443148  6344 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:35.443861  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1181) took 2478 ms. Trace:
I20260812 19:22:35.443609  6464 rpcz_store.cc:276] 0812 19:22:32.442759 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.672361 (+229602us) service_pool.cc:227] Handling call
0812 19:22:32.744034 (+ 71673us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:35.259003 (+2514969us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.271888 (+ 12885us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b5400364554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:35.272177 (+   289us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5280321408}
I20260812 19:22:35.444846  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1427) took 2366 ms. Trace:
I20260812 19:22:35.424906  9214 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:35.443926  8862 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.445346  6344 rpcz_store.cc:276] 0812 19:22:33.078864 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:33.079021 (+   157us) service_pool.cc:227] Handling call
0812 19:22:33.079510 (+   489us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:35.443794 (+2364284us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.444518 (+   724us) spinlock_profiling.cc:243] Waited 2.36 s on lock 0x7b54001ce3d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:35.444788 (+   270us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5434742016}
I20260812 19:22:35.447217  9214 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:35.447492  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1395) took 2340 ms. Trace:
I20260812 19:22:35.370393  8992 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:35.448472  9154 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.448869  8992 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.450815  9109 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.451079  7598 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:35.451735  8992 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.049469  9178 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.453912  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:35.048480  9080 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.455098  7603 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEARNER]: Advancing to term 3
I20260812 19:22:35.457231  6483 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:35.283134  9272 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:35.283610  8966 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.287395  6353 rpcz_store.cc:276] 0812 19:22:33.078298 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:33.078454 (+   156us) service_pool.cc:227] Handling call
0812 19:22:33.124303 (+ 45849us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:33.845010 (+720707us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:33.845073 (+    63us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:33.845814 (+   741us) log.cc:842] Serialized 26 byte log entry
0812 19:22:34.137192 (+291378us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:34.137265 (+    73us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:34.203197 (+ 65932us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:35.286253 (+1083056us) raft_consensus.cc:1671] finished
0812 19:22:35.286295 (+    42us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:35.286541 (+   246us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":65082,"raft.queue_time_us":606294,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":31438,"thread_start_us":856316,"threads_started":2,"wal-append.queue_time_us":1422039}
I20260812 19:22:35.305766  6354 rpcz_store.cc:276] 0812 19:22:33.541762 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:35.286467 (+1744705us) service_pool.cc:227] Handling call
0812 19:22:35.287169 (+   702us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:35.287593 (+   424us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:35.287629 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:35.287721 (+    92us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:35.287778 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.287856 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:35.287985 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:34.273357  9199 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.441090  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1340) took 3035 ms. Trace:
I20260812 19:22:35.290278  6228 rpcz_store.cc:276] 0812 19:22:33.190154 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:35.287826 (+2097672us) service_pool.cc:227] Handling call
0812 19:22:35.289677 (+  1851us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:35.447069  9163 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.451820  6473 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:35.454267  9178 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:35.282151  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 318065us
I20260812 19:22:35.448011  6475 rpcz_store.cc:276] 0812 19:22:33.107595 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:35.268842 (+2161247us) service_pool.cc:227] Handling call
0812 19:22:35.269389 (+   547us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:35.447211 (+177822us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.447409 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:34.206086  9267 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:34.744771  9164 consensus_meta.cc:287] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 2.009s	user 0.007s	sys 0.007s
I20260812 19:22:35.456663  9299 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:35.456705  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:35.463199  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:22:35.412767  7606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 306) took 3059 ms (client timeout 2936 ms). Trace:
I20260812 19:22:35.372088  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:35.313979  6238 rpcz_store.cc:269] 0812 19:22:33.191856 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:33.969884 (+778028us) service_pool.cc:227] Handling call
0812 19:22:35.313179 (+1343295us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540027ddd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:35.313373 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2976584960}
I20260812 19:22:35.328310  8892 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:35.363134  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49464 (request call id 12) took 2803 ms. Trace:
I20260812 19:22:35.422156  9264 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:35.368736  9193 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 2.683s	user 0.019s	sys 0.041s
I20260812 19:22:35.492961  9163 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:35.494086  7607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 311) took 3105 ms (client timeout 1795 ms). Trace:
I20260812 19:22:35.569396  6350 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:35.487411  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1385) took 3045 ms. Trace:
I20260812 19:22:35.432158  8698 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.456835  9080 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.421512  8728 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.450553  9060 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:35.360350  9081 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:35.357858  9273 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:35.441515  8791 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.433488  9026 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:35.459738  6347 rpcz_store.cc:276] 0812 19:22:32.965938 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.966071 (+   133us) service_pool.cc:227] Handling call
0812 19:22:32.966451 (+   380us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:35.442691 (+2476240us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.443497 (+   806us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b54004088d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:35.443793 (+   296us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5692111744}
W20260812 19:22:35.483908  9147 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.521s	user 0.007s	sys 0.020s
I20260812 19:22:35.355996  9309 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:35.505973  9178 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:35.441049  6481 rpcz_store.cc:276] 0812 19:22:33.316466 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:35.296866 (+1980400us) service_pool.cc:227] Handling call
0812 19:22:35.297530 (+   664us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:35.298556 (+  1026us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.311531 (+ 12975us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:35.353919  8955 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.372527  9156 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:22:35.506373  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 134582us
I20260812 19:22:35.492871  8930 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.560276  6352 raft_consensus.cc:2396] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:35.573300  6477 rpcz_store.cc:276] 0812 19:22:32.442402 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.445009 (+  2607us) service_pool.cc:227] Handling call
0812 19:22:32.568461 (+123452us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:22:32.568689 (+   228us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:32.678633 (+109944us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:32.678703 (+    70us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:32.712705 (+ 34002us) log.cc:842] Serialized 26 byte log entry
0812 19:22:35.365935 (+2653230us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b540033b6a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fdaf0 00007f98f7708028 00007f98f7778a7b 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c
0812 19:22:35.366061 (+   126us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:35.366138 (+    77us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.366251 (+   113us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:35.366314 (+    63us) raft_consensus.cc:1671] finished
0812 19:22:35.366332 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:35.487344 (+121012us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15527,"raft.queue_time_us":113767,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":226,"spinlock_wait_cycles":74921088,"thread_start_us":2395503,"threads_started":2,"wal-append.queue_time_us":2206687}
I20260812 19:22:35.582639  8862 consensus_queue.cc:1046] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260812 19:22:35.444540  6235 rpcz_store.cc:276] 0812 19:22:32.408526 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.880424 (+471898us) service_pool.cc:227] Handling call
0812 19:22:32.898592 (+ 18168us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:32.905953 (+  7361us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:32.906005 (+    52us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:32.915266 (+  9261us) log.cc:842] Serialized 26 byte log entry
0812 19:22:33.442096 (+526830us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:33.442142 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:33.442237 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:35.261755 (+1819518us) raft_consensus.cc:1671] finished
0812 19:22:35.264809 (+  3054us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:35.274289 (+  9480us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7175,"raft.queue_time_us":7678,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":11397,"spinlock_wait_cycles":262912,"thread_start_us":488547,"threads_started":1,"wal-append.queue_time_us":922421}
I20260812 19:22:35.484889  9214 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:35.431283  9170 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 2.841s	user 0.038s	sys 0.055s
W20260812 19:22:35.504410  7606 rpcz_store.cc:269] 0812 19:22:32.353162 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.355109 (+  1947us) service_pool.cc:227] Handling call
0812 19:22:35.412187 (+3057078us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54004d03d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:35.412489 (+   302us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3906514688}
I20260812 19:22:35.557883  6359 rpcz_store.cc:276] 0812 19:22:32.559765 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.559994 (+   229us) service_pool.cc:227] Handling call
0812 19:22:35.362689 (+2802695us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b540009ecd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7772bc3 00007f98fc6bc81a 00007f98f5dbbd04 00007f98f5dbbc92 00007f98f5dbbbc1 00007f98f5dbbb3c 00007f98f5dbadf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:35.362886 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":707866368}
W20260812 19:22:35.575707  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 52749.8us
I20260812 19:22:35.327528  8887 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:22:35.576896  9177 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.798s	user 0.042s	sys 0.089s
I20260812 19:22:35.466532  6224 rpcz_store.cc:276] 0812 19:22:32.405946 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.879445 (+473499us) service_pool.cc:227] Handling call
0812 19:22:32.879885 (+   440us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:32.932507 (+ 52622us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:32.932569 (+    62us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:32.933123 (+   554us) log.cc:842] Serialized 26 byte log entry
0812 19:22:33.905352 (+972229us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:33.905413 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.440348 (+1534935us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b5400164ed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:35.440425 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:35.440482 (+    57us) raft_consensus.cc:1671] finished
0812 19:22:35.440496 (+    14us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:35.440880 (+   384us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4331,"raft.queue_time_us":6896,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":20129,"spinlock_wait_cycles":96216960,"thread_start_us":857049,"threads_started":1,"wal-append.queue_time_us":1120983}
I20260812 19:22:35.576908  6229 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:35.574172  8992 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:35.582758  9210 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260812 19:22:35.583143  9147 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.625s	user 0.007s	sys 0.021s
I20260812 19:22:35.588625  8852 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:35.625022  9214 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:35.370808  8983 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:35.626322  8983 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.627513  9214 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:35.628207  7599 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:35.628316  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:35.628921  8983 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.459077  7600 rpcz_store.cc:276] 0812 19:22:32.389530 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.392516 (+  2986us) service_pool.cc:227] Handling call
0812 19:22:32.473150 (+ 80634us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:32.473376 (+   226us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:22:32.583176 (+109800us) log.cc:842] Serialized 14 byte log entry
0812 19:22:32.650960 (+ 67784us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:32.651015 (+    55us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:32.651060 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:32.651136 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:35.253171 (+2602035us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b540022abd0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:35.253437 (+   266us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":206349,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":402551,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":47637,"spinlock_wait_cycles":180451200,"thread_start_us":151335,"threads_started":2,"wal-append.queue_time_us":310620,"wal-append.run_cpu_time_us":1563,"wal-append.run_wall_time_us":1061935}
I20260812 19:22:35.597863  6228 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:35.599447  9163 consensus_queue.cc:1046] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260812 19:22:35.606576  6474 raft_consensus.cc:2354] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3.
I20260812 19:22:35.606240  9156 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.606439  9267 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.579888  9302 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:35.580945  9026 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:35.618448  8962 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:35.623600  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:22:35.569775  7607 rpcz_store.cc:269] 0812 19:22:32.388722 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.389661 (+   939us) service_pool.cc:227] Handling call
0812 19:22:35.255683 (+2866022us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b5800005498. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:35.493979 (+238296us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":46107392}
I20260812 19:22:35.640897  8860 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.625442  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1381) took 3161 ms. Trace:
I20260812 19:22:35.606454  9090 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:35.620792  9177 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.933s	user 0.042s	sys 0.090s
I20260812 19:22:35.635432  7603 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a [term 3 LEARNER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:22:35.636036  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1472) took 2427 ms. Trace:
I20260812 19:22:35.621330  9272 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:35.506373  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 49831.6us
I20260812 19:22:35.631328  8887 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:35.646206  6228 rpcz_store.cc:276] 0812 19:22:33.204496 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:35.500656 (+2296160us) service_pool.cc:227] Handling call
0812 19:22:35.582040 (+ 81384us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:35.631418 (+ 49378us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.631710 (+   292us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:35.649088  9267 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.650344  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1471) took 2446 ms. Trace:
I20260812 19:22:35.584923  9213 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260812 19:22:35.572748  9299 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:35.650965  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:35.650700  9205 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:35.655843  7607 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:35.658178  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:35.640911  9210 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:35.659586  9026 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:35.642561  9053 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.909s	user 0.019s	sys 0.028s
W20260812 19:22:35.660511  6298 connection.cc:232] RPC call timeout handler was delayed by -1.2738895160146058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2936s for a response
I20260812 19:22:35.642256  6482 rpcz_store.cc:276] 0812 19:22:32.409168 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.409322 (+   154us) service_pool.cc:227] Handling call
0812 19:22:32.471087 (+ 61765us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:32.471464 (+   377us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:32.471489 (+    25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:32.497912 (+ 26423us) log.cc:842] Serialized 26 byte log entry
0812 19:22:33.088227 (+590315us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:33.088292 (+    65us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:33.088400 (+   108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:35.298189 (+2209789us) spinlock_profiling.cc:243] Waited 52.2 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:22:35.368053 (+ 69864us) raft_consensus.cc:1671] finished
0812 19:22:35.368071 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:35.570431 (+202360us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":22659,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":10856,"spinlock_wait_cycles":119947136,"thread_start_us":560677,"threads_started":1,"wal-append.queue_time_us":636214}
I20260812 19:22:35.575613  9293 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.664024  8992 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:35.673776  9156 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.675544  8691 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:35.676367  6477 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 1.
I20260812 19:22:35.678845  9299 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:35.680619  9053 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.093s	user 0.020s	sys 0.028s
I20260812 19:22:35.672701  9164 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:35.687536  6224 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:35.629938  9309 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:35.663666  6241 rpcz_store.cc:276] 0812 19:22:33.204048 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:35.445056 (+2241008us) service_pool.cc:227] Handling call
0812 19:22:35.445558 (+   502us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:35.446021 (+   463us) raft_consensus.cc:1520] Early marking committed up to index 2
0812 19:22:35.567880 (+121859us) log.cc:842] Serialized 14 byte log entry
0812 19:22:35.649874 (+ 81994us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:35.649947 (+    73us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:35.650003 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.650112 (+   109us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:35.650272 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7544,"prepare.queue_time_us":177796,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":57,"raft.queue_time_us":14352,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":10814,"thread_start_us":165310,"threads_started":2}
I20260812 19:22:35.443998  6232 rpcz_store.cc:276] 0812 19:22:31.733389 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.150781 (+417392us) service_pool.cc:227] Handling call
0812 19:22:32.151228 (+   447us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:32.196508 (+ 45280us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:32.197655 (+  1147us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:32.241674 (+ 44019us) log.cc:842] Serialized 26 byte log entry
0812 19:22:33.211202 (+969528us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:33.281209 (+ 70007us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:33.347879 (+ 66670us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:35.268942 (+1921063us) raft_consensus.cc:1671] finished
0812 19:22:35.269000 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:35.269274 (+   274us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":31117,"raft.queue_time_us":43867,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":14209,"thread_start_us":870189,"threads_started":1,"wal-append.queue_time_us":847927}
I20260812 19:22:35.697275  6228 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:35.666033  9251 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:35.687301  8847 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:35.697882  8886 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.826701  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:35.827652  6465 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:35.828125  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:35.829159  6470 raft_consensus.cc:2354] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5.
I20260812 19:22:35.830351  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:35.832064  8930 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:35.832867  8930 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.834703  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:35.835601  6470 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:35.753003  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:35.836057  9309 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.730680  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1477) took 2502 ms. Trace:
I20260812 19:22:35.779960  6475 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260812 19:22:35.774525  6481 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
W20260812 19:22:35.770555  7553 connection.cc:232] RPC call timeout handler was delayed by -2.9648617929778993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
I20260812 19:22:35.767961  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:35.836488  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:35.843521  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1350) took 2654 ms. Trace:
I20260812 19:22:35.843740  8930 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.752024  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1475) took 2546 ms. Trace:
I20260812 19:22:35.694412  9163 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:35.767961  6352 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260812 19:22:35.773597  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:35.842269  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 191442us
W20260812 19:22:35.841609  7553 connection.cc:232] RPC call timeout handler was delayed by -2.9540617931634188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
I20260812 19:22:35.840288  6224 rpcz_store.cc:276] 0812 19:22:33.213790 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:35.642835 (+2429045us) service_pool.cc:227] Handling call
0812 19:22:35.680989 (+ 38154us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:35.716070 (+ 35081us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.716369 (+   299us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:22:35.844537  9324 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260812 19:22:35.712700  8691 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:35.845813  6235 rpcz_store.cc:276] 0812 19:22:33.205538 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:35.631937 (+2426399us) service_pool.cc:227] Handling call
0812 19:22:35.641949 (+ 10012us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:35.664919 (+ 22970us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:35.664966 (+    47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:35.669104 (+  4138us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:35.669131 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.751623 (+ 82492us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54002fab54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:35.751724 (+   101us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:35.751940 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":43622144}
I20260812 19:22:35.691972  8962 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:35.849161  7553 connection.cc:232] RPC call timeout handler was delayed by -2.910861792974174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
I20260812 19:22:35.692200  8992 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:35.773525  7591 raft_consensus.cc:1226] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:35.858405  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1331) took 4121 ms. Trace:
I20260812 19:22:35.774716  9207 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:35.726205  9302 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:35.796757  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:35.689182  9154 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.164s
I20260812 19:22:35.727849  6482 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:22:35.867347  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:35.844002  6236 rpcz_store.cc:276] 0812 19:22:33.188839 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:33.188982 (+   143us) service_pool.cc:227] Handling call
0812 19:22:33.302192 (+113210us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:35.438490 (+2136298us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b180018baa0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f4859155 00007f98f77703d0 00007f98f7770f6b 00007f98f777b78b
0812 19:22:35.490444 (+ 51954us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:35.490497 (+    53us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:35.583588 (+ 93091us) log.cc:842] Serialized 26 byte log entry
0812 19:22:35.632979 (+ 49391us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:35.633013 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:35.639066 (+  6053us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:35.842243 (+203177us) raft_consensus.cc:1671] finished
0812 19:22:35.842268 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:35.843345 (+  1077us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":631413,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":13985,"spinlock_wait_cycles":23594240,"thread_start_us":689307,"threads_started":2,"wal-append.queue_time_us":68757}
I20260812 19:22:35.797863  7599 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:35.848582  9163 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:35.747463  8860 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.130s
I20260812 19:22:35.871104  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:35.871459  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:22:35.872014  6297 connection.cc:232] RPC call timeout handler was delayed by -2.5428663140628487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260812 19:22:35.872458  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 120147us
I20260812 19:22:35.885826  6464 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:35.866070  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:35.795954  9001 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:35.875623  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:35.726238  9156 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.137s
I20260812 19:22:35.727195  9267 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.137s
I20260812 19:22:35.900399  6470 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:35.725888  9242 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.156s
W20260812 19:22:35.901793  6297 connection.cc:232] RPC call timeout handler was delayed by -1.626021453179419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
I20260812 19:22:35.881911  6359 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 4: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:35.877928  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:35.797122  9210 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.904093  6475 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:35.877928  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:35.904640  7553 connection.cc:232] RPC call timeout handler was delayed by -2.5454617929644883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
I20260812 19:22:35.892051  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:35.871450  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:35.870071  6347 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:35.906342  6228 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 2: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:35.896003  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:35.873488  6242 rpcz_store.cc:276] 0812 19:22:31.733116 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.148600 (+415484us) service_pool.cc:227] Handling call
0812 19:22:32.149014 (+   414us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:32.188408 (+ 39394us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:32.188464 (+    56us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:32.198169 (+  9705us) log.cc:842] Serialized 26 byte log entry
0812 19:22:32.460986 (+262817us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b18002964a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:22:32.571642 (+110656us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:32.572169 (+   527us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:32.572751 (+   582us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:35.354813 (+2782062us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b48001110d8. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fc61f7f1 00007f98fc6168e7 00007f98fc61677a 00007f98fc70a95f 00007f98fc70a627 00007f98fc71eb2c 00007f98fc71ead8 00007f98fc71ea58 00007f98fc71ea13 00007f98fc71dcbc 00007f98fb69fbe6
0812 19:22:35.367535 (+ 12722us) spinlock_profiling.cc:243] Waited 8.94 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:22:35.734620 (+367085us) raft_consensus.cc:1671] finished
0812 19:22:35.734674 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:35.854247 (+119573us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17370,"raft.queue_time_us":43671,"raft.run_cpu_time_us":35227,"raft.run_wall_time_us":3158325,"spinlock_wait_cycles":48214912,"thread_start_us":109578,"threads_started":1,"wal-append.queue_time_us":476012}
I20260812 19:22:35.906821  6236 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:35.887815  9163 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:35.869096  8992 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:35.898566  6235 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:35.908133  8930 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:35.911979  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:35.912184  6054 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 230) took 10327 ms. Trace:
I20260812 19:22:35.913383  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:35.914011  6474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1389) took 3417 ms (client timeout 1806 ms). Trace:
I20260812 19:22:35.899499  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:35.886139  9293 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.887216  6482 raft_consensus.cc:595] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
W20260812 19:22:35.905076  7553 connection.cc:232] RPC call timeout handler was delayed by -2.1280347849242389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260812 19:22:35.750872  9199 consensus_queue.cc:1046] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.167s
I20260812 19:22:35.890592  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:35.914426  6235 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:35.915093  6477 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:35.920318  7553 connection.cc:232] RPC call timeout handler was delayed by -1.8288357511628419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
W20260812 19:22:35.923641  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 63022.6us
W20260812 19:22:35.924005  7553 connection.cc:232] RPC call timeout handler was delayed by -1.8288357511628419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
W20260812 19:22:35.924463  7553 connection.cc:232] RPC call timeout handler was delayed by -1.330235751112923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
I20260812 19:22:35.922271  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:35.912189  8930 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:35.925216  7607 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
W20260812 19:22:35.914537  6474 rpcz_store.cc:269] 0812 19:22:32.497090 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.586327 (+ 89237us) service_pool.cc:227] Handling call
0812 19:22:35.913753 (+3327426us) spinlock_profiling.cc:243] Waited 2.88 s on lock 0x7b5400074ed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:35.913923 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6628289920}
I20260812 19:22:35.927363  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:35.915613  9053 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:35.930918  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:35.932019  6228 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:35.914814  8888 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:35.936209  8930 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.937613  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:35.938370  9210 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:35.944784  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:35.945300  6235 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:35.945521  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:35.903112  9001 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:35.929026  6232 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:35.929922  9164 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.945274  9251 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:35.960274  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:22:35.961242  6344 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:35.962608  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:35.955268  8888 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:35.957026  8962 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:35.938880  9053 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:35.957712  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:35.973668  9314 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260812 19:22:35.974642  8962 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:35.985267  6179 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:35.987524  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:35.912663  6054 rpcz_store.cc:276] 0812 19:22:25.584558 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:25.591693 (+  7135us) service_pool.cc:227] Handling call
0812 19:22:35.911888 (+10320195us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:22:28.224023 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:22:28.444399 (+220376us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:22:28.463387 (+ 18988us) write_op.cc:435] Acquired schema lock
0812 19:22:28.473660 (+ 10273us) tablet.cc:660] Decoding operations
0812 19:22:28.643652 (+169992us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:22:28.643736 (+    84us) write_op.cc:641] Partition lock acquired for write op
0812 19:22:28.643774 (+    38us) tablet.cc:683] Acquiring locks for 5 operations
0812 19:22:28.644509 (+   735us) tablet.cc:699] Row locks acquired
0812 19:22:28.644534 (+    25us) write_op.cc:260] PREPARE: finished
0812 19:22:28.644725 (+   191us) write_op.cc:270] Start()
0812 19:22:28.644863 (+   138us) write_op.cc:276] Timestamp: P: 1786562548644671 usec, L: 0
0812 19:22:28.644885 (+    22us) op_driver.cc:331] REPLICATION: starting
0812 19:22:28.645693 (+   808us) log.cc:842] Serialized 2038 byte log entry
0812 19:22:30.002350 (+1356657us) op_driver.cc:444] REPLICATION: finished
0812 19:22:31.104303 (+1101953us) write_op.cc:301] APPLY: starting
0812 19:22:31.110863 (+  6560us) tablet.cc:1365] starting BulkCheckPresence
0812 19:22:31.168351 (+ 57488us) tablet.cc:1368] finished BulkCheckPresence
0812 19:22:31.268422 (+100071us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:22:31.297395 (+ 28973us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:22:31.297842 (+   447us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0812 19:22:31.297960 (+   118us) write_op.cc:312] APPLY: finished
0812 19:22:31.298524 (+   564us) log.cc:842] Serialized 46 byte log entry
0812 19:22:31.701423 (+402899us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:31.701566 (+   143us) write_op.cc:454] Released schema lock
0812 19:22:31.701640 (+    74us) write_op.cc:341] FINISH: Updating metrics
0812 19:22:31.710177 (+  8537us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:31.710216 (+    39us) write_op.cc:454] Released schema lock
0812 19:22:34.364579 (+2654363us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
Metrics: {"mutex_wait_us":41702,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":1077862,"apply.run_cpu_time_us":14834,"apply.run_wall_time_us":610254,"num_ops":5,"prepare.queue_time_us":609385,"prepare.run_cpu_time_us":17436,"prepare.run_wall_time_us":637844,"raft.queue_time_us":374891,"raft.run_cpu_time_us":60240,"raft.run_wall_time_us":1395892,"replication_time_us":1322201,"spinlock_wait_cycles":4181376,"thread_start_us":2463695,"threads_started":5,"wal-append.queue_time_us":1031897,"wal-append.run_cpu_time_us":22064,"wal-append.run_wall_time_us":1931447}]]}
I20260812 19:22:35.969208  9301 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260812 19:22:35.990360  9158 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:35.991549  9158 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:35.991983  9158 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:35.992647  9053 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.993707  8516 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:35.995682  6178 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:36.003209  9330 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260812 19:22:35.987120  8962 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.012871  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.013998  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1175) took 3071 ms. Trace:
I20260812 19:22:36.014470  6350 rpcz_store.cc:276] 0812 19:22:32.942295 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.942451 (+   156us) service_pool.cc:227] Handling call
0812 19:22:32.942857 (+   406us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:35.576386 (+2633529us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:36.013611 (+437225us) spinlock_profiling.cc:243] Waited 2.56 s on lock 0x7b540036e054. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:36.013926 (+   315us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5889867648}
I20260812 19:22:36.016655  6344 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:36.016770  6481 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:36.000639  8516 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:36.024729  9277 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:36.025221  9277 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:36.026362  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.030993  6347 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:36.043452  8516 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:36.043658  8691 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.044232  8516 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:36.045202  8992 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.046816  8945 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:36.048564  8966 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:36.048787  8691 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:36.049728  8888 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:36.051095  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.052690  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.057670  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:36.058125  6475 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:36.060021  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.061249  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.061808  6474 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.062901  8983 raft_consensus.cc:3032] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:36.063349  8983 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:36.064548  8983 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:36.019306  9199 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260812 19:22:36.076396  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:36.076570  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.071094  6359 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:36.077396  6350 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:36.039273  6465 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:36.026263  9277 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:36.020829  8887 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:36.046372  8516 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:36.081658  9162 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:36.082108  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.086447  6235 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:36.084123  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:36.088925  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.089978  6350 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:36.093480  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.080500  9210 raft_consensus.cc:2741] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260812 19:22:36.095322  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 58565.5us
I20260812 19:22:36.080749  9251 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:36.096365  8992 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:36.092687  9001 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:36.100093  9251 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:36.103011  8887 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:36.096190  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:36.106313  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.106529  9251 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:36.109278  9277 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:36.107211  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:36.110405  9207 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:36.110803  9207 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:36.111156  9207 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:36.093116  9163 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.114861  6224 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:36.114935  8945 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:36.115363  8945 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:36.115765  8945 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:36.116820  9147 consensus_queue.cc:1046] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260812 19:22:36.117182  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 81058.3us
I20260812 19:22:36.117816  9147 consensus_queue.cc:1046] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:36.118063  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:36.119036  8791 raft_consensus.cc:3032] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:36.119131  8860 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:36.119521  8791 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:36.119606  8860 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:36.100415  9162 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.121417  8860 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.122228  7591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 172) took 3597 ms. Trace:
I20260812 19:22:36.123095  8860 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.122709  7591 rpcz_store.cc:276] 0812 19:22:32.562392 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:32.575367 (+ 12975us) service_pool.cc:227] Handling call
0812 19:22:32.627856 (+ 52489us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:35.892457 (+3264601us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:36.121951 (+229494us) spinlock_profiling.cc:243] Waited 3.14 s on lock 0x7b5400611cd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:36.122159 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7218578688}
I20260812 19:22:36.124063  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1352) took 2934 ms. Trace:
I20260812 19:22:36.125103  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:36.125948  6241 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:36.123095  9162 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:36.127799  6179 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:36.128319  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:36.128566  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.129563  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:36.130270  6345 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:36.130884  9251 consensus_queue.cc:1046] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:22:36.120741  8791 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.132386  9251 raft_consensus.cc:3032] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:36.134459  8791 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.130483  9162 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:36.135849  9162 raft_consensus.cc:686] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:22:36.135998  6229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1335) took 4390 ms (client timeout 1633 ms). Trace:
I20260812 19:22:36.136629  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.137471  6342 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.136960  9162 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:36.124498  6230 rpcz_store.cc:276] 0812 19:22:33.189597 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:35.419312 (+2229715us) service_pool.cc:227] Handling call
0812 19:22:35.419985 (+   673us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:35.647580 (+227595us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:35.647632 (+    52us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:35.648494 (+   862us) log.cc:842] Serialized 26 byte log entry
0812 19:22:35.716197 (+ 67703us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:35.716242 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:36.123413 (+407171us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54001649d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:36.123466 (+    53us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:36.123517 (+    51us) raft_consensus.cc:1671] finished
0812 19:22:36.123530 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:36.123953 (+   423us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":522444032,"thread_start_us":44924,"threads_started":1,"wal-append.queue_time_us":110554}
I20260812 19:22:36.138773  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:22:36.141060  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:22:36.138798  6238 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:36.131132  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:36.132828  9251 raft_consensus.cc:729] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:36.144022  8966 raft_consensus.cc:3032] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:36.144616  8966 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:36.144192  9251 consensus_queue.cc:260] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:36.145685  9251 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.145560  8966 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.146461  7591 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:36.130682  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.094410  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:36.147874  7593 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:36.136476  6229 rpcz_store.cc:269] 0812 19:22:31.745713 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:31.880399 (+134686us) service_pool.cc:227] Handling call
0812 19:22:33.052786 (+1172387us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5800001898. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:36.135704 (+3082918us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b54000f4bd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:36.135899 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5224202368}
I20260812 19:22:36.149623  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.150274  6228 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:36.150383  6235 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.147264  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1394) took 3065 ms. Trace:
I20260812 19:22:36.150846  8983 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.150980  6483 rpcz_store.cc:276] 0812 19:22:33.082051 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:35.039042 (+1956991us) service_pool.cc:227] Handling call
0812 19:22:35.039874 (+   832us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:35.463635 (+423761us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:36.147025 (+683390us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54002d2154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:36.147205 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":959302912}
I20260812 19:22:36.120678  6475 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:36.107198  6465 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:36.153646  6344 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:36.154459  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.160444  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:36.161356  9257 raft_consensus.cc:979] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: : Instructing follower 54f83319db6b49929cc8f18a66a66975 to start an election
I20260812 19:22:36.161345  9026 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.169502  6477 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:36.156827  6055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 106) took 10505 ms. Trace:
I20260812 19:22:36.187806  6055 rpcz_store.cc:276] 0812 19:22:25.650605 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:25.650760 (+   155us) service_pool.cc:227] Handling call
0812 19:22:36.155902 (+10505142us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3788722,"reported_tablets":3}
W20260812 19:22:36.146322  9323 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.257s	user 0.002s	sys 0.000s
I20260812 19:22:36.167797  6235 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:36.177482  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:36.182861  6470 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:36.192987  6359 raft_consensus.cc:2379] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:36.168447  6236 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:36.194778  9204 raft_consensus.cc:2741] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260812 19:22:36.196318  9257 raft_consensus.cc:1067] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Signalling peer 54f83319db6b49929cc8f18a66a66975 to start an election
I20260812 19:22:36.197180  9164 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:36.194458  9240 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:36.200371  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:36.201836  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:36.209890  6474 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:36.214221  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:22:36.214604  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 96666.9us
I20260812 19:22:36.144090  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.210829  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:36.219923  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 135088us
I20260812 19:22:36.221900  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:36.226702  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:36.204144  9163 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:36.230780  8856 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:36.231314  9022 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:36.231853  9022 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:36.232302  9022 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.224287  6349 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:36.239471  9163 raft_consensus.cc:1013] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: attempt to promote peer f4ef77b3328a44e8a21dd902b370e25a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 19:22:36.241735  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 65413.5us
I20260812 19:22:36.224021  8966 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:36.247237  8847 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260812 19:22:36.253167  8847 raft_consensus.cc:3032] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:36.253592  8847 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:36.254343  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.255133  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1391) took 3732 ms. Trace:
I20260812 19:22:36.255578  6473 rpcz_store.cc:276] 0812 19:22:32.522622 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:34.018923 (+1496301us) service_pool.cc:227] Handling call
0812 19:22:34.069594 (+ 50671us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:35.557529 (+1487935us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:36.254842 (+697313us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54004457d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:36.255057 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3168104320}
I20260812 19:22:36.256868  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.257717  8886 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:36.258175  8886 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:36.259166  8886 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.260506  8886 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.261516  9158 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:36.255262  6345 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:36.263723  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:36.264329  6345 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:36.231364  7599 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:36.247083  8791 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:36.271139  8791 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:36.271781  8791 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:36.272279  6178 connection.cc:232] RPC call timeout handler was delayed by -1.6161903431639075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260812 19:22:36.272712  6178 connection.cc:232] RPC call timeout handler was delayed by -1.4244903430808336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260812 19:22:36.273084  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2450926930177957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.281s for a response
W20260812 19:22:36.273396  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2165903430432081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
I20260812 19:22:36.271096  6179 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:36.275422  9277 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:36.276592  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:36.250710  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1473) took 3045 ms. Trace:
I20260812 19:22:36.277721  6238 rpcz_store.cc:276] 0812 19:22:33.204849 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:35.559621 (+2354772us) service_pool.cc:227] Handling call
0812 19:22:36.138497 (+578876us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:36.143071 (+  4574us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:36.250403 (+107332us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54000f4bd0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:36.250610 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1300455680}
I20260812 19:22:36.279803  6475 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:36.258241  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.249960  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:36.282472  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.231366  8856 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:36.275952  9277 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:36.286312  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:36.266568  6342 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:36.288719  6481 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:36.289312  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:36.289417  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.291608  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:36.275422  9164 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:36.297242  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:36.298578  6241 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:36.281574  8847 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.299683  6474 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:36.286314  9277 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.288162  6473 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:36.288734  8856 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.304852  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:36.308776  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 87111.6us
W20260812 19:22:36.296655  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 46773.8us
I20260812 19:22:36.326058  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.327023  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.328896  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.330982  6353 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 3.
I20260812 19:22:36.332744  9164 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:36.333268  9164 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.333714  8791 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:36.338948  9337 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260812 19:22:36.339426  6482 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:36.341123  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.319506  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:36.344563  6350 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:36.307132  9242 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260812 19:22:36.348130  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 45861.7us
I20260812 19:22:36.346740  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.345974  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:36.387375  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.387604  6359 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:36.388266  6474 raft_consensus.cc:2354] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4.
I20260812 19:22:36.389577  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:36.394393  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.395371  6236 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:36.395776  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.396523  6241 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.354545  9242 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:36.402952  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.404865  8983 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:36.406257  8983 consensus_queue.cc:1046] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:36.406836  8992 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:36.407385  8992 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:36.408681  9156 raft_consensus.cc:3032] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:36.409092  9156 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:36.408540  8992 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.410008  9156 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.418222  6475 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:36.419560  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:36.357197  9251 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260812 19:22:36.387756  8847 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.386750  8862 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:36.427867  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:36.411923  9156 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:36.417287  9242 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.410213  8992 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.389843  8962 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:36.481763  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:36.485486  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.488123  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:36.488626  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:36.490980  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 52968.4us
I20260812 19:22:36.491863  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:36.442319  9213 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:36.437933  8983 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:36.433486  9158 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:36.415257  9163 consensus_queue.cc:1046] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.068s
I20260812 19:22:36.508417  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:36.512404  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.514189  7600 raft_consensus.cc:1226] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:36.481123  9094 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:36.442087  7593 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:36.517048  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.497622  9080 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:36.490684  8862 raft_consensus.cc:686] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:36.506507  8860 raft_consensus.cc:3032] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:36.445314  9257 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:36.440588  9207 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.449829  9022 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.444388  8945 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.546519  9022 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:36.547595  9158 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:36.548074  8945 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:36.549925  6483 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 4: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:36.551402  6179 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:36.552661  6347 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:36.514874  9162 raft_consensus.cc:2741] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260812 19:22:36.528848  9293 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:36.554075  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:36.555683  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.516881  9147 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:36.557756  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.522915  9094 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:36.561447  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:36.563848  6474 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:36.571733  6481 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:36.507684  8930 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260812 19:22:36.536726  8983 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 2 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:36.528034  9213 raft_consensus.cc:686] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:36.537046  8860 raft_consensus.cc:729] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:36.582026  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:36.584589  7603 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:36.556962  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:36.561774  8791 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:36.563220  9293 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:36.587497  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.597537  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.602718  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.578860  9162 raft_consensus.cc:3032] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:36.584141  9147 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:36.618822  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.622385  6475 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:36.561681  9257 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.602324  8945 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:36.628626  6344 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:36.628794  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.629033  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.630259  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.610699  9162 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:36.631536  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.632146  6474 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:36.631820  9162 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.633996  8945 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:36.610505  9293 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.635197  8945 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:36.628847  9209 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.007s	sys 0.039s
W20260812 19:22:36.639251  9209 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.008s	sys 0.040s
I20260812 19:22:36.642894  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.643271  8983 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.644187  9147 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.646224  9277 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:36.650409  9277 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:36.651587  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:36.657984  8856 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.646858  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:36.638912  9094 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.663306  6350 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:36.662087  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.720824  6359 raft_consensus.cc:2396] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:36.659621  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.612423  9163 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:36.660656  6235 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:36.676172  6241 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:36.678478  9251 raft_consensus.cc:3032] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:36.678889  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.679000  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.682554  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.729591  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.730201  6241 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:36.684762  9213 consensus_queue.cc:237] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.682277  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.684391  6349 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:36.687896  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.689495  6228 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:36.690119  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.690953  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:36.691051  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.691709  6230 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:36.692723  6232 raft_consensus.cc:1226] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:36.693274  8862 consensus_queue.cc:237] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.694103  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.694355  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:36.694108  8691 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:36.626876  8888 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:36.699594  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.705842  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.707458  9207 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:36.708575  8860 consensus_queue.cc:260] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.710429  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.711326  8962 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:36.712546  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:36.716358  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.716419  7603 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:36.797816  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.798457  7603 raft_consensus.cc:2379] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 4: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:36.715935  6473 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:36.799052  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.799773  6470 raft_consensus.cc:2354] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3.
W20260812 19:22:36.717319  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 188770us
I20260812 19:22:36.718573  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.725363  6347 raft_consensus.cc:2396] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:36.702967  9242 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.732841  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.802799  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:36.733839  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:36.741420  6474 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:36.757786  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:36.739882  9163 raft_consensus.cc:686] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:36.717890  9293 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.756752  6482 raft_consensus.cc:2354] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4.
I20260812 19:22:36.766621  9094 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.767218  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.723694  9080 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:36.724291  7597 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:36.780983  6352 raft_consensus.cc:2396] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:36.782385  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.811956  6238 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:36.724490  9251 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:36.784956  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.815428  6475 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:36.786787  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:36.817153  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:36.786836  6416 connection.cc:232] RPC call timeout handler was delayed by -2.0399874150753021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
I20260812 19:22:36.790570  6241 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:36.781279  8691 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:36.819938  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.820602  6353 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:36.795598  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.800731  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:36.824677  6354 raft_consensus.cc:2354] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4.
I20260812 19:22:36.801647  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.825520  6230 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:36.802171  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:36.761286  6481 raft_consensus.cc:2396] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:36.826520  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:36.826974  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:36.796831  8888 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:36.803942  6242 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:36.766485  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.808573  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.797978  6464 raft_consensus.cc:2396] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:36.832758  7607 raft_consensus.cc:2379] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 4: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:36.833325  9293 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:36.811005  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.834980  6474 raft_consensus.cc:2396] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:36.835538  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:36.812705  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.717298  9164 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:36.813987  6477 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:36.739084  9026 consensus_queue.cc:1046] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260812 19:22:36.819211  6416 connection.cc:232] RPC call timeout handler was delayed by -1.8734874150250107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
I20260812 19:22:36.822184  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:36.843092  6416 connection.cc:232] RPC call timeout handler was delayed by -1.8527874150313437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260812 19:22:36.830206  6473 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:36.832329  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:36.810140  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 97678.2us
I20260812 19:22:36.845615  6470 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 2: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:36.814273  8860 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:36.830175  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:36.848034  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:36.810860  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.849988  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:36.838534  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.850914  6236 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:36.851197  6235 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 4: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:36.833904  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.851002  6359 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 4: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:36.839709  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.854281  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.824004  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:22:36.843441  6416 connection.cc:232] RPC call timeout handler was delayed by -1.7870874151121825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260812 19:22:36.867566  6416 connection.cc:232] RPC call timeout handler was delayed by -1.3388874151278287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24760000000000001s for a response
W20260812 19:22:36.867895  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0229874150827527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2827s for a response
I20260812 19:22:36.844259  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.846380  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.868422  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:36.868435  6352 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:36.816847  9343 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:36.826766  9302 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:36.842092  9267 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:36.870383  7603 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 5: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:36.872002  6474 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:36.854486  9369 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election won for term 4
W20260812 19:22:36.879644  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 49556us
I20260812 19:22:36.877005  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:36.851643  6465 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:36.886724  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.887629  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:36.887837  7607 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:36.893710  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.896128  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:36.896958  6228 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:36.878391  9267 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:36.867069  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.898953  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.875105  8847 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:36.875708  8962 raft_consensus.cc:2741] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260812 19:22:36.904507  6477 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 2: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:36.878443  9369 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:36.905154  7553 leader_election.cc:398] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5.
I20260812 19:22:36.913363  7553 leader_election.cc:401] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260812 19:22:36.913630  6473 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260812 19:22:36.914151  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.914973  6474 raft_consensus.cc:2354] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3.
I20260812 19:22:36.906744  6483 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:36.906152  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:36.880894  8691 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.916955  7606 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:22:36.917531  8691 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:36.880759  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:36.908087  6235 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:36.922071  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:36.915359  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.927299  6481 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:36.928404  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:36.929329  6241 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:36.893483  9257 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:36.898953  9207 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:36.892431  8856 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:36.903158  9267 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:36.936653  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:36.902137  9343 raft_consensus.cc:686] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:36.935954  6236 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:36.940091  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.945676  6345 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:22:36.940713  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.946331  6344 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:36.947475  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.948000  6224 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:36.938810  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 49560.4us
I20260812 19:22:36.942492  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.942706  6242 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:36.943693  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.925913  8516 raft_consensus.cc:2741] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260812 19:22:36.950853  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:36.951078  8516 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:22:36.951556  6235 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:36.908257  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:36.952924  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.959605  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:36.960951  6236 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 4
W20260812 19:22:36.964600  6178 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.822s (SENT)
I20260812 19:22:36.944334  9366 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:36.941231  8962 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5.
I20260812 19:22:36.944854  9207 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:36.969389  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:36.889339  9080 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:36.959406  6232 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:36.945986  9302 raft_consensus.cc:2741] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260812 19:22:36.932756  9156 consensus_queue.cc:1046] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260812 19:22:36.952401  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.977408  6235 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:36.978217  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:36.970036  6359 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:36.980774  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:36.849809  9251 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:22:36.980392  9164 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:36.986166  8930 raft_consensus.cc:3032] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:36.965677  9242 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:36.903851  9163 consensus_queue.cc:237] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:36.936913  9199 consensus_queue.cc:1046] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260812 19:22:36.991034  6352 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:37.014633  6298 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:37.027086  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:36.919750  8888 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:37.004539  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:37.027772  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:37.003589  6236 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:37.004884  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:36.994849  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:36.976887  9207 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:37.016239  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:37.024608  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:37.031684  6352 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:37.029320  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:37.033236  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:37.032085  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:37.035389  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:37.044910  6359 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 1.
W20260812 19:22:37.045351  6178 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 3.308s (SENT)
I20260812 19:22:37.046555  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:37.047379  8962 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:37.049685  6417 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:37.013120  9257 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:37.050635  9257 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:37.051052  9257 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:37.051218  6359 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 2.
I20260812 19:22:37.047948  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:37.048273  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:37.045131  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:37.050139  6224 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:37.016295  8930 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:37.018486  8983 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260812 19:22:37.067576  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 72836.6us
I20260812 19:22:37.069357  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:37.080607  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:37.091104  6344 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260812 19:22:37.093338  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 78814.9us
I20260812 19:22:37.093698  6359 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:37.041175  9053 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:37.096942  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:37.053534  8856 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:37.070797  9251 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:37.089167  9370 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260812 19:22:37.107424  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 57820.9us
I20260812 19:22:37.068557  9158 raft_consensus.cc:3032] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
W20260812 19:22:37.108264  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60387.2us
I20260812 19:22:37.117785  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:37.099653  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 165470us
I20260812 19:22:37.065063  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:37.031178  9164 consensus_queue.cc:1046] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260812 19:22:37.103133  6353 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:37.080613  9242 raft_consensus.cc:3032] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:37.121456  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:37.094460  9293 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:37.131470  6238 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:37.120527  6359 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:45954
I20260812 19:22:37.030452  9369 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:37.137660  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:37.151840  8955 raft_consensus.cc:2741] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260812 19:22:37.177932  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:37.120337  9158 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:37.155164  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:22:37.156384  8992 consensus_meta.cc:287] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.671s	user 0.008s	sys 0.002s
I20260812 19:22:37.131796  9242 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:37.155171  6349 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:37.099414  9053 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:37.110834  8886 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:37.025455  9343 consensus_queue.cc:237] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:37.173348  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:37.202759  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45296.4us
I20260812 19:22:37.110570  9209 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:37.154910  9380 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:37.141455  8856 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:37.181466  6350 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
W20260812 19:22:37.156487  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 62396.3us
I20260812 19:22:37.191689  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:37.187461  6464 raft_consensus.cc:2379] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:37.181790  8962 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:37.208590  6238 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
W20260812 19:22:37.223580  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 50346.5us
I20260812 19:22:37.233269  6224 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260812 19:22:37.200065  9053 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:37.232206  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:37.237814  6347 raft_consensus.cc:2396] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:37.232705  6354 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 4: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:37.255391  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:37.239966  6353 pending_rounds.cc:76] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 4
I20260812 19:22:37.224591  9162 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:37.257725  6353 pending_rounds.cc:97] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260812 19:22:37.263439  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:37.224877  9204 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:37.221176  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:37.258507  6481 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:37.186348  9272 consensus_queue.cc:1046] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260812 19:22:37.263948  6353 raft_consensus.cc:2866] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:22:37.270087  6230 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:37.232236  8955 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:37.271136  6224 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:37.274310  6298 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:37.275561  9381 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260812 19:22:37.276942  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:37.276868  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:22:37.278913  9377 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260812 19:22:37.178773  8930 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:37.316299  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:37.292403  9257 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:37.292512  9242 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:37.294054  9380 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:37.356038  6235 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:37.377985  6238 raft_consensus.cc:2379] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:37.382936  6236 raft_consensus.cc:2379] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:37.282361  6349 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
W20260812 19:22:37.384361  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 193339us
I20260812 19:22:37.393181  6417 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:37.395973  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:37.397850  9293 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:37.398378  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:37.399004  8955 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:37.392046  6345 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:37.400285  8955 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:37.398538  9293 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:37.404419  9293 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:37.404947  9343 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:37.405807  9343 raft_consensus.cc:686] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:22:37.410929  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 362705us
I20260812 19:22:37.411949  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:37.412845  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:22:37.417107  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 145052us
I20260812 19:22:37.295912  9366 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 2 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:37.418140  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:37.415328  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:37.420096  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 242968us
I20260812 19:22:37.427424  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:37.429291  6417 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:37.272691  8856 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.146s
I20260812 19:22:37.390607  8791 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260812 19:22:37.418861  9094 consensus_meta.cc:287] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.606s	user 0.013s	sys 0.001s
I20260812 19:22:37.417981  9391 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:37.446697  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:37.423069  9272 raft_consensus.cc:3032] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:37.422634  9080 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:37.262660  9158 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:37.457113  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 182881us
I20260812 19:22:37.435370  8862 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:37.422863  9389 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:37.464078  6298 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:37.439845  8691 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:37.451694  8966 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:37.455545  9242 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:37.456182  9391 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:37.391390  9267 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:37.457212  8930 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:37.428447  9209 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260812 19:22:37.462553  8983 raft_consensus.cc:2741] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260812 19:22:37.457671  9272 raft_consensus.cc:729] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:37.469274  8691 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:37.482575  6298 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:37.467330  8888 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:37.465051  9164 raft_consensus.cc:3032] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:37.434918  8962 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:37.460911  9080 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:37.470168  9421 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:37.477702  9391 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:37.482456  9158 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:37.482290  9416 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:37.492941  9164 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:37.485025  9343 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:37.531405  9417 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:37.535179  9417 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:37.533026  8847 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:37.497747  8862 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:37.535506  9272 consensus_queue.cc:260] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:37.517107  6298 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:37.535667  9267 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:37.519734  9080 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:37.535655  9417 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
W20260812 19:22:37.535171  9392 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260812 19:22:37.531258  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 113204us
W20260812 19:22:37.537303  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 60248.5us
I20260812 19:22:37.491078  8691 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:37.546491  6298 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:37.495342  9366 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:37.552400  6298 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:37.531075  9416 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:37.541064  8862 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:37.568706  6298 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:37.557575  9397 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260812 19:22:37.547726  8847 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260812 19:22:37.548449  9147 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:37.556659  8860 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:37.569595  9293 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 19:22:37.633785  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 73932.2us
I20260812 19:22:37.555891  9257 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:37.560474  9416 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:22:37.665409  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 96463.1us
I20260812 19:22:37.673517  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:22:37.635448  7597 consensus_meta.cc:287] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.799s	user 0.009s	sys 0.010s
I20260812 19:22:37.634382  8966 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 19:22:37.701180  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 134566us
I20260812 19:22:37.681735  9257 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
W20260812 19:22:37.685662  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 272846us
W20260812 19:22:37.703544  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 256958us
I20260812 19:22:37.634641  9164 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:37.689608  8791 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:37.709666  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:37.690613  7597 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:37.703500  9426 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:37.719415  9426 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:37.719775  9401 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:37.719823  9426 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:37.720417  9401 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:37.721455  6354 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:22:37.680218  9414 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260812 19:22:37.722733  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:37.723413  9414 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:37.723469  6349 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:37.723855  9414 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:37.724941  9414 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:37.726985  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:22:37.727399  9420 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260812 19:22:37.727725  6345 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:37.692461  9421 raft_consensus.cc:686] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:37.731441  7600 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:37.727048  9414 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:37.717501  9251 consensus_meta.cc:287] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.004s
I20260812 19:22:37.706578  9257 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:37.739454  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:37.740798  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:37.678975  9425 consensus_queue.cc:1046] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260812 19:22:37.746929  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:37.727962  8930 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:37.753187  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:37.755636  6352 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:37.761202  6345 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:37.735839  9080 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:37.715257  8966 consensus_queue.cc:1046] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260812 19:22:37.786345  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:37.777640  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:37.787446  6477 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:37.737885  9164 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:37.777231  6483 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260812 19:22:37.738602  7597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 303) took 1132 ms. Trace:
I20260812 19:22:37.773330  6481 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:37.787034  6242 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:37.781159  6224 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260812 19:22:37.789336  6224 pending_rounds.cc:76] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 1
I20260812 19:22:37.776268  6470 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:37.782806  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:37.782045  6230 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:37.795286  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:37.789593  6224 pending_rounds.cc:97] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260812 19:22:37.797212  6224 raft_consensus.cc:2894] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260812 19:22:37.748855  6232 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:37.755067  8930 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:37.766881  9343 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:37.716528  9418 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260812 19:22:37.836524  6238 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260812 19:22:37.766935  8955 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
W20260812 19:22:37.839788  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44617.6us
I20260812 19:22:37.844883  6224 raft_consensus.cc:2866] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:22:37.766863  9430 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election won for term 2
W20260812 19:22:37.856160  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 123345us
W20260812 19:22:37.851868  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 102636us
I20260812 19:22:37.856701  6238 pending_rounds.cc:76] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 1
I20260812 19:22:37.925163  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:22:37.927055  6238 pending_rounds.cc:97] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260812 19:22:37.859246  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:37.928088  6238 raft_consensus.cc:2866] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:22:37.920756  9207 consensus_meta.cc:287] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.856s	user 0.014s	sys 0.000s
I20260812 19:22:37.926719  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:37.855523  8930 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:37.853338  8847 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:37.793598  9080 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:37.851219  9436 raft_consensus.cc:2741] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260812 19:22:37.960179  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:37.965363  6477 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:37.935441  9251 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:37.967555  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:37.793604  7597 rpcz_store.cc:276] 0812 19:22:36.603083 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:36.604670 (+  1587us) service_pool.cc:227] Handling call
0812 19:22:37.731889 (+1127219us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:37.967958  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:37.936023  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:37.969128  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:56280 (request call id 3) took 17627 ms. Trace:
I20260812 19:22:37.968992  8992 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:37.968963  8983 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260812 19:22:37.971388  9409 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260812 19:22:37.943764  9162 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:37.944311  9434 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:37.946178  9430 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:37.947176  8847 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:22:37.972157  9428 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260812 19:22:37.837201  9439 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.168s
I20260812 19:22:37.963213  9418 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:37.975958  6224 rpcz_store.cc:276] 0812 19:22:20.328555 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:20.328682 (+   127us) service_pool.cc:227] Handling call
0812 19:22:20.552316 (+223634us) log.cc:842] Serialized 492 byte log entry
0812 19:22:37.935373 (+17383057us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":122,"raft.queue_time_us":1406,"raft.run_cpu_time_us":1833,"raft.run_wall_time_us":1834,"spinlock_wait_cycles":230912,"thread_start_us":12182,"threads_started":1,"wal-append.queue_time_us":103629,"wal-append.run_cpu_time_us":3306,"wal-append.run_wall_time_us":1116969}
I20260812 19:22:37.931545  9257 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:37.947593  9207 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:37.979749  8992 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:37.961030  9267 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260812 19:22:38.025449  9343 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:37.971869  9448 consensus_queue.cc:1046] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.236s
I20260812 19:22:37.987351  8847 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:38.035439  9391 consensus_meta.cc:287] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260812 19:22:38.035498  9471 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:37.987638  9434 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.037226  9391 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.027987  8992 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:38.035099  9430 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:37.924484  9421 consensus_queue.cc:237] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.045528  6224 pending_rounds.cc:97] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260812 19:22:38.092314  6224 raft_consensus.cc:2866] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:22:38.023711  9405 log.cc:924] Time spent T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260812 19:22:37.986326  9467 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.047289  6482 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:37.990089  9457 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:38.083424  8955 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:37.976131  9251 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.047819  8983 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:38.096078  6297 leader_election.cc:398] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3.
W20260812 19:22:38.097005  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 129524us
I20260812 19:22:38.112043  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:38.113077  6297 leader_election.cc:401] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:22:38.119028  8983 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:38.096349  9418 raft_consensus.cc:686] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:22:38.119626  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 260453us
I20260812 19:22:38.124188  6242 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:38.106172  9257 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:38.120332  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 110) took 1113 ms. Trace:
I20260812 19:22:38.114264  9389 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.148226  6353 rpcz_store.cc:276] 0812 19:22:37.006496 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:37.185199 (+178703us) service_pool.cc:227] Handling call
0812 19:22:37.230436 (+ 45237us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:37.419618 (+189182us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:37.419668 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:37.427587 (+  7919us) log.cc:842] Serialized 26 byte log entry
0812 19:22:37.547042 (+119455us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:22:37.547086 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:37.547165 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:38.120109 (+572944us) raft_consensus.cc:1671] finished
0812 19:22:38.120135 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:38.120272 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":77140,"threads_started":1,"wal-append.queue_time_us":238466}
W20260812 19:22:38.114334  9442 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260812 19:22:38.156148  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:38.151548  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 183645us
W20260812 19:22:38.155339  9053 consensus_meta.cc:287] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.893s	user 0.008s	sys 0.005s
I20260812 19:22:38.136855  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:38.171753  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:38.090678  9471 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:38.170043  6178 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.651s (SENT)
W20260812 19:22:38.168582  9387 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.699s	user 0.000s	sys 0.003s
I20260812 19:22:38.163502  9485 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.168597  9425 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:38.168160  9267 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.106215  9467 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.225826  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:38.203238  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:38.111363  9343 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:38.173094  8691 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.002s
I20260812 19:22:38.171012  9080 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.111379  9457 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.199792  8791 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:38.274116  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:38.200554  9452 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:38.164059  9448 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260812 19:22:38.254875  6342 raft_consensus.cc:2354] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4.
I20260812 19:22:38.222388  9487 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3.
W20260812 19:22:38.299717  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 129672us
I20260812 19:22:38.171355  9053 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:38.303865  6178 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.726s (SENT)
I20260812 19:22:38.304500  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:38.291193  9391 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.255261  9267 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.273852  9366 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260812 19:22:38.297664  9207 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:38.273751  8691 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.347004  9425 raft_consensus.cc:686] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:38.255726  8983 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:38.362987  6138 auto_rebalancer.cc:254] failed to send replica move request: Aborted: Op aborted by new leader
I20260812 19:22:38.371682  6345 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:38.380551  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:38.380551  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:38.382946  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:38.466248  6230 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:38.383008  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:22:38.314141  6342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1454) took 1384 ms (client timeout 1826 ms). Trace:
I20260812 19:22:38.353029  9484 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.168376  9389 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:38.363036  9379 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.233s	user 0.002s	sys 0.008s
I20260812 19:22:38.384018  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:38.255138  9485 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.469523  6354 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:38.475374  6238 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:38.487502  6354 raft_consensus.cc:595] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Received request to transfer leadership to TS f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:38.458112  9158 consensus_meta.cc:287] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.925s	user 0.010s	sys 0.003s
I20260812 19:22:38.487959  6354 raft_consensus.cc:603] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:38.286731  8955 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.463954  9080 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 19:22:38.456558  9468 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
I20260812 19:22:38.463348  9207 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:38.296767  9418 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.486698  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:38.470197  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:38.521445  7600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 330) took 1668 ms. Trace:
I20260812 19:22:38.521855  7600 rpcz_store.cc:276] 0812 19:22:36.829883 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:36.879249 (+ 49366us) service_pool.cc:227] Handling call
0812 19:22:37.391808 (+512559us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b5800005498. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:22:37.731192 (+339384us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:37.733515 (+  2323us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:38.497647 (+764132us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54002c5950. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:38.497798 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":789829120}
W20260812 19:22:38.512393  9242 consensus_meta.cc:287] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.021s	user 0.009s	sys 0.004s
I20260812 19:22:38.496141  6229 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:38.557057  6352 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:38.510803  9472 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:38.488485  9499 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.497198  9158 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:38.559454  6344 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:22:38.495527  9434 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:38.563081  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:38.563213  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:38.556953  9450 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
W20260812 19:22:38.470583  6342 rpcz_store.cc:269] 0812 19:22:36.918884 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:36.936520 (+ 17636us) service_pool.cc:227] Handling call
0812 19:22:38.115276 (+1178756us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b5800004598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824b7c 00007f98f482473b 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:38.302836 (+187560us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3947264}
I20260812 19:22:38.577014  6230 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:38.579026  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:38.581521  6242 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:38.553947  9495 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:38.589473  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 285634us
W20260812 19:22:38.590154  6178 leader_election.cc:334] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.741s (SENT)
I20260812 19:22:38.590512  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:38.570408  6349 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 2: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:38.564667  9510 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.561980  9391 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.568321  9472 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:22:38.591248  9417 consensus_meta.cc:287] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 1.040s	user 0.002s	sys 0.009s
I20260812 19:22:38.582249  9471 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.481381  9484 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.586182  9053 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:38.634755  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.010s	sys 0.018s
W20260812 19:22:38.653899  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.010s	sys 0.018s
W20260812 19:22:38.654538  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 542568us
W20260812 19:22:38.642999  9426 consensus_meta.cc:287] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.922s	user 0.009s	sys 0.004s
W20260812 19:22:38.658766  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.018s	sys 0.023s
W20260812 19:22:38.667464  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.018s	sys 0.023s
I20260812 19:22:38.674320  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:38.654763  9467 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:38.684664  9498 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260812 19:22:38.654467  9417 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:38.685650  9513 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260812 19:22:38.686969  9417 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.687276  9538 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260812 19:22:38.688716  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 592750us
W20260812 19:22:38.688993  9528 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260812 19:22:38.690025  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:38.591768  9495 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.690712  6464 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:22:38.691043  9529 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:38.691609  9155 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260812 19:22:38.692494  8992 consensus_meta.cc:287] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.591s	user 0.005s	sys 0.003s
I20260812 19:22:38.693104  8992 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.672690  9426 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.695735  9401 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:38.696758  8992 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:38.696918  9426 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.681279  9530 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:38.681084  9472 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:38.681923  9478 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260812 19:22:38.639299  9391 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.568459  9499 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.559068  9425 consensus_queue.cc:237] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.682574  9497 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:38.683279  8847 consensus_meta.cc:287] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.651s	user 0.007s	sys 0.003s
W20260812 19:22:38.683487  9500 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260812 19:22:38.684128  9164 consensus_meta.cc:287] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.887s	user 0.009s	sys 0.002s
I20260812 19:22:38.698591  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:38.699667  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:38.670569  9457 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.701910  9530 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.705899  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:38.676741  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:38.707185  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:38.724004  6224 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 3.
I20260812 19:22:38.665455  9267 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.709188  6238 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:38.637424  9510 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.668581  8691 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.711301  6349 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:38.731086  7591 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260812 19:22:38.731539  7591 pending_rounds.cc:76] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Aborting all ops after (but not including) 5
I20260812 19:22:38.731629  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:38.733232  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:38.733853  6349 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:38.719821  7600 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:38.735057  9484 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.735478  8791 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:38.735945  9499 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.736326  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:38.739550  7598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 196) took 1028 ms. Trace:
I20260812 19:22:38.722967  8847 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.692512  9495 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.712294  9391 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.719110  9369 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.674903  9053 consensus_queue.cc:1046] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260812 19:22:38.745105  9510 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.746490  6179 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:22:38.747038  8930 consensus_meta.cc:287] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.786s	user 0.010s	sys 0.002s
I20260812 19:22:38.747440  8930 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.748485  9267 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:38.749198  9267 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:38.749286  9485 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.749589  9267 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:38.730281  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:22:38.731199  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:38.748473  9416 consensus_meta.cc:287] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 1.051s	user 0.009s	sys 0.004s
I20260812 19:22:38.731932  7591 pending_rounds.cc:97] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260812 19:22:38.724961  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 161790us
I20260812 19:22:38.678283  9448 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260812 19:22:38.743902  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:38.769340  9417 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:38.769814  9417 raft_consensus.cc:686] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:38.770632  9417 consensus_queue.cc:237] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.770970  9539 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:38.770886  9495 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:38.739980  7598 rpcz_store.cc:276] 0812 19:22:37.735119 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:37.738423 (+  3304us) service_pool.cc:227] Handling call
0812 19:22:37.852282 (+113859us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:37.966929 (+114647us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:37.970333 (+  3404us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:38.033868 (+ 63535us) log.cc:842] Serialized 26 byte log entry
0812 19:22:38.169002 (+135134us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:38.171426 (+  2424us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:38.202858 (+ 31432us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:38.739286 (+536428us) raft_consensus.cc:1671] finished
0812 19:22:38.739315 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:38.739469 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7362,"raft.queue_time_us":25768,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":14050,"thread_start_us":125201,"threads_started":1,"wal-append.queue_time_us":422054}
I20260812 19:22:38.761533  8992 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260812 19:22:38.773113  9495 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:38.744583  9369 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:38.753971  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.759246  7591 raft_consensus.cc:2866] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:22:38.759680  7594 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 5: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:38.776466  9369 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.761165  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:38.778918  6354 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:38.765218  9053 raft_consensus.cc:3032] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:38.765867  9523 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:38.722915  9497 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.783010  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:38.754215  8930 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:38.767802  9530 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:38.768044  6229 raft_consensus.cc:2396] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:38.760241  9510 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.773288  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:22:38.800788  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 56989.7us
I20260812 19:22:38.801748  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:38.804250  6228 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:38.775097  9416 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.775805  8847 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:38.779103  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:38.779413  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:38.782162  9523 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:38.786403  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:38.789101  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 1e69ce57e6c74dea9e207b6ae03c43b2, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:38.827644  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 1e69ce57e6c74dea9e207b6ae03c43b2, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.789477  9539 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.760519  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:38.828891  6350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1452) took 1910 ms (client timeout 1833 ms). Trace:
I20260812 19:22:38.812419  6224 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260812 19:22:38.829882  6224 pending_rounds.cc:76] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 1
W20260812 19:22:38.829403  6350 rpcz_store.cc:269] 0812 19:22:36.918184 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:36.932458 (+ 14274us) service_pool.cc:227] Handling call
0812 19:22:38.828684 (+1896226us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400028854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:38.828812 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":443257088}
I20260812 19:22:38.830251  6224 pending_rounds.cc:97] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260812 19:22:38.830631  6224 raft_consensus.cc:2866] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:22:38.814864  9388 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.345s	user 0.004s	sys 0.002s
I20260812 19:22:38.844117  6230 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:38.835734  6354 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:22:38.815140  9391 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:38.817903  9497 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:38.780607  9053 raft_consensus.cc:729] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:22:38.819341  9414 consensus_meta.cc:287] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.074s	user 0.011s	sys 0.002s
I20260812 19:22:38.848807  9155 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:38.822247  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:38.850626  9539 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.851747  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:38.852995  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:38.853574  6470 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
W20260812 19:22:38.834513  6178 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.510s (SENT)
I20260812 19:22:38.854586  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:38.845759  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:38.835812  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:38.827430  9523 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.863833  9523 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:38.871724  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:38.871971  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:38.873001  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:38.873579  6481 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:38.875869  9416 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:38.848927  9514 consensus_queue.cc:1046] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260812 19:22:38.856559  6350 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:22:38.857487  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:38.812309  9510 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.860131  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:38.860867  8791 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:38.862216  9053 consensus_queue.cc:260] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.847532  9391 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:38.880239  6470 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:38.874379  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:38.892503  6228 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260812 19:22:38.892843  6481 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:38.813004  8930 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:38.888410  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:38.897912  6224 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:38.897905  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:38.834203  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1491) took 2097 ms. Trace:
I20260812 19:22:38.894480  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:38.888090  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:38.902504  6350 raft_consensus.cc:2379] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:38.876566  9251 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:38.900439  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet fd2a75ee87424ce9809bec32f2ae38fa, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:38.907362  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet fd2a75ee87424ce9809bec32f2ae38fa, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.908666  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1430) took 2019 ms. Trace:
I20260812 19:22:38.903622  9440 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.903869  6232 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:38.903726  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:38.911115  6241 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:38.904091  9053 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:38.912029  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:38.912613  6228 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
W20260812 19:22:38.904258  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 93469.2us
I20260812 19:22:38.905311  6470 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260812 19:22:38.853494  9539 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:38.909166  6475 rpcz_store.cc:276] 0812 19:22:36.888918 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:36.889038 (+   120us) service_pool.cc:227] Handling call
0812 19:22:36.986877 (+ 97839us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:36.987066 (+   189us) raft_consensus.cc:1520] Early marking committed up to index 2
0812 19:22:36.987369 (+   303us) log.cc:842] Serialized 14 byte log entry
0812 19:22:37.422034 (+434665us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:37.422099 (+    65us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:37.422147 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:37.422223 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:38.038523 (+616300us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:22:38.908455 (+869932us) spinlock_profiling.cc:243] Waited 70.8 ms on lock 0x7b54003eeed0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:38.908599 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3079,"prepare.queue_time_us":5153,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":65430,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":42964,"spinlock_wait_cycles":165236352,"thread_start_us":395249,"threads_started":2,"wal-append.queue_time_us":256443}
I20260812 19:22:38.915501  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:38.915774  8847 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:38.917807  9251 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.918032  9272 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:38.918690  9026 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:38.896885  8992 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:38.915061  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:38.927060  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:22:38.928695  6178 leader_election.cc:334] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.868s (SENT)
I20260812 19:22:38.935472  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:38.928597  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 168168us
I20260812 19:22:38.929733  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:38.896461  9391 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:38.930745  6474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33386 (request call id 93) took 1916 ms (client timeout 2087 ms). Trace:
I20260812 19:22:38.936595  6350 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:38.932749  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:38.937280  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:38.937716  6475 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:38.938978  9505 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.940327  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:38.897073  9257 consensus_meta.cc:287] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.743s	user 0.007s	sys 0.005s
W20260812 19:22:38.936997  6474 rpcz_store.cc:269] 0812 19:22:37.011341 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:37.011489 (+   148us) service_pool.cc:227] Handling call
0812 19:22:38.915345 (+1903856us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:38.927451 (+ 12106us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6219008}
I20260812 19:22:38.947412  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:38.927948  9514 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.943826  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:38.897207  6349 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:38.935235  9416 raft_consensus.cc:3032] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:38.948204  6474 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260812 19:22:38.974346  6474 pending_rounds.cc:76] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 1
I20260812 19:22:38.974725  6474 pending_rounds.cc:97] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260812 19:22:38.975067  6474 raft_consensus.cc:2866] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:22:38.943796  6230 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:38.949898  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:38.953174  6354 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:38.952011  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:38.951722  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:38.954869  6470 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:38.946094  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:38.936892  9026 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:38.969521  6350 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 2.
W20260812 19:22:38.971836  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 56973.9us
W20260812 19:22:38.982511  6178 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.872s (SENT)
I20260812 19:22:38.941030  9094 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:38.978530  6241 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:38.987124  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:38.988384  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:38.936450  9497 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:38.990550  9497 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:38.990967  9510 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:38.993579  9497 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:38.995455  6470 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:38.995965  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:38.969350  9539 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:38.996702  9539 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:38.996340  9514 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:38.983726  8888 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:38.998528  8888 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:38.983886  9026 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:38.945267  9457 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:38.982995  6350 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260812 19:22:38.931133  8930 raft_consensus.cc:686] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:38.985531  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:38.981336  6224 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 5: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:38.999130  9525 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.110s
I20260812 19:22:39.008924  9414 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:38.999145  8888 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:38.937456  9207 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:38.950050  8862 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:39.074985  8862 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:39.075443  8862 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:39.077948  9389 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:39.061959  6349 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:22:38.939880  9505 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:39.022445  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:38.901818  6229 rpcz_store.cc:276] 0812 19:22:36.736472 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:36.834321 (+ 97849us) service_pool.cc:227] Handling call
0812 19:22:38.358068 (+1523747us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5800001898. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:38.812724 (+454656us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":29474176}
I20260812 19:22:38.934247  9251 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:39.055114  6416 leader_election.cc:398] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4.
I20260812 19:22:38.997434  9539 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:39.040885  9204 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:39.045667  9510 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260812 19:22:38.979964  9416 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:39.053843  9257 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260812 19:22:39.041297  8992 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:39.060161  7594 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:39.126353  8992 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:39.128069  6473 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:39.081650  9457 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:39.064460  6224 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:39.133365  6224 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:39.073608  9147 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:39.079234  9207 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:39.005343  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:39.091076  8847 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:39.093259  6416 leader_election.cc:401] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260812 19:22:39.096616  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:39.029683  9497 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:39.098899  9199 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:39.099373  9543 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:39.094349  9530 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:39.100214  8856 raft_consensus.cc:3032] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:39.101014  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:39.101533  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1441) took 1331 ms. Trace:
I20260812 19:22:39.113104  9490 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:39.101450  6229 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260812 19:22:39.123064  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 04c512eaceae43d2a378065361eb4854, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:39.161775  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 04c512eaceae43d2a378065361eb4854, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:39.063248  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 77822.3us
W20260812 19:22:39.110598  9428 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260812 19:22:38.949076  9440 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:39.096029  9162 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:39.156054  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 125834us
I20260812 19:22:39.157366  6345 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:39.010829  9467 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260812 19:22:39.158991  6482 rpcz_store.cc:276] 0812 19:22:37.770150 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:37.773446 (+  3296us) service_pool.cc:227] Handling call
0812 19:22:37.773841 (+   395us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:38.101992 (+328151us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:39.101270 (+999278us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400363b54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:39.101471 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":628292352}
I20260812 19:22:39.130234  9448 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:39.143237  9147 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:39.194506  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:39.159277  8856 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:39.158254  9199 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:39.278519  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:39.362159  6354 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:39.160470  6232 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
W20260812 19:22:39.331563  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 129958us
W20260812 19:22:39.368819  6178 leader_election.cc:334] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.609s (SENT)
I20260812 19:22:39.176862  9389 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:39.363920  9505 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:39.364490  8856 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:39.176438  9213 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.184s
I20260812 19:22:39.175688  9490 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:22:39.194978  9493 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.032s
W20260812 19:22:39.389194  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 194782us
I20260812 19:22:39.158432  8847 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:39.262976  9272 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4.
I20260812 19:22:39.390630  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:39.327821  9147 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:39.161811  9530 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:39.386304  9199 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:39.404126  9204 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:39.403913  9414 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:39.405560  9272 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:39.201936  9162 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:39.360862  9401 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:39.394013  9493 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.007s	sys 0.033s
W20260812 19:22:39.420217  9053 consensus_meta.cc:287] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.505s	user 0.004s	sys 0.008s
I20260812 19:22:39.336102  8992 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:39.433702  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1392) took 2530 ms. Trace:
I20260812 19:22:39.417975  8856 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:39.371732  9514 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:39.451380  6235 rpcz_store.cc:276] 0812 19:22:36.902870 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:37.005682 (+102812us) service_pool.cc:227] Handling call
0812 19:22:37.296959 (+291277us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:37.391932 (+ 94973us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:39.424410 (+2032478us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b540013ef50. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:39.433614 (+  9204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":607206272}
I20260812 19:22:39.332906  9431 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:39.171954  8930 consensus_queue.cc:237] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:39.427542  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 58734.5us
W20260812 19:22:39.447098  6347 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1450) took 2529 ms (client timeout 3285 ms). Trace:
W20260812 19:22:39.420738  9418 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.007s	sys 0.048s
I20260812 19:22:39.198720  9366 consensus_queue.cc:1046] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.219s
I20260812 19:22:39.490104  7600 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:39.399313  9525 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260812 19:22:39.439954  9199 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:39.503429  6347 rpcz_store.cc:269] 0812 19:22:36.917476 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:36.920099 (+  2623us) service_pool.cc:227] Handling call
0812 19:22:39.436840 (+2516741us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b5400060c54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:39.446988 (+ 10148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":668771200}
I20260812 19:22:39.193701  9543 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:39.437371  9272 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:39.520349  9419 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.885s	user 0.000s	sys 0.007s
I20260812 19:22:39.520676  9272 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:39.522076  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1499) took 1296 ms. Trace:
I20260812 19:22:39.522540  6242 rpcz_store.cc:276] 0812 19:22:38.225246 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:38.225471 (+   225us) service_pool.cc:227] Handling call
0812 19:22:39.521883 (+1296412us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54000f50d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:39.522000 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":595415808}
I20260812 19:22:39.396601  9389 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:39.205181  9026 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:39.458793  8983 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.026s	sys 0.045s
W20260812 19:22:39.488417  7593 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.029s	sys 0.081s
I20260812 19:22:39.521086  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1214) took 2565 ms. Trace:
I20260812 19:22:39.543601  6344 rpcz_store.cc:276] 0812 19:22:36.955752 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:37.092387 (+136635us) service_pool.cc:227] Handling call
0812 19:22:37.114406 (+ 22019us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:38.565293 (+1450887us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:39.520821 (+955528us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54001b8854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:39.521013 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3322253568}
W20260812 19:22:39.508072  9418 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.008s	sys 0.048s
W20260812 19:22:39.551481  9544 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260812 19:22:39.549353  8888 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:39.560918  9543 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:39.511353  9251 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:39.553689  8983 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.026s	sys 0.046s
I20260812 19:22:39.566642  8847 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:39.567116  9378 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 2.384s	user 0.000s	sys 0.007s
I20260812 19:22:39.568655  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1221) took 1346 ms. Trace:
I20260812 19:22:39.586099  6352 rpcz_store.cc:276] 0812 19:22:38.221972 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:38.222140 (+   168us) service_pool.cc:227] Handling call
0812 19:22:39.568403 (+1346263us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54002d05d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:39.568561 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":632540544}
I20260812 19:22:39.498095  9431 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:39.447964  9401 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:39.564474  9389 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:39.576061  6464 raft_consensus.cc:595] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
W20260812 19:22:39.598132  8862 consensus_meta.cc:287] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.000s
W20260812 19:22:39.554183  7593 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.029s	sys 0.082s
I20260812 19:22:39.574636  9404 raft_consensus.cc:3032] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:39.608129  9401 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:39.612601  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:39.505728  9490 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:39.614472  9267 consensus_meta.cc:287] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.864s	user 0.014s	sys 0.000s
I20260812 19:22:39.610347  9162 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:39.627667  9404 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:39.629961  9389 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:39.642095  9490 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:39.628846  8862 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:39.661034  6228 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.729s	user 0.007s	sys 0.007s
I20260812 19:22:39.646121  9389 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:39.661679  6228 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:39.641513  9440 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:39.668315  8888 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:39.644120  9267 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:39.673405  6342 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:39.674376  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:22:39.679776  6473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33386 (request call id 94) took 2657 ms (client timeout 1952 ms). Trace:
I20260812 19:22:39.688516  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1395) took 1923 ms. Trace:
I20260812 19:22:39.693148  6179 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:39.332389  9448 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:39.698092  9516 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 19:22:39.643018  9369 consensus_queue.cc:1159] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "54f83319db6b49929cc8f18a66a66975" responder_term: 4 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: [3.2-3.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:22:39.701108  9094 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:39.750252  6473 rpcz_store.cc:269] 0812 19:22:37.022800 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:37.037969 (+ 15169us) service_pool.cc:227] Handling call
0812 19:22:37.782604 (+744635us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:39.679484 (+1896880us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54004461d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:39.679648 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3060120192}
I20260812 19:22:39.750349  6236 rpcz_store.cc:276] 0812 19:22:37.764922 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:37.765045 (+   123us) service_pool.cc:227] Handling call
0812 19:22:37.765399 (+   354us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:37.765592 (+   193us) raft_consensus.cc:1520] Early marking committed up to index 2
0812 19:22:37.930326 (+164734us) log.cc:842] Serialized 14 byte log entry
0812 19:22:39.687791 (+1757465us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b1800390b80. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f4859155 00007f98f77703d0 00007f98f7782576 00007f98f77930d7
0812 19:22:39.687932 (+   141us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:39.688005 (+    73us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:39.688090 (+    85us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:39.688214 (+   124us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:39.688396 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":88680,"prepare.queue_time_us":91190,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":114503,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4567,"spinlock_wait_cycles":5316352,"thread_start_us":505621,"threads_started":3,"wal-append.queue_time_us":417218,"wal-append.run_cpu_time_us":2285,"wal-append.run_wall_time_us":1331428}
W20260812 19:22:39.750813  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 57808.8us
I20260812 19:22:39.711102  7600 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:39.711269  9466 raft_consensus.cc:3032] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:39.711746  7591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 331) took 1004 ms. Trace:
W20260812 19:22:39.713167  9523 consensus_meta.cc:287] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.849s	user 0.005s	sys 0.008s
I20260812 19:22:39.695199  9530 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:39.626026  9431 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:22:39.740787  6238 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.020s	sys 0.013s
I20260812 19:22:39.749387  6353 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:39.748404  9417 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.023s	sys 0.061s
W20260812 19:22:39.774104  9417 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.024s	sys 0.061s
W20260812 19:22:39.777550  6238 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.020s	sys 0.013s
W20260812 19:22:39.787642  6178 leader_election.cc:334] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.053s (SENT)
I20260812 19:22:39.788204  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:39.658375  9404 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:39.790894  9404 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:39.791909  6353 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:39.792568  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1225) took 1093 ms. Trace:
I20260812 19:22:39.792886  6353 rpcz_store.cc:276] 0812 19:22:38.699631 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:38.700521 (+   890us) service_pool.cc:227] Handling call
0812 19:22:39.674200 (+973679us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b5800004598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:39.792496 (+118296us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5603712}
I20260812 19:22:39.799683  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:59812 (request call id 3) took 1160 ms. Trace:
I20260812 19:22:39.800639  6464 rpcz_store.cc:276] 0812 19:22:38.639559 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:38.676801 (+ 37242us) service_pool.cc:227] Handling call
0812 19:22:39.799283 (+1122482us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b5400074ed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7772bc3 00007f98fc6bc81a 00007f98f5dbbd04 00007f98f5dbbc92 00007f98f5dbbbc1 00007f98f5dbbb3c 00007f98f5dbadf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:39.799496 (+   213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2034484096}
W20260812 19:22:39.814728  9472 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.074s	user 0.019s	sys 0.041s
W20260812 19:22:39.815281  9472 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.019s	sys 0.041s
I20260812 19:22:39.759245  9401 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260812 19:22:39.817348  9425 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.024s	user 0.053s	sys 0.044s
I20260812 19:22:39.760133  9026 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:39.839190  6481 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.004s	sys 0.022s
W20260812 19:22:39.802213  9163 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.753s	user 0.034s	sys 0.060s
W20260812 19:22:39.839692  9277 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.009s	sys 0.017s
W20260812 19:22:39.867967  6481 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.005s	sys 0.022s
W20260812 19:22:39.826259  9156 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.023s	sys 0.058s
W20260812 19:22:39.866182  9425 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.054s	sys 0.044s
I20260812 19:22:39.870564  8983 consensus_queue.cc:1046] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:22:39.786954  9466 raft_consensus.cc:729] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:39.824927  9436 raft_consensus.cc:3032] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:39.825024  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1223) took 1126 ms. Trace:
I20260812 19:22:39.775254  9094 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:39.881834  9549 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:39.882617  8862 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:39.918390  7593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 201) took 1219 ms. Trace:
I20260812 19:22:39.920001  9267 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:39.896942  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:22:39.925213  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 146234us
I20260812 19:22:39.844956  9401 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:39.864081  9162 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:39.874842  9163 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.825s	user 0.035s	sys 0.060s
W20260812 19:22:39.883411  9156 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.024s	sys 0.058s
I20260812 19:22:39.873498  9523 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 19:22:39.930125  9277 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.010s	sys 0.017s
I20260812 19:22:39.897050  9094 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:39.901049  9302 raft_consensus.cc:3032] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:39.899068  9492 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:39.919361  7593 rpcz_store.cc:276] 0812 19:22:38.698600 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:38.699807 (+  1207us) service_pool.cc:227] Handling call
0812 19:22:38.701867 (+  2060us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:38.702185 (+   318us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:38.702241 (+    56us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:38.702905 (+   664us) log.cc:842] Serialized 26 byte log entry
0812 19:22:39.639745 (+936840us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:22:39.642804 (+  3059us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:39.642987 (+   183us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:39.917913 (+274926us) raft_consensus.cc:1671] finished
0812 19:22:39.917943 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:39.918265 (+   322us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":920251,"threads_started":1,"wal-append.queue_time_us":1171274}
W20260812 19:22:39.983410  9529 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.003s	sys 0.024s
I20260812 19:22:39.770848  7591 rpcz_store.cc:276] 0812 19:22:38.706930 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:38.711110 (+  4180us) service_pool.cc:227] Handling call
0812 19:22:38.711448 (+   338us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:38.776544 (+ 65096us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:39.711284 (+934740us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b54002e95d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:39.711609 (+   325us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":37855616}
I20260812 19:22:40.027078  6464 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "545108632fab48129db7f032619a1e55"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:59812
W20260812 19:22:40.062188  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 134437us
I20260812 19:22:39.888526  9436 raft_consensus.cc:729] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:39.935467  9401 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:39.942818  6465 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:40.047336  9302 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:39.890967  6342 rpcz_store.cc:276] 0812 19:22:38.663656 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:38.664979 (+  1323us) service_pool.cc:227] Handling call
0812 19:22:39.672467 (+1007488us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5800004598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:22:39.672844 (+   377us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:39.759601 (+ 86757us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:39.789846 (+ 30245us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":27356928}
I20260812 19:22:40.073113  9389 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:39.888276  9466 consensus_queue.cc:260] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:40.094056  9147 consensus_meta.cc:287] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.004s
W20260812 19:22:40.092072  9529 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.003s	sys 0.025s
I20260812 19:22:39.942044  9162 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:40.082127  9492 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:22:39.929452  8955 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.241s	user 0.034s	sys 0.115s
W20260812 19:22:40.147275  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.199s	user 0.004s	sys 0.033s
W20260812 19:22:40.147933  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.200s	user 0.004s	sys 0.033s
W20260812 19:22:40.151651  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 1.20419e+06us
I20260812 19:22:40.153760  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:22:40.146394  6477 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.226s	user 0.025s	sys 0.036s
W20260812 19:22:40.155216  6477 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.235s	user 0.025s	sys 0.036s
I20260812 19:22:39.944186  9416 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:40.161202  9580 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260812 19:22:40.164232  9199 consensus_meta.cc:287] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.005s
W20260812 19:22:40.223037  6350 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.101s	user 0.005s	sys 0.039s
W20260812 19:22:40.226034  6350 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.005s	sys 0.040s
I20260812 19:22:40.229363  6359 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:22:40.229990  6359 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:40.247026  6475 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.307s	user 0.011s	sys 0.038s
W20260812 19:22:40.213303  6241 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.018s	sys 0.024s
W20260812 19:22:40.249157  6241 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.018s	sys 0.025s
W20260812 19:22:40.250545  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.034s	sys 0.015s
I20260812 19:22:40.218731  9164 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election won for term 4
W20260812 19:22:40.128017  4094 debug-util.cc:398] Leaking SignalData structure 0x7b0800357d80 after lost signal to thread 6483
W20260812 19:22:40.251446  6475 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.311s	user 0.011s	sys 0.038s
I20260812 19:22:40.224344  9416 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:40.253206  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.034s	sys 0.015s
W20260812 19:22:40.254310  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.2:39969 timed out after 1.525s (SENT) [suppressed 49 similar messages]
W20260812 19:22:40.246763  9473 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.046s	sys 0.111s
I20260812 19:22:40.144805  9147 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:40.267263  6178 leader_election.cc:334] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.566s (SENT)
W20260812 19:22:40.264189  9473 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.046s	sys 0.113s
I20260812 19:22:40.245149  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:22:40.269014  9570 log.cc:924] Time spent T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260812 19:22:40.275132  6178 leader_election.cc:334] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.610s (SENT)
I20260812 19:22:40.275604  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:40.259343  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:40.189811  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:40.277293  6359 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:40.261489  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 848567us
I20260812 19:22:40.288431  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:40.282174  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.021s	sys 0.029s
I20260812 19:22:40.265307  9164 raft_consensus.cc:686] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:22:40.284785  6417 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.012s	sys 0.041s
W20260812 19:22:40.299768  6417 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.012s	sys 0.042s
W20260812 19:22:40.300480  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 907511us
I20260812 19:22:40.227890  9302 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:40.123522  9451 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 2.192s	user 0.000s	sys 0.016s
I20260812 19:22:40.286300  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1454) took 1432 ms. Trace:
I20260812 19:22:40.366999  6481 rpcz_store.cc:276] 0812 19:22:38.855497 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:38.893466 (+ 37969us) service_pool.cc:227] Handling call
0812 19:22:38.893769 (+   303us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:38.920264 (+ 26495us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:38.920314 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:38.936150 (+ 15836us) log.cc:842] Serialized 26 byte log entry
0812 19:22:39.881044 (+944894us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:39.881107 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:39.881211 (+   104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:40.285979 (+404768us) raft_consensus.cc:1671] finished
0812 19:22:40.286009 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:40.286217 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26049,"raft.queue_time_us":33871,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5369,"thread_start_us":911605,"threads_started":1,"wal-append.queue_time_us":987828}
W20260812 19:22:40.290817  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.117s	user 0.021s	sys 0.030s
W20260812 19:22:40.290382  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 100717us
W20260812 19:22:40.369626  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 1.1958e+06us
I20260812 19:22:40.369963  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:40.144702  9389 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:40.134168  6464 raft_consensus.cc:595] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
W20260812 19:22:40.265691  4094 kernel_stack_watchdog.cc:198] Thread 6483 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 265ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260812 19:22:40.281328  9391 consensus_meta.cc:287] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 1.329s	user 0.006s	sys 0.011s
I20260812 19:22:40.290315  9523 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260812 19:22:40.306689  9404 consensus_meta.cc:287] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.515s	user 0.013s	sys 0.001s
I20260812 19:22:40.304615  9529 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election won for term 5
W20260812 19:22:40.428529  6238 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.005s	sys 0.009s
I20260812 19:22:40.286949  7593 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:40.256945  9436 consensus_queue.cc:260] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:40.339392  9568 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260812 19:22:40.304945  9257 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:40.304440  9549 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:40.264573  9492 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:40.347585  9366 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:40.323972  9431 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:40.413026  9163 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:40.360522  9539 consensus_meta.cc:287] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.232s	user 0.015s	sys 0.001s
I20260812 19:22:40.354911  9162 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:40.445170  9147 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:40.465314  9564 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.329s	user 0.000s	sys 0.002s
I20260812 19:22:40.352658  9380 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:40.427299  9389 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:40.467350  9598 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260812 19:22:40.467097  9380 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:40.468569  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1455) took 1576 ms. Trace:
I20260812 19:22:40.469385  9380 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:40.468950  6475 rpcz_store.cc:276] 0812 19:22:38.892260 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:38.938548 (+ 46288us) service_pool.cc:227] Handling call
0812 19:22:38.939010 (+   462us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:38.939476 (+   466us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:38.939515 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:38.940071 (+   556us) log.cc:842] Serialized 26 byte log entry
0812 19:22:40.256893 (+1316822us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:40.256947 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:40.257106 (+   159us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:40.468325 (+211219us) raft_consensus.cc:1671] finished
0812 19:22:40.468346 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:40.468494 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":186,"thread_start_us":1316315,"threads_started":1,"wal-append.queue_time_us":1340494}
W20260812 19:22:40.450179  9490 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.786s	user 0.012s	sys 0.003s
W20260812 19:22:40.418522  6178 leader_election.cc:334] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.503s (SENT)
W20260812 19:22:40.094477  7598 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.175s	user 0.017s	sys 0.033s
I20260812 19:22:40.358834  9425 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:40.431623  6238 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.006s	sys 0.009s
W20260812 19:22:40.370447  9207 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.010s	sys 0.009s
I20260812 19:22:40.521111  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1400) took 1718 ms. Trace:
W20260812 19:22:40.441154  6483 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.597s	user 0.006s	sys 0.056s
W20260812 19:22:40.524571  6483 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.680s	user 0.006s	sys 0.056s
I20260812 19:22:40.524250  9436 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:40.426869  9391 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:40.451185  6359 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:40.452772  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:40.322528  9448 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:40.523747  6238 rpcz_store.cc:276] 0812 19:22:38.802969 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:38.806053 (+  3084us) service_pool.cc:227] Handling call
0812 19:22:38.847178 (+ 41125us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:38.847368 (+   190us) raft_consensus.cc:1520] Early marking committed up to index 3
0812 19:22:39.778284 (+930916us) log.cc:842] Serialized 14 byte log entry
0812 19:22:40.520613 (+742329us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:40.520682 (+    69us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:22:40.520743 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:40.520844 (+   101us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:40.521032 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5376,"prepare.queue_time_us":1031031,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":11346,"thread_start_us":1635804,"threads_started":2}
I20260812 19:22:40.412707  9094 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:40.457789  9366 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:40.462062  9565 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260812 19:22:40.461555  9539 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:40.155539  8955 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.467s	user 0.035s	sys 0.117s
I20260812 19:22:40.500500  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:40.574103  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 155625us
I20260812 19:22:40.457046  9257 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:40.576531  6178 leader_election.cc:334] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.787s (SENT)
W20260812 19:22:40.577612  6178 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.810s (SENT)
I20260812 19:22:40.428086  9595 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260812 19:22:40.470132  9583 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260812 19:22:40.453576  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 91) took 3456 ms. Trace:
W20260812 19:22:40.513471  6298 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.340s	user 0.032s	sys 0.048s
I20260812 19:22:40.426695  9026 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260812 19:22:40.436689  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:40.592096  6228 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:40.429071  9473 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
W20260812 19:22:40.499402  9430 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.018s	sys 0.012s
W20260812 19:22:40.597102  6178 leader_election.cc:334] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.831s (SENT)
I20260812 19:22:40.144683  9466 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:40.509095  7598 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.583s	user 0.017s	sys 0.033s
I20260812 19:22:40.426189  6464 raft_consensus.cc:603] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:40.587154  9516 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:40.499565  9389 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:40.500070  9592 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:40.563841  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45954 (request call id 1459) took 3584 ms. Trace:
I20260812 19:22:40.443512  9164 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:40.471167  9163 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:22:40.580303  6296 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.954s	user 0.008s	sys 0.051s
W20260812 19:22:40.588909  6298 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.415s	user 0.032s	sys 0.048s
I20260812 19:22:40.563891  9094 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:40.566239  9213 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:40.565361  9490 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:40.588899  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:40.656982  6238 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 5
I20260812 19:22:40.593200  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:40.597446  9199 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:40.658069  7600 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:40.658258  9199 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:40.660480  6179 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:40.661895  8516 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260812 19:22:40.597142  9430 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.020s	sys 0.012s
I20260812 19:22:40.526929  9425 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:40.662516  8516 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:40.663122  8516 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:40.665187  9425 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:40.583720  9595 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:40.611934  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:40.666293  9595 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:40.667080  6224 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 5
I20260812 19:22:40.597725  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:40.589428  9380 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:40.510759  9492 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:40.632050  6296 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.305s	user 0.011s	sys 0.051s
I20260812 19:22:40.668545  9380 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:40.623482  6235 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:40.592304  8955 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:40.616428  9147 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:22:40.671034  9600 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260812 19:22:40.671389  9147 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:40.672312  6235 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260812 19:22:40.673214  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1238) took 1557 ms. Trace:
I20260812 19:22:40.617412  7591 raft_consensus.cc:2379] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:40.673823  6350 rpcz_store.cc:276] 0812 19:22:39.115989 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:39.120077 (+  4088us) service_pool.cc:227] Handling call
0812 19:22:39.120483 (+   406us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:39.121255 (+   772us) raft_consensus.cc:1520] Early marking committed up to index 1
0812 19:22:39.121294 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:39.121885 (+   591us) log.cc:842] Serialized 26 byte log entry
0812 19:22:40.229125 (+1107240us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:40.229187 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:40.234004 (+  4817us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:40.672994 (+438990us) raft_consensus.cc:1671] finished
0812 19:22:40.673014 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:40.673148 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"thread_start_us":1106724,"threads_started":1,"wal-append.queue_time_us":1308506}
I20260812 19:22:40.676296  9162 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:40.676049  9213 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:40.638741  9592 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:40.640189  9163 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:40.640815  9094 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:40.640959  9473 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:40.642391  8691 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:40.678604  9473 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:40.678781  8691 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:40.633611  6359 rpcz_store.cc:276] 0812 19:22:36.959363 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:37.112590 (+153227us) service_pool.cc:227] Handling call
0812 19:22:39.451620 (+2339030us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b5800004598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6d1030 00007f98fc6bc3f9 00007f98fc6bbe95 00007f98f5db9784
0812 19:22:40.439602 (+987982us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54004114d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f776fda7 00007f98fc6bbee0 00007f98f5db9784 00007f98f5db9712 00007f98f5db9641 00007f98f5db95bc 00007f98f5db8872 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:40.543916 (+104314us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1748461696}
I20260812 19:22:40.605051  9401 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:40.655951  9490 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:40.627665  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:40.608071  9026 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:40.662086  9199 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:40.702203  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 105124us
I20260812 19:22:40.686489  8791 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:40.703552  6230 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
W20260812 19:22:40.703517  9156 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.008s	sys 0.042s
I20260812 19:22:40.714025  6228 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
W20260812 19:22:40.706547  8930 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.056s	sys 0.132s
W20260812 19:22:40.717271  8930 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.145s	user 0.058s	sys 0.132s
W20260812 19:22:40.723152  6178 leader_election.cc:334] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.424s (SENT)
I20260812 19:22:40.723635  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:40.737668  6224 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:40.707170  9026 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:22:40.715611  9156 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.008s	sys 0.043s
I20260812 19:22:40.713275  9599 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:40.671049  8955 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:40.775949  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 52826.9us
I20260812 19:22:40.776886  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:22:40.779420  6178 leader_election.cc:334] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.701s (SENT)
I20260812 19:22:40.720386  8930 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:40.789500  6178 leader_election.cc:334] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.882s (SENT)
I20260812 19:22:40.782339  9213 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:40.798066  9380 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:40.798833  9389 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:40.799661  9490 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:40.740949  9147 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:40.802310  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:40.712601  8791 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:40.781545  9163 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:40.802219  9516 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260812 19:22:40.815775  6178 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.889s (SENT)
I20260812 19:22:40.588627  6465 rpcz_store.cc:276] 0812 19:22:36.991157 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:36.992700 (+  1543us) service_pool.cc:227] Handling call
0812 19:22:39.099087 (+2106387us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:22:39.099513 (+   426us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:40.130953 (+1031440us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:40.426700 (+295747us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b5400364054. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:40.447879 (+ 21179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1916018304}
W20260812 19:22:40.836400  6178 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.931s (SENT)
I20260812 19:22:40.840427  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:40.807765  9539 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:40.804572  9366 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:40.811751  9156 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:40.844147  6238 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:40.803798  9162 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260812 19:22:40.782966  9599 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:40.812825  9592 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:40.810753  9391 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:40.848047  6178 leader_election.cc:334] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.946s (SENT)
I20260812 19:22:40.835578  9516 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:40.828441  9490 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:40.806095  8930 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:40.836433  9473 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:40.853809  9163 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:40.848784  9257 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:40.854553  8691 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:40.888460  9516 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:40.865480  9156 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:40.928076  9277 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.021s	sys 0.022s
W20260812 19:22:40.955874  6477 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.037s	sys 0.031s
I20260812 19:22:40.931845  9401 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:40.968883  6477 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.038s	sys 0.031s
I20260812 19:22:40.951985  9490 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:40.974546  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1451) took 2121 ms. Trace:
I20260812 19:22:40.977653  6477 rpcz_store.cc:276] 0812 19:22:38.852908 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:38.887577 (+ 34669us) service_pool.cc:227] Handling call
0812 19:22:38.898951 (+ 11374us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:38.899251 (+   300us) raft_consensus.cc:1520] Early marking committed up to index 2
0812 19:22:40.155757 (+1256506us) log.cc:842] Serialized 14 byte log entry
0812 19:22:40.973809 (+818052us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:40.973891 (+    82us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:40.973959 (+    68us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:40.974276 (+   317us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:40.974462 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5782,"prepare.queue_time_us":1463849,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":101,"thread_start_us":2053503,"threads_started":2}
W20260812 19:22:40.947045  6178 leader_election.cc:334] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.015s (SENT)
I20260812 19:22:40.981997  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:40.973342  9277 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.021s	sys 0.022s
W20260812 19:22:40.986444  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.044s	sys 0.065s
W20260812 19:22:40.997795  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.045s	sys 0.065s
W20260812 19:22:40.997836  6417 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.025s	sys 0.067s
W20260812 19:22:40.998310  6417 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.025s	sys 0.067s
W20260812 19:22:40.998390  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 692396us
W20260812 19:22:40.981998  9204 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.481s	user 0.027s	sys 0.089s
W20260812 19:22:41.032299  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 85302.7us
W20260812 19:22:41.037869  6178 leader_election.cc:334] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.201s (SENT)
I20260812 19:22:41.050315  6416 leader_election.cc:398] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4.
I20260812 19:22:41.050755  6416 leader_election.cc:401] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:22:40.998060  9401 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:41.008726  8955 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.059526  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.060629  6481 raft_consensus.cc:2379] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:41.031342  9257 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:41.058151  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.031045  9436 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:40.979635  9490 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.061872  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.064947  6477 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:41.065495  6473 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:22:41.032382  9204 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.546s	user 0.027s	sys 0.089s
I20260812 19:22:41.063612  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.041806  8791 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.059082  9272 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:41.069114  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.069697  9026 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.070061  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.070865  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.071619  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:41.072783  9607 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260812 19:22:41.092123  6475 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:41.074030  9302 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:41.074957  9594 log.cc:924] Time spent T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260812 19:22:41.099423  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.100234  6482 raft_consensus.cc:2354] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4.
I20260812 19:22:41.099890  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.101215  6474 raft_consensus.cc:2396] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:41.102579  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.103281  6465 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:41.104190  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.104749  6465 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:41.105485  9401 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:41.106402  9401 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.107812  6481 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:41.107868  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.108848  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.109061  9401 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:41.109731  6413 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.007s	sys 0.022s
W20260812 19:22:41.110112  6413 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.007s	sys 0.022s
I20260812 19:22:41.111841  9602 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:41.112324  9602 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.112632  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:41.113240  7600 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:41.114413  9602 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:41.114837  6236 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.011s	sys 0.010s
I20260812 19:22:41.115140  9602 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:41.115259  6236 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.011s	sys 0.010s
I20260812 19:22:41.115280  9026 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:41.115621  9602 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.117637  9602 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:41.119285  9612 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260812 19:22:41.075453  6477 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:41.055475  9599 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.101092  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.105573  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.123517  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:41.080307  6178 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.906s (SENT)
I20260812 19:22:41.084805  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.102284  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.142895  6473 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:41.143201  6474 raft_consensus.cc:2396] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:41.144101  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.145131  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:41.127017  6482 raft_consensus.cc:2362] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5. Re-sending same reply.
I20260812 19:22:41.090204  6229 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260812 19:22:41.157621  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.158059  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.158931  6474 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:41.159658  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.094185  9204 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:41.095325  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.164288  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.176770  6477 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:41.177989  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.179311  6477 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:41.124732  8930 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.146477  9163 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:41.161237  6465 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:41.095640  7591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60760 (request call id 212) took 1002 ms. Trace:
I20260812 19:22:41.163151  6475 raft_consensus.cc:2396] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260812 19:22:41.175230  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.003s	sys 0.024s
I20260812 19:22:41.077080  9436 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.077169  9257 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.166738  6481 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:41.194209  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.169961  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.196192  6474 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
W20260812 19:22:41.163873  9529 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.002s	sys 0.021s
W20260812 19:22:41.213121  9529 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.002s	sys 0.022s
I20260812 19:22:41.213547  9529 raft_consensus.cc:686] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:22:41.214114  9615 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260812 19:22:41.215237  9601 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260812 19:22:41.214881  9529 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.217854  7600 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
W20260812 19:22:41.204396  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.003s	sys 0.024s
I20260812 19:22:41.208031  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1416) took 2262 ms. Trace:
W20260812 19:22:41.219820  6242 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.013s	sys 0.017s
I20260812 19:22:41.212323  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:41.209303  7552 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.001s	sys 0.024s
I20260812 19:22:41.218745  6241 rpcz_store.cc:276] 0812 19:22:38.945916 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:38.987133 (+ 41217us) service_pool.cc:227] Handling call
0812 19:22:39.198135 (+211002us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b5800001898. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:22:39.198377 (+   242us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:39.335311 (+136934us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:39.335352 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:39.367230 (+ 31878us) log.cc:842] Serialized 26 byte log entry
0812 19:22:40.250260 (+883030us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:40.250318 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:40.250435 (+   117us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:41.199726 (+949291us) raft_consensus.cc:1671] finished
0812 19:22:41.199757 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:41.207935 (+  8178us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":46993,"raft.queue_time_us":47123,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":12265,"spinlock_wait_cycles":41221888,"thread_start_us":824479,"threads_started":1,"wal-append.queue_time_us":1437988}
I20260812 19:22:41.156517  6055 catalog_manager.cc:5495] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:41.212208  6477 raft_consensus.cc:2362] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5. Re-sending same reply.
I20260812 19:22:41.225028  6477 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: []
W20260812 19:22:41.221907  6242 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.014s	sys 0.017s
W20260812 19:22:41.220847  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 849684us
I20260812 19:22:41.225765  6179 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:41.227249  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.228367  6475 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:41.159025  8516 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.230923  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:41.231796  6473 raft_consensus.cc:2396] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260812 19:22:41.232282  6474 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:41.237648  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.238368  6474 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:41.238039  6055 catalog_manager.cc:5495] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 4, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 4 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:41.239871  6055 catalog_manager.cc:5495] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 4, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 4 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:22:41.221338  7598 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.008s	sys 0.021s
W20260812 19:22:41.242060  6483 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.014s	sys 0.029s
W20260812 19:22:41.242460  6483 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.014s	sys 0.029s
W20260812 19:22:41.224077  7552 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.001s	sys 0.025s
I20260812 19:22:41.248385  6475 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:41.257041  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 99) took 2460 ms. Trace:
I20260812 19:22:41.248935  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.256696  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.259316  6473 raft_consensus.cc:2396] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260812 19:22:41.250941  6055 catalog_manager.cc:5495] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:41.261083  6055 catalog_manager.cc:5495] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 3, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:41.263450  6055 catalog_manager.cc:5495] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 2, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:22:41.234213  9416 consensus_meta.cc:287] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.967s	user 0.010s	sys 0.005s
I20260812 19:22:41.266294  6481 raft_consensus.cc:2396] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260812 19:22:41.271248  9616 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260812 19:22:41.257531  6483 rpcz_store.cc:276] 0812 19:22:38.796627 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:38.797144 (+   517us) service_pool.cc:227] Handling call
0812 19:22:38.831834 (+ 34690us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:38.832111 (+   277us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:22:40.525245 (+1693134us) log.cc:842] Serialized 14 byte log entry
0812 19:22:41.256604 (+731359us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:41.256669 (+    65us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:41.256734 (+    65us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:41.256820 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:41.256970 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13490,"prepare.queue_time_us":1526157,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":14495,"thread_start_us":2398239,"threads_started":2}
I20260812 19:22:41.268151  9272 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4.
I20260812 19:22:41.269709  9257 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:41.273969  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.039s	sys 0.053s
W20260812 19:22:41.249586  7598 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.009s	sys 0.022s
W20260812 19:22:41.277251  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.039s	sys 0.053s
I20260812 19:22:41.235311  9156 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.282491  6470 raft_consensus.cc:2354] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4.
I20260812 19:22:41.256659  9163 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:41.257385  9448 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:41.203856  7591 rpcz_store.cc:276] 0812 19:22:40.132614 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:40.148296 (+ 15682us) service_pool.cc:227] Handling call
0812 19:22:41.075802 (+927506us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b540048b554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:41.090770 (+ 14968us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":702362880}
I20260812 19:22:41.289492  6475 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260812 19:22:41.287639  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 402903us
I20260812 19:22:41.288908  9599 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:41.291960  9613 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260812 19:22:41.285619  9204 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.292105  9599 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.293804  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:41.293892  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 213625us
I20260812 19:22:41.294626  6483 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:41.293828  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:41.295120  6178 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.902s (SENT)
I20260812 19:22:41.295513  6178 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:41.297335  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:41.286022  9164 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.014s	sys 0.031s
I20260812 19:22:41.299371  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:41.299572  6296 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.023s	sys 0.024s
I20260812 19:22:41.300940  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.265208  6474 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:41.320204  6473 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:41.323037  6296 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.024s	sys 0.025s
I20260812 19:22:41.277405  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.327754  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.286955  9416 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:41.325533  6474 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:41.302284  6055 catalog_manager.cc:5495] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 3, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:41.318738  6477 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:41.286762  8930 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:22:41.336145  6178 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.242s (SENT)
W20260812 19:22:41.304106  9164 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.014s	sys 0.031s
I20260812 19:22:41.341051  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:41.364931  6178 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.315s (SENT)
I20260812 19:22:41.336184  6055 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 4, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 4 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:22:41.367869  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.368726  6475 raft_consensus.cc:2379] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:41.299650  9163 raft_consensus.cc:686] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:41.375660  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:41.338570  6473 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:41.329110  9094 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:41.333103  9525 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:41.389252  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:41.391294  6481 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:41.334249  7598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 205) took 2416 ms. Trace:
I20260812 19:22:41.391371  6474 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:41.370347  6055 catalog_manager.cc:5495] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 3, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:22:41.392419  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:41.379447  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica a1541d11be514114966dc1e92a345298 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:22:41.333882  9490 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.299160  8791 consensus_queue.cc:1046] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.078s
I20260812 19:22:41.304134  8955 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260812 19:22:41.299315  9466 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260812 19:22:41.326321  9621 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:41.296659  9448 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.404702  6473 raft_consensus.cc:2362] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4. Re-sending same reply.
I20260812 19:22:41.420646  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:41.408005  6415 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.076s	user 0.027s	sys 0.085s
W20260812 19:22:41.421787  6415 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.027s	sys 0.086s
I20260812 19:22:41.372885  9473 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260812 19:22:41.411459  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.405166  6055 catalog_manager.cc:5495] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:22:41.413172  9627 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:41.428194  8791 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:41.428800  8791 raft_consensus.cc:686] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:41.428454  9627 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.429694  8791 consensus_queue.cc:237] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.430693  9627 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.394416  9164 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:41.431443  9164 raft_consensus.cc:686] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:41.432632  9466 raft_consensus.cc:3032] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:41.432355  9164 consensus_queue.cc:237] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.433152  9466 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:41.416054  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1420) took 1037 ms. Trace:
I20260812 19:22:41.422123  6477 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:41.434813  6236 rpcz_store.cc:276] 0812 19:22:40.381126 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:40.381285 (+   159us) service_pool.cc:227] Handling call
0812 19:22:40.381703 (+   418us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:40.382117 (+   414us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:40.382145 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:40.382641 (+   496us) log.cc:842] Serialized 26 byte log entry
0812 19:22:41.115760 (+733119us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:41.115806 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:41.115878 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:41.415810 (+299932us) raft_consensus.cc:1671] finished
0812 19:22:41.415838 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:41.415986 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":984,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"thread_start_us":727739,"threads_started":1,"wal-append.queue_time_us":931692}
I20260812 19:22:41.435755  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.436687  6477 raft_consensus.cc:2396] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260812 19:22:41.437108  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 956de4b24b3d4a2693e1dcc392b1dd00, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.423545  9621 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:22:41.437465  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 956de4b24b3d4a2693e1dcc392b1dd00, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.437539  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.438143  6477 raft_consensus.cc:2362] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4. Re-sending same reply.
I20260812 19:22:41.439028  9621 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:41.380129  9343 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:22:41.438984  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.369336  9416 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.420245  8691 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:41.442736  8691 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.443637  9272 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:41.443758  9416 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:41.424422  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 193596us
I20260812 19:22:41.444180  9272 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.445137  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:41.445497  9620 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:41.446038  9416 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:41.446260  9272 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:41.446684  9416 raft_consensus.cc:686] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:41.456168  9416 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.457060  8955 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:41.457581  8955 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.446854  9623 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:41.459106  9623 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.459720  8955 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.375089  8930 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.461367  9623 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:41.462059  8930 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.439011  6359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:41.462826  6359 raft_consensus.cc:595] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Received request to transfer leadership to TS f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:41.421331  6473 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:41.446063  9620 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.464973  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.466071  9448 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:41.466990  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.397236  7598 rpcz_store.cc:276] 0812 19:22:38.917420 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:38.918785 (+  1365us) service_pool.cc:227] Handling call
0812 19:22:38.919104 (+   319us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:38.919353 (+   249us) raft_consensus.cc:1520] Early marking committed up to index 6
0812 19:22:40.609419 (+1690066us) log.cc:842] Serialized 14 byte log entry
0812 19:22:41.284872 (+675453us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:41.288822 (+  3950us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:22:41.293391 (+  4569us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:41.304754 (+ 11363us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:41.331126 (+ 26372us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":599129,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":126488,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":2354237,"threads_started":2,"wal-append.queue_time_us":787727}
I20260812 19:22:41.452929  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:41.454440  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 8b1f6c5d06f046a1818f453d9b609502, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:41.476246  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 8b1f6c5d06f046a1818f453d9b609502, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.477069  6241 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260812 19:22:41.467789  6359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:41.464174  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.478562  6477 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:41.427290  6055 catalog_manager.cc:5495] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 3, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:41.479594  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.480042  6055 catalog_manager.cc:5495] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 3, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:41.478440  6359 raft_consensus.cc:595] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:41.448861  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.384263  9592 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260812 19:22:41.475651  6236 raft_consensus.cc:2379] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:41.484597  6474 raft_consensus.cc:2379] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:41.482268  6055 catalog_manager.cc:5495] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 3 to 4, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 4 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:41.467641  6473 raft_consensus.cc:2362] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5. Re-sending same reply.
I20260812 19:22:41.487700  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.488905  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.488996  6238 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:22:41.489727  6473 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:41.490857  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.445137  8691 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:41.492098  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.493566  6473 raft_consensus.cc:2362] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4. Re-sending same reply.
I20260812 19:22:41.426210  9585 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:41.484095  8930 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260812 19:22:41.491386  6055 catalog_manager.cc:5495] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:22:41.495931  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.422168  9436 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:41.495250  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:22:41.501688  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.466795  9620 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:41.504594  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:22:41.505581  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:22:41.495301  9585 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:41.507043  9585 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:41.415103  9525 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260812 19:22:41.512668  6236 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260812 19:22:41.490345  9595 consensus_meta.cc:287] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.819s	user 0.018s	sys 0.007s
I20260812 19:22:41.519047  6474 raft_consensus.cc:2396] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260812 19:22:41.512846  6473 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:41.478603  8516 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:41.500779  6055 catalog_manager.cc:5495] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 3, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:41.524534  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.521238  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.529071  7603 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:41.529824  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.530368  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:41.531440  7603 raft_consensus.cc:2379] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:41.528380  7600 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:41.533201  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:41.534724  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:41.535557  7600 raft_consensus.cc:2362] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3. Re-sending same reply.
I20260812 19:22:41.536753  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:41.540546  7594 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: []
W20260812 19:22:41.540752  9634 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260812 19:22:41.540714  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:41.542150  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:41.542445  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:41.542846  7603 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:41.543632  6229 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:41.544829  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:22:41.545126  9516 consensus_meta.cc:287] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.597s	user 0.002s	sys 0.009s
I20260812 19:22:41.545502  7591 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:41.545611  9516 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.549080  9643 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:41.549672  9643 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.551198  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:41.552119  9643 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:41.553032  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:41.522795  9595 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.555007  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:41.555902  9595 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.558693  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1423) took 1176 ms. Trace:
I20260812 19:22:41.559121  6242 rpcz_store.cc:276] 0812 19:22:40.382101 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:40.382908 (+   807us) service_pool.cc:227] Handling call
0812 19:22:40.408528 (+ 25620us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:40.408921 (+   393us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:40.408969 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:40.435113 (+ 26144us) log.cc:842] Serialized 26 byte log entry
0812 19:22:41.226061 (+790948us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:41.226126 (+    65us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:41.226234 (+   108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:41.558429 (+332195us) raft_consensus.cc:1671] finished
0812 19:22:41.558451 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:41.558603 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3638,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":18759,"thread_start_us":764692,"threads_started":1,"wal-append.queue_time_us":1030466}
I20260812 19:22:41.560847  7603 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:41.434257  9466 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.562079  7607 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:41.564628  6477 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260812 19:22:41.566634  6477 pending_rounds.cc:76] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 1
I20260812 19:22:41.567025  6477 pending_rounds.cc:97] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260812 19:22:41.567446  6477 raft_consensus.cc:2866] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:22:41.569919  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:22:41.572710  9635 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260812 19:22:41.573346  8516 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:41.574096  8516 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.543678  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:41.575713  7594 raft_consensus.cc:2396] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260812 19:22:41.578063  8516 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.580982  6464 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:41.589002  7598 raft_consensus.cc:1226] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
W20260812 19:22:41.589563  9492 consensus_meta.cc:287] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.921s	user 0.009s	sys 0.008s
I20260812 19:22:41.592214  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:41.592801  6178 leader_election.cc:334] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.179s (SENT)
I20260812 19:22:41.593053  6474 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:41.593247  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:41.613879  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.615274  6298 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:41.528450  9599 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.632057  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.633036  6477 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:41.634601  6477 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260812 19:22:41.603245  9490 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:41.642890  7591 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:22:41.597450  9632 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:41.650256  6477 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:41.654273  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.655416  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.605528  9492 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:41.604815  9466 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:41.582654  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.601238  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:41.661749  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.499132  9163 consensus_queue.cc:237] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.644681  9026 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:41.669569  6474 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:41.670888  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.609676  9643 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260812 19:22:41.679098  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:41.690438  9633 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260812 19:22:41.661296  9632 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.681142  9592 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:41.684557  9585 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.692603  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:41.694945  6236 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260812 19:22:41.695246  6238 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:41.696542  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.729887  6230 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:41.730345  6224 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 3: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:41.698693  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:41.704629  6473 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:41.680646  9599 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:41.711042  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 321885us
I20260812 19:22:41.659868  9492 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:41.725898  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.734999  6241 raft_consensus.cc:1226] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:41.735913  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.736846  6235 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:41.726974  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.671030  6179 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:22:41.740470  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 69525.7us
I20260812 19:22:41.741382  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.734835  6474 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:41.743446  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.743937  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.744755  6224 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:41.747224  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.748512  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:41.703338  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:41.742127  6477 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:41.751312  6224 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:41.752875  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.754303  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.754838  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.756325  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:41.752420  7598 raft_consensus.cc:2362] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4. Re-sending same reply.
I20260812 19:22:41.719851  9026 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:41.755879  6344 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:41.765972  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:41.766556  6344 raft_consensus.cc:2362] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5. Re-sending same reply.
I20260812 19:22:41.767242  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.767315  9525 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:41.761225  6359 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:41.768079  9525 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:41.768600  9525 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:41.764051  6473 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:22:41.746302  9302 consensus_meta.cc:287] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.000s
I20260812 19:22:41.764705  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.777087  6238 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:41.767463  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.777630  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.778479  6224 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:41.767917  6474 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:41.779997  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.742581  9492 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:41.751158  6232 raft_consensus.cc:2379] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:41.789263  6241 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:41.772032  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:41.761968  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.775547  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.795426  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.796370  6347 raft_consensus.cc:2396] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:41.796981  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.800411  6345 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:41.749943  8516 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:22:41.780661  6474 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:41.783011  6483 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:41.783812  6353 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260812 19:22:41.784267  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.784993  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.785691  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.813723  6228 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:41.815740  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:41.816654  6465 consensus_meta.cc:287] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.597s	user 0.011s	sys 0.000s
I20260812 19:22:41.817068  6465 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:41.817456  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.818166  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:41.788031  6178 leader_election.cc:334] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.246s (SENT)
I20260812 19:22:41.822453  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:41.823035  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:41.747177  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.792702  9585 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.793056  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:41.804287  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.760004  9516 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.808189  6350 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:41.811465  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.738415  9592 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.820600  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.786424  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.836022  6236 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:41.812203  6238 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:41.824316  6477 raft_consensus.cc:2362] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3. Re-sending same reply.
I20260812 19:22:41.825198  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.789990  9630 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:41.828472  6474 raft_consensus.cc:2396] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260812 19:22:41.828431  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 56480.7us
I20260812 19:22:41.819360  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.829386  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.822316  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.838562  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.742645  9599 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:41.843235  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 55242.7us
I20260812 19:22:41.843829  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:41.781437  9343 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:41.819365  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.830809  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:41.844014  6178 leader_election.cc:334] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Timed out: RequestConsensusVote RPC to 127.3.253.2:39969 timed out after 1.525s (SENT)
I20260812 19:22:41.837586  6344 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:41.849610  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:41.850188  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.844770  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.841717  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.854498  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.845746  7606 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:41.854570  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.842432  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.839053  6473 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:41.856233  6236 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:41.839624  6350 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:41.776512  8955 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260812 19:22:41.853031  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.863423  6483 raft_consensus.cc:2354] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5.
I20260812 19:22:41.863561  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.852394  9630 raft_consensus.cc:686] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:41.828255  9643 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:41.857772  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.852171  9026 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.869724  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.869803  9094 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:41.870210  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:41.858511  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.870884  9094 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:41.871330  9094 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:41.871472  6230 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:41.872318  9094 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.872797  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.872720  9630 consensus_queue.cc:237] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.870602  6353 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 2.
I20260812 19:22:41.858208  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.877110  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:41.860184  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 324683us
I20260812 19:22:41.864391  6359 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:41.850592  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:41.878895  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.860908  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.879902  6238 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:41.880053  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.842767  8516 raft_consensus.cc:686] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:41.869297  6477 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:41.858677  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.850471  9490 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:41.853628  7597 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:41.862061  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.864464  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:41.886876  6416 connection.cc:232] RPC call timeout handler was delayed by -2.1272631909232587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
I20260812 19:22:41.838838  9648 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:41.888312  6350 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:41.877475  6344 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:41.888820  6417 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:41.860510  9302 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:22:41.859489  9585 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
W20260812 19:22:41.895731  6416 connection.cc:232] RPC call timeout handler was delayed by -2.1142635599244386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3285s for a response
W20260812 19:22:41.904656  6416 connection.cc:232] RPC call timeout handler was delayed by -1.8266631909646094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260812 19:22:41.905153  6416 connection.cc:232] RPC call timeout handler was delayed by -1.57916319090873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
W20260812 19:22:41.905435  6416 connection.cc:232] RPC call timeout handler was delayed by -1.5557631908450276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
I20260812 19:22:41.907361  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:41.908253  6238 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:41.910039  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.912083  6349 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:41.915475  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.916298  6345 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:41.917575  6345 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:41.894130  9516 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260812 19:22:41.900218  6344 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:41.852072  9343 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.901700  6350 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260812 19:22:41.919467  8516 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.922748  9343 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.923688  9623 raft_consensus.cc:2741] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260812 19:22:41.814054  9525 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.924154  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:41.924726  6359 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:41.924990  9272 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:41.925706  9272 consensus_queue.cc:1046] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 19:22:41.926622  9525 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:41.926887  9272 raft_consensus.cc:3032] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:41.873572  9094 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:41.927381  9272 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:41.927881  9621 consensus_queue.cc:1046] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 19:22:41.928696  9621 consensus_queue.cc:1225] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer f4ef77b3328a44e8a21dd902b370e25a log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260812 19:22:41.928303  9272 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.929394  9623 raft_consensus.cc:3032] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:41.927142  9257 consensus_queue.cc:1046] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 19:22:41.929800  9623 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:41.930455  9257 raft_consensus.cc:3032] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:22:41.931178  9257 raft_consensus.cc:729] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:41.931213  9623 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.932205  9257 consensus_queue.cc:260] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:41.932708  9623 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:41.933527  9257 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:41.903008  9650 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260812 19:22:41.936087  6349 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:41.937245  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:41.940994  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.944185  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:41.946301  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:41.888039  9636 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:41.958443  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:41.959501  6354 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
W20260812 19:22:41.965049  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet fa4336f7dd434c238a9022aa16490450, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:41.965616  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet fa4336f7dd434c238a9022aa16490450, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:41.929680  9272 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:41.951057  9624 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:41.947793  9648 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:41.899377  9448 consensus_queue.cc:1046] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
I20260812 19:22:41.947549  9614 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:42.111176  6482 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:41.899927  9436 consensus_queue.cc:1046] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
I20260812 19:22:42.044699  9302 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:42.133967  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 254100us
I20260812 19:22:42.137725  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1465) took 1024 ms. Trace:
I20260812 19:22:42.121171  9204 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:42.138255  6475 rpcz_store.cc:276] 0812 19:22:41.113627 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:41.375351 (+261724us) service_pool.cc:227] Handling call
0812 19:22:41.391071 (+ 15720us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:41.398131 (+  7060us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:41.398164 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:41.398672 (+   508us) log.cc:842] Serialized 26 byte log entry
0812 19:22:41.781967 (+383295us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:41.782016 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:41.782081 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:42.137475 (+355394us) raft_consensus.cc:1671] finished
0812 19:22:42.137501 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:42.137657 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3472,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":11677,"spinlock_wait_cycles":17408,"thread_start_us":327027,"threads_started":1,"wal-append.queue_time_us":501782}
I20260812 19:22:42.140770  9614 raft_consensus.cc:3032] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:42.140707  9448 raft_consensus.cc:3032] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:42.142966  9599 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:42.147436  9651 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
W20260812 19:22:42.152681  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 273418us
I20260812 19:22:42.155361  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:42.173300  6242 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:42.173672  6242 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:42.158614  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:42.175107  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:42.175519  6230 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:42.158484  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:42.176337  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:42.176887  6354 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:42.159407  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:42.178010  6228 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 5
I20260812 19:22:42.159799  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:42.180727  6353 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:42.160624  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:42.160846  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:42.182385  6350 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:42.183486  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:42.161835  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:42.185267  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:42.185988  6344 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:42.161835  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:42.192505  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:42.193411  6475 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:42.195812  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:42.197054  6236 raft_consensus.cc:2396] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:42.209946  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:42.213948  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:42.220112  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:42.140434  9436 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:42.174530  6242 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:42.223508  6242 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:42.223356  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:42.224414  6350 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
W20260812 19:22:42.172897  9666 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260812 19:22:42.225930  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:42.227607  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:42.227530  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:42.228451  6473 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:42.228895  6353 raft_consensus.cc:2396] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:42.154572  9614 raft_consensus.cc:729] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:42.231573  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:42.232143  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 55886.8us
I20260812 19:22:42.167049  9448 raft_consensus.cc:729] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:42.234201  6230 raft_consensus.cc:2396] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:42.234846  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:42.238060  6350 raft_consensus.cc:2354] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5.
I20260812 19:22:42.154336  9585 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:42.132674  9302 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:42.181433  9204 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:42.240247  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:42.244187  6235 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:42.190302  9473 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:42.251332  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:42.251729  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:42.252242  6238 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 5: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:42.245007  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:42.245205  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:42.238456  6242 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:42.151127  9648 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:42.263983  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:42.262616  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:42.265246  6353 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:42.262773  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:42.261881  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:42.267206  6242 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:42.268363  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:42.224223  9592 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:42.264505  6241 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:42.260361  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:42.269805  6354 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 3. Current term is 4. Ops: []
W20260812 19:22:42.275378  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 329622us
I20260812 19:22:42.276389  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:42.276861  6242 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:22:42.278488  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:42.279394  6238 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:42.284946  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:42.285600  6483 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:42.285974  6224 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:42.286617  6359 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260812 19:22:42.288015  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:42.289412  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:42.290138  6353 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:42.293105  9490 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:42.293598  9490 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:42.294097  9490 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:42.212651  9492 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:42.258839  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:42.304641  6344 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:22:42.231824  9436 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:42.309124  6228 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:42.277702  8516 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:42.264809  9473 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:42.318732  6475 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:42.292110  9685 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:42.341089  6483 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:42.342338  6235 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:42.342362  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:42.351536  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:42.361354  6235 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260812 19:22:42.342285  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 107507us
I20260812 19:22:42.370469  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:42.352723  6475 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:42.350813  6353 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:42.385453  6238 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:42.387346  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:42.389369  6353 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:42.396556  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:42.401559  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:42.401041  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 91140.8us
I20260812 19:22:42.402463  6483 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
W20260812 19:22:42.386066  9645 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260812 19:22:42.326153  9632 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:42.304394  9687 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.104s
I20260812 19:22:42.384429  9650 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:42.332283  9599 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260812 19:22:42.388442  8516 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:42.345429  9592 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260812 19:22:42.435194  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:42.396008  9163 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:42.433884  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 122946us
I20260812 19:22:42.465104  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:22:42.430892  9656 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260812 19:22:42.403821  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:42.419891  9678 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260812 19:22:42.439703  9677 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260812 19:22:42.468511  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:42.487074  9636 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:42.487584  9636 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:42.487989  9636 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:42.490706  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:42.407387  9696 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260812 19:22:42.458642  9661 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.292s	user 0.001s	sys 0.001s
I20260812 19:22:42.445261  8516 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:42.328650  9585 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:42.335920  9204 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:42.324808  9448 consensus_queue.cc:260] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:42.518381  9448 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:42.519286  9620 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:42.519747  9620 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:42.520123  9620 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:42.311518  9614 consensus_queue.cc:260] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:42.491634  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:42.395403  9685 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.087s
I20260812 19:22:42.517444  9492 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:42.511016  9697 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:42.524248  9436 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:42.524793  9675 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260812 19:22:42.525643  9699 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260812 19:22:42.526353  9690 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260812 19:22:42.526280  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:42.443740  9650 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:42.494488  6464 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
W20260812 19:22:42.521881  9676 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260812 19:22:42.507162  9302 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:42.511377  8516 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:42.482240  9163 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:42.554805  6473 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
W20260812 19:22:42.544173  9671 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
W20260812 19:22:42.643503  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 150560us
I20260812 19:22:42.510511  9694 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.131s
I20260812 19:22:42.569622  9697 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:22:42.657691  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 166132us
I20260812 19:22:42.671490  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:42.672642  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:42.636008  9592 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:42.648617  8930 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:42.658258  9687 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:42.656314  9473 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:42.705998  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1243) took 1008 ms. Trace:
I20260812 19:22:42.707338  6352 rpcz_store.cc:276] 0812 19:22:41.697987 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:41.698135 (+   148us) service_pool.cc:227] Handling call
0812 19:22:41.801966 (+103831us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b5800004598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:22:41.802257 (+   291us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:41.802480 (+   223us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:41.802502 (+    22us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:41.821752 (+ 19250us) log.cc:842] Serialized 26 byte log entry
0812 19:22:42.184009 (+362257us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:42.184052 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:42.184128 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:42.705642 (+521514us) raft_consensus.cc:1671] finished
0812 19:22:42.705661 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:42.705916 (+   255us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12851072,"thread_start_us":361919,"threads_started":1,"wal-append.queue_time_us":422802}
I20260812 19:22:42.724709  7598 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:22:42.674594  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:42.733588  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:42.680828  9592 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:42.706209  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 94) took 1052 ms. Trace:
I20260812 19:22:42.738780  9741 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:42.739022  8791 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:42.739434  8791 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:42.690092  8930 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:42.747907  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:42.740932  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:42.758185  6473 raft_consensus.cc:2396] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:42.757980  6474 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:42.760571  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:42.761394  6474 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:42.763547  9627 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:42.764534  9632 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:42.764319  9627 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:42.765342  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:42.765182  9632 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:42.765717  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:42.766575  9627 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:42.767302  9627 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:42.767361  9632 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:42.769263  6475 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
W20260812 19:22:42.763510  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 90936.5us
I20260812 19:22:42.773149  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:42.775238  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:42.776446  6483 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 4: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:22:42.753062  9094 consensus_meta.cc:287] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.825s	user 0.011s	sys 0.002s
I20260812 19:22:42.812270  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:42.740221  9592 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:42.815024  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:42.815670  6344 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:42.755677  8791 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:42.739460  9741 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:42.819657  6236 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
W20260812 19:22:42.819949  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46910.3us
I20260812 19:22:42.814347  6230 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:42.771567  8930 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:42.829490  6344 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:22:42.756027  9687 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:22:42.834100  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 68455.4us
W20260812 19:22:42.804353  9466 consensus_meta.cc:287] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.138s	user 0.012s	sys 0.004s
I20260812 19:22:42.841599  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:42.843376  6345 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 19:22:42.844648  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:42.849116  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:42.852342  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:22:42.830578  9257 consensus_meta.cc:287] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.890s	user 0.012s	sys 0.004s
I20260812 19:22:42.853036  6230 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:42.812510  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:42.923790  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:42.999540  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 172088us
I20260812 19:22:43.000345  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:22:43.000607  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 77457.6us
I20260812 19:22:42.893337  9627 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:22:42.892894  6352 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260812 19:22:42.755739  9302 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.176s
I20260812 19:22:42.923725  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:42.836897  7598 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260812 19:22:42.899163  9687 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:42.900496  9623 consensus_meta.cc:287] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.967s	user 0.014s	sys 0.000s
W20260812 19:22:42.921967  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 423582us
W20260812 19:22:43.002259  9272 consensus_meta.cc:287] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.958s	user 0.019s	sys 0.000s
I20260812 19:22:42.786929  9620 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:42.738889  6229 rpcz_store.cc:276] 0812 19:22:41.647615 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:41.651599 (+  3984us) service_pool.cc:227] Handling call
0812 19:22:41.734278 (+ 82679us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:41.741369 (+  7091us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:41.751944 (+ 10575us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:41.791552 (+ 39608us) log.cc:842] Serialized 26 byte log entry
0812 19:22:42.141965 (+350413us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:42.142058 (+    93us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:42.142177 (+   119us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:42.680347 (+538170us) raft_consensus.cc:1671] finished
0812 19:22:42.680368 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:42.700434 (+ 20066us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":341580,"threads_started":1,"wal-append.queue_time_us":479021}
I20260812 19:22:43.052587  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:43.055958  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:42.999271  6342 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:43.004237  9492 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:42.780629  9694 consensus_queue.cc:1046] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
I20260812 19:22:42.999413  9710 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:42.905514  9632 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:43.034734  9163 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:43.034493  9741 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:43.039767  9734 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260812 19:22:43.022120  9525 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
W20260812 19:22:43.040539  9715 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260812 19:22:43.042872  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 95) took 1221 ms. Trace:
I20260812 19:22:43.106858  6232 rpcz_store.cc:276] 0812 19:22:41.821575 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:41.829855 (+  8280us) service_pool.cc:227] Handling call
0812 19:22:41.863724 (+ 33869us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:42.236344 (+372620us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:42.240312 (+  3968us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:42.336312 (+ 96000us) log.cc:842] Serialized 26 byte log entry
0812 19:22:42.608528 (+272216us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:42.636330 (+ 27802us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:42.643361 (+  7031us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:43.042565 (+399204us) raft_consensus.cc:1671] finished
0812 19:22:43.042593 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:43.042790 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":37411,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":8071,"thread_start_us":384441,"threads_started":2,"wal-append.queue_time_us":651925}
W20260812 19:22:43.109059  9636 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.011s
I20260812 19:22:43.109685  9636 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:43.048075  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:43.007925  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.028s	sys 0.032s
W20260812 19:22:43.110893  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.028s	sys 0.032s
W20260812 19:22:43.111207  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 646189us
I20260812 19:22:43.111056  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:43.113225  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:43.114355  9623 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:43.114764  9623 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:43.115104  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:43.063861  6230 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:22:43.077167  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:43.116122  6229 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:43.116389  6242 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:43.117798  6242 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:43.087718  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1254) took 1324 ms. Trace:
I20260812 19:22:42.850755  9697 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:43.064234  6465 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:43.118273  9592 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:43.141677  9592 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:43.103685  9694 consensus_queue.cc:1225] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer f4ef77b3328a44e8a21dd902b370e25a log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:22:43.105170  9738 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260812 19:22:43.119298  6347 rpcz_store.cc:276] 0812 19:22:41.763072 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:41.854225 (+ 91153us) service_pool.cc:227] Handling call
0812 19:22:43.080647 (+1226422us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54002d05d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:43.087619 (+  6972us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2088946432}
I20260812 19:22:43.032236  9650 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:43.121613  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:22:43.122550  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 74561.7us
I20260812 19:22:43.064464  9711 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:43.126853  9257 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:43.095289  9710 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:43.129823  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:43.131270  9163 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:22:43.131462  9490 consensus_meta.cc:287] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.837s	user 0.015s	sys 0.000s
I20260812 19:22:43.011754  9686 consensus_queue.cc:1046] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260812 19:22:43.125123  9448 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:43.137043  9525 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:43.182173  9525 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:43.143400  6230 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260812 19:22:43.146353  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet c8fcb9244e2242f0bb95ee6cb9a69d50, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:43.146597  6352 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:43.153760  9711 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:43.150647  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:43.152364  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:43.156366  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:43.115132  9623 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:43.168262  6241 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260812 19:22:43.166739  9257 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:43.174294  6465 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:43.174919  9636 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:43.175457  9686 consensus_queue.cc:1225] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260812 19:22:43.178728  6464 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:43.179808  9490 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:43.180685  9448 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:43.281502  8791 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:43.150094  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 113332us
I20260812 19:22:43.288925  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:43.156167  9694 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:43.191051  9710 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:43.289657  9694 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:43.290179  9490 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:43.291986  9257 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:43.216604  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 66047.9us
I20260812 19:22:43.293771  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:43.213275  9711 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:43.235263  9703 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:43.153298  8930 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:43.243130  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:43.298043  6230 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:43.244133  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 87848.3us
I20260812 19:22:43.185696  9599 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:22:43.256753  8516 consensus_meta.cc:287] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.004s
I20260812 19:22:43.275614  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:43.283187  9448 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:43.185309  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet c8fcb9244e2242f0bb95ee6cb9a69d50, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:43.287405  9655 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.067s	user 0.018s	sys 0.009s
I20260812 19:22:43.287714  9516 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:43.215615  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 63365us
I20260812 19:22:43.317719  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:43.296756  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:43.290060  9694 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:43.299103  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:43.319213  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:43.299327  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:43.260038  9718 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:43.308507  9163 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:43.311795  9632 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:22:43.297811  9703 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:43.317399  6230 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:43.349745  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:22:43.398684  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 49013.6us
I20260812 19:22:43.400838  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:43.402478  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:43.357189  9492 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260812 19:22:43.333171  9718 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:43.332717  9686 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:43.318523  6465 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:43.408722  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:43.353562  9627 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:22:43.349606  9620 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:43.353981  9163 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:43.352514  9490 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:43.407665  9436 raft_consensus.cc:3032] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:43.399887  9703 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:43.432848  9436 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:43.428222  9620 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:43.433470  9620 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:43.348333  8791 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:43.356590  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:43.424865  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1466) took 2311 ms. Trace:
I20260812 19:22:43.438484  6481 rpcz_store.cc:276] 0812 19:22:41.113865 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:41.395517 (+281652us) service_pool.cc:227] Handling call
0812 19:22:41.399277 (+  3760us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:41.399625 (+   348us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:41.399657 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:41.421335 (+ 21678us) log.cc:842] Serialized 26 byte log entry
0812 19:22:41.951011 (+529676us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:41.951070 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:41.951167 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:43.286536 (+1335369us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:22:43.424475 (+137939us) raft_consensus.cc:1671] finished
0812 19:22:43.424504 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:43.424778 (+   274us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":532,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":9908,"spinlock_wait_cycles":65892608,"thread_start_us":461931,"threads_started":1,"wal-append.queue_time_us":666646}
I20260812 19:22:43.410117  9749 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:43.314687  8516 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:22:43.434500  9761 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260812 19:22:43.324685  9516 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:43.348623  9636 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260812 19:22:43.433902  9620 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:43.396670  9739 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260812 19:22:43.433863  9436 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:43.414685  9686 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:43.411928  9632 raft_consensus.cc:686] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:43.411918  9718 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:43.431913  9760 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260812 19:22:43.315376  9599 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:43.423723  9163 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:43.424027  9490 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:43.408399  9691 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:43.455418  6238 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260812 19:22:43.357962  9757 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260812 19:22:43.409946  9302 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260812 19:22:43.457466  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 121535us
I20260812 19:22:43.439198  9257 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:43.466059  8516 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:43.447533  9749 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:22:43.576421  9762 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260812 19:22:43.563457  9632 consensus_queue.cc:237] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:43.552742  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1445) took 1389 ms. Trace:
I20260812 19:22:43.583595  6236 rpcz_store.cc:276] 0812 19:22:42.163782 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:42.213606 (+ 49824us) service_pool.cc:227] Handling call
0812 19:22:43.552488 (+1338882us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b5400179154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:43.552656 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1388562816}
I20260812 19:22:43.574927  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:43.555584  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1142) took 2490 ms. Trace:
I20260812 19:22:43.457998  9738 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:43.585474  6482 rpcz_store.cc:276] 0812 19:22:41.067274 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:41.211833 (+144559us) service_pool.cc:227] Handling call
0812 19:22:41.232332 (+ 20499us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:42.121295 (+888963us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:43.555216 (+1433921us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b540003d4d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:43.555488 (+   272us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2020514688}
I20260812 19:22:43.450618  6464 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
W20260812 19:22:43.589212  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 270055us
I20260812 19:22:43.481848  9686 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:43.609865  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:22:43.507422  9750 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
W20260812 19:22:43.571606  9774 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260812 19:22:43.615836  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 260535us
W20260812 19:22:43.569013  9766 log.cc:924] Time spent T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260812 19:22:43.593641  9749 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:43.575434  9780 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260812 19:22:43.489778  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:43.621665  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 212987us
I20260812 19:22:43.643435  6178 leader_election.cc:398] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5.
I20260812 19:22:43.644068  6178 leader_election.cc:401] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:22:43.645954  8516 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5.
I20260812 19:22:43.624043  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1462) took 1215 ms. Trace:
I20260812 19:22:43.489441  9436 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:43.597441  9691 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:43.515864  8930 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:43.641414  6482 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:43.617327  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:43.586889  9490 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:43.586989  9257 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:43.586761  9302 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:43.646883  6228 rpcz_store.cc:276] 0812 19:22:42.409062 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.145104 (+736042us) service_pool.cc:227] Handling call
0812 19:22:43.146464 (+  1360us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:43.146717 (+   253us) raft_consensus.cc:1520] Early marking committed up to index 2
0812 19:22:43.373525 (+226808us) log.cc:842] Serialized 14 byte log entry
0812 19:22:43.619229 (+245704us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:43.619312 (+    83us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:43.619380 (+    68us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:43.619470 (+    90us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:43.623977 (+  4507us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14755,"prepare.queue_time_us":306490,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":67,"raft.queue_time_us":146954,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":105,"spinlock_wait_cycles":15865216,"thread_start_us":452358,"threads_started":3,"wal-append.queue_time_us":66607}
I20260812 19:22:43.637965  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1460) took 1359 ms. Trace:
I20260812 19:22:43.663112  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:43.668365  6242 rpcz_store.cc:276] 0812 19:22:42.278080 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.118485 (+840405us) service_pool.cc:227] Handling call
0812 19:22:43.118824 (+   339us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:43.119046 (+   222us) raft_consensus.cc:1520] Early marking committed up to index 2
0812 19:22:43.309480 (+190434us) log.cc:842] Serialized 14 byte log entry
0812 19:22:43.637426 (+327946us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:43.637505 (+    79us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:43.637581 (+    76us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:43.637685 (+   104us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:43.637880 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":318315,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":2894,"raft.queue_time_us":19736,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":91,"thread_start_us":482668,"threads_started":2,"wal-append.queue_time_us":347015}
I20260812 19:22:43.649639  9516 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:43.673619  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 56418.3us
I20260812 19:22:43.678010  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:43.774960  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 97061.2us
I20260812 19:22:43.687064  9627 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:43.776836  6464 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260812 19:22:43.777752  9800 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.337s	user 0.000s	sys 0.003s
I20260812 19:22:43.777810  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:43.672405  9257 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:43.780925  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:22:43.781253  9650 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:43.781694  9650 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:43.782100  9650 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:43.784016  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1487) took 1498 ms. Trace:
I20260812 19:22:43.784479  6475 rpcz_store.cc:276] 0812 19:22:42.285355 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:42.397720 (+112365us) service_pool.cc:227] Handling call
0812 19:22:42.420668 (+ 22948us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:42.769811 (+349143us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:43.783709 (+1013898us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400363b54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:43.783944 (+   235us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":794391296}
I20260812 19:22:43.653596  6465 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:43.799232  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 138147us
I20260812 19:22:43.800026  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:43.801287  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:43.802846  8516 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:43.804497  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:43.805102  6230 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:43.808051  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:43.808688  6347 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:43.811201  6347 raft_consensus.cc:3032] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:22:43.658015  9691 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:43.811512  6347 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:43.827172  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:43.813002  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:43.817004  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:43.671945  9302 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:43.711217  8930 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:43.757208  9791 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:43.820983  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:43.814450  6230 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
W20260812 19:22:43.830853  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 221049us
I20260812 19:22:43.878531  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:43.878960  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:43.879360  6473 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:43.848886  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:43.848977  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:22:43.686810  9775 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
W20260812 19:22:43.839182  9782 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.287s	user 0.002s	sys 0.000s
I20260812 19:22:43.845131  6347 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:43.894867  6347 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:43.826264  9808 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:43.839274  9811 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:43.821573  9625 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:43.827370  9805 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:43.819368  9599 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:43.907019  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 86125.9us
I20260812 19:22:43.965307  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:43.907553  8516 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:43.839934  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1456) took 1592 ms. Trace:
W20260812 19:22:43.919616  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 143120us
I20260812 19:22:43.875788  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1459) took 1601 ms. Trace:
I20260812 19:22:43.777752  9627 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:43.901074  8930 raft_consensus.cc:686] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:43.849375  9620 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:43.975214  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1521) took 2191 ms. Trace:
I20260812 19:22:44.009959  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:44.012641  6224 rpcz_store.cc:276] 0812 19:22:41.783466 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:41.786787 (+  3321us) service_pool.cc:227] Handling call
0812 19:22:41.787136 (+   349us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:42.286525 (+499389us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:43.974461 (+1687936us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54002f8d54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:43.975146 (+   685us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1146612096}
I20260812 19:22:44.014938  6224 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 19:22:44.012090  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:44.022256  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:44.028631  6483 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:22:43.976493  8516 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:44.044297  7600 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:22:43.960286  9805 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:44.044828  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:44.101050  6483 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:44.043619  6417 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:44.102571  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 59051.2us
I20260812 19:22:44.099690  9753 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:43.975546  6229 rpcz_store.cc:276] 0812 19:22:42.274574 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.117275 (+842701us) service_pool.cc:227] Handling call
0812 19:22:43.117714 (+   439us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:43.118015 (+   301us) raft_consensus.cc:1520] Early marking committed up to index 3
0812 19:22:43.332450 (+214435us) log.cc:842] Serialized 14 byte log entry
0812 19:22:43.758347 (+425897us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:43.794627 (+ 36280us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:22:43.805782 (+ 11155us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:43.835338 (+ 29556us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:43.849880 (+ 14542us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":44165,"prepare.queue_time_us":307554,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":83118,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":10520,"thread_start_us":465151,"threads_started":2,"wal-append.queue_time_us":565090}
I20260812 19:22:43.974450  9827 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:44.117164  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1497) took 1024 ms. Trace:
I20260812 19:22:44.135258  6352 rpcz_store.cc:276] 0812 19:22:43.092406 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.092748 (+   342us) service_pool.cc:227] Handling call
0812 19:22:44.116919 (+1024171us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b5400180454. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:44.117088 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":73401728}
I20260812 19:22:44.121441  6475 raft_consensus.cc:3032] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:44.136663  6475 raft_consensus.cc:729] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:44.122426  9687 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260812 19:22:44.129993  9793 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.506s	user 0.001s	sys 0.001s
I20260812 19:22:44.143963  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:44.144287  9624 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260812 19:22:44.144650  9812 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260812 19:22:44.009160  9585 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 19:22:44.038575  9711 consensus_meta.cc:287] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.724s	user 0.008s	sys 0.006s
W20260812 19:22:43.969985  9706 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260812 19:22:44.137686  6475 consensus_queue.cc:260] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:44.176409  6483 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:22:44.182163  9685 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:44.185794  6224 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260812 19:22:44.194746  6475 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:44.130525  9805 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:22:44.174858  9788 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.538s	user 0.000s	sys 0.002s
I20260812 19:22:43.961526  9811 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:44.224056  6473 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:44.162593  9687 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:44.189654  9845 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:44.214985  9685 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:44.264289  9685 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:44.266053  9630 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.057s	user 0.002s	sys 0.013s
W20260812 19:22:44.266507  9630 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.075s	user 0.002s	sys 0.013s
I20260812 19:22:44.141440  9827 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:44.267326  7606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 231) took 1007 ms. Trace:
W20260812 19:22:44.282902  9815 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
W20260812 19:22:44.284665  9829 log.cc:924] Time spent T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260812 19:22:44.272558  9844 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:44.286135  9749 consensus_meta.cc:287] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.644s	user 0.012s	sys 0.000s
I20260812 19:22:44.286626  9749 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:44.273072  7606 rpcz_store.cc:276] 0812 19:22:43.259813 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.260092 (+   279us) service_pool.cc:227] Handling call
0812 19:22:43.274781 (+ 14689us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:43.291981 (+ 17200us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:43.292031 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:43.292518 (+   487us) log.cc:842] Serialized 26 byte log entry
0812 19:22:43.475185 (+182667us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:43.475251 (+    66us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:43.475369 (+   118us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:44.267061 (+791692us) raft_consensus.cc:1671] finished
0812 19:22:44.267085 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:44.267260 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18939,"raft.queue_time_us":22416,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":16369,"thread_start_us":182133,"threads_started":1,"wal-append.queue_time_us":257546}
I20260812 19:22:44.289978  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:22:44.258952  9810 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.528s	user 0.002s	sys 0.000s
W20260812 19:22:44.252542  9623 consensus_meta.cc:287] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.998s	user 0.014s	sys 0.000s
I20260812 19:22:44.164453  9753 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:44.310596  8955 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:44.288956  9749 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:44.145036  9820 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.157s
I20260812 19:22:44.253669  9687 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:44.245862  9621 raft_consensus.cc:2741] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260812 19:22:43.974948  9808 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:44.332792  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 323111us
I20260812 19:22:44.375527  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:44.244397  9585 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:44.314246  6475 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 19:22:44.202890  9711 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:44.311185  9755 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260812 19:22:44.311467  9163 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.800s	user 0.005s	sys 0.005s
I20260812 19:22:44.273290  9827 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:44.386346  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:44.312634  9624 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:44.250532  8930 consensus_queue.cc:237] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:44.488121  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1449) took 2323 ms. Trace:
I20260812 19:22:44.279392  9845 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:44.369769  7598 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260812 19:22:44.418689  9757 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:44.286449  9844 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:44.578058  6235 rpcz_store.cc:276] 0812 19:22:42.164822 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:42.367997 (+203175us) service_pool.cc:227] Handling call
0812 19:22:42.422788 (+ 54791us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:43.444063 (+1021275us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b1800391240. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f4859155 00007f98f77703d0 00007f98f7770f6b 00007f98f777b78b
0812 19:22:43.444259 (+   196us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:43.444303 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:43.445007 (+   704us) log.cc:842] Serialized 26 byte log entry
0812 19:22:43.588601 (+143594us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:43.588637 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:43.588709 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:44.385560 (+796851us) raft_consensus.cc:1671] finished
0812 19:22:44.385590 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:44.488030 (+102440us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":21620,"raft.queue_time_us":124368,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":63796,"spinlock_wait_cycles":15602432,"thread_start_us":253539,"threads_started":2,"wal-append.queue_time_us":314241}
W20260812 19:22:44.561710  9869 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.074s	user 0.001s	sys 0.001s
I20260812 19:22:44.419360  9620 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:44.562227  9858 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260812 19:22:44.593297  9757 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:44.593152  9630 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260812 19:22:44.623828  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 237550us
I20260812 19:22:44.769395  9630 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:44.769886  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:44.770176  9630 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:44.771824  9757 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:44.363183  8955 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:44.777307  8955 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:44.644699  9811 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:44.645223  9703 consensus_meta.cc:287] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.212s	user 0.013s	sys 0.002s
W20260812 19:22:44.648901  9257 consensus_meta.cc:287] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.869s	user 0.007s	sys 0.003s
I20260812 19:22:44.778913  9257 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:44.571527  9163 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:44.786006  9257 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:44.663452  9821 log.cc:924] Time spent T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.576s	user 0.000s	sys 0.002s
I20260812 19:22:44.585760  9624 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:43.970489  6232 rpcz_store.cc:276] 0812 19:22:42.247549 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.109996 (+862447us) service_pool.cc:227] Handling call
0812 19:22:43.110383 (+   387us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:43.166804 (+ 56421us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:43.169889 (+  3085us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:43.183374 (+ 13485us) log.cc:842] Serialized 26 byte log entry
0812 19:22:43.349331 (+165957us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:43.357421 (+  8090us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:43.399408 (+ 41987us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:43.787830 (+388422us) raft_consensus.cc:1671] finished
0812 19:22:43.796638 (+  8808us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:43.827139 (+ 30501us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33694,"raft.queue_time_us":40457,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4920,"thread_start_us":136441,"threads_started":1,"wal-append.queue_time_us":263848}
I20260812 19:22:44.660720  9711 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:44.670589  9753 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:44.631544  9620 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:44.790019  9620 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:44.419581  9846 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 19:22:44.715009  9686 consensus_meta.cc:287] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.105s	user 0.009s	sys 0.004s
W20260812 19:22:44.686564  9718 consensus_meta.cc:287] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.182s	user 0.012s	sys 0.000s
I20260812 19:22:44.720434  9845 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:44.726202  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1451) took 2560 ms. Trace:
I20260812 19:22:44.729789  9614 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:44.740700  9436 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.081s	user 0.004s	sys 0.009s
I20260812 19:22:44.330642  9623 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:44.743427  9694 consensus_meta.cc:287] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.391s	user 0.003s	sys 0.012s
I20260812 19:22:44.431321  9585 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:44.778764  9703 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:44.660439  6347 consensus_meta.cc:287] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.765s	user 0.008s	sys 0.004s
I20260812 19:22:44.794723  6238 rpcz_store.cc:276] 0812 19:22:42.166113 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:42.397807 (+231694us) service_pool.cc:227] Handling call
0812 19:22:42.398145 (+   338us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:43.585612 (+1187467us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:44.725774 (+1140162us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540035eb54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:44.726118 (+   344us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2429410560}
W20260812 19:22:44.958102  6242 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.028s	sys 0.024s
W20260812 19:22:44.929509  6178 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.006s	sys 0.010s
W20260812 19:22:45.312117  6178 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.015s	sys 0.022s
I20260812 19:22:44.890298  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:44.888307  9473 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260812 19:22:45.279645  6172 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.068s	user 0.014s	sys 0.039s
I20260812 19:22:45.308169  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1475) took 1506 ms. Trace:
I20260812 19:22:44.856518  9827 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:45.314257  9620 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:44.889631  9784 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.331s	user 0.008s	sys 0.002s
I20260812 19:22:45.314357  6228 rpcz_store.cc:276] 0812 19:22:43.801498 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.838741 (+ 37243us) service_pool.cc:227] Handling call
0812 19:22:43.844019 (+  5278us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:22:43.844396 (+   377us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:43.844431 (+    35us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:22:43.877731 (+ 33300us) log.cc:842] Serialized 52 byte log entry
0812 19:22:44.078498 (+200767us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:44.078549 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:44.078676 (+   127us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:45.307863 (+1229187us) raft_consensus.cc:1671] finished
0812 19:22:45.307893 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:45.308087 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":336938,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":198,"thread_start_us":121114,"threads_started":1,"wal-append.queue_time_us":357655}
W20260812 19:22:44.914875  6415 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.048s	sys 0.065s
W20260812 19:22:45.316790  6415 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.328s	user 0.057s	sys 0.078s
W20260812 19:22:45.317000  6172 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.420s	user 0.017s	sys 0.041s
I20260812 19:22:45.318689  9856 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:45.319157  6347 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260812 19:22:45.319381  9621 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:45.320112  6475 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:22:45.320506  6470 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260812 19:22:45.311687  6242 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.277s	user 0.034s	sys 0.031s
I20260812 19:22:45.320978  6470 pending_rounds.cc:76] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 1
I20260812 19:22:45.321398  6470 pending_rounds.cc:97] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260812 19:22:45.321305  9448 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:45.319561  9856 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:45.321959  6470 raft_consensus.cc:2866] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:22:45.322311  9448 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:45.312485  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 1.13102e+06us
I20260812 19:22:45.324908  9856 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:44.911361  9257 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:44.928809  9850 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:45.324867  6178 connection.cc:232] RPC call timeout handler was delayed by -1.158720328938216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
I20260812 19:22:45.326130  9448 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:45.312186  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 542366us
W20260812 19:22:44.974594  8516 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.015s	sys 0.053s
W20260812 19:22:45.643517  8516 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.387s	user 0.025s	sys 0.079s
I20260812 19:22:45.160734  9757 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:22:44.766471  9650 consensus_meta.cc:287] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.948s	user 0.007s	sys 0.007s
W20260812 19:22:44.952505  9302 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.071s	user 0.007s	sys 0.007s
W20260812 19:22:44.890959  9805 consensus_meta.cc:287] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.646s	user 0.001s	sys 0.012s
W20260812 19:22:44.972299  9627 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.008s	sys 0.011s
W20260812 19:22:45.301009  9831 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.291s	user 0.000s	sys 0.000s
I20260812 19:22:44.794339  9718 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:45.496241  9820 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:22:44.888190  9817 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.672s	user 0.003s	sys 0.000s
W20260812 19:22:45.108639  9835 log.cc:924] Time spent T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.768s	user 0.004s	sys 0.006s
W20260812 19:22:45.664770  9725 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.043s	user 0.005s	sys 0.021s
W20260812 19:22:45.402542  9837 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.016s	user 0.003s	sys 0.000s
W20260812 19:22:45.632236  9630 consensus_meta.cc:287] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.861s	user 0.010s	sys 0.007s
W20260812 19:22:44.928110  9794 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.004s	sys 0.014s
I20260812 19:22:45.298413  9854 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:44.874825  9833 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:45.302567  9791 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:44.883347  9685 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:45.326678  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1414454749319702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260812 19:22:44.973577  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.024s	sys 0.024s
W20260812 19:22:45.759442  6229 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.514s	user 0.022s	sys 0.046s
I20260812 19:22:45.761562  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1476) took 1959 ms. Trace:
W20260812 19:22:45.080277  6342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1472) took 3329 ms (client timeout 2071 ms). Trace:
W20260812 19:22:45.769925  6352 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.203s	user 0.004s	sys 0.030s
I20260812 19:22:45.319592  6347 pending_rounds.cc:76] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 5
I20260812 19:22:45.774420  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:44.974061  6474 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.012s	sys 0.038s
W20260812 19:22:45.783135  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.889s	user 0.018s	sys 0.034s
I20260812 19:22:45.465168  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1510) took 2288 ms. Trace:
W20260812 19:22:44.983536  6465 consensus_meta.cc:287] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.164s	user 0.005s	sys 0.012s
I20260812 19:22:45.788493  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1506) took 2612 ms. Trace:
I20260812 19:22:45.439755  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:45.790042  6482 raft_consensus.cc:1226] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260812 19:22:45.804152  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.597s	user 0.008s	sys 0.008s
W20260812 19:22:45.805869  7593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60760 (request call id 233) took 2494 ms (client timeout 2154 ms). Trace:
W20260812 19:22:45.848415  6474 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.999s	user 0.020s	sys 0.060s
W20260812 19:22:45.850298  7593 rpcz_store.cc:269] 0812 19:22:43.311100 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.314406 (+  3306us) service_pool.cc:227] Handling call
0812 19:22:44.890015 (+1575609us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b5800005498. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:45.805507 (+915492us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3796864}
I20260812 19:22:45.851085  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1515) took 2063 ms. Trace:
W20260812 19:22:45.805840  7551 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.464s	user 0.000s	sys 0.012s
I20260812 19:22:45.680564  9820 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:45.852536  7551 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.511s	user 0.001s	sys 0.012s
W20260812 19:22:45.845245  6342 rpcz_store.cc:269] 0812 19:22:41.696297 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:41.702767 (+  6470us) service_pool.cc:227] Handling call
0812 19:22:41.872616 (+169849us) spinlock_profiling.cc:243] Waited 7.58 ms on lock 0x7b5800004598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:45.021937 (+3149321us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b54001ba154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:45.025810 (+  3873us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2273046016}
I20260812 19:22:45.853009  9718 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:45.813705  7598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 344) took 1824 ms. Trace:
I20260812 19:22:45.815989  8516 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:44.870292  9687 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:45.665123  9163 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:45.816962  8930 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.120s	user 0.007s	sys 0.015s
W20260812 19:22:45.861028  8930 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.007s	sys 0.015s
I20260812 19:22:45.861174  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 109) took 2643 ms. Trace:
I20260812 19:22:45.413641  9585 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:45.817108  8691 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:45.691555  9833 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:45.326442  9257 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:44.885975  9272 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
W20260812 19:22:44.762899  9490 consensus_meta.cc:287] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.063s	user 0.014s	sys 0.001s
I20260812 19:22:45.669816  9302 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:45.819911  9516 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.636s	user 0.020s	sys 0.035s
I20260812 19:22:45.638844  9473 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:22:45.894215  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.887s	user 0.028s	sys 0.036s
I20260812 19:22:44.793505  9624 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:45.673008  9627 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.386s	user 0.016s	sys 0.036s
I20260812 19:22:45.665429  9650 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:45.896806  9473 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:44.793889  9686 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:45.637624  9703 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:45.679265  9725 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.005s	sys 0.021s
I20260812 19:22:45.921344  9686 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:45.923036  6349 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:22:44.926349  9738 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.047s	sys 0.071s
W20260812 19:22:45.826848  9700 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.457s	user 0.004s	sys 0.035s
W20260812 19:22:45.826697  9632 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.558s	user 0.031s	sys 0.028s
W20260812 19:22:45.937481  9738 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.981s	user 0.053s	sys 0.091s
W20260812 19:22:45.937803  9632 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.681s	user 0.032s	sys 0.028s
I20260812 19:22:45.476034  9754 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:45.663708  9757 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:45.438201  9803 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.277s	user 0.000s	sys 0.000s
I20260812 19:22:44.870991  9808 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:45.684434  9794 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.546s	user 0.013s	sys 0.037s
W20260812 19:22:45.692749  9836 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.127s	user 0.000s	sys 0.025s
I20260812 19:22:45.285288  9844 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:45.335954  9850 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:45.949738  9836 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.384s	user 0.001s	sys 0.025s
I20260812 19:22:45.950279  9650 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:45.693851  9854 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:45.953862  9757 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:45.304535  9867 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260812 19:22:45.672490  9805 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:45.957412  9302 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:45.941341  9754 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:45.959002  9805 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:45.831629  9828 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 1.074s	user 0.006s	sys 0.019s
W20260812 19:22:45.959263  6349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1276) took 2146 ms (client timeout 2853 ms). Trace:
W20260812 19:22:45.959878  9828 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.006s	sys 0.020s
W20260812 19:22:45.832690  9875 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260812 19:22:45.691265  9791 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:45.851979  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1507) took 2675 ms. Trace:
I20260812 19:22:45.962815  6474 rpcz_store.cc:276] 0812 19:22:43.176295 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.584760 (+408465us) service_pool.cc:227] Handling call
0812 19:22:43.585084 (+   324us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:43.585288 (+   204us) raft_consensus.cc:1520] Early marking committed up to index 3
0812 19:22:43.606756 (+ 21468us) log.cc:842] Serialized 14 byte log entry
0812 19:22:45.851172 (+2244416us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:45.851278 (+   106us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:22:45.851414 (+   136us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:45.851592 (+   178us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:45.851891 (+   299us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4441,"prepare.queue_time_us":36271,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":255719,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":100,"thread_start_us":2239048,"threads_started":2,"wal-append.queue_time_us":1351812}
W20260812 19:22:45.854972  6178 connection.cc:232] RPC call timeout handler was delayed by -1.0286125759594142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260812 19:22:44.977239  8791 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.438s	user 0.020s	sys 0.060s
W20260812 19:22:45.971827  8791 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.441s	user 0.022s	sys 0.092s
I20260812 19:22:45.971874  9302 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:45.848640  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.955s	user 0.019s	sys 0.035s
W20260812 19:22:45.855340  6229 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.610s	user 0.023s	sys 0.046s
I20260812 19:22:45.861801  6482 rpcz_store.cc:276] 0812 19:22:43.217753 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.659190 (+441437us) service_pool.cc:227] Handling call
0812 19:22:43.672557 (+ 13367us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:45.859679 (+2187122us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:45.860731 (+  1052us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b54004461d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:45.861090 (+   359us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4867367296}
W20260812 19:22:45.857156  6352 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.290s	user 0.005s	sys 0.030s
W20260812 19:22:45.866900  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.660s	user 0.008s	sys 0.008s
W20260812 19:22:45.842679  9625 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.568s	user 0.027s	sys 0.076s
I20260812 19:22:45.872390  6470 rpcz_store.cc:276] 0812 19:22:43.177082 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.594729 (+417647us) service_pool.cc:227] Handling call
0812 19:22:43.641199 (+ 46470us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:45.322869 (+1681670us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:45.464759 (+141890us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400272254. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:45.465075 (+   316us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3861065600}
I20260812 19:22:45.863641  8691 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:45.644543  9694 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:45.975801  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:45.976936  6353 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:45.978061  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:45.851745  6464 rpcz_store.cc:276] 0812 19:22:43.787711 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.956653 (+168942us) service_pool.cc:227] Handling call
0812 19:22:45.439484 (+1482831us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824bce 000000000034aea9 00007f98fc644a30 00007f98fc70a7b4 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:45.850785 (+411301us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":63203712}
I20260812 19:22:45.888576  9623 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:45.979509  9627 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:22:45.980121  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1481) took 2170 ms. Trace:
I20260812 19:22:45.980458  9632 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:45.981045  9632 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:45.981124  6477 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260812 19:22:45.981508  9632 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:45.843901  6481 rpcz_store.cc:276] 0812 19:22:43.176019 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.442097 (+266078us) service_pool.cc:227] Handling call
0812 19:22:43.457459 (+ 15362us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:43.457828 (+   369us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:43.457874 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:43.464960 (+  7086us) log.cc:842] Serialized 26 byte log entry
0812 19:22:43.743053 (+278093us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:43.743112 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:43.743229 (+   117us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:44.886715 (+1143486us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:22:45.787517 (+900802us) raft_consensus.cc:1671] finished
0812 19:22:45.787576 (+    59us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:45.788192 (+   616us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":105906,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":5331,"spinlock_wait_cycles":38311808,"thread_start_us":217437,"threads_started":1,"wal-append.queue_time_us":584266}
I20260812 19:22:45.983456  8691 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:45.320554  9621 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:45.983680  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:45.985291  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 133) took 1775 ms. Trace:
I20260812 19:22:45.890304  9257 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:45.841493  6242 rpcz_store.cc:276] 0812 19:22:43.801735 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.845514 (+ 43779us) service_pool.cc:227] Handling call
0812 19:22:43.845833 (+   319us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:43.980060 (+134227us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:44.007894 (+ 27834us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:44.028109 (+ 20215us) log.cc:842] Serialized 26 byte log entry
0812 19:22:45.321355 (+1293246us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:45.321410 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:45.321490 (+    80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:45.760296 (+438806us) raft_consensus.cc:1671] finished
0812 19:22:45.760394 (+    98us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:45.761132 (+   738us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":335837,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":1419850,"threads_started":2,"wal-append.queue_time_us":1671377}
I20260812 19:22:45.857373  7598 rpcz_store.cc:276] 0812 19:22:43.988765 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:44.009430 (+ 20665us) service_pool.cc:227] Handling call
0812 19:22:44.278923 (+269493us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:44.595495 (+316572us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:45.812903 (+1217408us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54002e95d0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:45.813395 (+   492us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":287952256}
I20260812 19:22:45.908324  9585 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 19:22:45.974406  9625 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.723s	user 0.028s	sys 0.076s
I20260812 19:22:45.908958  9820 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:45.909919  9490 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:44.814209  9691 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.963s	user 0.009s	sys 0.001s
I20260812 19:22:45.996628  9691 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:45.901352  9516 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.718s	user 0.021s	sys 0.035s
I20260812 19:22:45.896138  9630 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:45.998744  9490 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:45.912716  9685 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:45.914822  8516 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:45.913707  6465 raft_consensus.cc:2396] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:46.003968  9685 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:46.004498  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1514) took 2826 ms. Trace:
W20260812 19:22:45.907658  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 1.93652e+06us
I20260812 19:22:46.004891  6342 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:46.009146  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:45.906471  9827 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:46.010120  9794 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:22:45.935015  6241 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:22:45.937521  9700 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.620s	user 0.004s	sys 0.035s
W20260812 19:22:45.941830  6417 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.078s	user 0.009s	sys 0.035s
W20260812 19:22:45.940929  7597 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.305s	user 0.016s	sys 0.021s
I20260812 19:22:45.298018  9865 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:45.954044  9854 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:45.952973  9850 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:45.962184  9624 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:46.061565  9865 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:46.062045  9624 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:46.064148  9624 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:45.970254  9614 consensus_meta.cc:287] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.653s	user 0.020s	sys 0.004s
W20260812 19:22:45.959919  6349 rpcz_store.cc:269] 0812 19:22:43.812587 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.812731 (+   144us) service_pool.cc:227] Handling call
0812 19:22:45.958942 (+2146211us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b540009f1d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:45.959143 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4811664640}
I20260812 19:22:45.889039  6347 pending_rounds.cc:97] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260812 19:22:45.890846  9687 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:45.973212  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 2.09411e+06us
I20260812 19:22:45.960460  9754 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:45.983516  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1479) took 3815 ms. Trace:
I20260812 19:22:45.980719  6229 rpcz_store.cc:276] 0812 19:22:43.809498 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:44.146889 (+337391us) service_pool.cc:227] Handling call
0812 19:22:44.211806 (+ 64917us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:44.212031 (+   225us) raft_consensus.cc:1520] Early marking committed up to index 2
0812 19:22:44.244608 (+ 32577us) log.cc:842] Serialized 14 byte log entry
0812 19:22:45.979281 (+1734673us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:45.979426 (+   145us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:45.979525 (+    99us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:45.979691 (+   166us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:45.980021 (+   330us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":79909,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":8223,"thread_start_us":1733942,"threads_started":1,"wal-append.queue_time_us":1456037}
I20260812 19:22:45.986563  9621 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:45.978379  9694 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:46.001035  6236 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:46.001816  9630 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:46.009394  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:45.906543  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 132740us
W20260812 19:22:46.006352  6178 connection.cc:232] RPC call timeout handler was delayed by -2.050055735046044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3371s for a response
I20260812 19:22:46.015055  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:46.015357  9691 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:46.003968  8516 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:46.015476  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:46.015820  9627 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:46.016418  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:45.985769  6352 rpcz_store.cc:276] 0812 19:22:44.210151 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:44.210956 (+   805us) service_pool.cc:227] Handling call
0812 19:22:44.253186 (+ 42230us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:44.280406 (+ 27220us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:44.280453 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:44.322971 (+ 42518us) log.cc:842] Serialized 26 byte log entry
0812 19:22:45.984589 (+1661618us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:22:45.984725 (+   136us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:45.984891 (+   166us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:45.984961 (+    70us) raft_consensus.cc:1671] finished
0812 19:22:45.984973 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:45.985207 (+   234us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26647,"raft.queue_time_us":27361,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":71372,"thread_start_us":1417022,"threads_started":1,"wal-append.queue_time_us":1328482}
I20260812 19:22:45.990044  9805 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:46.004904  6465 rpcz_store.cc:276] 0812 19:22:43.178201 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.436873 (+258672us) service_pool.cc:227] Handling call
0812 19:22:46.004370 (+2567497us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:46.019308  9490 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:46.022733  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:22:46.023602  6417 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.206s	user 0.010s	sys 0.035s
W20260812 19:22:46.024223  6298 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 2.206s (SENT) [suppressed 26 similar messages]
I20260812 19:22:46.024500  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:46.025282  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:46.026072  6238 raft_consensus.cc:1226] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:46.027308  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:46.083206  7594 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:46.083480  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:46.084481  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:46.084781  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:22:46.085150  6178 leader_election.cc:334] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.557s (SENT)
I20260812 19:22:46.085604  8516 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:46.017026  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1470) took 2217 ms. Trace:
I20260812 19:22:46.086244  6241 rpcz_store.cc:276] 0812 19:22:43.799972 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.809084 (+  9112us) service_pool.cc:227] Handling call
0812 19:22:46.016740 (+2207656us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b540013f454. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:46.016940 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4670720256}
I20260812 19:22:46.086366  8516 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:46.086768  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:46.028807  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:46.028164  6232 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:46.088014  6359 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:46.031531  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:46.089200  6354 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:46.070868  6347 raft_consensus.cc:2866] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:22:46.030455  6350 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260812 19:22:45.973006  9302 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:45.967643  9833 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:46.091215  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1275) took 2280 ms. Trace:
I20260812 19:22:46.072444  6345 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:46.069208  6477 rpcz_store.cc:276] 0812 19:22:42.167773 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:42.168055 (+   282us) service_pool.cc:227] Handling call
0812 19:22:43.402244 (+1234189us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:22:43.402439 (+   195us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:45.981767 (+2579328us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:45.983140 (+  1373us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b5400450954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:45.983447 (+   307us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5931899392}
I20260812 19:22:46.064147  9865 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:46.081211  6242 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:46.035487  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:46.091708  6347 rpcz_store.cc:276] 0812 19:22:43.810638 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.810811 (+   173us) service_pool.cc:227] Handling call
0812 19:22:43.811094 (+   283us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:46.090839 (+2279745us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:46.091134 (+   295us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:46.072887  9627 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:46.084538  9614 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:46.085736  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:46.091235  9742 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260812 19:22:46.081313  9490 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:46.059554  7597 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.469s	user 0.017s	sys 0.022s
I20260812 19:22:46.084697  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:46.082044  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:46.123615  6353 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:46.141218  6349 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:46.143476  9805 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:46.167870  9796 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:46.168125  9302 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:46.146399  9805 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:46.172433  6345 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:46.139070  9627 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:22:46.183763  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 1.36664e+06us
W20260812 19:22:46.221386  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 136822us
I20260812 19:22:46.221728  9448 raft_consensus.cc:2741] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260812 19:22:46.223749  9739 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:46.224550  9739 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:46.225986  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:46.074189  9625 consensus_queue.cc:1046] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260812 19:22:46.138965  9614 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:46.210458  6359 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:46.254622  9865 raft_consensus.cc:2741] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260812 19:22:46.206218  9796 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:46.275105  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 68270.4us
W20260812 19:22:46.307878  6417 connection.cc:232] RPC call timeout handler was delayed by -1.0142062399536371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
W20260812 19:22:46.679277  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 456821us
I20260812 19:22:46.367626  9898 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:46.678354  8516 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:46.298832  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 274800us
W20260812 19:22:46.675971  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 590858us
I20260812 19:22:46.685900  8516 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:46.385710  9915 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.268s	user 0.000s	sys 0.002s
I20260812 19:22:46.263607  9614 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:46.689595  8516 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:46.263470  9302 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:46.322688  9490 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:46.450729  9448 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:46.628162  9700 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:46.702157  6349 consensus_meta.cc:287] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
I20260812 19:22:46.298539  9833 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:46.702750  6349 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
W20260812 19:22:46.705816  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 565681us
I20260812 19:22:46.691381  7597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 343) took 2708 ms. Trace:
I20260812 19:22:46.715811  8516 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:46.716275  6178 leader_election.cc:334] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.567s (SENT)
W20260812 19:22:46.716113  9917 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.151s	user 0.002s	sys 0.000s
I20260812 19:22:46.721800  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:46.723052  7607 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.006s	sys 0.029s
W20260812 19:22:46.726017  7607 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.006s	sys 0.029s
I20260812 19:22:46.719444  7591 raft_consensus.cc:1203] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[3.6-3.6]   Dedup: 3.6->[]
I20260812 19:22:46.714298  9833 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:46.727741  9791 consensus_meta.cc:287] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.715s	user 0.010s	sys 0.005s
I20260812 19:22:46.717633  9448 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:46.739900  7591 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260812 19:22:46.713040  9898 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:46.739212  9632 consensus_meta.cc:287] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.757s	user 0.016s	sys 0.000s
W20260812 19:22:46.742576  9627 consensus_meta.cc:287] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.003s
W20260812 19:22:46.745162  9473 consensus_meta.cc:287] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.826s	user 0.013s	sys 0.004s
I20260812 19:22:46.740526  9490 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:46.727416  9700 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:46.713505  7597 rpcz_store.cc:276] 0812 19:22:43.976961 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.990588 (+ 13627us) service_pool.cc:227] Handling call
0812 19:22:44.196735 (+206147us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:44.245162 (+ 48427us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:44.250728 (+  5566us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:44.385964 (+135236us) log.cc:842] Serialized 26 byte log entry
0812 19:22:46.308387 (+1922423us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:46.353172 (+ 44785us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:46.359899 (+  6727us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:46.379665 (+ 19766us) raft_consensus.cc:1671] finished
0812 19:22:46.379720 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:46.685005 (+305285us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":1576131,"threads_started":1,"wal-append.queue_time_us":1358902}
I20260812 19:22:46.740628  9791 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:46.754793  9473 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:46.762846  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 51818us
I20260812 19:22:46.751820  9632 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:46.766062  6475 raft_consensus.cc:595] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:46.766824  6475 raft_consensus.cc:603] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:46.752568  9627 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:46.769016  6344 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:46.775736  7593 raft_consensus.cc:2379] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:46.793761  9833 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:46.794061  9448 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:46.796420  9791 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:46.797935  9473 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:46.800956  9614 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:46.805308  7598 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:46.813908  9632 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:46.803628  9614 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:46.800971  9627 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:46.834136  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 62109.3us
W20260812 19:22:46.838049  9929 log.cc:924] Time spent T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260812 19:22:46.841710  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 147681us
I20260812 19:22:46.839793  9700 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:46.842387  9490 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:46.850534  9490 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:46.856355  9794 raft_consensus.cc:3032] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:46.856999  9794 raft_consensus.cc:729] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:46.857025  9490 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:46.858148  9794 consensus_queue.cc:260] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:46.860955  9794 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:46.868010  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 127751us
I20260812 19:22:46.873198  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:46.874245  7606 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:46.881204  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:46.882944  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:59812 (request call id 5) took 1564 ms. Trace:
I20260812 19:22:46.883368  6475 rpcz_store.cc:276] 0812 19:22:45.318817 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:45.319957 (+  1140us) service_pool.cc:227] Handling call
0812 19:22:46.882669 (+1562712us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54004448d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7772bc3 00007f98fc6bc81a 00007f98f5dbbd04 00007f98f5dbbc92 00007f98f5dbbbc1 00007f98f5dbbb3c 00007f98f5dbadf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:46.882829 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3316153088}
W20260812 19:22:46.886059  9923 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.003s
I20260812 19:22:46.893512  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:46.894234  6179 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:46.894404  6349 raft_consensus.cc:595] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:46.895129  9490 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:46.895536  9490 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:46.895911  9490 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:46.897606  6344 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:46.898471  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:46.899231  6347 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:22:46.899803  6354 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260812 19:22:46.900916  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:46.901471  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:46.899144  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:46.906021  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:46.906585  6342 raft_consensus.cc:595] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Received request to transfer leadership to TS f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:46.906991  6342 raft_consensus.cc:603] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:46.907141  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:46.907415  9739 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:46.915354  6242 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:22:46.915419  6349 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:22:46.901595  7599 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:46.918709  9739 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260812 19:22:46.920038  6236 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1473) took 3119 ms (client timeout 3262 ms). Trace:
W20260812 19:22:46.920472  6236 rpcz_store.cc:269] 0812 19:22:43.800901 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.801032 (+   131us) service_pool.cc:227] Handling call
0812 19:22:46.919820 (+3118788us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b54000f50d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:46.919982 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5054486400}
I20260812 19:22:46.917959  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:46.926949  6465 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:46.927148  9796 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:46.918510  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:46.925486  9898 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:46.937179  6475 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:22:46.937839  6475 raft_consensus.cc:595] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:46.937923  6242 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:46.938202  6475 raft_consensus.cc:603] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:46.927202  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:46.947247  6178 leader_election.cc:334] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.782s (SENT)
I20260812 19:22:46.952430  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:46.952968  7553 connection.cc:232] RPC call timeout handler was delayed by -1.2026013410650194s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
I20260812 19:22:46.953032  9898 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:46.953563  7553 connection.cc:232] RPC call timeout handler was delayed by -1.126101341098547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260812 19:22:46.953946  9898 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:46.954504  9627 consensus_queue.cc:1046] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 19:22:46.955157  6477 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:46.955696  9627 raft_consensus.cc:3032] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:46.956112  9627 raft_consensus.cc:729] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:46.956228  9898 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:46.956439  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:46.957204  9627 consensus_queue.cc:260] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:46.960426  9627 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:46.961611  6352 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 1.
I20260812 19:22:46.963074  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:46.969587  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:46.971539  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:46.972513  6229 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:46.957386  6242 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:46.983242  6344 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:46.984097  6344 raft_consensus.cc:595] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:46.984546  6344 raft_consensus.cc:603] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:46.987737  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260812 19:22:46.992122  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 123409us
I20260812 19:22:46.995952  9632 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:22:47.001894  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:46.996791  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:22:46.997143  9898 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:22:46.996438  6060 catalog_manager.cc:5495] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 1 to 4, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 4 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:47.021420  6241 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260812 19:22:47.021850  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:47.028554  6475 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:47.025349  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:22:47.035413  6242 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260812 19:22:47.040036  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:47.040577  6345 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:47.040953  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:47.041478  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:47.041903  6352 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
W20260812 19:22:47.045966  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 116482us
I20260812 19:22:47.046515  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:47.029582  9930 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 19:22:47.051945  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 52269.5us
I20260812 19:22:47.053777  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:47.054557  9936 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
I20260812 19:22:47.055019  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:47.054610  6481 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:47.016803  9898 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:47.062624  9739 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:47.067548  6241 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:47.067976  6238 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:47.010380  9700 consensus_queue.cc:1046] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260812 19:22:47.069693  9700 raft_consensus.cc:3032] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:22:47.070076  9700 raft_consensus.cc:729] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:47.064678  6060 catalog_manager.cc:5495] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 3 to 4, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 4 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:47.064406  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:47.080847  9632 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 19:22:47.083847  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:22:47.084492  6178 leader_election.cc:334] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.891s (SENT)
I20260812 19:22:47.072484  6060 catalog_manager.cc:5495] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 1 to 4, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 4 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:47.086035  6242 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:47.086897  6060 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:47.083052  9898 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.088387  6060 catalog_manager.cc:5495] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 3 to 4, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 4 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:47.089159  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:47.089429  9898 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:47.090708  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:47.090862  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:47.091490  6238 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:47.091748  6349 raft_consensus.cc:2396] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260812 19:22:47.095093  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:47.095685  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:47.096235  9739 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:47.096401  6241 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:47.096681  9739 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:47.097153  9739 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:47.087726  9700 consensus_queue.cc:260] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.098400  9700 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:47.100890  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:47.112169  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:47.113363  9805 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:47.073390  9490 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.117280  6228 raft_consensus.cc:2379] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 5: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:47.122061  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:47.124536  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:47.132692  6352 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:47.134917  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:47.136130  6349 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:47.138317  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:47.139389  6345 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:47.141148  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:47.142066  6345 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:47.144189  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:22:47.150344  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 75690.2us
I20260812 19:22:47.154500  6475 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:22:47.157338  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:47.157361  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:47.158044  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:47.158670  6236 raft_consensus.cc:2396] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:47.159161  6232 raft_consensus.cc:2396] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260812 19:22:47.159368  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:47.157574  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:47.160025  6055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38512 (request call id 226) took 6406 ms. Trace:
I20260812 19:22:47.160408  6235 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:47.160552  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:47.161420  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:47.162026  6352 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:47.162966  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:47.161091  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:22:47.165349  6178 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.932s (SENT)
W20260812 19:22:47.166471  6178 leader_election.cc:334] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.938s (SENT)
W20260812 19:22:47.166882  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 71957.2us
I20260812 19:22:47.167311  9490 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:47.160913  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:47.175513  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:47.176380  6230 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:47.177726  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:47.178927  6481 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:22:47.170063  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:47.173663  6238 raft_consensus.cc:2396] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260812 19:22:47.179427  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:47.180523  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:47.181223  9742 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:47.186335  6242 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:47.186561  7591 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:47.187069  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:47.187752  6345 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:47.188571  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:47.188764  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:47.189924  6228 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:47.181646  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:47.190994  6230 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:47.191134  6232 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:47.168431  6235 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:47.166935  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:47.198182  9791 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:47.198789  9791 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.200018  6241 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:47.200727  9791 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:47.150835  6060 catalog_manager.cc:5495] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 1 to 3, now has a pending config: VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1), VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2), VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3), NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 3 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:22:47.160393  6055 rpcz_store.cc:276] 0812 19:22:40.798621 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:40.798939 (+   318us) service_pool.cc:227] Handling call
0812 19:22:47.103971 (+6305032us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b6800086960. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6cd12a 00007f98fd6cb868 00007f98fd6c9e70 00007f98fd7cd4fe 00007f98fbadefb4 00007f98fbadef42 00007f98fbadee71 00007f98fbadedec 00007f98fbade0a2 00007f98f5bae94c
0812 19:22:47.159843 (+ 55872us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:22:42.141210 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:22:42.342792 (+201582us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:22:42.385190 (+ 42398us) write_op.cc:435] Acquired schema lock
0812 19:22:42.385221 (+    31us) tablet.cc:660] Decoding operations
0812 19:22:42.747772 (+362551us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:22:42.747875 (+   103us) write_op.cc:641] Partition lock acquired for write op
0812 19:22:42.747911 (+    36us) tablet.cc:683] Acquiring locks for 15 operations
0812 19:22:42.749230 (+  1319us) tablet.cc:699] Row locks acquired
0812 19:22:42.749278 (+    48us) write_op.cc:260] PREPARE: finished
0812 19:22:42.749496 (+   218us) write_op.cc:270] Start()
0812 19:22:42.749671 (+   175us) write_op.cc:276] Timestamp: P: 1786562562749410 usec, L: 0
0812 19:22:42.749715 (+    44us) op_driver.cc:331] REPLICATION: starting
0812 19:22:42.905015 (+155300us) log.cc:842] Serialized 5874 byte log entry
0812 19:22:44.756948 (+1851933us) op_driver.cc:444] REPLICATION: finished
0812 19:22:45.707468 (+950520us) write_op.cc:301] APPLY: starting
0812 19:22:45.707642 (+   174us) tablet.cc:1365] starting BulkCheckPresence
0812 19:22:45.708923 (+  1281us) tablet.cc:1368] finished BulkCheckPresence
0812 19:22:45.709132 (+   209us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:22:45.712485 (+  3353us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:22:45.713082 (+   597us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0812 19:22:45.713137 (+    55us) write_op.cc:312] APPLY: finished
0812 19:22:45.713905 (+   768us) log.cc:842] Serialized 107 byte log entry
0812 19:22:46.018588 (+304683us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:46.019089 (+   501us) write_op.cc:454] Released schema lock
0812 19:22:46.026807 (+  7718us) write_op.cc:341] FINISH: Updating metrics
0812 19:22:46.073003 (+ 46196us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:46.074294 (+  1291us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2611,"reported_tablets":24,"spinlock_wait_cycles":2477824,"child_traces":[["op",{"apply.queue_time_us":949956,"apply.run_cpu_time_us":17515,"apply.run_wall_time_us":475816,"num_ops":15,"prepare.queue_time_us":357445,"prepare.run_cpu_time_us":25544,"prepare.run_wall_time_us":1035730,"raft.queue_time_us":852418,"raft.run_cpu_time_us":32042,"raft.run_wall_time_us":1381975,"replication_time_us":2006975,"thread_start_us":1904657,"threads_started":5,"wal-append.queue_time_us":547056,"wal-append.run_cpu_time_us":44202,"wal-append.run_wall_time_us":1572976}]]}
I20260812 19:22:47.204444  6060 catalog_manager.cc:5495] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 3 to 5, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 5 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:47.206079  7591 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:47.207535  6179 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:47.213188  9805 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:47.213824  9805 raft_consensus.cc:686] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:47.214931  9805 consensus_queue.cc:237] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.218386  6229 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:22:47.227659  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:47.228771  9742 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:47.229205  9742 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:47.229559  9742 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:47.231046  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 64633.9us
W20260812 19:22:47.257036  6178 leader_election.cc:334] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.989s (SENT)
I20260812 19:22:47.259819  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:47.269171  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:47.283272  6230 raft_consensus.cc:2396] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:47.284278  9302 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:47.276752  9794 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:22:47.294409  9490 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:47.291641  7598 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:22:47.304875  9805 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:47.307878  9794 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:22:47.319849  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 66056.4us
I20260812 19:22:47.318591  9960 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
W20260812 19:22:47.337664  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 82805.5us
I20260812 19:22:47.362847  9473 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260812 19:22:47.363739  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Leader has not yet committed an operation in its own term
I20260812 19:22:47.346573  9490 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.367843  9490 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:47.370997  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 2661573faf994c8f9bb837f55af974d9, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:47.371407  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 2661573faf994c8f9bb837f55af974d9, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.341574  9794 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:22:47.381568  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 9e38bc4707784979b4d00b45879a8f0b, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:47.382092  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 9e38bc4707784979b4d00b45879a8f0b, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:47.375917  6178 leader_election.cc:334] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.018s (SENT)
W20260812 19:22:47.393693  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 3bc485edcf4e4bbc84bff9c14c471284, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:47.394074  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 3bc485edcf4e4bbc84bff9c14c471284, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.394796  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:47.395707  9490 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 19:22:47.396246  6178 leader_election.cc:334] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.053s (SENT)
W20260812 19:22:47.397468  6178 leader_election.cc:334] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.085s (SENT)
I20260812 19:22:47.397894  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:47.399226  6178 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.112s (SENT)
I20260812 19:22:47.348860  9960 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260812 19:22:47.399514  9302 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:47.399618  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:47.401355  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:47.401751  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.404825  9302 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:47.404039  9739 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.417507  9739 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:47.404385  9742 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.420714  9742 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:47.422829  9614 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:47.423419  9614 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.425432  9614 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:47.425945  9614 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:47.426420  9614 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.428597  9614 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:47.429320  6416 connection.cc:232] RPC call timeout handler was delayed by -3.6647816319018602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260812 19:22:47.430693  6416 connection.cc:232] RPC call timeout handler was delayed by -3.5828816320281476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260812 19:22:47.429754  9614 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:47.431232  6416 connection.cc:232] RPC call timeout handler was delayed by -3.5774816318880767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
W20260812 19:22:47.439079  6416 connection.cc:232] RPC call timeout handler was delayed by -3.5603816320654005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260812 19:22:47.439607  6416 connection.cc:232] RPC call timeout handler was delayed by -3.4613816319033504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260812 19:22:47.442592  6416 connection.cc:232] RPC call timeout handler was delayed by -3.4064816320315003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260812 19:22:47.443117  6416 connection.cc:232] RPC call timeout handler was delayed by -3.350681632058695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
W20260812 19:22:47.443542  6416 connection.cc:232] RPC call timeout handler was delayed by -3.3497816319577396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260812 19:22:47.444021  6416 connection.cc:232] RPC call timeout handler was delayed by -3.2939816319849342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260812 19:22:47.444453  6416 connection.cc:232] RPC call timeout handler was delayed by -3.2768816319294274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
W20260812 19:22:47.444903  6416 connection.cc:232] RPC call timeout handler was delayed by -3.158981631975621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260812 19:22:47.445144  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45995.7us
W20260812 19:22:47.445367  6416 connection.cc:232] RPC call timeout handler was delayed by -3.0905816319864243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260812 19:22:47.445914  6178 leader_election.cc:334] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.170s (SENT)
W20260812 19:22:47.446034  6416 connection.cc:232] RPC call timeout handler was delayed by -3.0878816319163889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
I20260812 19:22:47.446381  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:47.446682  6416 connection.cc:232] RPC call timeout handler was delayed by -3.0311816320754588s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
W20260812 19:22:47.447299  6416 connection.cc:232] RPC call timeout handler was delayed by -2.6108816319610924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.268s for a response
I20260812 19:22:47.446934  9794 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:47.447696  6178 leader_election.cc:334] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.177s (SENT)
I20260812 19:22:47.447894  9700 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:47.448138  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:47.448892  9700 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 19:22:47.449227  6178 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.225s (SENT)
I20260812 19:22:47.449625  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:47.451618  9794 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:47.450237  6416 connection.cc:232] RPC call timeout handler was delayed by -2.5289816320873797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2771s for a response
W20260812 19:22:47.453233  6416 connection.cc:232] RPC call timeout handler was delayed by -2.3939816320780665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29209999999999997s for a response
W20260812 19:22:47.454154  6416 connection.cc:232] RPC call timeout handler was delayed by -2.2652816320769489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3064s for a response
I20260812 19:22:47.457703  9700 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 19:22:47.461537  6178 connection.cc:232] RPC call timeout handler was delayed by -1.6354030119255185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33690000000000003s for a response
W20260812 19:22:47.461936  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 153171us
I20260812 19:22:47.464211  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:47.464355  9960 consensus_queue.cc:1046] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:22:47.465405  9632 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:47.465670  9960 raft_consensus.cc:3032] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:47.465804  9632 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:47.465898  9700 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:47.466270  9632 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:47.466684  9700 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.468706  9700 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:47.469754  9700 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:47.470474  9700 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.473670  9700 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:47.474579  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:47.476436  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:47.477818  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:47.466089  9960 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:22:47.479975  6416 connection.cc:232] RPC call timeout handler was delayed by -2.2148816320113838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31200000000000006s for a response
I20260812 19:22:47.489460  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:47.489738  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:47.490216  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:47.490824  7597 raft_consensus.cc:2379] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:47.491175  7607 raft_consensus.cc:2379] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:47.492071  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:47.492841  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:47.493010  6230 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:47.499148  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:47.492345  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:47.495999  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:47.501391  6475 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 3.
I20260812 19:22:47.500340  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:47.504398  6350 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 3.
W20260812 19:22:47.508888  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 158417us
I20260812 19:22:47.527709  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:47.533881  6352 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260812 19:22:47.507829  9700 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:47.534617  6298 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:47.538844  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:47.450614  9614 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.538489  7598 raft_consensus.cc:2396] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260812 19:22:47.548691  9967 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:47.549276  9967 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:47.554994  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:47.549666  9614 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:47.537786  9700 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:47.539790  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:47.545236  9739 raft_consensus.cc:2741] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260812 19:22:47.549666  9967 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
W20260812 19:22:47.581678  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 72926.9us
I20260812 19:22:47.581816  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:47.570500  9700 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:47.579602  6342 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:22:47.575073  9958 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260812 19:22:47.614230  9956 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:47.615229  9956 raft_consensus.cc:686] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:47.616665  9956 consensus_queue.cc:237] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.605140  9930 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260812 19:22:47.604811  9805 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260812 19:22:47.590559  9490 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260812 19:22:47.642810  9490 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:47.643107  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:47.643402  9490 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:47.644657  9490 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.653117  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:47.655081  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:47.645344  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:47.656620  9983 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:47.657281  9983 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:47.657653  9983 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:47.613590  9969 raft_consensus.cc:2741] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260812 19:22:47.664659  9614 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:47.670399  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:47.671890  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:47.681294  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:47.683280  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:47.685130  9627 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:47.685700  9627 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:47.686179  9627 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:47.694860  9302 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:47.695490  9302 raft_consensus.cc:686] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:47.696389  9302 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.698450  9627 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.700559  9627 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:47.692325  9796 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 19:22:47.703497  6417 leader_election.cc:334] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.515s (SENT)
W20260812 19:22:47.704885  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 150007us
I20260812 19:22:47.645262  9632 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.679702  9963 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:47.657909  9960 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:47.720690  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 75433.8us
I20260812 19:22:47.691691  9805 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:47.684381  9490 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:47.715454  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:47.721048  7598 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: []
I20260812 19:22:47.691156  9794 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:22:47.731532  6342 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:22:47.734051  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:47.735075  9691 consensus_queue.cc:1046] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:22:47.736047  7591 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:47.737118  9632 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:47.738951  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:47.733183  9930 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:47.738369  9960 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:47.733557  9963 raft_consensus.cc:686] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:47.749339  9632 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:47.749779  9632 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:47.750144  9632 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:47.751281  9963 consensus_queue.cc:237] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.753464  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:47.754421  7598 raft_consensus.cc:2354] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4.
I20260812 19:22:47.754348  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:47.755151  6342 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 19:22:47.755224  6354 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:47.757731  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:47.764398  6344 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:47.768913  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:47.769097  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:47.772161  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:47.772744  6342 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:47.770936  6481 pending_rounds.cc:76] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 5
I20260812 19:22:47.774590  6481 pending_rounds.cc:97] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260812 19:22:47.774938  6481 raft_consensus.cc:2866] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:22:47.779601  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:47.780444  6474 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:47.774307  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:47.771924  9794 raft_consensus.cc:686] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:47.785823  9990 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260812 19:22:47.787242  9982 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260812 19:22:47.771399  9969 consensus_queue.cc:1046] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260812 19:22:47.804194  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:47.805131  9796 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:47.805542  9796 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:47.805891  9967 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.806811  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:47.805909  9796 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
W20260812 19:22:47.807885  9980 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260812 19:22:47.819795  6354 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:47.845099 10003 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:22:47.858587  6342 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 2.
I20260812 19:22:47.795790  9302 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:22:47.854242  6474 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:47.869850  9963 raft_consensus.cc:3032] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:47.872311  9791 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 19:22:47.874172  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 67446.5us
I20260812 19:22:47.863538  9805 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:47.874776 10003 raft_consensus.cc:686] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:22:47.890480  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 119919us
I20260812 19:22:47.870319  9963 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:47.814633  9983 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.896896  9930 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:47.901082  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:47.903563  9967 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:47.907277  9959 consensus_queue.cc:1046] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:47.910857  6470 raft_consensus.cc:3032] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:47.911793  6474 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 19:22:47.911926  6475 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:22:47.912932  6230 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:22:47.954562  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:47.914140  6229 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:47.955559  6477 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:47.915366  6241 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:22:47.916332  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:47.917573 10003 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.918211 10008 consensus_queue.cc:1046] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:47.962873  9967 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:47.920274  7599 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260812 19:22:47.927295 10014 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260812 19:22:47.881011  9302 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:47.951901  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:47.964000  9691 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:22:47.973855  9691 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:47.974838  9691 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.975768  6236 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:47.976502  9963 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.977847  9963 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:47.979058  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:47.964314 10004 raft_consensus.cc:3032] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:22:47.981050 10004 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:47.983662  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:47.987584 10016 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:22:47.954514  6470 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:47.947868  9969 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260812 19:22:47.989859  6470 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.990965  6470 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:47.992624  9700 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.960606  9959 raft_consensus.cc:3032] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:47.994935  9959 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:47.931005  9794 consensus_queue.cc:237] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.982018 10004 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.996080  9959 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.996678 10004 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:22:47.997423  9959 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
W20260812 19:22:48.001772 10006 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260812 19:22:47.961418  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 45251us
I20260812 19:22:47.974756  9302 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:47.956593  6228 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:47.987205  9805 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:47.983673  6236 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
W20260812 19:22:47.957458  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 56688.6us
I20260812 19:22:48.006353  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:48.008424  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:47.964154  9983 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:47.958385  9939 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260812 19:22:48.030526  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:48.039491  7599 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:48.041798  6060 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 107) took 4608 ms. Trace:
I20260812 19:22:48.041517  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:48.044106  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:48.008369  9490 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260812 19:22:48.041950  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:48.022320  9969 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:22:47.965134  9960 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:48.050565  6229 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:22:48.051689  6475 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:48.052148  6298 leader_election.cc:398] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4.
I20260812 19:22:48.054407  6298 leader_election.cc:401] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260812 19:22:48.042337  6060 rpcz_store.cc:276] 0812 19:22:43.433526 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:43.456662 (+ 23136us) service_pool.cc:227] Handling call
0812 19:22:48.041724 (+4585062us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:22:47.423306 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:22:47.424023 (+   717us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:22:47.424074 (+    51us) write_op.cc:435] Acquired schema lock
0812 19:22:47.424095 (+    21us) tablet.cc:660] Decoding operations
0812 19:22:47.425127 (+  1032us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:22:47.425242 (+   115us) write_op.cc:641] Partition lock acquired for write op
0812 19:22:47.425290 (+    48us) tablet.cc:683] Acquiring locks for 7 operations
0812 19:22:47.426122 (+   832us) tablet.cc:699] Row locks acquired
0812 19:22:47.426147 (+    25us) write_op.cc:260] PREPARE: finished
0812 19:22:47.426351 (+   204us) write_op.cc:270] Start()
0812 19:22:47.426507 (+   156us) write_op.cc:276] Timestamp: P: 1786562567426266 usec, L: 0
0812 19:22:47.426553 (+    46us) op_driver.cc:331] REPLICATION: starting
0812 19:22:47.448662 (+ 22109us) log.cc:842] Serialized 3041 byte log entry
0812 19:22:47.532187 (+ 83525us) op_driver.cc:444] REPLICATION: finished
0812 19:22:47.654765 (+122578us) write_op.cc:301] APPLY: starting
0812 19:22:47.655947 (+  1182us) tablet.cc:1365] starting BulkCheckPresence
0812 19:22:47.721099 (+ 65152us) tablet.cc:1368] finished BulkCheckPresence
0812 19:22:47.721253 (+   154us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:22:47.784737 (+ 63484us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:22:47.849982 (+ 65245us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0812 19:22:47.867001 (+ 17019us) write_op.cc:312] APPLY: finished
0812 19:22:47.899197 (+ 32196us) log.cc:842] Serialized 59 byte log entry
0812 19:22:47.899385 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:47.899512 (+   127us) write_op.cc:454] Released schema lock
0812 19:22:47.899553 (+    41us) write_op.cc:341] FINISH: Updating metrics
0812 19:22:47.899827 (+   274us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:47.899860 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":91424,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":116953,"apply.run_cpu_time_us":5006,"apply.run_wall_time_us":245478,"num_ops":7,"prepare.queue_time_us":77885,"prepare.run_cpu_time_us":4628,"prepare.run_wall_time_us":34251,"replication_time_us":77700,"thread_start_us":100867,"threads_started":2}]]}
I20260812 19:22:48.042870  9796 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:48.062616  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:48.048416  9967 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 19:22:48.064157  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 57917.7us
I20260812 19:22:48.065109  6232 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 5: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:22:48.071307  6297 connection.cc:232] RPC call timeout handler was delayed by -2.1358920340426266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
W20260812 19:22:48.071751  6297 connection.cc:232] RPC call timeout handler was delayed by -1.5283920338843018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28809999999999997s for a response
W20260812 19:22:48.072072  6297 connection.cc:232] RPC call timeout handler was delayed by -1.2367920340038836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3205s for a response
I20260812 19:22:48.072098  6416 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:48.073530  6054 catalog_manager.cc:5495] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 3 to 4, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 4 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:48.074841  9614 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:48.075326  9791 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:48.077684  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:48.078282  9739 consensus_queue.cc:1046] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260812 19:22:48.072438  6297 connection.cc:232] RPC call timeout handler was delayed by -1.1854920338373631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32620000000000005s for a response
I20260812 19:22:48.104689  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:48.105573  6474 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:48.078433  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:48.078795  9930 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:48.079511  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:48.083093  6465 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:48.108067  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:48.061198  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:48.110189  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 331981us
I20260812 19:22:48.111930  6228 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:48.111912  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 61262.4us
I20260812 19:22:48.143813  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:48.147992  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:48.148970  6482 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:48.069758  9700 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:48.152491  6475 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 4: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:48.157279  6470 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260812 19:22:48.165071  9969 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:48.101608  9990 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4.
I20260812 19:22:48.166035  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:48.166265  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:48.177318  6349 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:48.157728  6470 pending_rounds.cc:76] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 1
I20260812 19:22:48.094592  9614 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:48.172405  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:48.177870  6470 pending_rounds.cc:97] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260812 19:22:48.178294  6470 raft_consensus.cc:2866] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:22:48.174919  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:48.184166  6474 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:48.188719  6354 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:48.188886  6229 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:48.189921  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:48.191161  6178 connection.cc:232] RPC call timeout handler was delayed by -2.10335490712896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2477s for a response
I20260812 19:22:48.185598  6054 catalog_manager.cc:5495] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:22:48.196537  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:48.101418  9632 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:48.203805  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:48.205451  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:48.208545  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 129117us
I20260812 19:22:48.186403  9614 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:48.223201  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:48.225384  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:48.209961  6474 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:48.193651  6464 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:48.228154  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:48.230705  6054 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 1 to 5, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 5 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:48.224334  9742 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:48.245713  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:48.245582  6236 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:48.258747  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:48.260066  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:48.260934  6352 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:48.262202  7599 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:48.264483  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:48.268111  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:48.269101  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:48.269405  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:48.270095  6482 raft_consensus.cc:2354] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4.
I20260812 19:22:48.274909  6054 catalog_manager.cc:5495] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:22:48.275874  9632 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:48.276547  9739 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:48.276729  6054 catalog_manager.cc:5495] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:22:48.279294  9796 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:48.279614 10026 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260812 19:22:48.279927  9796 raft_consensus.cc:2741] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260812 19:22:48.280563  9796 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:48.282840  6350 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260812 19:22:48.284039  6347 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:48.285116  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:48.285693  6483 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:48.286536  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:48.287315 10020 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260812 19:22:48.210819  9979 consensus_queue.cc:1046] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260812 19:22:48.291348  6477 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:48.294905  6236 raft_consensus.cc:2396] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260812 19:22:48.297240  6241 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:48.300117  6232 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:48.301141  6228 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:48.304831  6474 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:22:48.306341  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:48.307782  6465 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260812 19:22:48.310623  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:48.311318  6230 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:48.308282  9614 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:48.302762  6054 catalog_manager.cc:5495] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 1 to 4, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 4 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:22:48.322903  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:48.323966  6349 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:48.305032 10042 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:48.242163  9960 raft_consensus.cc:686] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:48.337994  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:48.344798  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:48.320400 10004 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:48.318360  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 125079us
I20260812 19:22:48.319514  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:48.356143  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260812 19:22:48.356498  6178 connection.cc:232] RPC call timeout handler was delayed by -1.8443233871366829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.50359999999999994s for a response
W20260812 19:22:48.373719  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 96461.3us
I20260812 19:22:48.338064 10042 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:48.380693  6054 catalog_manager.cc:5495] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:22:48.390611  6230 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:22:48.393714  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:48.402755  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:48.405001 10023 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260812 19:22:48.407348  6178 connection.cc:232] RPC call timeout handler was delayed by -1.7649549071211368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28530000000000005s for a response
I20260812 19:22:48.407220  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:48.407763  6178 connection.cc:232] RPC call timeout handler was delayed by -1.7046549071092159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.292s for a response
I20260812 19:22:48.408057  6473 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:22:48.411166 10019 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:48.411747 10019 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:48.412914 10019 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:48.406056  6054 catalog_manager.cc:5495] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 1 to 2, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:22:48.421912  6473 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260812 19:22:48.419210  6054 catalog_manager.cc:5495] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } }
I20260812 19:22:48.428057  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:48.436815  6470 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 2. Current term is 3. Ops: []
W20260812 19:22:48.436478  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 212764us
I20260812 19:22:48.403667  9979 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:48.399962 10022 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:48.458056  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:48.415252  9473 raft_consensus.cc:3032] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:48.302512  9969 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:48.381966 10004 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:48.465317  6178 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.914s (SENT)
I20260812 19:22:48.414564 10030 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:48.513584 10030 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:48.514166  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 56200.4us
I20260812 19:22:48.515848 10030 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:48.465054  9473 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:48.516979  9473 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:48.427125  9990 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260812 19:22:48.509084 10042 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:48.518812 10042 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:48.511204 10004 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:48.520640  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:48.468101  9791 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:22:48.438728 10040 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260812 19:22:48.594394  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 78752.9us
W20260812 19:22:48.564599 10043 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260812 19:22:48.456971 10018 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260812 19:22:48.596725  6416 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:48.564216 10004 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:48.462992  9627 consensus_queue.cc:1046] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
W20260812 19:22:48.609373  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 95643.1us
I20260812 19:22:48.564113  9791 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:48.615010  6465 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:48.468700  9979 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:22:48.639601  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 174286us
I20260812 19:22:48.634006  6228 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260812 19:22:48.470201 10022 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:48.670259 10022 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:48.615617 10030 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:48.671264 10030 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:48.674266 10030 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:48.657974 10000 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:48.644009  9791 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:22:48.659046  9614 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:48.665627  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:48.650174 10059 consensus_queue.cc:1046] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
W20260812 19:22:48.656606 10048 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260812 19:22:48.470744  9960 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:48.683938  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:48.665807  9979 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:48.730710 10024 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.375s	user 0.000s	sys 0.001s
W20260812 19:22:48.732658 10052 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260812 19:22:48.688305  9963 raft_consensus.cc:3032] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:48.733695  9963 raft_consensus.cc:729] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:48.735186  9963 consensus_queue.cc:260] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:48.737043  9963 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:48.689436  6352 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260812 19:22:48.685571 10069 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:48.740211 10069 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:48.741410 10069 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:48.724390  6470 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:22:48.755903  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:48.697417  9958 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260812 19:22:48.769280 10071 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:48.769719 10071 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:48.770613 10071 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:48.772032 10021 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.564s	user 0.007s	sys 0.000s
I20260812 19:22:48.773046 10038 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:48.764990  6464 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:48.773571 10038 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:48.773998 10038 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:48.767184 10018 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260812 19:22:48.776799  9967 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:48.777195  9967 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:48.720850  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:48.778005  9967 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:48.727485  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:48.717394 10000 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:48.841744  7606 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260812 19:22:48.810441  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 213773us
W20260812 19:22:48.848356  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 327236us
I20260812 19:22:48.840880  6230 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260812 19:22:48.842347  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:49.171823  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:48.793771  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 128) took 1021 ms. Trace:
I20260812 19:22:49.176162  6481 rpcz_store.cc:276] 0812 19:22:47.770234 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:47.770423 (+   189us) service_pool.cc:227] Handling call
0812 19:22:47.770737 (+   314us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:47.782757 (+ 12020us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:47.782789 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:47.783247 (+   458us) log.cc:842] Serialized 26 byte log entry
0812 19:22:48.025960 (+242713us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:48.025994 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:48.026060 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:48.771400 (+745340us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:22:48.783762 (+ 12362us) raft_consensus.cc:1671] finished
0812 19:22:48.783791 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:48.791575 (+  7784us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8281984,"thread_start_us":230600,"threads_started":1,"wal-append.queue_time_us":302625}
I20260812 19:22:49.186224  6228 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
W20260812 19:22:49.076076  9959 consensus_meta.cc:287] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.078s	user 0.013s	sys 0.003s
W20260812 19:22:49.207379  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 479989us
I20260812 19:22:49.208348  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:48.792618  9691 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:48.904356  9632 raft_consensus.cc:3032] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:22:49.178129 10069 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:49.176049  9969 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.180418  9990 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.187117  9967 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:49.195524 10059 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:49.184122 10046 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:49.176082  9805 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.222904 10047 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:49.231845  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.232987  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.237226  9983 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260812 19:22:49.237699  9959 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:49.213028  9632 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:49.211349  9930 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:49.226452  9969 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:49.184595 10038 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:49.238065 10093 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:49.233769  9990 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:49.263607 10093 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.240001  6481 raft_consensus.cc:2396] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260812 19:22:49.246783  6482 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260812 19:22:49.283227  6482 pending_rounds.cc:76] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 5
I20260812 19:22:49.283504  6482 pending_rounds.cc:97] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260812 19:22:49.283757  6482 raft_consensus.cc:2866] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:22:49.249230  6470 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260812 19:22:49.287993  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:49.288527  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:49.289346  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:49.297518  9963 consensus_meta.cc:287] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.560s	user 0.016s	sys 0.000s
I20260812 19:22:49.241822 10000 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:49.248149  9791 consensus_meta.cc:287] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.001s
I20260812 19:22:49.242831  7591 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:49.246555  6465 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260812 19:22:49.298974  9791 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:49.300276  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.300987  6465 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:49.302042  9791 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:49.230962 10059 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:49.259265 10046 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:49.303392 10046 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:49.266997  9805 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.309500  9805 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:49.311034  9614 raft_consensus.cc:3032] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:49.316627  9614 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:49.318037  9614 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.318729 10071 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:49.249366  9930 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.319519  9614 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:22:49.294420  9969 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:49.247778  9632 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:49.296746  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:49.321477  9930 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:49.322417  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.324571  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.325601  6470 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:49.266309 10093 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:49.255577  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:49.327206  6464 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:49.298259  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:49.302177  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.289389  6482 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:49.266459  9990 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:49.260938 10038 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:49.316038 10059 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:49.326572  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:49.332453 10008 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.333253  9473 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:49.367504  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 159157us
I20260812 19:22:49.334137 10004 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:49.371043 10008 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.372120 10004 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.335340  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1537) took 1081 ms. Trace:
I20260812 19:22:49.349682  6481 raft_consensus.cc:2396] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260812 19:22:49.361231  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 181544us
I20260812 19:22:49.375221  6475 rpcz_store.cc:276] 0812 19:22:48.254446 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:48.254604 (+   158us) service_pool.cc:227] Handling call
0812 19:22:48.267321 (+ 12717us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:22:48.355507 (+ 88186us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:48.355536 (+    29us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:22:48.374538 (+ 19002us) log.cc:842] Serialized 52 byte log entry
0812 19:22:48.594833 (+220295us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:48.633149 (+ 38316us) log.cc:842] Serialized 14 byte log entry
0812 19:22:49.294005 (+660856us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b180033dea0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f4859155 00007f98f77703d0 00007f98f7782576 00007f98f77930d7 00007f98f7793058
0812 19:22:49.334841 (+ 40836us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:49.334927 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:49.334957 (+    30us) raft_consensus.cc:1671] finished
0812 19:22:49.335062 (+   105us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:49.335229 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":26986,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":128399,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":249,"spinlock_wait_cycles":5801216,"thread_start_us":308293,"threads_started":3,"wal-append.queue_time_us":299138}
I20260812 19:22:49.381188  9632 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:49.382033 10019 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:49.365926  6465 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:49.367621  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.388648  6482 raft_consensus.cc:2379] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:49.403339  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.350117  9700 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:49.406584  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.006s	sys 0.010s
W20260812 19:22:49.469321  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.007s	sys 0.011s
I20260812 19:22:49.443519  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.467908  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:49.469686  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 592632us
W20260812 19:22:49.466820  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 812215us
I20260812 19:22:49.470623  6482 raft_consensus.cc:2354] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5.
W20260812 19:22:49.470224  6483 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.009s	sys 0.009s
I20260812 19:22:49.470973  6481 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:49.474521  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:49.492270  6483 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.010s	sys 0.009s
I20260812 19:22:49.535509  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1542) took 1252 ms. Trace:
I20260812 19:22:49.536803  6230 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:49.535940  6483 rpcz_store.cc:276] 0812 19:22:48.283189 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:48.286461 (+  3272us) service_pool.cc:227] Handling call
0812 19:22:48.286856 (+   395us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:48.287233 (+   377us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:48.287268 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:48.287728 (+   460us) log.cc:842] Serialized 26 byte log entry
0812 19:22:48.399322 (+111594us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:22:48.641202 (+241880us) log.cc:842] Serialized 14 byte log entry
0812 19:22:49.535176 (+893974us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:49.535261 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:49.535304 (+    43us) raft_consensus.cc:1671] finished
0812 19:22:49.535320 (+    16us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:49.535450 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3538,"prepare.queue_time_us":70856,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":127766,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":9137,"thread_start_us":1194743,"threads_started":3,"wal-append.queue_time_us":300175}
I20260812 19:22:49.536145  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:49.538122  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.539018 10074 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:49.539521  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.539603 10074 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.540755  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:49.541381  6230 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:22:49.541565  9990 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:49.542070 10074 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:49.543016  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.527413  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.541987  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.473646  9930 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.473176 10030 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.468933 10069 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.543808  6483 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:49.552039  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:49.553063  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:49.535969  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:49.544147  9956 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260812 19:22:49.556006  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:49.556985  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:49.558768 10109 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:49.560518  6235 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 19:22:49.563182 10008 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:49.563488  9302 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:49.543560  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.545173  6417 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:49.548172  6473 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
W20260812 19:22:49.571861  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 97360.2us
I20260812 19:22:49.543596  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:49.581009 10046 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:49.587066  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.774586  6482 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:49.774731  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 211537us
I20260812 19:22:49.776863  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:49.777079  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:49.777539  6483 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:49.594110  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:49.771363  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:49.593532  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:49.778144  6236 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:49.778971  6241 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:49.779129  6481 raft_consensus.cc:2396] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:49.778673  6230 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 6
I20260812 19:22:49.785826  6470 raft_consensus.cc:2396] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:49.782884  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:49.782850  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 237752us
I20260812 19:22:49.783892  6354 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:22:49.790940  6228 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:49.607896  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:49.800428  6242 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:49.803427  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.807545  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:49.804303  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:49.805364  6229 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:22:49.807469  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:49.807489  6475 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:49.812400  6224 raft_consensus.cc:2396] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:49.809680  6235 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:49.810302  6232 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:49.533902 10113 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.814158  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:49.543713 10076 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:49.818966  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.819732  6481 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:49.820626  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:49.820930  6236 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:49.814395  6349 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:49.605882  7591 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:49.828754 10004 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:49.488309 10093 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.302s
I20260812 19:22:49.815441 10101 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.831446 10101 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.818254 10113 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.833267  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:49.833750 10113 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:49.834201  6242 raft_consensus.cc:2396] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:49.834539  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:49.835129  6475 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:49.828764  6352 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:49.839475  6481 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:49.823675  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:49.790004  9967 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:49.822727  6359 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
W20260812 19:22:49.845252  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 66513.7us
I20260812 19:22:49.827924  7598 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:49.857005  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:49.791133  9302 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.858230  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:49.777892 10030 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.844256  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.489795  9700 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.851790  6241 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:49.852803 10082 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.853030 10104 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:49.854701  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:49.854878  9967 raft_consensus.cc:686] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:49.855893  9739 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:22:49.874102  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:49.874429  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:49.856516  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:49.859056  9614 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:49.859941  9302 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:49.860723  6354 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:49.862288  9627 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.864445  6481 raft_consensus.cc:2379] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:49.823019  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:49.864337  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:49.866947  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:49.867277  6242 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260812 19:22:49.867455  6350 raft_consensus.cc:2379] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:49.813886 10008 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:49.868976  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:49.661819  9930 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:49.789152  6465 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:49.872156  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:49.891294  6344 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260812 19:22:49.843034 10109 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:22:49.781859 10069 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.896597  6232 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:49.877357  6359 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:49.878691  6224 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 3: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:22:49.898819  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44230.5us
I20260812 19:22:49.882341  6230 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:22:49.888650  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:49.887652  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.895495  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:49.892161  6475 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:49.901819  6481 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:49.902033  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.902477  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.900820  6483 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:22:49.903107  6481 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:49.894351 10074 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.888424  9627 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:49.904203 10074 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:49.905669  9627 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:49.906231 10074 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:49.907887 10030 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:49.908651  9739 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:49.909230  9739 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:22:49.909379  9632 consensus_meta.cc:287] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.000s
I20260812 19:22:49.909096  9967 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:49.910183  9739 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:49.912959  9473 consensus_meta.cc:287] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.000s
I20260812 19:22:49.913494  6347 raft_consensus.cc:595] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Received request to transfer leadership to TS f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:49.913923  6347 raft_consensus.cc:603] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:49.883635 10008 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:22:49.914225  6464 consensus_meta.cc:287] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.004s
I20260812 19:22:49.873687 10082 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:49.883327 10046 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:49.841576 10076 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.914955  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:49.915747  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.925221  6475 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:49.925644  6481 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
I20260812 19:22:49.927721  6350 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260812 19:22:49.928503  6482 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:49.890854 10093 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:22:49.931790 10074 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:49.933331 10074 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.934088 10082 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:49.900633  9614 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.894941 10113 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.935678 10113 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:49.936583  9614 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:49.914629 10008 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:49.923920  6464 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:49.938997  6464 raft_consensus.cc:3032] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:49.938870  9898 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:22:49.939395  6464 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:49.940291  9898 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 19:22:49.940256  6464 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.937726 10103 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:49.941387  6464 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:49.940330 10101 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:49.942070  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:49.943931 10069 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:49.916960 10071 consensus_meta.cc:287] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.598s	user 0.013s	sys 0.001s
I20260812 19:22:49.948041  6470 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 19:22:49.937726 10113 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:49.948501  9974 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:49.949003  9974 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:49.950289  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:49.952194  6342 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260812 19:22:49.953063 10101 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.953649 10076 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:49.953585 10101 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:49.957448  6482 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260812 19:22:49.931136  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.931747  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.960346  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.960922  6470 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:22:49.949865  9974 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.964538  6481 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:49.966177  6475 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260812 19:22:49.956082 10059 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.591s	user 0.014s	sys 0.002s
I20260812 19:22:49.966799  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:49.956193  9632 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:22:49.968544  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:49.975122  6483 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:22:49.955874 10074 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:49.899813  9963 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260812 19:22:49.977644  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:49.977768  9632 raft_consensus.cc:686] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:49.977802  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:49.941388 10103 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:22:49.971805  6229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1504) took 1732 ms (client timeout 1795 ms). Trace:
W20260812 19:22:49.997013  6229 rpcz_store.cc:269] 0812 19:22:48.233771 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:48.234138 (+   367us) service_pool.cc:227] Handling call
0812 19:22:49.965697 (+1731559us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540027ced4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:49.965811 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3223524608}
I20260812 19:22:49.978137  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:49.979166  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49464 (request call id 19) took 1305 ms. Trace:
I20260812 19:22:50.001662  6347 rpcz_store.cc:276] 0812 19:22:48.665307 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:48.665473 (+   166us) service_pool.cc:227] Handling call
0812 19:22:49.970366 (+1304893us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540036d654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7772bc3 00007f98fc6bc81a 00007f98f5dbbd04 00007f98f5dbbc92 00007f98f5dbbbc1 00007f98f5dbbb3c 00007f98f5dbadf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:49.970476 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2753157888}
I20260812 19:22:49.978211  9627 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.977708  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:49.960834 10101 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:49.980801  9700 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:49.929266 10114 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:49.994107  6473 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:22:50.037514  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:50.005018 10103 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:50.007452  9974 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:49.975637 10059 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:49.992755  9969 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.050s
I20260812 19:22:50.039992  9700 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260812 19:22:50.047236 10019 consensus_meta.cc:287] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.663s	user 0.006s	sys 0.006s
I20260812 19:22:50.042351  6465 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260812 19:22:50.069077  6477 raft_consensus.cc:2354] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6.
I20260812 19:22:50.070711  6235 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260812 19:22:50.059535  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 80246.2us
I20260812 19:22:50.012214  9627 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:50.080046  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:50.083081  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "545108632fab48129db7f032619a1e55"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:50.083870  6347 raft_consensus.cc:595] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:50.061003  9700 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:50.034572 10109 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260812 19:22:50.034932 10114 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:50.075404  9930 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:50.036669  9632 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:50.114601  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 75041us
I20260812 19:22:50.115785  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:50.099879  9700 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:22:50.124099  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 224647us
I20260812 19:22:50.125005  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:50.126345  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:50.123214  6416 connection.cc:232] RPC call timeout handler was delayed by -1.46033855387941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
I20260812 19:22:50.123222  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:22:50.127075  6416 connection.cc:232] RPC call timeout handler was delayed by -1.40723855397664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260812 19:22:50.129781  6416 connection.cc:232] RPC call timeout handler was delayed by -1.364038554020226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
W20260812 19:22:50.130101  6416 connection.cc:232] RPC call timeout handler was delayed by -1.1552385538816452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260812 19:22:50.130465  6416 connection.cc:232] RPC call timeout handler was delayed by -1.1480385540053248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260812 19:22:50.130838  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0751385539770126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260812 19:22:50.131156  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0751385539770126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260812 19:22:50.131500  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0103385539259762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260812 19:22:50.136785  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:50.149789  6178 leader_election.cc:398] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5.
I20260812 19:22:50.120342  9963 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:50.163691  6347 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 19:22:50.124526 10074 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:50.134913 10093 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:50.176923  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:50.134420  9967 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:50.170046  6342 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:22:50.186092  6349 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:22:50.127585  9898 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260812 19:22:50.147035  9930 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260812 19:22:50.186211  6178 leader_election.cc:334] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.939s (SENT)
I20260812 19:22:50.164110  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.190330  6359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:50.153545 10069 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:50.167748  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:50.153158 10101 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:50.153355  9983 consensus_queue.cc:1046] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260812 19:22:50.193893  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.152730  9990 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:50.193357  6344 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260812 19:22:50.195593  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.196291  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.241005  6349 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260812 19:22:50.290813  6342 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:50.172780  9963 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:50.298548  6350 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
W20260812 19:22:50.234972  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 58105.8us
I20260812 19:22:50.190106  9956 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 19:22:50.313459  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 173087us
W20260812 19:22:50.235248  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:22:50.310143  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:50.299178  6359 raft_consensus.cc:595] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:50.319839  6359 raft_consensus.cc:603] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:50.295691 10114 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:50.175021 10113 consensus_queue.cc:1046] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.132s
I20260812 19:22:50.294775 10109 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:50.235453  9473 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:50.324929  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:50.323796  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.297816 10059 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:50.330364  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.304160  6464 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260812 19:22:50.351291  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:50.333657  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.352283  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.173223 10008 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:50.342461  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 174886us
I20260812 19:22:50.191690  9739 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.138s
I20260812 19:22:50.190727 10074 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:50.347167  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 160887us
I20260812 19:22:50.193593  9967 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:50.297946  9990 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:50.339274 10104 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:50.341013 10038 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:22:50.370750  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:50.350451  6464 pending_rounds.cc:76] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 1
W20260812 19:22:50.399855  6178 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.979s (SENT)
I20260812 19:22:50.400425  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.401352  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.409933  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.354537 10114 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:50.407907  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:50.411146  6345 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:50.412931  6350 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:50.413548  6350 raft_consensus.cc:595] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:50.400000 10082 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:50.418279 10082 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:50.418804 10071 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:50.419310 10074 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:50.419404 10071 raft_consensus.cc:686] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:50.419680  9960 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:22:50.420563 10071 consensus_queue.cc:237] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:50.350749  9473 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:50.391849  9627 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:50.398149  7599 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:50.407447 10004 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:50.487255  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:50.353598  9983 raft_consensus.cc:3032] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:22:50.354403  9898 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260812 19:22:50.347903 10109 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:50.461282  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.411154  6464 pending_rounds.cc:97] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260812 19:22:50.493796  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:50.400120 10104 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:22:50.482867 10080 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260812 19:22:50.480801  9614 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:50.502882  6417 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:50.504639  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:50.568979  7607 raft_consensus.cc:2379] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:50.504992  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:22:50.505206  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 7e0797ad50cb46cfb10b4a38cc815917, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:50.569885  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 7e0797ad50cb46cfb10b4a38cc815917, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:50.506920  6473 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:22:50.506965  9739 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 19:22:50.493423 10147 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.184s	user 0.002s	sys 0.000s
I20260812 19:22:50.518414  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:50.519136  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.487280 10131 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:50.547005  6475 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:22:50.577318  6475 raft_consensus.cc:595] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:50.577745  6475 raft_consensus.cc:603] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:50.549046  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.501533 10126 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:50.508713  9969 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:50.521229  6347 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:22:50.508538  7598 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260812 19:22:50.483795 10074 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260812 19:22:50.482612 10120 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:22:50.483285 10114 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:50.419423 10082 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:50.513168  9983 raft_consensus.cc:729] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:50.518637 10004 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:50.501900 10156 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:50.579633  6477 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 3.
I20260812 19:22:50.546567  6464 raft_consensus.cc:2866] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:22:50.580734  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 75815.3us
W20260812 19:22:50.582752  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 79977.6us
W20260812 19:22:50.586059 10123 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260812 19:22:50.588423  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.568542 10104 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:50.591889 10069 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:22:50.589133  9963 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:50.576958 10131 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:50.628237  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:50.639935  6347 raft_consensus.cc:595] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
W20260812 19:22:50.599438  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 105750us
W20260812 19:22:50.608168  6178 leader_election.cc:334] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.154s (SENT)
I20260812 19:22:50.645185  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:50.645903  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:50.605026  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:50.629838 10109 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:50.607797  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:50.647188  6475 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
W20260812 19:22:50.630975 10135 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.224s	user 0.003s	sys 0.000s
I20260812 19:22:50.652640  6229 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260812 19:22:50.626945 10154 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260812 19:22:50.655221  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:50.602567  9614 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 19:22:50.637252 10119 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260812 19:22:50.657704  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:50.656716  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:50.665365  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260812 19:22:50.602751 10157 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election won for term 5
W20260812 19:22:50.668008  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 59953.8us
I20260812 19:22:50.628741 10114 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:50.676514  6178 leader_election.cc:334] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.476s (SENT)
I20260812 19:22:50.677053  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:22:50.678217  6229 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:50.682379  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:22:50.684504  6470 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:22:50.686789  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:50.689222  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:50.600678 10008 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:50.700335  6470 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:50.700585  6473 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260812 19:22:50.637184 10120 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:50.704582  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:50.647974 10131 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:50.706123  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 48529.2us
I20260812 19:22:50.668895  9967 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:50.702641  6473 pending_rounds.cc:76] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 1
I20260812 19:22:50.665365  9898 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:50.709237  6473 pending_rounds.cc:97] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260812 19:22:50.709726  6473 raft_consensus.cc:2866] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:22:50.680579 10103 consensus_meta.cc:287] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.005s
I20260812 19:22:50.665541 10069 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:50.671244  9691 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:22:50.711851  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.664501 10113 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:50.714699  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.723425  6349 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:50.715024  6350 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 2.
I20260812 19:22:50.704301 10157 raft_consensus.cc:686] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:50.719997  6470 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:22:50.675093  9473 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:50.722101  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:50.680547 10074 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:50.727173  6230 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:50.690263  9990 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:50.713239  9632 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:50.731419  6228 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:50.732339  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:50.712129  9898 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:50.744810  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:50.756295  6342 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:22:50.750948  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:50.751646  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:50.752965  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 76503.5us
I20260812 19:22:50.753410  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:50.758461  6473 raft_consensus.cc:2396] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260812 19:22:50.748800  9700 consensus_meta.cc:287] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.604s	user 0.012s	sys 0.001s
I20260812 19:22:50.746481  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1254) took 1202 ms. Trace:
I20260812 19:22:50.754145  9632 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:50.762158  9898 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:51.059711  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 166) took 1513 ms. Trace:
I20260812 19:22:50.721340 10103 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:50.800676 10140 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260812 19:22:50.801702 10160 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260812 19:22:50.589704 10126 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:50.631814 10156 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:50.988701  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 238088us
I20260812 19:22:51.001947 10071 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:50.747000  9963 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260812 19:22:51.121390  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 127) took 1295 ms. Trace:
I20260812 19:22:51.067468  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:51.121827  6236 rpcz_store.cc:276] 0812 19:22:49.825611 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:49.825753 (+   142us) service_pool.cc:227] Handling call
0812 19:22:49.865136 (+ 39383us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:49.869711 (+  4575us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:49.869740 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:49.885167 (+ 15427us) log.cc:842] Serialized 26 byte log entry
0812 19:22:50.173562 (+288395us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:50.173600 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:50.173668 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:50.803281 (+629613us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b24002cd428. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f46b4cf4 00007f98f46b2dfb 00007f98f4741559 00007f98f47411e5 00007f98f4740740 00007f98f7427578 00007f98f7427cd8 00007f98f73ff6e8 00007f98f73faaea 00007f98f73f9f36
0812 19:22:51.118136 (+314855us) raft_consensus.cc:1671] finished
0812 19:22:51.118156 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:51.121325 (+  3169us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6225,"raft.queue_time_us":5617,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5212,"spinlock_wait_cycles":6309120,"thread_start_us":266674,"threads_started":1,"wal-append.queue_time_us":434313}
I20260812 19:22:50.766506 10113 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:22:50.723819  9614 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:50.774290  9691 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260812 19:22:50.759243 10166 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260812 19:22:50.747524 10114 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260812 19:22:50.829342 10157 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:50.633888 10155 consensus_queue.cc:1046] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.189s
I20260812 19:22:50.823573 10069 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:51.057183  9700 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:51.032020  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 272880us
I20260812 19:22:51.033077 10008 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:22:51.033886 10101 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:51.034380 10161 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:51.034898 10038 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:50.828881 10120 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:51.032496  9969 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:51.060197  6353 rpcz_store.cc:276] 0812 19:22:49.545953 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:49.546085 (+   132us) service_pool.cc:227] Handling call
0812 19:22:49.592894 (+ 46809us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:22:49.835231 (+242337us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:49.835266 (+    35us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:22:49.835994 (+   728us) log.cc:842] Serialized 52 byte log entry
0812 19:22:50.149437 (+313443us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:22:50.327591 (+178154us) log.cc:842] Serialized 14 byte log entry
0812 19:22:50.328331 (+   740us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:50.328462 (+   131us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:50.630273 (+301811us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:22:51.052619 (+422346us) raft_consensus.cc:1671] finished
0812 19:22:51.059461 (+  6842us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:51.059616 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":267863,"prepare.queue_time_us":268664,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":255581,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":11765,"spinlock_wait_cycles":8807168,"thread_start_us":448426,"threads_started":2,"wal-append.queue_time_us":553563}
I20260812 19:22:51.030404 10074 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:51.116340  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:51.059240  9632 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:51.109040 10179 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:51.125986 10162 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260812 19:22:51.132045 10046 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:51.031452  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 278126us
I20260812 19:22:51.208621  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:51.143275  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:51.133505  9627 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:51.052212  6464 rpcz_store.cc:276] 0812 19:22:49.532117 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:49.938510 (+406393us) service_pool.cc:227] Handling call
0812 19:22:49.938864 (+   354us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:50.711357 (+772493us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:50.733969 (+ 22612us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:51.138095 10004 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:51.153657 10109 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
W20260812 19:22:51.226428  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 4995e2d6140a4fa3a2dadad444b9a924, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:51.226794  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 4995e2d6140a4fa3a2dadad444b9a924, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:51.152434  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:22:51.228406  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 76053.2us
I20260812 19:22:51.125296 10071 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:51.174350  6232 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260812 19:22:51.194065  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 133) took 1043 ms. Trace:
I20260812 19:22:51.152998 10161 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:51.154405  7591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 267) took 1315 ms. Trace:
I20260812 19:22:51.213878 10179 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:51.249578 10179 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:51.214705 10059 raft_consensus.cc:3032] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:51.222865  9627 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:51.250195 10059 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:51.243040 10074 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:51.251010  9700 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:51.191315 10038 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:22:51.194515  9969 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:51.236234  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:51.241995  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:51.237212  6235 rpcz_store.cc:276] 0812 19:22:50.151028 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:50.151191 (+   163us) service_pool.cc:227] Handling call
0812 19:22:50.175199 (+ 24008us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:50.175573 (+   374us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:50.175605 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:50.191350 (+ 15745us) log.cc:842] Serialized 26 byte log entry
0812 19:22:50.341494 (+150144us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b18003b7be0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:22:50.424039 (+ 82545us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:22:50.424107 (+    68us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:50.424245 (+   138us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:51.155043 (+730798us) raft_consensus.cc:1671] finished
0812 19:22:51.155070 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:51.193993 (+ 38923us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":14963,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":41145,"spinlock_wait_cycles":7929600,"thread_start_us":82299,"threads_started":1,"wal-append.queue_time_us":467102}
I20260812 19:22:51.225831 10156 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:51.238103 10004 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:51.240091 10114 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:51.263563  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:51.269304  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:51.250195 10071 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:51.230512 10046 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:51.284639  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:22:51.286860  6297 connection.cc:232] RPC call timeout handler was delayed by -1.2579198710154742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260812 19:22:51.286965  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:22:51.288304  6297 connection.cc:232] RPC call timeout handler was delayed by -1.1607198708225042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
W20260812 19:22:51.288651  6297 connection.cc:232] RPC call timeout handler was delayed by -1.1130198708269745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260812 19:22:51.288946  6297 connection.cc:232] RPC call timeout handler was delayed by -1.0842198708560318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20260812 19:22:51.296717  6297 connection.cc:232] RPC call timeout handler was delayed by -1.076119870878756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260812 19:22:51.262167 10109 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260812 19:22:51.297058  6297 connection.cc:232] RPC call timeout handler was delayed by -1.0248198709450662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
I20260812 19:22:51.289835 10126 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:51.290408  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:51.251116 10074 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:51.275436 10008 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 19:22:51.276026  9974 consensus_meta.cc:287] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.226s	user 0.019s	sys 0.004s
I20260812 19:22:51.251205 10059 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:51.287817 10101 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:22:51.265429 10004 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:51.305577  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:51.321476  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:51.310966  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:51.322289  6344 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:22:51.322697  6228 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:22:51.279829 10179 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:22:51.289043  9627 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:51.321635  6349 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:22:51.296829 10103 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:51.330519  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 54373.2us
I20260812 19:22:51.616638  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:51.335193  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:51.301904 10109 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:51.618850  9473 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:51.619339 10109 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:22:51.616782  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:51.327114 10004 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
W20260812 19:22:51.430756  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.505s (SENT) [suppressed 30 similar messages]
I20260812 19:22:51.615653 10046 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:51.643468  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:51.506255  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:22:51.627269 10131 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.905s	user 0.009s	sys 0.005s
W20260812 19:22:51.326118 10104 consensus_meta.cc:287] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.662s	user 0.010s	sys 0.006s
W20260812 19:22:51.636107  9898 consensus_meta.cc:287] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.002s
I20260812 19:22:51.319190 10101 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:51.334722  9700 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:51.511023 10147 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260812 19:22:51.442802 10190 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260812 19:22:51.658556  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:22:51.421131 10210 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260812 19:22:51.619493  9473 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:51.328941 10114 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:51.682736  6229 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:51.351897 10059 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:51.658525 10217 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:51.682756 10101 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
W20260812 19:22:51.689246  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 386125us
I20260812 19:22:51.686527  9898 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:51.682891  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:51.522852 10074 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:51.244956  7591 rpcz_store.cc:276] 0812 19:22:49.838948 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:49.841191 (+  2243us) service_pool.cc:227] Handling call
0812 19:22:49.884574 (+ 43383us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:49.950822 (+ 66248us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:49.950886 (+    64us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:49.951477 (+   591us) log.cc:842] Serialized 26 byte log entry
0812 19:22:50.191870 (+240393us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:22:50.328783 (+136913us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:50.333716 (+  4933us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:51.144874 (+811158us) raft_consensus.cc:1671] finished
0812 19:22:51.145818 (+   944us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:51.153092 (+  7274us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13500,"raft.queue_time_us":26763,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":91,"thread_start_us":215413,"threads_started":1,"wal-append.queue_time_us":717256}
I20260812 19:22:51.682559  9967 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260812 19:22:51.713596  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 70213.2us
I20260812 19:22:51.709347  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:51.747004  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:51.523025  9983 consensus_queue.cc:260] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:51.687616 10184 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:51.315626 10161 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:51.772480  6470 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260812 19:22:51.782609  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 351882us
I20260812 19:22:51.749797 10166 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:22:51.743713 10046 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election won for term 5
W20260812 19:22:51.794641  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47710.8us
I20260812 19:22:51.683481 10131 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:51.763616  6465 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:51.750864  9990 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:22:51.816288  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 128170us
I20260812 19:22:51.745983 10217 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:51.760988 10114 raft_consensus.cc:686] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:51.683660 10104 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:51.826783  6229 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:22:51.828280  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:51.773103  9967 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:51.850562  6475 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
W20260812 19:22:51.785506  6178 leader_election.cc:334] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.515s (SENT)
I20260812 19:22:51.834615  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1546) took 1174 ms. Trace:
I20260812 19:22:51.817682 10166 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:51.693601  9700 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:51.826398 10161 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:51.851868  6477 rpcz_store.cc:276] 0812 19:22:50.659834 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:50.660012 (+   178us) service_pool.cc:227] Handling call
0812 19:22:50.689082 (+ 29070us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:51.002856 (+313774us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:51.002887 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:51.003405 (+   518us) log.cc:842] Serialized 26 byte log entry
0812 19:22:51.059444 (+ 56039us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:51.059477 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:51.059539 (+    62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:51.834355 (+774816us) raft_consensus.cc:1671] finished
0812 19:22:51.834377 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:51.834547 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26404,"raft.queue_time_us":14414,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5273,"thread_start_us":155891,"threads_started":2,"wal-append.queue_time_us":142506}
I20260812 19:22:51.853008  9967 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:51.885762  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:51.891727  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 106240us
I20260812 19:22:51.824309 10179 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:51.779008 10176 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.081s
I20260812 19:22:51.834573 10217 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:51.823052  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:51.898612  6054 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 190) took 10613 ms. Trace:
I20260812 19:22:51.782563 10184 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:51.929184  6178 leader_election.cc:334] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.519s (SENT)
I20260812 19:22:51.827598 10169 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260812 19:22:51.834625  9990 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:52.002425  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:51.907124 10166 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:22:52.009483  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 181308us
W20260812 19:22:52.004842  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 119202us
I20260812 19:22:51.931764  6054 rpcz_store.cc:276] 0812 19:22:41.270429 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:41.277747 (+  7318us) service_pool.cc:227] Handling call
0812 19:22:51.875569 (+10597822us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:22:49.236958 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:22:49.261163 (+ 24205us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:22:49.261220 (+    57us) write_op.cc:435] Acquired schema lock
0812 19:22:49.261246 (+    26us) tablet.cc:660] Decoding operations
0812 19:22:49.262572 (+  1326us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:22:49.275078 (+ 12506us) write_op.cc:641] Partition lock acquired for write op
0812 19:22:49.275130 (+    52us) tablet.cc:683] Acquiring locks for 9 operations
0812 19:22:49.276551 (+  1421us) tablet.cc:699] Row locks acquired
0812 19:22:49.276580 (+    29us) write_op.cc:260] PREPARE: finished
0812 19:22:49.276953 (+   373us) write_op.cc:270] Start()
0812 19:22:49.277128 (+   175us) write_op.cc:276] Timestamp: P: 1786562569276792 usec, L: 0
0812 19:22:49.277186 (+    58us) op_driver.cc:331] REPLICATION: starting
0812 19:22:49.469238 (+192052us) log.cc:842] Serialized 3578 byte log entry
0812 19:22:50.393755 (+924517us) op_driver.cc:444] REPLICATION: finished
0812 19:22:50.508531 (+114776us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f483e5fe 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98fb188410
0812 19:22:51.002776 (+494245us) write_op.cc:301] APPLY: starting
0812 19:22:51.002869 (+    93us) tablet.cc:1365] starting BulkCheckPresence
0812 19:22:51.003085 (+   216us) tablet.cc:1368] finished BulkCheckPresence
0812 19:22:51.003104 (+    19us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:22:51.114903 (+111799us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:22:51.115234 (+   331us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0812 19:22:51.115298 (+    64us) write_op.cc:312] APPLY: finished
0812 19:22:51.130074 (+ 14776us) log.cc:842] Serialized 71 byte log entry
0812 19:22:51.140219 (+ 10145us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:51.147004 (+  6785us) write_op.cc:454] Released schema lock
0812 19:22:51.152125 (+  5121us) write_op.cc:341] FINISH: Updating metrics
0812 19:22:51.202217 (+ 50092us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:51.204390 (+  2173us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":608710,"apply.run_cpu_time_us":8779,"apply.run_wall_time_us":230098,"num_ops":9,"prepare.queue_time_us":528070,"prepare.run_cpu_time_us":76557,"prepare.run_wall_time_us":653971,"raft.queue_time_us":441975,"raft.run_cpu_time_us":14933,"raft.run_wall_time_us":275162,"replication_time_us":1116420,"spinlock_wait_cycles":5264768,"thread_start_us":1030662,"threads_started":4,"wal-append.queue_time_us":470889}]]}
I20260812 19:22:52.015275  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:51.931988 10046 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:51.998814 10179 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:22:52.008181 10221 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260812 19:22:52.019886  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 90794.6us
I20260812 19:22:52.020018  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:52.020951  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:52.053980  6349 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 4
W20260812 19:22:52.014151  9969 consensus_meta.cc:287] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.739s	user 0.030s	sys 0.035s
W20260812 19:22:52.013705 10038 consensus_meta.cc:287] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.751s	user 0.012s	sys 0.000s
I20260812 19:22:52.009646 10074 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:51.898540 10227 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.135s
W20260812 19:22:52.105785 10234 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260812 19:22:52.106482 10074 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:52.107270 10074 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:52.107668 10074 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:52.108114 10074 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:52.109998  6349 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
W20260812 19:22:52.105213  6178 leader_election.cc:334] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.647s (SENT)
I20260812 19:22:52.014197 10184 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:52.057077  9473 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:52.007192 10114 consensus_queue.cc:237] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:52.129701  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:22:52.125648  6178 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.659s (SENT)
I20260812 19:22:52.098276 10232 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260812 19:22:52.128388 10224 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260812 19:22:52.130384  6473 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:52.137497 10131 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:52.251526  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1526) took 1222 ms. Trace:
I20260812 19:22:52.118825  9898 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:52.144199 10104 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:52.098706  9969 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:52.151160 10226 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
W20260812 19:22:52.129082 10222 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260812 19:22:52.251993  9632 consensus_meta.cc:287] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 1.039s	user 0.010s	sys 0.005s
I20260812 19:22:52.123580 10252 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:22:52.103221 10038 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:52.196053 10220 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260812 19:22:52.197099 10101 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:52.144781 10046 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:52.200845  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:22:52.128425 10179 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:52.234357 10209 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.758s	user 0.004s	sys 0.008s
I20260812 19:22:52.237497 10256 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:52.239140  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1545) took 1584 ms. Trace:
I20260812 19:22:52.308286  6475 rpcz_store.cc:276] 0812 19:22:50.655031 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:50.656670 (+  1639us) service_pool.cc:227] Handling call
0812 19:22:50.657279 (+   609us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:51.883390 (+1226111us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:52.238803 (+355413us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400213754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:52.239069 (+   266us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2718552448}
W20260812 19:22:52.239624 10219 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260812 19:22:52.246078 10239 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.136s	user 0.000s	sys 0.003s
I20260812 19:22:52.273501  9700 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:52.247642 10082 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:22:52.246405 10211 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.734s	user 0.005s	sys 0.008s
I20260812 19:22:52.252020  6242 rpcz_store.cc:276] 0812 19:22:51.029495 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:51.218627 (+189132us) service_pool.cc:227] Handling call
0812 19:22:51.218999 (+   372us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:51.219347 (+   348us) raft_consensus.cc:1520] Early marking committed up to index 1
0812 19:22:51.219377 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:51.219877 (+   500us) log.cc:842] Serialized 26 byte log entry
0812 19:22:51.371000 (+151123us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:51.371058 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:51.371163 (+   105us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:52.251323 (+880160us) raft_consensus.cc:1671] finished
0812 19:22:52.251346 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:52.251467 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1409,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":121,"thread_start_us":112042,"threads_started":1,"wal-append.queue_time_us":466489}
W20260812 19:22:52.253585  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 43747.7us
I20260812 19:22:52.253047  6473 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:22:52.123452 10184 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
W20260812 19:22:52.315663  6178 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.842s (SENT)
I20260812 19:22:52.261086  7598 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:52.262236  9969 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:52.263916  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1521) took 1543 ms. Trace:
I20260812 19:22:52.263747  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:52.319972  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:52.263715  9967 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:52.274609  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 254647us
W20260812 19:22:52.292232  6342 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.012s	sys 0.010s
I20260812 19:22:52.303218  6465 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
W20260812 19:22:52.323750  6342 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.013s	sys 0.010s
W20260812 19:22:52.295699 10157 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.009s	sys 0.026s
W20260812 19:22:52.304481 10230 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.137s	user 0.000s	sys 0.002s
I20260812 19:22:52.316098  6178 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:52.321288  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.014s	sys 0.019s
I20260812 19:22:52.319546  6241 rpcz_store.cc:276] 0812 19:22:50.720640 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:51.203328 (+482688us) service_pool.cc:227] Handling call
0812 19:22:51.232032 (+ 28704us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:51.241176 (+  9144us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:51.241220 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:51.246698 (+  5478us) log.cc:842] Serialized 26 byte log entry
0812 19:22:51.313712 (+ 67014us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:51.313751 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:51.313814 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:52.263693 (+949879us) raft_consensus.cc:1671] finished
0812 19:22:52.263713 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:52.263853 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8626,"raft.queue_time_us":19327,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3887,"thread_start_us":47450,"threads_started":1,"wal-append.queue_time_us":630255}
I20260812 19:22:52.328424  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:52.329229  6353 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:22:52.329252  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.015s	sys 0.019s
I20260812 19:22:52.324512  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:52.326308  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:22:52.330678  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 315543us
I20260812 19:22:52.331050  6349 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:52.332881  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 146) took 1835 ms. Trace:
I20260812 19:22:52.333236  6474 rpcz_store.cc:276] 0812 19:22:50.497367 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:50.497486 (+   119us) service_pool.cc:227] Handling call
0812 19:22:50.507622 (+ 10136us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:50.522677 (+ 15055us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:50.522735 (+    58us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:50.524612 (+  1877us) log.cc:842] Serialized 26 byte log entry
0812 19:22:51.039820 (+515208us) spinlock_profiling.cc:243] Waited 939 us on lock 0x7b1800306400. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:22:51.301338 (+261518us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:51.301395 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:51.301464 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:52.326802 (+1025338us) raft_consensus.cc:1671] finished
0812 19:22:52.326825 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:52.332788 (+  5963us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14608,"raft.queue_time_us":14723,"raft.run_cpu_time_us":5765,"raft.run_wall_time_us":51576,"spinlock_wait_cycles":2160000,"thread_start_us":261164,"threads_started":1,"wal-append.queue_time_us":1258558}
W20260812 19:22:52.334726  6178 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.896s (SENT)
I20260812 19:22:52.273761  9632 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:52.335162  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:52.336788  6297 leader_election.cc:398] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4.
I20260812 19:22:52.329704  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:52.339303  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 175) took 1627 ms. Trace:
W20260812 19:22:52.325495 10157 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.009s	sys 0.027s
I20260812 19:22:52.324445 10120 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 19:22:52.329704  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 690629us
I20260812 19:22:52.346640  6349 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:22:52.328655  9974 raft_consensus.cc:3032] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:52.328821 10169 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:52.347604  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:22:52.347846  6178 leader_election.cc:334] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.912s (SENT)
I20260812 19:22:52.339704  6347 rpcz_store.cc:276] 0812 19:22:50.711725 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:50.711842 (+   117us) service_pool.cc:227] Handling call
0812 19:22:50.712165 (+   323us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:51.132948 (+420783us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:51.132983 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:51.138534 (+  5551us) log.cc:842] Serialized 26 byte log entry
0812 19:22:51.257389 (+118855us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:22:51.257442 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:51.512565 (+255123us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54001b9754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:51.512629 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:52.233555 (+720926us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:22:52.339077 (+105522us) raft_consensus.cc:1671] finished
0812 19:22:52.339100 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:52.339240 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1626,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3102,"spinlock_wait_cycles":991117312,"thread_start_us":105178,"threads_started":1,"wal-append.queue_time_us":174283}
I20260812 19:22:52.352113  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:52.330304  9700 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:52.356063  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:52.363996  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1336) took 1078 ms. Trace:
I20260812 19:22:52.364463  6345 rpcz_store.cc:276] 0812 19:22:51.285882 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:51.286015 (+   133us) service_pool.cc:227] Handling call
0812 19:22:51.290154 (+  4139us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:51.619836 (+329682us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:51.619872 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:51.621460 (+  1588us) log.cc:842] Serialized 26 byte log entry
0812 19:22:51.748770 (+127310us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:51.748819 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:51.748906 (+    87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:52.245298 (+496392us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:22:52.360357 (+115059us) raft_consensus.cc:1671] finished
0812 19:22:52.360378 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:52.363924 (+  3546us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":329297,"raft.queue_time_us":344439,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":66354,"spinlock_wait_cycles":4692992,"thread_start_us":112026,"threads_started":1,"wal-append.queue_time_us":373669}
I20260812 19:22:52.367103  6242 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 19:22:52.367141 10265 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:52.369446  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1334) took 1088 ms. Trace:
I20260812 19:22:52.369863  6342 rpcz_store.cc:276] 0812 19:22:51.281428 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:51.281612 (+   184us) service_pool.cc:227] Handling call
0812 19:22:51.303605 (+ 21993us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:51.758349 (+454744us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:51.758387 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:51.759581 (+  1194us) log.cc:842] Serialized 26 byte log entry
0812 19:22:52.324190 (+564609us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:52.324230 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:52.324315 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:52.369229 (+ 44914us) raft_consensus.cc:1671] finished
0812 19:22:52.369248 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:52.369382 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":316114,"raft.queue_time_us":333495,"spinlock_wait_cycles":128528256,"thread_start_us":674295,"threads_started":2,"wal-append.queue_time_us":579718}
I20260812 19:22:52.371464  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1520) took 1659 ms. Trace:
I20260812 19:22:52.371557  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:52.371852  6236 rpcz_store.cc:276] 0812 19:22:50.711615 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:51.201652 (+490037us) service_pool.cc:227] Handling call
0812 19:22:51.224871 (+ 23219us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:51.225208 (+   337us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:51.225238 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:51.225738 (+   500us) log.cc:842] Serialized 26 byte log entry
0812 19:22:51.634193 (+408455us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:51.634256 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:51.634329 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:52.371230 (+736901us) raft_consensus.cc:1671] finished
0812 19:22:52.371253 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:52.371390 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":409,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":90224,"threads_started":1,"wal-append.queue_time_us":705904}
I20260812 19:22:52.316872 10217 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:52.340950  9960 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:22:52.388283 10038 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:52.391244  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:52.391501  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:52.392177  6345 raft_consensus.cc:2354] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6.
I20260812 19:22:52.394940 10038 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:22:52.395565 10038 raft_consensus.cc:686] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:52.395972  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:52.396445 10038 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:52.399096  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:52.398380  6345 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:52.400266 10262 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:22:52.401242 10262 consensus_queue.cc:1046] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:22:52.402107 10262 raft_consensus.cc:3032] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:52.402436 10262 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:52.403718  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:52.405264  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:52.321641 10082 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:52.407307  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:52.409808  6235 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:52.350765  9974 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:52.411707  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:52.411857 10259 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260812 19:22:52.412191  9974 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:52.413376 10109 consensus_meta.cc:287] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.735s	user 0.012s	sys 0.003s
I20260812 19:22:52.411207 10101 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:52.413893 10109 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:52.403592 10157 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:52.413323  9974 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:52.408309  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:52.355410 10266 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:52.315024 10256 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:52.417058  7607 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:52.422793  6236 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:52.418928  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:22:52.500250  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 80146.2us
I20260812 19:22:52.343269 10104 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260812 19:22:52.414966  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:52.430913  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:52.526809  6230 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:52.434149  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:52.528066  6232 raft_consensus.cc:2396] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:52.437240  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:52.437398  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:52.438160  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:52.440742  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:52.531625  6353 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:52.441134  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:52.532768  6228 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:52.442181  6354 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260812 19:22:52.443639  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:52.447114  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:52.449462  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:52.451989  9990 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:52.457160  6416 connection.cc:232] RPC call timeout handler was delayed by -1.4614262960385531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260812 19:22:52.457258 10161 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:52.457551 10131 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:52.552762  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:52.460486  9983 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:22:52.463083  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:52.553797  6242 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:52.468248 10202 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.133s	user 0.000s	sys 0.013s
W20260812 19:22:52.470466 10185 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.028s	user 0.004s	sys 0.006s
W20260812 19:22:52.484349 10251 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.247s	user 0.002s	sys 0.000s
I20260812 19:22:52.490702  6058 catalog_manager.cc:5495] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 3 to 4, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 4 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:22:52.500821  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:52.501209  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:22:52.513444  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 114558us
I20260812 19:22:52.406538  9700 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:52.525326  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:52.535009  6344 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:52.540282  6359 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 4: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:22:52.541373  6416 connection.cc:232] RPC call timeout handler was delayed by -1.4236262959893793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260812 19:22:52.603545  6416 connection.cc:232] RPC call timeout handler was delayed by -1.4092262960039079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260812 19:22:52.603943  6416 connection.cc:232] RPC call timeout handler was delayed by -1.3471262960229069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260812 19:22:52.604414  6416 connection.cc:232] RPC call timeout handler was delayed by -1.3309262960683554s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260812 19:22:52.604894  6416 connection.cc:232] RPC call timeout handler was delayed by -1.2652262961491942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260812 19:22:52.605322  6416 connection.cc:232] RPC call timeout handler was delayed by -1.2049262961372733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
W20260812 19:22:52.605693  6416 connection.cc:232] RPC call timeout handler was delayed by -1.1896262960508466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
W20260812 19:22:52.606084  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0780262961052358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
I20260812 19:22:52.528699  6235 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:52.545233  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:52.546377  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:52.409888  9960 raft_consensus.cc:686] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:52.547578  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:52.551673  6354 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:52.422201 10157 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:52.606547  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0159262961242348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260812 19:22:52.627157  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 275113us
I20260812 19:22:52.622309  6235 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 3. Current term is 4. Ops: []
W20260812 19:22:52.630295  6178 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.780s (SENT)
I20260812 19:22:52.630818  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:52.631044  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:52.631366  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:52.632107  6470 raft_consensus.cc:2396] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260812 19:22:52.632450  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.634061  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.631074  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:52.622742  6236 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:52.641633  6236 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260812 19:22:52.644366  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.645525  6475 raft_consensus.cc:2396] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:52.660920  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.595202 10169 raft_consensus.cc:686] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:52.539377 10266 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:22:52.671821  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 170715us
I20260812 19:22:52.551700  7598 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: []
I20260812 19:22:52.673130  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.671722  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:52.686342  6470 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:52.686668  6232 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:52.674502  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.687717  6470 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260812 19:22:52.688068  6470 pending_rounds.cc:76] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 2
I20260812 19:22:52.688589  6470 pending_rounds.cc:97] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260812 19:22:52.688838  6470 raft_consensus.cc:2866] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:22:52.607852 10004 consensus_meta.cc:287] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.925s	user 0.012s	sys 0.007s
I20260812 19:22:52.624634  6058 catalog_manager.cc:5495] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 1 to 3, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 3 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:22:52.689507  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:52.697093  6465 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:52.688074  6475 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:52.719415  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.720340  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:52.721289  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.705770  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.722070  6470 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:52.723533  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:52.671115 10157 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:52.724375  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:52.724463  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.733059  6483 raft_consensus.cc:2396] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260812 19:22:52.724404  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.728018  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:52.719712  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:52.727206  6477 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:52.734891  6345 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:52.722719  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.743371  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:52.745074  6470 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:52.717829  6058 catalog_manager.cc:5495] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 1 to 2, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:22:52.741747  6465 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:52.734505  6482 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:52.779933  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.701714  9739 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:52.595818 10161 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:52.835676  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 147141us
I20260812 19:22:52.790758  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:52.599351 10131 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:52.831499  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.719072 10169 consensus_queue.cc:237] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:52.724045 10246 consensus_queue.cc:1046] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260812 19:22:52.833897  6232 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:22:52.920215  6235 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:52.920456  6482 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:52.921263  6465 raft_consensus.cc:2362] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5. Re-sending same reply.
I20260812 19:22:52.922219  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "04c512eaceae43d2a378065361eb4854"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:52.943378  6347 raft_consensus.cc:595] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:52.762635  9967 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:52.851960 10297 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:52.744046  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:52.791541  6470 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:52.750766  6230 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:22:52.966042  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.967438  6470 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:52.968516  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:52.722059 10004 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:52.939556  6242 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:52.755594  6058 catalog_manager.cc:5495] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 1 to 2, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:22:52.536599 10262 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:52.783128  9956 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:52.948951  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:52.833375 10074 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.003s
I20260812 19:22:52.938092  6474 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:52.759074 10069 consensus_queue.cc:1046] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.189s
I20260812 19:22:52.793588  9990 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.193s
I20260812 19:22:52.785358 10259 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.217s
I20260812 19:22:52.832350 10126 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.204s
I20260812 19:22:52.969149  6470 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:53.256161 10168 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.308s
W20260812 19:22:53.126767  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 496449us
W20260812 19:22:53.258737  6178 leader_election.cc:334] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.798s (SENT)
I20260812 19:22:53.259567  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:52.976325  6473 raft_consensus.cc:2396] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260812 19:22:53.261684  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:53.260546  6474 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:53.260790  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:53.034673  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:53.261520  6229 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:53.258590  6465 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:53.262060  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:52.835623  9632 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:53.201915  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:53.790378  6347 raft_consensus.cc:595] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:53.791487  6482 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:53.458792  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:53.792423  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1291) took 1018 ms. Trace:
I20260812 19:22:53.792896  6482 rpcz_store.cc:276] 0812 19:22:52.773852 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:52.947625 (+173773us) service_pool.cc:227] Handling call
0812 19:22:53.792350 (+844725us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:22:53.283864  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 470866us
W20260812 19:22:53.796975  6242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1578) took 1343 ms (client timeout 1649 ms). Trace:
W20260812 19:22:53.797783  6178 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.005s	sys 0.009s
W20260812 19:22:53.798345  6178 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.005s	sys 0.009s
I20260812 19:22:53.323041  6228 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
W20260812 19:22:53.788616  6345 consensus_meta.cc:287] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.053s	user 0.012s	sys 0.024s
I20260812 19:22:53.801595  6345 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:22:53.321960  6058 catalog_manager.cc:5495] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 1 to 2, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:22:53.795367  6236 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:53.799034  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1553) took 1015 ms. Trace:
I20260812 19:22:53.803692  6058 catalog_manager.cc:5495] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:22:53.804183  6465 rpcz_store.cc:276] 0812 19:22:52.783643 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:52.943388 (+159745us) service_pool.cc:227] Handling call
0812 19:22:53.798972 (+855584us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:53.794813  6232 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
W20260812 19:22:53.797480  6242 rpcz_store.cc:269] 0812 19:22:52.453299 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:52.462685 (+  9386us) service_pool.cc:227] Handling call
0812 19:22:53.796913 (+1334228us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:22:53.805958  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 546057us
W20260812 19:22:53.807126  6178 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.119s (SENT)
I20260812 19:22:53.807580  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:53.536048  6296 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.016s	sys 0.022s
W20260812 19:22:53.813508  6296 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.024s	sys 0.024s
I20260812 19:22:53.815330  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:53.816955  6242 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:22:53.818324  6058 catalog_manager.cc:5495] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:22:53.823969  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:53.828246  6235 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:53.829082  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1294) took 1054 ms. Trace:
I20260812 19:22:53.829509  6465 rpcz_store.cc:276] 0812 19:22:52.774780 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:53.804865 (+1030085us) service_pool.cc:227] Handling call
0812 19:22:53.829017 (+ 24152us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:53.826395  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 190) took 1112 ms. Trace:
I20260812 19:22:53.832145  6058 catalog_manager.cc:5495] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:22:53.833223  6345 rpcz_store.cc:276] 0812 19:22:52.689757 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:52.689925 (+   168us) service_pool.cc:227] Handling call
0812 19:22:53.802096 (+1112171us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:22:53.255010 10242 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
W20260812 19:22:53.822976  6470 consensus_meta.cc:287] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.000s
W20260812 19:22:53.726989 10166 consensus_meta.cc:287] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 1.709s	user 0.010s	sys 0.003s
I20260812 19:22:53.172331 10109 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:53.835727  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:53.836690  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:53.838939  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:53.840516  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:53.848511  7551 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.000s	sys 0.015s
W20260812 19:22:53.857669  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 50568us
I20260812 19:22:53.237596  9739 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:53.171885  9930 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.692s
I20260812 19:22:53.895675  6474 raft_consensus.cc:2396] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260812 19:22:53.627521 10316 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:53.902367  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:53.344856 10074 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:53.838385  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:53.245515 10256 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:53.909734  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 71409.5us
I20260812 19:22:53.052255 10246 raft_consensus.cc:3032] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:22:53.787146 10177 raft_consensus.cc:3032] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
W20260812 19:22:53.902415 10206 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 2.397s	user 0.009s	sys 0.071s
I20260812 19:22:53.172544 10082 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:53.869544  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:53.815603 10131 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:53.815559 10297 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:53.071079 10217 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:53.877007  6229 raft_consensus.cc:1261] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260812 19:22:53.815466 10046 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:53.875530  6470 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
W20260812 19:22:53.860873 10179 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.234s	user 0.005s	sys 0.011s
I20260812 19:22:53.893790  6241 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:53.894410  6482 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
W20260812 19:22:53.894891  7551 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.000s	sys 0.015s
I20260812 19:22:53.932607  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1292) took 1158 ms. Trace:
I20260812 19:22:53.892730  6465 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
W20260812 19:22:53.896811  6178 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.477s (SENT)
I20260812 19:22:53.934144  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:53.835397 10281 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.005s	sys 0.009s
W20260812 19:22:53.865110 10008 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.005s	sys 0.011s
I20260812 19:22:53.903258  6474 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:53.907884  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:53.865016 10259 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:53.910787  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:53.934518 10179 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.313s	user 0.005s	sys 0.011s
I20260812 19:22:53.255239 10233 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 1.131s
I20260812 19:22:53.876227  9700 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:53.974599  9700 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:53.977490  9700 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:53.939714 10281 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.006s	sys 0.010s
I20260812 19:22:53.906857 10316 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:53.981760 10316 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:53.982775  9930 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:22:53.983006 10179 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:52.951112  9960 consensus_queue.cc:237] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:53.907179 10279 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260812 19:22:53.983614 10179 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:53.708384  9967 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:53.984127 10179 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:53.984236  9967 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:53.913127  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.018s	sys 0.015s
I20260812 19:22:53.937144  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:53.986326 10179 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:53.912112 10322 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:53.994629 10322 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:53.971911  9983 consensus_meta.cc:287] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 1.373s	user 0.012s	sys 0.001s
I20260812 19:22:53.940698  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:53.996863  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1282) took 1267 ms. Trace:
I20260812 19:22:53.938671  9739 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:53.997207  6482 rpcz_store.cc:276] 0812 19:22:52.729226 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:53.932409 (+1203183us) service_pool.cc:227] Handling call
0812 19:22:53.996802 (+ 64393us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:53.997632  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 134) took 3340 ms. Trace:
I20260812 19:22:53.998185  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:54.000156  6482 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:53.997213 10322 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:53.945791 10307 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
W20260812 19:22:53.966552  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55899.1us
I20260812 19:22:54.002260  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:54.003654  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:54.004714  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:54.005299  6464 consensus_meta.cc:287] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.969s	user 0.008s	sys 0.002s
W20260812 19:22:53.967089  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 70339.1us
I20260812 19:22:53.967291  6345 raft_consensus.cc:595] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:53.917884 10177 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:22:53.944000  9974 consensus_meta.cc:287] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.416s	user 0.008s	sys 0.003s
I20260812 19:22:53.969833  6474 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
W20260812 19:22:53.946586 10008 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.005s	sys 0.013s
W20260812 19:22:53.972860  7552 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.009s	sys 0.013s
I20260812 19:22:53.934303 10046 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:53.917271  6236 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:53.984416  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:54.027318 10004 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:53.933100  6470 rpcz_store.cc:276] 0812 19:22:52.774179 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:52.968249 (+194070us) service_pool.cc:227] Handling call
0812 19:22:53.922480 (+954231us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:53.918968  6475 raft_consensus.cc:2396] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:54.028543  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1287) took 1297 ms. Trace:
I20260812 19:22:54.028642  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:54.028903  6475 rpcz_store.cc:276] 0812 19:22:52.730965 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:52.737058 (+  6093us) service_pool.cc:227] Handling call
0812 19:22:53.869366 (+1132308us) spinlock_profiling.cc:243] Waited 8.7 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:54.028479 (+159113us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":19998592}
I20260812 19:22:54.029479  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1279) took 1324 ms. Trace:
I20260812 19:22:54.030023  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:54.030700  6475 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:54.031543 10046 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:54.032086 10046 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 19:22:54.033113 10157 consensus_meta.cc:287] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.223s	user 0.006s	sys 0.003s
I20260812 19:22:54.033515 10157 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:53.910396 10109 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:54.034772  6481 raft_consensus.cc:2379] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:53.986490  9967 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:54.019043  6464 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:54.036422  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1257) took 1408 ms. Trace:
I20260812 19:22:53.930274 10297 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:54.036754  6464 rpcz_store.cc:276] 0812 19:22:52.627803 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:52.672991 (+ 45188us) service_pool.cc:227] Handling call
0812 19:22:54.036356 (+1363365us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:53.986668  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:53.934062 10131 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:54.043485  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:54.038786 10297 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:53.998731 10152 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:53.070838 10266 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:53.941636 10346 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:53.896698 10166 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:53.481129 10059 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:54.006623 10253 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:54.000952  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1278) took 1296 ms. Trace:
I20260812 19:22:53.997970  6238 rpcz_store.cc:276] 0812 19:22:50.657610 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:50.705581 (+ 47971us) service_pool.cc:227] Handling call
0812 19:22:50.713891 (+  8310us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:50.714228 (+   337us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:50.714255 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:50.724305 (+ 10050us) log.cc:842] Serialized 26 byte log entry
0812 19:22:51.239136 (+514831us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:22:51.239185 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:51.239271 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:53.399196 (+2159925us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:22:53.997319 (+598123us) raft_consensus.cc:1671] finished
0812 19:22:53.997340 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:53.997545 (+   205us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":7813,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":8868,"spinlock_wait_cycles":24139008,"thread_start_us":190877,"threads_started":1,"wal-append.queue_time_us":560600}
I20260812 19:22:54.010167  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:53.918344 10246 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:54.014919 10256 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:54.015478  9700 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:54.034934 10109 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:54.016970  9691 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:54.019119  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1296) took 1211 ms. Trace:
W20260812 19:22:54.021896  7552 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.009s	sys 0.014s
I20260812 19:22:54.025868 10177 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:53.986564 10259 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:54.029860  6470 rpcz_store.cc:276] 0812 19:22:52.704704 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.028381 (+1323677us) service_pool.cc:227] Handling call
0812 19:22:54.029424 (+  1043us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:54.121580  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:54.122215  6470 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:54.122687  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1285) took 1392 ms. Trace:
I20260812 19:22:54.122985  6470 rpcz_store.cc:276] 0812 19:22:52.730351 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.121290 (+1390939us) service_pool.cc:227] Handling call
0812 19:22:54.122612 (+  1322us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:54.123786  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:54.124208  6470 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:54.043663  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1274) took 1351 ms. Trace:
I20260812 19:22:54.044198  6345 raft_consensus.cc:595] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:53.995929 10074 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:53.988919  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.019s	sys 0.015s
W20260812 19:22:54.127535  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 1.11409e+06us
I20260812 19:22:54.045164  6475 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:54.019191 10179 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:54.083089 10253 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:54.016230  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:54.117653  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 107519us
I20260812 19:22:54.118813  6474 rpcz_store.cc:276] 0812 19:22:52.807941 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:53.899548 (+1091607us) service_pool.cc:227] Handling call
0812 19:22:54.019056 (+119508us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:54.125538  6465 rpcz_store.cc:276] 0812 19:22:52.692254 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:53.986354 (+1294100us) service_pool.cc:227] Handling call
0812 19:22:54.043601 (+ 57247us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:54.134305  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:54.134470  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:54.134814  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:54.135119  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:54.128650  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:54.116986 10232 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:54.082719  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:54.054672  6482 rpcz_store.cc:276] 0812 19:22:52.704445 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:53.997897 (+1293452us) service_pool.cc:227] Handling call
0812 19:22:54.000871 (+  2974us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:54.140542  6354 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 19:22:54.132380  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:54.136332  6465 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:54.141918  6470 raft_consensus.cc:2379] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:54.142158  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:54.142359  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1289) took 1369 ms. Trace:
W20260812 19:22:54.138142  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 122007us
I20260812 19:22:54.136104  6475 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:54.078266 10059 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:54.137943  6474 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:54.143913  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:54.142437  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:54.118826  9967 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:54.144444  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1271) took 1453 ms. Trace:
W20260812 19:22:54.136061 10114 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.890s	user 0.028s	sys 0.042s
I20260812 19:22:54.134552 10177 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:54.049492 10152 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:54.116305 10256 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:54.160097  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:54.162910  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:54.164614  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:54.160415  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:54.163858  6481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1264) took 1533 ms (client timeout 1912 ms). Trace:
I20260812 19:22:54.144853  6465 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:54.149257  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:22:54.152063  6178 connection.cc:232] RPC call timeout handler was delayed by -1.5041815568692982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30610000000000004s for a response
I20260812 19:22:54.148358  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:54.149817  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:54.150070  6416 leader_election.cc:398] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6.
I20260812 19:22:54.144490  6475 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 1.
W20260812 19:22:54.210801  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 60799.1us
I20260812 19:22:54.211057  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1300) took 1008 ms. Trace:
I20260812 19:22:54.211583  6475 rpcz_store.cc:276] 0812 19:22:53.202818 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.143677 (+940859us) service_pool.cc:227] Handling call
0812 19:22:54.210983 (+ 67306us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:54.212587  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:54.212744  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:54.213673  6475 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 6
I20260812 19:22:54.215204  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:54.206562  6477 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
W20260812 19:22:54.216756  6477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1280) took 1491 ms (client timeout 1627 ms). Trace:
W20260812 19:22:54.217191  6477 rpcz_store.cc:269] 0812 19:22:52.725771 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:52.735350 (+  9579us) service_pool.cc:227] Handling call
0812 19:22:54.164416 (+1429066us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:54.216682 (+ 52266us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":24107904}
I20260812 19:22:54.209285  6345 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:22:54.209439  6178 connection.cc:232] RPC call timeout handler was delayed by -1.4681815570220351s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31010000000000004s for a response
W20260812 19:22:54.164389 10343 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260812 19:22:54.224687  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
W20260812 19:22:54.220264  6178 connection.cc:232] RPC call timeout handler was delayed by -1.410581556847319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3165s for a response
W20260812 19:22:54.225261  6178 connection.cc:232] RPC call timeout handler was delayed by -1.4045525779947639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28530000000000005s for a response
W20260812 19:22:54.225713  6178 connection.cc:232] RPC call timeout handler was delayed by -1.3591948701068759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260812 19:22:54.226022  6178 connection.cc:232] RPC call timeout handler was delayed by -1.3442525779828429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.292s for a response
I20260812 19:22:54.144695 10344 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:22:54.125022  9700 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:54.223160  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:54.148972  6464 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:54.218510  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:54.225298  6342 raft_consensus.cc:595] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:54.239022  6342 raft_consensus.cc:603] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260812 19:22:54.207623  6481 rpcz_store.cc:269] 0812 19:22:52.629967 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:52.633771 (+  3804us) service_pool.cc:227] Handling call
0812 19:22:54.163605 (+1529834us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540003cfd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:54.163784 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3219344768}
I20260812 19:22:54.241761  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:54.245960  6481 raft_consensus.cc:2362] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5. Re-sending same reply.
I20260812 19:22:54.246711  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1281) took 1518 ms. Trace:
I20260812 19:22:54.228161  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:22:54.201392 10114 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.958s	user 0.031s	sys 0.042s
I20260812 19:22:54.143174  6470 rpcz_store.cc:276] 0812 19:22:52.773096 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.132129 (+1359033us) service_pool.cc:227] Handling call
0812 19:22:54.142304 (+ 10175us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:54.160863 10074 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260812 19:22:54.232679  6178 leader_election.cc:334] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.991s (SENT)
I20260812 19:22:54.252632  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:54.229533  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:54.143992 10314 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:54.146270 10179 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:22:54.238433  6352 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:54.247089  6481 rpcz_store.cc:276] 0812 19:22:52.728347 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.241435 (+1513088us) service_pool.cc:227] Handling call
0812 19:22:54.246595 (+  5160us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:54.248940  6477 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:54.269328  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1560) took 1176 ms. Trace:
I20260812 19:22:54.269745  6477 rpcz_store.cc:276] 0812 19:22:53.093120 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.218173 (+1125053us) service_pool.cc:227] Handling call
0812 19:22:54.269253 (+ 51080us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:54.147676  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:54.223640  9967 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:54.230757  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:54.271857  6482 raft_consensus.cc:2396] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:54.146483  6474 rpcz_store.cc:276] 0812 19:22:52.691321 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.134229 (+1442908us) service_pool.cc:227] Handling call
0812 19:22:54.144394 (+ 10165us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:54.256294  6345 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:22:54.256985  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:22:54.275204  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:22:54.276079  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:22:54.253809  6354 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
W20260812 19:22:54.258759  6178 leader_election.cc:334] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.085s (SENT)
I20260812 19:22:54.279896  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:54.144412 10232 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:54.287667  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1556) took 1327 ms. Trace:
W20260812 19:22:54.288405  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 140763us
I20260812 19:22:54.289088  6482 rpcz_store.cc:276] 0812 19:22:52.960491 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.206208 (+1245717us) service_pool.cc:227] Handling call
0812 19:22:54.287590 (+ 81382us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:54.161453 10253 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:54.232992 10157 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:54.205029 10323 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260812 19:22:54.251348  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1273) took 1559 ms. Trace:
W20260812 19:22:54.310521  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 44070.9us
I20260812 19:22:54.311491  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1554) took 1527 ms. Trace:
I20260812 19:22:54.310794  6464 rpcz_store.cc:276] 0812 19:22:52.691941 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.048417 (+1356476us) service_pool.cc:227] Handling call
0812 19:22:54.244950 (+196533us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:54.311861  6481 rpcz_store.cc:276] 0812 19:22:52.783941 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.268665 (+1484724us) service_pool.cc:227] Handling call
0812 19:22:54.299521 (+ 30856us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:54.311118 (+ 11597us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:54.311144 (+    26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:54.311195 (+    51us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:22:54.311234 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:54.311309 (+    75us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:54.311431 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:54.313171  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:54.313511  6481 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260812 19:22:54.313592  6464 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:22:54.313781  6236 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:54.314571  6178 leader_election.cc:334] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.121s (SENT)
I20260812 19:22:54.315268  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1559) took 1277 ms. Trace:
I20260812 19:22:54.316867  6464 rpcz_store.cc:276] 0812 19:22:53.038438 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.312801 (+1274363us) service_pool.cc:227] Handling call
0812 19:22:54.313131 (+   330us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:54.314208 (+  1077us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:54.315187 (+   979us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:54.319423  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:54.319635  6464 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:54.257543 10344 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:22:54.315382  6178 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.550s (SENT)
I20260812 19:22:54.301741  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1555) took 1509 ms. Trace:
I20260812 19:22:54.289624 10297 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:54.230917 10131 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260812 19:22:54.298177  9960 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260812 19:22:54.307145 10350 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260812 19:22:54.352283  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:54.403533  6347 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 7
I20260812 19:22:54.141079 10246 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:54.351755  6481 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:54.311365 10046 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:54.304641 10069 raft_consensus.cc:3032] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:54.299161 10004 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:54.451696  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:54.162591 10346 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260812 19:22:54.392104  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:54.457419  6229 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:22:54.367169  6475 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:22:54.393612  6354 raft_consensus.cc:3032] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:54.393010  6477 rpcz_store.cc:276] 0812 19:22:52.792673 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.270564 (+1477891us) service_pool.cc:227] Handling call
0812 19:22:54.299582 (+ 29018us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:54.299803 (+   221us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:54.301336 (+  1533us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:54.301401 (+    65us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:22:54.301453 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:54.301530 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:54.301667 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2304}
I20260812 19:22:54.458562  6354 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:54.467063  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:54.459372  6354 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:54.473469  6354 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:54.393913  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:54.322460 10166 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:54.392922  6236 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:54.399611  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:54.447643 10342 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260812 19:22:54.406692  6481 pending_rounds.cc:76] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 1
I20260812 19:22:54.358090 10109 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:54.453207  6232 raft_consensus.cc:2396] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260812 19:22:54.478155  6481 pending_rounds.cc:97] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260812 19:22:54.453462  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:54.455487  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:54.478564  6481 raft_consensus.cc:2866] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:22:54.478407  6235 raft_consensus.cc:2396] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:54.479424 10256 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:54.471617 10179 consensus_queue.cc:1159] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "54f83319db6b49929cc8f18a66a66975" responder_term: 6 status { last_received { term: 3 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:22:54.481552  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:54.451356 10046 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:54.486775  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:54.510610  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:54.512270  6232 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:54.512485  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:22:54.488641  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 173266us
I20260812 19:22:54.492015  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:54.493018  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:54.467883 10246 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:54.452016 10069 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:54.481297 10334 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:54.516134  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:54.467073 10318 raft_consensus.cc:2741] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260812 19:22:54.481935  9967 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:54.514195  6483 raft_consensus.cc:2396] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260812 19:22:54.517966  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:54.529253  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:54.542398  6241 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:54.519136  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:54.543429  6242 raft_consensus.cc:2396] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:22:54.483906 10259 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:54.491096 10059 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:54.491865 10157 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:54.493849  9930 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:54.509917  7598 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: []
I20260812 19:22:54.511125 10320 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:54.521085 10046 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:54.546116  6352 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:54.547039  6229 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
W20260812 19:22:54.564060  6483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1284) took 1834 ms (client timeout 1606 ms). Trace:
W20260812 19:22:54.543813  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2380525779444724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3038s for a response
I20260812 19:22:54.590575  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:54.511319 10114 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:54.536607 10301 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:22:54.540583 10131 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:54.580261  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:22:54.627221  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2269815569743514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33690000000000003s for a response
I20260812 19:22:54.636659  6241 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
W20260812 19:22:54.655694  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2251815570052713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3371s for a response
W20260812 19:22:54.627156  6483 rpcz_store.cc:269] 0812 19:22:52.730052 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:52.733915 (+  3863us) service_pool.cc:227] Handling call
0812 19:22:54.491777 (+1757862us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:54.563947 (+ 72170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":27405056}
I20260812 19:22:54.544536 10314 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:54.628669  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:54.544566 10344 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:54.651803  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1286) took 1921 ms. Trace:
I20260812 19:22:54.626137 10232 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:54.656682  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1252815569750965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.34820000000000007s for a response
I20260812 19:22:54.533608  9960 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.108s
I20260812 19:22:54.633348 10059 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:54.662323  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:54.659938  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:54.661537  6465 rpcz_store.cc:276] 0812 19:22:52.730641 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.242966 (+1512325us) service_pool.cc:227] Handling call
0812 19:22:54.243385 (+   419us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:54.243893 (+   508us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:54.243929 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:54.244479 (+   550us) log.cc:842] Serialized 26 byte log entry
0812 19:22:54.467597 (+223118us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:22:54.639220 (+171623us) log.cc:842] Serialized 14 byte log entry
0812 19:22:54.639436 (+   216us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:54.639507 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:54.651570 (+ 12063us) raft_consensus.cc:1671] finished
0812 19:22:54.651588 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:54.651746 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1016,"prepare.queue_time_us":157199,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":207,"raft.run_cpu_time_us":478,"raft.run_wall_time_us":47801,"thread_start_us":280962,"threads_started":2,"wal-append.queue_time_us":255122}
I20260812 19:22:54.671633  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:54.565415  9967 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:54.638425  9700 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:54.675369  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 151246us
I20260812 19:22:54.619197 10157 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:54.540134 10334 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:54.655028 10301 raft_consensus.cc:686] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:54.677115  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:54.662276 10378 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:22:54.687409  6483 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:22:54.670925 10074 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:54.693033  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:54.671939 10232 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:22:54.620849 10069 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:54.697335 10074 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:54.703081  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:54.694785  9700 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:54.704777  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:54.655715 10131 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:54.709903  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:54.706694  6178 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.505s (SENT)
I20260812 19:22:54.710368  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:54.716157  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:54.642283 10114 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:54.681419 10059 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:54.715407  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1531) took 1795 ms. Trace:
I20260812 19:22:54.724025  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:54.707754 10069 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:54.709496  6350 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:22:54.744083  6354 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:22:54.624586 10320 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:54.734371  6241 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:54.739006  6228 rpcz_store.cc:276] 0812 19:22:52.920489 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:52.920614 (+   125us) service_pool.cc:227] Handling call
0812 19:22:53.260898 (+340284us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:53.819174 (+558276us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:54.715133 (+895959us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b54000f4bd0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:54.715334 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":111570176}
I20260812 19:22:54.736519  6347 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
W20260812 19:22:54.749154  6178 leader_election.cc:334] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.582s (SENT)
I20260812 19:22:54.749734  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:54.759239 10038 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:22:54.748098  9969 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:22:54.763646  9969 raft_consensus.cc:686] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:54.765033  9969 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:54.768675  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:54.769376  7607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 344) took 2514 ms. Trace:
I20260812 19:22:54.768510 10379 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:22:54.769896  7607 rpcz_store.cc:276] 0812 19:22:52.254922 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:52.255072 (+   150us) service_pool.cc:227] Handling call
0812 19:22:52.264886 (+  9814us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:52.500025 (+235139us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:54.769079 (+2269054us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540058e154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:54.769305 (+   226us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":349332736}
I20260812 19:22:54.773442 10232 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:54.708997 10074 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:54.786456  6228 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 19:22:54.673977 10008 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.051s
I20260812 19:22:54.665295 10314 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:54.718561 10297 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:54.710194  9700 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:54.797597 10334 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:54.807657  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 136129us
I20260812 19:22:54.820515  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:54.822480  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:54.815301  6483 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 19:22:54.824427  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:54.825584  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 76451.3us
W20260812 19:22:54.826501  6178 leader_election.cc:334] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.606s (SENT)
I20260812 19:22:54.827111  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:54.832371  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:22:54.833248  6178 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.627s (SENT)
I20260812 19:22:54.834924 10385 raft_consensus.cc:2741] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260812 19:22:54.836128 10385 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 19:22:54.837741  6178 leader_election.cc:334] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.853s (SENT)
I20260812 19:22:54.838304  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:54.839447 10346 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 19:22:54.841331  6178 leader_election.cc:334] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.920s (SENT)
I20260812 19:22:54.841818  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:54.824884 10378 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:54.846336 10378 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:54.851123 10378 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:54.851150 10367 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.256s	user 0.004s	sys 0.000s
I20260812 19:22:54.856814 10346 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:54.832258 10297 raft_consensus.cc:686] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:54.859186 10297 consensus_queue.cc:237] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:54.868052  7591 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260812 19:22:54.868940  6178 leader_election.cc:334] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 3.302s (SENT)
I20260812 19:22:54.871920  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:54.872146  9967 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:54.873952 10157 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:54.874087 10346 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 19:22:54.876046  6178 leader_election.cc:334] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 3.369s (SENT)
I20260812 19:22:54.818920  9700 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:54.832962 10008 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:54.898615  6477 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260812 19:22:54.899291  6477 pending_rounds.cc:76] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 6
I20260812 19:22:54.899595  6477 pending_rounds.cc:97] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260812 19:22:54.899935  6477 raft_consensus.cc:2866] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:22:54.924721  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 100386us
I20260812 19:22:54.844678 10232 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:22:54.929817  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:54.931708  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:54.803495 10266 consensus_queue.cc:1046] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260812 19:22:54.843391 10161 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:54.935439  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:54.888912 10377 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.132s	user 0.000s	sys 0.002s
I20260812 19:22:54.833153 10223 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.103s
W20260812 19:22:54.926223 10368 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.415s	user 0.006s	sys 0.000s
W20260812 19:22:54.959097 10177 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.750s	user 0.017s	sys 0.000s
I20260812 19:22:54.961081 10177 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:54.963442  9739 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:54.963832 10177 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:54.967579 10275 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.660s	user 0.007s	sys 0.000s
W20260812 19:22:54.969861  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 93852.1us
W20260812 19:22:54.970494  6178 leader_election.cc:334] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 3.371s (SENT)
I20260812 19:22:54.961912 10268 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:54.971835 10268 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:54.962580 10334 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:54.959395 10046 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:54.971592  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:54.968052 10361 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.518s	user 0.001s	sys 0.000s
I20260812 19:22:54.942693 10246 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:54.966246  9739 consensus_queue.cc:1046] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.013s
I20260812 19:22:54.984589  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:54.968070 10177 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:54.993182  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:54.954346 10298 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:22:54.945647 10394 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:55.010795  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:54.829797 10301 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:55.012854  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:55.009297  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:54.983502 10246 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:55.015064  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:55.017256  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:55.040452  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:55.003052  9967 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:22:54.997661 10266 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:55.043026  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:54.998028 10298 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:55.093223 10298 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:54.987875 10334 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:22:55.038008 10386 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260812 19:22:55.006814 10157 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:55.082185  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:55.123682  6465 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:22:55.123930  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:55.083693  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:55.125476  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:55.015966 10320 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:55.015775  9930 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:55.014643  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:55.085847  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1565) took 1175 ms. Trace:
I20260812 19:22:55.128957  6464 rpcz_store.cc:276] 0812 19:22:53.910338 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.350187 (+439849us) service_pool.cc:227] Handling call
0812 19:22:54.350549 (+   362us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:22:54.350969 (+   420us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:54.350996 (+    27us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:22:54.371364 (+ 20368us) log.cc:842] Serialized 52 byte log entry
0812 19:22:54.653997 (+282633us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:54.654035 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:54.654105 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:55.085520 (+431415us) raft_consensus.cc:1671] finished
0812 19:22:55.085550 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:55.085766 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1586,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3380,"thread_start_us":158654,"threads_started":1,"wal-append.queue_time_us":248107}
I20260812 19:22:55.131285  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:55.030167 10394 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:55.041864 10246 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:55.029366 10323 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260812 19:22:55.091122  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 131691us
I20260812 19:22:55.134004  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:55.042433 10268 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:55.096772 10395 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260812 19:22:55.097301  9700 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:55.099345 10046 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:55.102231  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:55.104321  6345 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 19:22:55.158849  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:55.159379  6465 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:22:55.088351 10059 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:55.105578  6232 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260812 19:22:55.105862  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:55.109094 10314 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:55.109798  6350 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260812 19:22:55.164139  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:55.111675  6235 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:22:55.112298  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:55.013598 10256 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260812 19:22:55.112910  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:55.115733  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:55.070848 10253 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:55.089504  9691 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:22:55.125759  6481 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:55.016626 10114 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:55.102077 10392 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260812 19:22:55.140435  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:55.084488  9967 raft_consensus.cc:686] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:55.145121  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:55.196067  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 51033us
I20260812 19:22:55.166800 10268 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:55.197275  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:55.161726  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:55.132571  9930 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:55.082690 10074 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:55.143052  9473 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:22:55.169298  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:55.200731  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:22:55.173170 10353 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.823s	user 0.000s	sys 0.003s
I20260812 19:22:55.141474 10323 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:55.172873  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:55.143611 10157 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:55.141655 10131 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:55.118597 10378 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:55.184125  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:55.156455 10394 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:55.146864  7598 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
W20260812 19:22:55.192955  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 52639.5us
I20260812 19:22:55.210527  6229 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260812 19:22:55.165972  6236 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:55.202494  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:55.202607  6232 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:55.204279  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:55.208529  6481 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:55.172358 10059 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:55.184967 10253 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:55.216686  6474 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:55.201061 10327 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:55.223122  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:55.183076  9691 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:55.193902  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 178896us
I20260812 19:22:55.219494  9967 consensus_queue.cc:237] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:55.200160  9930 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:55.205507 10385 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:55.204703 10114 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:55.204466 10323 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:55.205199 10266 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:55.213846  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:55.217561 10253 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:55.231007  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:55.255985 10157 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:55.232177  9700 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:55.233058  6298 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:55.234450  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 165) took 1087 ms. Trace:
I20260812 19:22:55.259485 10071 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:22:55.259297 10411 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:55.260213 10071 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:55.258955  6477 rpcz_store.cc:276] 0812 19:22:54.147023 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.461062 (+314039us) service_pool.cc:227] Handling call
0812 19:22:54.461465 (+   403us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:54.900477 (+439012us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:55.234186 (+333709us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54001045d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:55.234374 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":977258240}
I20260812 19:22:55.229163 10069 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:55.227451 10059 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:55.262151  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:55.262961  6477 raft_consensus.cc:2362] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5. Re-sending same reply.
I20260812 19:22:55.242230  6481 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:55.239964 10408 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:22:55.264148  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:55.247045 10394 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:55.265017  6477 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:55.239494  9691 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:55.250761 10334 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:55.278847 10344 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:22:55.253023 10378 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:55.264909  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:55.252939 10402 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.003s
I20260812 19:22:55.282730  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:22:55.269771  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46758.1us
I20260812 19:22:55.260979 10071 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:22:55.275610 10074 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:55.286172  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:55.287182  6481 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:55.286145  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:55.288161  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:55.289348  6481 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:55.290436  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:55.298278  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:55.298760  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:55.299163  6350 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:55.300607  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:55.301291  6236 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:55.313293  6236 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:55.316922  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:55.317870  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:55.320573  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:55.320883  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:55.318449  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:55.322240  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:55.323100  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:55.321902  6481 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:55.328099  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:55.328442  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:55.328927  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:55.329046  6481 raft_consensus.cc:2362] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6. Re-sending same reply.
I20260812 19:22:55.330088  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:55.333984  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:55.334671  6229 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:55.334874  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:55.334022  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:55.338178  6477 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:22:55.338728  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:55.339190  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:55.339983  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:55.340248  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:55.341001  6477 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:55.342079  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:55.344354  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:55.345297  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:55.348738  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:55.316461 10074 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:55.386804  6349 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:55.387449  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:55.352528 10046 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:22:55.327292 10320 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:55.291822 10131 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260812 19:22:55.346447 10327 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260812 19:22:55.333469 10411 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:22:55.336227 10385 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:55.346253  9700 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:22:55.320931 10259 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.074s
I20260812 19:22:55.383713 10179 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:55.383980 10266 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:55.414408  6229 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:55.326850 10114 consensus_queue.cc:1046] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260812 19:22:55.335937 10378 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
I20260812 19:22:55.420413 10314 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:22:55.414347 10409 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:55.417191  9700 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:55.422859 10179 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:55.336087 10408 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260812 19:22:55.422693 10266 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:55.416154  9967 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260812 19:22:55.473169  6345 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:22:55.447239  9700 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:22:55.478685  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:22:55.450701 10179 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:55.456849 10266 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:55.496680 10415 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260812 19:22:55.453976 10314 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:22:55.506276 10416 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260812 19:22:55.508690  6350 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
W20260812 19:22:55.542531  6238 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.011s	sys 0.001s
W20260812 19:22:55.543078  6238 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.011s	sys 0.002s
I20260812 19:22:55.498394 10114 raft_consensus.cc:3032] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Stepping down as leader of term 5
W20260812 19:22:55.602759 10403 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.307s	user 0.000s	sys 0.002s
I20260812 19:22:55.603819 10429 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:22:55.604238 10256 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:55.604782 10256 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:55.620559  6230 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260812 19:22:55.623370  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 281383us
I20260812 19:22:55.627038  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:55.621632  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1533) took 2695 ms. Trace:
I20260812 19:22:55.633476  6230 rpcz_store.cc:276] 0812 19:22:52.926482 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:52.996740 (+ 70258us) service_pool.cc:227] Handling call
0812 19:22:55.619962 (+2623222us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5800001898. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824b7c 00007f98f482473b 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:22:55.620215 (+   253us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:55.621296 (+  1081us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:55.621560 (+   264us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2633984}
W20260812 19:22:55.620625  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 271600us
I20260812 19:22:55.642769  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:22:55.607205 10424 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260812 19:22:55.683547  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:55.595724 10114 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:55.448895 10409 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:55.644196 10430 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.156s	user 0.002s	sys 0.000s
I20260812 19:22:55.690903  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:22:55.751513  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 60721.9us
W20260812 19:22:55.718153 10417 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
I20260812 19:22:55.759140 10385 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:55.759930 10385 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:55.718735  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 151) took 1028 ms. Trace:
I20260812 19:22:55.721005 10152 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:55.723110  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:55.726943  6482 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:55.760957 10385 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:55.604293 10429 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:22:55.761982  7606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 367) took 1616 ms (client timeout 1849 ms). Trace:
W20260812 19:22:55.762151 10253 consensus_meta.cc:287] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.002s
I20260812 19:22:55.685091 10413 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 19:22:55.732996 10419 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
W20260812 19:22:55.762559  7606 rpcz_store.cc:269] 0812 19:22:54.147430 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.152347 (+  4917us) service_pool.cc:227] Handling call
0812 19:22:55.722942 (+1570595us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b5800005498. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:22:55.761892 (+ 38950us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12797184}
W20260812 19:22:55.765465 10246 consensus_meta.cc:287] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.609s	user 0.014s	sys 0.000s
I20260812 19:22:55.767738 10318 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:55.767448 10429 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:55.760593  6241 rpcz_store.cc:276] 0812 19:22:54.690481 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.690854 (+   373us) service_pool.cc:227] Handling call
0812 19:22:54.691251 (+   397us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:54.748137 (+ 56886us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:55.718451 (+970314us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b540013ea54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:55.718643 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":95082752}
W20260812 19:22:55.769045  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 57690.5us
I20260812 19:22:55.731293 10131 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:55.700497 10256 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:55.768954  6235 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260812 19:22:55.785239  6347 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260812 19:22:55.791759  6350 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:55.691738 10378 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:55.796849  6349 raft_consensus.cc:3032] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:55.762022  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1558) took 2741 ms. Trace:
I20260812 19:22:55.818733  6349 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:55.783548 10327 raft_consensus.cc:2741] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260812 19:22:55.830981  6241 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:55.810146  6350 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:55.819125  6482 rpcz_store.cc:276] 0812 19:22:53.020475 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.289823 (+1269348us) service_pool.cc:227] Handling call
0812 19:22:55.726463 (+1436640us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:22:55.726738 (+   275us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:55.761765 (+ 35027us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:55.761971 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2746112}
I20260812 19:22:55.748044 10408 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:22:55.817765 10131 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:55.890947  6241 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260812 19:22:55.844003  6349 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:55.900393  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:55.901094  6482 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:22:55.838587  6350 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:55.901978  6350 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:55.903072  6481 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.017s	sys 0.030s
W20260812 19:22:55.903542  6481 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.017s	sys 0.030s
I20260812 19:22:55.905316  6349 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:55.832605 10059 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:55.791760 10253 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:55.803828 10246 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:55.938951  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.003s	sys 0.006s
I20260812 19:22:55.945684  6349 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:55.950397  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:55.952839  6347 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 19:22:55.957904  6349 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 19:22:55.699128 10314 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:55.891840 10378 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:22:55.967216  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 132523us
W20260812 19:22:55.956166  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.003s	sys 0.008s
W20260812 19:22:55.950407  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 323454us
W20260812 19:22:55.968780  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 620261us
I20260812 19:22:55.969612  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:55.908057 10429 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:22:55.938755 10394 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.003s	sys 0.006s
I20260812 19:22:55.992206  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:55.899736 10183 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.083s
I20260812 19:22:55.958523 10334 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:55.973868  9930 consensus_meta.cc:287] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.705s	user 0.013s	sys 0.001s
I20260812 19:22:55.918030 10408 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
W20260812 19:22:55.991773 10394 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.003s	sys 0.007s
W20260812 19:22:55.993616 10280 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 2.108s	user 0.004s	sys 0.002s
I20260812 19:22:55.873539 10114 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:55.925186 10431 consensus_queue.cc:1046] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260812 19:22:55.955348 10059 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.003129 10327 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260812 19:22:56.043376 10409 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:56.013723 10334 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.020100  9930 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.045841 10183 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260812 19:22:55.810525 10318 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:56.047293 10157 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260812 19:22:56.095996  9930 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:56.089663 10438 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:56.104903 10131 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:56.115965 10439 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.297s	user 0.000s	sys 0.002s
W20260812 19:22:56.117305 10323 consensus_meta.cc:287] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.872s	user 0.011s	sys 0.006s
I20260812 19:22:56.051774 10187 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260812 19:22:56.054885 10378 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.137394 10433 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260812 19:22:56.139123 10179 consensus_meta.cc:287] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.628s	user 0.000s	sys 0.015s
I20260812 19:22:56.080766 10394 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260812 19:22:56.124871 10438 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:56.147162 10435 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:56.128686 10059 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:56.135869 10246 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:56.156040 10441 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
I20260812 19:22:56.151990 10433 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:22:56.257671 10459 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260812 19:22:56.260645 10071 consensus_meta.cc:287] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.970s	user 0.010s	sys 0.005s
W20260812 19:22:56.228056 10069 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.000s	sys 0.018s
I20260812 19:22:56.155994 10253 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:56.199259 10438 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:56.144862 10323 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.158981 10179 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.262908 10433 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:56.272042 10318 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:56.217298 10435 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:56.296247 10455 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.194s	user 0.000s	sys 0.002s
I20260812 19:22:56.315671 10435 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:56.310087 10334 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:56.364666  6236 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:56.367803  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1566) took 1067 ms. Trace:
I20260812 19:22:56.368621  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 157) took 1330 ms. Trace:
I20260812 19:22:56.368706  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 170) took 1602 ms. Trace:
I20260812 19:22:56.261411 10071 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:56.365940  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 347107us
I20260812 19:22:56.559767 10409 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:56.369213  6238 rpcz_store.cc:276] 0812 19:22:55.038010 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:55.038526 (+   516us) service_pool.cc:227] Handling call
0812 19:22:55.038949 (+   423us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:55.039365 (+   416us) raft_consensus.cc:1520] Early marking committed up to index 6
0812 19:22:55.581226 (+541861us) log.cc:842] Serialized 14 byte log entry
0812 19:22:55.928066 (+346840us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:55.950008 (+ 21942us) log.cc:842] Serialized 26 byte log entry
0812 19:22:55.950132 (+   124us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:22:55.950160 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:55.950230 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:56.368041 (+417811us) raft_consensus.cc:1671] finished
0812 19:22:56.368088 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:56.368366 (+   278us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7268,"prepare.queue_time_us":190467,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":3305,"raft.queue_time_us":117139,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":28462,"thread_start_us":731111,"threads_started":2,"wal-append.queue_time_us":468696}
I20260812 19:22:56.465196  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 155) took 1585 ms. Trace:
W20260812 19:22:56.379344  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 410002us
W20260812 19:22:56.525369  6473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1261) took 3896 ms (client timeout 1659 ms). Trace:
I20260812 19:22:56.565742 10461 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:22:56.565833  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 503022us
W20260812 19:22:56.565907  6473 rpcz_store.cc:269] 0812 19:22:52.629014 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:52.631143 (+  2129us) service_pool.cc:227] Handling call
0812 19:22:56.524604 (+3893461us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b540003d4d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:56.524987 (+   383us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":790587136}
I20260812 19:22:56.567193 10461 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.572795 10409 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.574498 10071 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:56.576289  6473 raft_consensus.cc:1226] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:56.576848 10179 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:56.577208  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 171) took 1470 ms. Trace:
W20260812 19:22:56.577459  6242 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.000s	sys 0.013s
W20260812 19:22:56.578102  6242 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.000s	sys 0.014s
I20260812 19:22:56.534982 10291 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:56.465796  9700 consensus_meta.cc:287] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.972s	user 0.009s	sys 0.006s
I20260812 19:22:56.577770  6473 rpcz_store.cc:276] 0812 19:22:55.106870 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:56.569977 (+1463107us) service_pool.cc:227] Handling call
0812 19:22:56.575469 (+  5492us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:56.576940 (+  1471us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.577137 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:22:56.519562  6415 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.008s	sys 0.029s
W20260812 19:22:56.366101  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 396380us
W20260812 19:22:56.563446  6464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1309) took 1473 ms (client timeout 1799 ms). Trace:
I20260812 19:22:56.576995 10409 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:56.264999 10069 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.000s	sys 0.019s
W20260812 19:22:56.278743 10074 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.067s	sys 0.046s
W20260812 19:22:56.378326  9691 consensus_meta.cc:287] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.112s	user 0.014s	sys 0.004s
I20260812 19:22:56.580590  6344 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
W20260812 19:22:56.584748  6464 rpcz_store.cc:269] 0812 19:22:55.088519 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:55.130972 (+ 42453us) service_pool.cc:227] Handling call
0812 19:22:56.526631 (+1395659us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b5400073fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:56.561844 (+ 35213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2064460672}
I20260812 19:22:56.525993 10474 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:56.498203  6481 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.005s	sys 0.006s
I20260812 19:22:56.381054 10161 raft_consensus.cc:3032] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:22:56.564972  6228 rpcz_store.cc:276] 0812 19:22:54.879432 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.879567 (+   135us) service_pool.cc:227] Handling call
0812 19:22:54.879826 (+   259us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:54.939474 (+ 59648us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:54.939500 (+    26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:54.939552 (+    52us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:22:54.939587 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.464545 (+1524958us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b5400191754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:56.464636 (+    91us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:56.464997 (+   361us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":136623872}
W20260812 19:22:56.585611  6415 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.009s	sys 0.038s
I20260812 19:22:56.368448  6354 rpcz_store.cc:276] 0812 19:22:55.300042 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:55.300187 (+   145us) service_pool.cc:227] Handling call
0812 19:22:55.300592 (+   405us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:55.300852 (+   260us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:55.300886 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:55.301389 (+   503us) log.cc:842] Serialized 26 byte log entry
0812 19:22:55.590372 (+288983us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:55.590433 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:55.590577 (+   144us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:56.367064 (+776487us) raft_consensus.cc:1671] finished
0812 19:22:56.367112 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:56.367471 (+   359us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":288544,"threads_started":1,"wal-append.queue_time_us":384667}
I20260812 19:22:56.385155 10046 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:56.589296  9700 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:56.580616 10291 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:56.599464 10461 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:56.595613 10161 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:22:56.602849  6413 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.006s	sys 0.011s
I20260812 19:22:56.604125  6470 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:56.461995 10435 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:56.612771  6481 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.005s	sys 0.010s
I20260812 19:22:56.617594 10458 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:56.612110 10409 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:56.623723 10323 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:56.624938 10287 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:22:56.618094  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 169) took 1881 ms. Trace:
I20260812 19:22:56.369362  6475 rpcz_store.cc:276] 0812 19:22:54.766166 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.766367 (+   201us) service_pool.cc:227] Handling call
0812 19:22:54.766850 (+   483us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:54.767306 (+   456us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:54.767335 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:55.227662 (+460327us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b2c000cda88. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:22:55.268712 (+ 41050us) log.cc:842] Serialized 26 byte log entry
0812 19:22:55.774017 (+505305us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:55.774074 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:55.774155 (+    81us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:56.367800 (+593645us) raft_consensus.cc:1671] finished
0812 19:22:56.367843 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:56.368401 (+   558us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":522,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":210,"spinlock_wait_cycles":13693312,"thread_start_us":453713,"threads_started":1,"wal-append.queue_time_us":717249}
I20260812 19:22:56.606360 10474 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:56.649245 10287 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:56.647324  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1316) took 1556 ms. Trace:
I20260812 19:22:56.602798 10394 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:56.648787  6230 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 7. Current term is 8. Ops: []
I20260812 19:22:56.649793  6483 rpcz_store.cc:276] 0812 19:22:54.736389 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.742045 (+  5656us) service_pool.cc:227] Handling call
0812 19:22:54.742458 (+   413us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:54.823347 (+ 80889us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.611846 (+1788499us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b540003bbd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:56.617882 (+  6036us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":166398720}
W20260812 19:22:56.644920  6413 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.006s	sys 0.011s
I20260812 19:22:56.668557 10378 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:56.670933 10394 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.671384 10378 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.670591  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1560) took 1568 ms. Trace:
I20260812 19:22:56.671754  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1563) took 1569 ms. Trace:
W20260812 19:22:56.663010  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 43971.1us
I20260812 19:22:56.673717  6345 rpcz_store.cc:276] 0812 19:22:55.102115 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:55.167898 (+ 65783us) service_pool.cc:227] Handling call
0812 19:22:55.173643 (+  5745us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:55.473606 (+299963us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.671171 (+1197565us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b540025ec54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:56.671538 (+   367us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":687846272}
I20260812 19:22:56.673619  6342 rpcz_store.cc:276] 0812 19:22:55.101092 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:55.104868 (+  3776us) service_pool.cc:227] Handling call
0812 19:22:55.105356 (+   488us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:55.147817 (+ 42461us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:55.147865 (+    48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:55.147935 (+    70us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:55.147984 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.668776 (+1520792us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b54001b8354. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:56.668853 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:56.669150 (+   297us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2467,"raft.queue_time_us":3059,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6476,"spinlock_wait_cycles":90963712}
I20260812 19:22:56.650012 10179 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:56.650120 10298 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:22:56.656100  6482 rpcz_store.cc:276] 0812 19:22:55.094328 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:55.901772 (+807444us) service_pool.cc:227] Handling call
0812 19:22:55.950971 (+ 49199us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:55.963207 (+ 12236us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:55.963251 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:55.963826 (+   575us) log.cc:842] Serialized 26 byte log entry
0812 19:22:56.079002 (+115176us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:56.536148 (+457146us) log.cc:842] Serialized 14 byte log entry
0812 19:22:56.646709 (+110561us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.646842 (+   133us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:56.646921 (+    79us) raft_consensus.cc:1671] finished
0812 19:22:56.646940 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:56.647102 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":52710,"prepare.queue_time_us":382667,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":93,"raft.queue_time_us":140427,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":7876,"thread_start_us":70671,"threads_started":1,"wal-append.queue_time_us":312400}
I20260812 19:22:56.645241  9691 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.703526 10262 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:56.704483 10287 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:56.699856 10074 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.069s	sys 0.052s
W20260812 19:22:56.719476 10309 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 2.589s	user 0.013s	sys 0.021s
I20260812 19:22:56.705276 10378 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:56.694375 10046 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.716748 10458 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:56.733676 10059 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:56.733774 10179 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:56.734615 10059 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:56.736194  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1557) took 3739 ms. Trace:
I20260812 19:22:56.736610  6474 rpcz_store.cc:276] 0812 19:22:52.996646 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.272565 (+1275919us) service_pool.cc:227] Handling call
0812 19:22:55.116458 (+843893us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:22:55.116688 (+   230us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:55.217016 (+100328us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.735614 (+1518598us) spinlock_profiling.cc:243] Waited 99.8 ms on lock 0x7b5400000d54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:56.735979 (+   365us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":232516864}
I20260812 19:22:56.737160 10059 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:56.737462 10179 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:56.716424 10281 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:56.740345  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1315) took 1649 ms. Trace:
I20260812 19:22:56.744309 10321 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:56.745525 10458 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:56.745203 10321 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:56.697423 10435 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:56.753237 10492 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:56.726465 10409 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.740978 10281 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.730868 10394 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:56.755815  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 172) took 1642 ms. Trace:
I20260812 19:22:56.762058  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:56.745549 10291 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:56.767391 10246 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:56.761816 10492 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:56.764704  6473 rpcz_store.cc:276] 0812 19:22:55.108305 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:56.640756 (+1532451us) service_pool.cc:227] Handling call
0812 19:22:56.699418 (+ 58662us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:56.743414 (+ 43996us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:56.743448 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:56.750627 (+  7179us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:22:56.750691 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.750765 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:56.750897 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:56.771070  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1604) took 1004 ms. Trace:
I20260812 19:22:56.761140  9700 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:56.771996  6242 rpcz_store.cc:276] 0812 19:22:55.767172 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:55.790777 (+ 23605us) service_pool.cc:227] Handling call
0812 19:22:55.817883 (+ 27106us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:22:55.872443 (+ 54560us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:55.872506 (+    63us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:22:55.929666 (+ 57160us) log.cc:842] Serialized 52 byte log entry
0812 19:22:56.579281 (+649615us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:56.579388 (+   107us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.579598 (+   210us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:56.768044 (+188446us) raft_consensus.cc:1671] finished
0812 19:22:56.768069 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:56.771003 (+  2934us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10756,"raft.queue_time_us":117317,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":13494,"thread_start_us":587603,"threads_started":1,"wal-append.queue_time_us":722113}
I20260812 19:22:56.779022 10281 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:56.740860  6477 rpcz_store.cc:276] 0812 19:22:55.090466 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:55.406207 (+315741us) service_pool.cc:227] Handling call
0812 19:22:55.406629 (+   422us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:55.413738 (+  7109us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:55.413766 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:55.427808 (+ 14042us) log.cc:842] Serialized 26 byte log entry
0812 19:22:55.484338 (+ 56530us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:22:55.628436 (+144098us) log.cc:842] Serialized 14 byte log entry
0812 19:22:55.628655 (+   219us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.739613 (+1110958us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b18003b5fc0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9
0812 19:22:56.739702 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:56.739783 (+    81us) raft_consensus.cc:1671] finished
0812 19:22:56.739899 (+   116us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:56.740142 (+   243us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6649,"prepare.queue_time_us":210082,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":10712,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":55329,"spinlock_wait_cycles":18530560,"thread_start_us":137548,"threads_started":2,"wal-append.queue_time_us":39644}
I20260812 19:22:56.782491 10321 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:56.766512  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:22:56.789438  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 59613.9us
I20260812 19:22:56.790187  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:56.791397 10324 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:22:56.792100 10324 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:56.804598  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:56.799211  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:56.806432 10259 raft_consensus.cc:979] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:22:56.807670 10259 raft_consensus.cc:1067] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:22:56.799240 10177 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260812 19:22:56.811302 10246 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:56.816325 10433 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.007s
I20260812 19:22:56.815991 10324 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.839850 10046 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:56.828773  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 45441.2us
I20260812 19:22:56.814592 10246 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:56.849713 10046 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:56.839944 10481 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260812 19:22:56.857528  9691 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:56.854339 10161 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:56.850379 10474 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:56.851712 10385 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:56.856346 10321 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:56.858887  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 197) took 2123 ms. Trace:
I20260812 19:22:56.852703  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1290) took 4079 ms. Trace:
I20260812 19:22:56.859588  6470 rpcz_store.cc:276] 0812 19:22:52.773527 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.254607 (+1481080us) service_pool.cc:227] Handling call
0812 19:22:56.586322 (+2331715us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:56.638559 (+ 52237us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.852443 (+213884us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b540003d4d0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:56.852631 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5224938752}
I20260812 19:22:56.860395  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 160) took 1172 ms. Trace:
I20260812 19:22:56.857072 10046 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.859338 10385 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.860805  6230 rpcz_store.cc:276] 0812 19:22:55.688134 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:55.691798 (+  3664us) service_pool.cc:227] Handling call
0812 19:22:55.710256 (+ 18458us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:56.660455 (+950199us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.860114 (+199659us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b540035f554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:56.860337 (+   223us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2146093312}
I20260812 19:22:56.862962 10046 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:56.864059 10385 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:56.853901  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1313) took 1764 ms. Trace:
I20260812 19:22:56.859336  6352 rpcz_store.cc:276] 0812 19:22:54.735501 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.735675 (+   174us) service_pool.cc:227] Handling call
0812 19:22:54.758872 (+ 23197us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:54.781654 (+ 22782us) raft_consensus.cc:1520] Early marking committed up to index 6
0812 19:22:54.782293 (+   639us) log.cc:842] Serialized 14 byte log entry
0812 19:22:54.878950 (+ 96657us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:54.879006 (+    56us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:22:54.879049 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.857711 (+1978662us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b18003134e0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9
0812 19:22:56.858386 (+   675us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b54002b6454. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:56.858436 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:56.858674 (+   238us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":3596,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":66,"raft.queue_time_us":110,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":5138,"spinlock_wait_cycles":54660352,"thread_start_us":96018,"threads_started":1,"wal-append.queue_time_us":204519,"wal-append.run_cpu_time_us":3677,"wal-append.run_wall_time_us":1214392}
I20260812 19:22:56.850484 10409 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:56.867676  6465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1308) took 1780 ms (client timeout 1876 ms). Trace:
I20260812 19:22:56.867347  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:22:56.868238  6465 rpcz_store.cc:269] 0812 19:22:55.088101 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:55.161468 (+ 73367us) service_pool.cc:227] Handling call
0812 19:22:56.867174 (+1705706us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54003eeed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:56.867455 (+   281us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":493033344}
I20260812 19:22:56.867767  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:22:56.848649  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 168490us
I20260812 19:22:56.859534 10321 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:56.854024 10357 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 2.452s	user 0.003s	sys 0.006s
I20260812 19:22:56.882495  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:56.763128 10318 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.135s
I20260812 19:22:56.888391  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:56.893015  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:56.893503  9700 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:56.894557  9700 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:56.902729  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:56.908092  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:22:56.908740 10438 consensus_meta.cc:287] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.013s
I20260812 19:22:56.909281 10483 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:22:56.909349 10438 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.910092 10483 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:56.911479 10483 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.912670 10438 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:56.913501 10438 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:56.913841 10321 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:56.910111  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:56.915786 10409 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:22:56.917580  6359 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:56.917629  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:56.918619 10120 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:56.919342 10409 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:56.919288 10120 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.921038  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:56.921859 10409 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:56.922228 10409 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:56.922541 10409 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:56.939445  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 174) took 1655 ms. Trace:
W20260812 19:22:56.940105 10266 consensus_meta.cc:287] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.428s	user 0.014s	sys 0.011s
I20260812 19:22:56.941260  6475 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 19:22:56.939954  6483 rpcz_store.cc:276] 0812 19:22:55.284521 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:56.688442 (+1403921us) service_pool.cc:227] Handling call
0812 19:22:56.691421 (+  2979us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:56.734411 (+ 42990us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:56.734448 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:56.735647 (+  1199us) log.cc:842] Serialized 26 byte log entry
0812 19:22:56.843410 (+107763us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:22:56.843464 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.843555 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:56.939153 (+ 95598us) raft_consensus.cc:1671] finished
0812 19:22:56.939195 (+    42us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:56.939370 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9015,"raft.queue_time_us":9546,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":139,"thread_start_us":107294,"threads_started":1,"wal-append.queue_time_us":190669}
I20260812 19:22:56.942063  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 175) took 1442 ms. Trace:
I20260812 19:22:56.940737 10266 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.945663  9700 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:56.913831 10438 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:56.847122 10069 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.205s
I20260812 19:22:56.947156  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:56.954298 10438 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:56.942530  6475 rpcz_store.cc:276] 0812 19:22:55.499505 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:56.873060 (+1373555us) service_pool.cc:227] Handling call
0812 19:22:56.934604 (+ 61544us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:56.941760 (+  7156us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.941972 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:56.952817  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 173) took 1843 ms. Trace:
I20260812 19:22:56.962692  6464 rpcz_store.cc:276] 0812 19:22:55.109301 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:56.870837 (+1761536us) service_pool.cc:227] Handling call
0812 19:22:56.910381 (+ 39544us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:56.948375 (+ 37994us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:56.948404 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:56.952496 (+  4092us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:22:56.952541 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.952607 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:56.952748 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:56.957108  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 208) took 1007 ms. Trace:
I20260812 19:22:56.891033 10433 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:56.974050 10266 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:56.981832  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:56.969743  6344 rpcz_store.cc:276] 0812 19:22:55.949663 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:55.950164 (+   501us) service_pool.cc:227] Handling call
0812 19:22:56.956854 (+1006690us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400028d54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:56.957000 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1434122112}
I20260812 19:22:56.983353  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:56.984568 10325 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:56.985795  6470 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:56.987334  6474 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:56.990592  6242 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:56.978273  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:56.995326  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:53166 (request call id 286) took 5756 ms. Trace:
I20260812 19:22:56.996003  6224 rpcz_store.cc:276] 0812 19:22:51.238459 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:51.240665 (+  2206us) service_pool.cc:227] Handling call
0812 19:22:56.929730 (+5689065us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b54000f5fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fdaf0 00007f98f7780f2a 00007f98fc6bdc6e 00007f98f5dc0807 00007f98f5dc0792 00007f98f5dc06c1 00007f98f5dc063c 00007f98f5dbf8f2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:56.995017 (+ 65287us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5939846912}
I20260812 19:22:56.996639  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:56.997213  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:56.997916  6342 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
W20260812 19:22:57.003305  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 956de4b24b3d4a2693e1dcc392b1dd00, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:57.003839  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 956de4b24b3d4a2693e1dcc392b1dd00, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.006578 10161 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:56.957078 10114 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:57.016660  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.005996  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:57.029028  6474 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:57.032562  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:57.036679  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 115756us
I20260812 19:22:57.038075  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.056324  6470 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260812 19:22:57.038367  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60307.5us
I20260812 19:22:57.061606  6224 raft_consensus.cc:2379] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:57.066828 10433 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:57.071151  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1570) took 1299 ms. Trace:
I20260812 19:22:57.071631  6353 rpcz_store.cc:276] 0812 19:22:55.771874 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:55.772037 (+   163us) service_pool.cc:227] Handling call
0812 19:22:55.798369 (+ 26332us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:55.811482 (+ 13113us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:55.811526 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:56.673469 (+861943us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b18003da7a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a
0812 19:22:56.784459 (+110990us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b2c00012928. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:22:56.806996 (+ 22537us) log.cc:842] Serialized 26 byte log entry
0812 19:22:56.904242 (+ 97246us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:22:56.923528 (+ 19286us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.948921 (+ 25393us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:57.070751 (+121830us) raft_consensus.cc:1671] finished
0812 19:22:57.070778 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:57.070951 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14361,"raft.queue_time_us":10659,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":26400,"spinlock_wait_cycles":15240832,"thread_start_us":90509,"threads_started":1,"wal-append.queue_time_us":170239}
I20260812 19:22:57.074350  6474 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:57.075533  6475 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260812 19:22:57.070955  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:57.084256 10409 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.085747  6475 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260812 19:22:57.089929  6228 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:57.075560  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:57.088831  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:57.100180 10394 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:57.132685  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:57.125325 10232 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:57.152145 10232 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:57.152688 10232 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:57.157263  6229 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:57.137605  6477 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:57.171636  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:57.197160  6342 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260812 19:22:57.197748  6342 pending_rounds.cc:76] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 2
W20260812 19:22:57.203323  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 132517us
I20260812 19:22:57.198042  6342 pending_rounds.cc:97] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260812 19:22:57.210026 10166 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:22:57.209802  9983 consensus_queue.cc:1046] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260812 19:22:57.219771  6342 raft_consensus.cc:2866] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:22:57.223690  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:57.214818  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:57.194214 10409 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:57.194587 10435 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:57.239711 10168 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260812 19:22:57.241266  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:57.239921 10462 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:57.241699 10325 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:57.244140 10325 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:57.247284  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:57.210631 10166 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:22:57.253091 10519 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.210s	user 0.000s	sys 0.002s
I20260812 19:22:57.254367  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:57.257845 10438 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.261018 10152 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:22:57.262018  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:57.262140  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:22:57.263113  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:57.272074  7606 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:57.232076 10488 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:57.268463  6475 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:57.203198 10394 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.276583  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:57.277671  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:57.284548  6482 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 19:22:57.250303 10166 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:22:57.287047  6224 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:57.289829  6474 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:57.291052  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:57.288671  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:57.292646  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:57.301964  6354 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:22:57.302148 10298 consensus_meta.cc:287] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.007s
I20260812 19:22:57.310168  6477 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:57.320724 10305 consensus_queue.cc:1046] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260812 19:22:57.322381 10305 raft_consensus.cc:3032] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:22:57.322928 10305 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:57.323498  7606 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:57.324922  6349 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:57.324201 10305 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:22:57.326098 10509 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.315s	user 0.003s	sys 0.003s
I20260812 19:22:57.320783 10265 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:57.328193 10265 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:57.330931  6236 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1603) took 2029 ms (client timeout 2211 ms). Trace:
W20260812 19:22:57.331364  6236 rpcz_store.cc:269] 0812 19:22:55.301129 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:55.322761 (+ 21632us) service_pool.cc:227] Handling call
0812 19:22:57.330677 (+2007916us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400120cd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:57.330854 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2390828288}
W20260812 19:22:57.331893  6359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1343) took 3182 ms (client timeout 2175 ms). Trace:
W20260812 19:22:57.332499  6359 rpcz_store.cc:269] 0812 19:22:54.149813 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:54.149925 (+   112us) service_pool.cc:227] Handling call
0812 19:22:57.331514 (+3181589us) spinlock_profiling.cc:243] Waited 2.71 s on lock 0x7b540034fb54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:57.331731 (+   217us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6237547264}
I20260812 19:22:57.326040 10305 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:22:57.336172  6354 raft_consensus.cc:3032] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:57.340904  6354 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:57.315502 10161 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:57.299108 10488 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.338871 10461 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:57.359700  6235 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:56.864993  6481 rpcz_store.cc:276] 0812 19:22:55.089860 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:55.387251 (+297391us) service_pool.cc:227] Handling call
0812 19:22:55.387735 (+   484us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:55.903961 (+516226us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:55.904005 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:55.917054 (+ 13049us) log.cc:842] Serialized 26 byte log entry
0812 19:22:56.701403 (+784349us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:56.773569 (+ 72166us) log.cc:842] Serialized 14 byte log entry
0812 19:22:56.784866 (+ 11297us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:56.801922 (+ 17056us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:56.853634 (+ 51712us) raft_consensus.cc:1671] finished
0812 19:22:56.853650 (+    16us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:56.853835 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":555,"prepare.queue_time_us":13179,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":78,"raft.queue_time_us":58468,"raft.run_cpu_time_us":442,"raft.run_wall_time_us":35952,"thread_start_us":1163025,"threads_started":2,"wal-append.queue_time_us":778760}
W20260812 19:22:57.364254 10517 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.123s	user 0.002s	sys 0.000s
I20260812 19:22:57.368860  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:57.301736 10462 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:57.378261  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 138998us
I20260812 19:22:57.380338  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:57.381520  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 82582.6us
I20260812 19:22:57.382508  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:57.388978 10179 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:57.389922 10179 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.372254 10461 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:57.373107 10265 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:57.391788  6354 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.402899 10385 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260812 19:22:57.406101 10433 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:57.368847 10161 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.407840  6354 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:57.402012  6297 connection.cc:232] RPC call timeout handler was delayed by -2.38190811406821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
W20260812 19:22:57.415901  6297 connection.cc:232] RPC call timeout handler was delayed by -2.3684081139508635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260812 19:22:57.416390  6297 connection.cc:232] RPC call timeout handler was delayed by -2.3495081139262766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260812 19:22:57.416817  6297 connection.cc:232] RPC call timeout handler was delayed by -2.105608114041388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260812 19:22:57.417764 10526 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260812 19:22:57.420158 10155 raft_consensus.cc:3032] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:22:57.420596 10155 raft_consensus.cc:729] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:57.421644 10155 consensus_queue.cc:260] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:57.422266  6230 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:57.423493  6238 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:22:57.426326  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:57.407045 10438 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:57.434935  6241 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:57.435539 10433 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.426049 10488 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:57.422436 10462 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:57.436604  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:57.442471  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:57.442953 10411 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:57.443297 10394 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:57.448966  6241 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:57.450078  6464 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:57.469475  6416 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:57.442451 10155 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:57.440531 10492 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:57.453122 10179 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:57.474537  6238 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 2. Current term is 3. Ops: []
I20260812 19:22:57.445580 10433 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:57.454320 10161 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:57.463495 10265 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:57.452033 10429 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:57.488466 10429 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:57.491174 10232 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.492026  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:57.493286 10232 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:57.493484  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:57.475090 10394 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:22:57.494915 10385 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260812 19:22:57.495496  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 53131.3us
I20260812 19:22:57.496517  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:57.498135  6229 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:22:57.481431  9974 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260812 19:22:57.485956  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 57145.4us
I20260812 19:22:57.486784 10466 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:22:57.487489 10431 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:57.479665 10265 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:57.476639  9969 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:22:57.477361 10438 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:57.510061 10438 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.502928 10411 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.512171  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:57.512390 10438 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:57.506872  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.513942  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.512701 10411 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:57.501214  9974 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:57.531386  9974 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:57.505795  9969 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:57.535241  9969 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:22:57.537130  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:22:57.539318 10435 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:57.539776 10435 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:57.540158 10435 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:57.541250 10429 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:57.505411 10265 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:57.508826 10232 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:57.521435 10466 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:22:57.513005 10431 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.527511  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:57.547659  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:57.556320 10256 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:57.556617  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:57.504092 10462 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260812 19:22:57.559185  6238 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:22:57.576574  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:57.510500 10166 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:57.579082  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:57.591781  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:57.518579 10325 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.597138  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.596730  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:57.607455 10539 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.149s	user 0.002s	sys 0.000s
I20260812 19:22:57.629963  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.631135  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:57.631453  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 104042us
I20260812 19:22:57.597047 10232 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:57.638971  6241 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 2: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:57.650786  6352 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:57.628196 10394 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 19:22:57.663687  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 125141us
I20260812 19:22:57.674980 10558 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:57.675194  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:57.675951 10558 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.676993  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:57.678797 10558 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:57.684546 10558 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:22:57.657486  7591 raft_consensus.cc:2354] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8.
I20260812 19:22:57.681471  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.635113 10114 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:57.692974  6347 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 19:22:57.680217  6238 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:57.689194  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:57.704571  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:57.708577  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:57.712642  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:57.728331  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:57.728785  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.716338  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.710790 10488 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:22:57.714943 10385 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 19:22:57.741748 10541 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260812 19:22:57.712284 10461 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:57.746893  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.751746  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:57.748924  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:57.752447  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:57.742043 10166 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:57.714366 10114 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:57.755623  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:57.757411 10114 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:22:57.757814 10532 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.360s	user 0.000s	sys 0.009s
I20260812 19:22:57.755434  6238 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:57.760078 10120 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:57.761518  6350 raft_consensus.cc:2396] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260812 19:22:57.765200  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:57.765868  6352 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:22:57.766232  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:57.766849  6474 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:22:57.767235 10488 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:57.767635 10488 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:57.767971 10488 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:22:57.771955  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 67909us
I20260812 19:22:57.764232 10325 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:57.862840 10532 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260812 19:22:57.940795  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 110660us
I20260812 19:22:57.711064 10466 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.919561  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.919932  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:57.922246  6464 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:22:57.943392  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 176) took 2336 ms. Trace:
I20260812 19:22:57.943848  6464 raft_consensus.cc:595] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Received request to transfer leadership to TS f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:57.943809  6482 rpcz_store.cc:276] 0812 19:22:55.605653 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:56.698979 (+1093326us) service_pool.cc:227] Handling call
0812 19:22:56.712550 (+ 13571us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:57.284963 (+572413us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:57.801571 (+516608us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b540003cad4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:22:57.942287 (+140716us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1301638016}
I20260812 19:22:57.944712  6464 raft_consensus.cc:603] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:57.922246  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.924579 10287 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
W20260812 19:22:57.925202 10305 consensus_meta.cc:287] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.573s	user 0.013s	sys 0.002s
I20260812 19:22:57.927306  6238 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:22:57.931751  6352 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:22:57.749907 10556 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 19:22:57.934259  6354 consensus_meta.cc:287] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.001s
I20260812 19:22:57.956833  6354 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 19:22:57.926630  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:22:57.939664  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 89d6b10f5ff448f592a41c3a77692cfe, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:57.957713  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 89d6b10f5ff448f592a41c3a77692cfe, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:57.940106 10548 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.192s	user 0.000s	sys 0.009s
I20260812 19:22:57.959129  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:57.959323  6228 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
W20260812 19:22:57.933053 10539 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.163s	user 0.003s	sys 0.005s
I20260812 19:22:57.943652  6229 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:22:57.949285 10120 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
W20260812 19:22:57.946162 10549 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.230s	user 0.000s	sys 0.009s
I20260812 19:22:57.955988  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:57.958114  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.957237  6224 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
W20260812 19:22:57.962384  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 192050us
I20260812 19:22:57.979324  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:57.962368  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.982998  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.983644  6228 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:22:57.984346  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.984488  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:57.985085  6228 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:22:57.985780  6228 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:53178
I20260812 19:22:57.986675 10114 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:57.987396 10114 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:57.987896 10114 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:57.990746 10556 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:57.991465 10556 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.991854 10325 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:57.993911 10556 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:57.994678 10114 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:57.952638  9974 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:57.995347  6228 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:22:57.995790  6228 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:22:57.997089  9974 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:57.948163 10544 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.206s	user 0.003s	sys 0.006s
I20260812 19:22:58.000397 10492 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:57.977022  6344 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260812 19:22:58.001010 10492 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:58.002635  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 46739.2us
I20260812 19:22:58.003400 10114 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:58.004806  9627 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:22:58.005519  9627 raft_consensus.cc:686] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:58.005802  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:58.008747 10556 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:22:58.010196 10574 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:22:57.977813 10385 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:58.006752  9627 consensus_queue.cc:237] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:58.027338  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:58.044669  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:58.046417  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:58.051084  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:58.052974  6228 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:58.061956  6350 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:58.064239  6350 raft_consensus.cc:595] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:58.064709  6350 raft_consensus.cc:603] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:58.057451 10286 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260812 19:22:58.071518 10161 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260812 19:22:58.083370  9969 consensus_meta.cc:287] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.547s	user 0.018s	sys 0.000s
I20260812 19:22:58.084012  9969 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:58.085770  7600 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:58.089033  6474 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:22:58.095348  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:58.004411 10114 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:58.101354  6228 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:58.054543 10179 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:22:58.108872  6352 raft_consensus.cc:2396] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260812 19:22:58.067283 10385 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:22:58.087222 10556 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:22:58.124614  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 133189us
I20260812 19:22:58.141265  9969 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:58.143499 10157 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260812 19:22:58.144464 10157 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:22:58.144809 10157 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:58.108156 10559 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260812 19:22:58.148661  6228 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 19:22:58.163281  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:58.164036  6228 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:22:58.166716  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:58.167434  6352 raft_consensus.cc:595] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:58.154511 10492 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:58.173156  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:58.177412  6353 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 8
I20260812 19:22:58.179052 10114 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:58.187278  6298 leader_election.cc:398] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8.
I20260812 19:22:58.187671  6298 leader_election.cc:401] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260812 19:22:58.188571  9974 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8.
W20260812 19:22:58.192726  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 538444us
I20260812 19:22:58.193141  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:58.193626  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:58.194880 10232 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:58.196164  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:58.198813  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:58.206851 10438 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:58.186393  6236 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:22:58.212123  6228 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:22:58.213371  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:22:58.213557  6228 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260812 19:22:58.140089 10488 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:58.222325 10546 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:22:58.222441 10008 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:58.223091 10546 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:22:58.223379 10008 consensus_queue.cc:1225] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer bdfa5579d4534c618c00db6b4a841c81 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260812 19:22:58.225313  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:58.226064  6352 raft_consensus.cc:595] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
W20260812 19:22:58.201671 10435 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.661s	user 0.018s	sys 0.001s
I20260812 19:22:58.224133 10433 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:58.163666 10120 consensus_queue.cc:1046] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260812 19:22:58.237221  7607 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:58.229884 10411 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:22:58.262668 10265 consensus_meta.cc:287] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.004s
I20260812 19:22:58.278911 10577 consensus_queue.cc:1046] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260812 19:22:58.237884 10433 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:58.224542  9969 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
W20260812 19:22:58.287575  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 159226us
I20260812 19:22:58.289743  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:58.291167  6352 raft_consensus.cc:595] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:58.291615  6352 raft_consensus.cc:603] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:22:58.293061  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:58.278134 10411 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:22:58.237643 10435 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:58.288262  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 181733us
I20260812 19:22:58.305490  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:58.224133 10546 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:58.216321 10157 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:58.322571  6353 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:22:58.282506 10265 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:58.326767  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 128097us
I20260812 19:22:58.330467  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:58.335702  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:58.336637  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:58.355515  6242 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260812 19:22:58.360667  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:58.361971  6241 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:58.332795 10323 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:22:58.375320  9974 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:58.375885 10558 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:22:58.376506 10558 raft_consensus.cc:686] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:22:58.377393  9974 consensus_queue.cc:1046] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:58.378481  9974 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:58.378954  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:58.380283  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:58.380911  9974 raft_consensus.cc:3032] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:22:58.381762  9974 raft_consensus.cc:729] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:58.382828 10576 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 19:22:58.383525  7607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60760 (request call id 304) took 1635 ms (client timeout 1523 ms). Trace:
W20260812 19:22:58.375623  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 53909.4us
I20260812 19:22:58.383726  9974 consensus_queue.cc:260] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:58.389832 10435 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:58.390717  6179 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.523s (SENT) [suppressed 18 similar messages]
I20260812 19:22:58.383564 10576 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:58.385735  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:58.392508 10431 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:58.393167 10431 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:22:58.393565 10431 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:58.393362  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:58.395256  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:58.395717 10411 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:58.396493 10265 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:58.396704  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:58.398911 10114 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:58.399485 10114 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:58.399920 10114 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:58.402439  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:58.398223  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:58.389919  9974 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:58.385250 10429 raft_consensus.cc:3032] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:58.356550 10157 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:58.426009  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:22:58.394009 10431 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:22:58.383978  7607 rpcz_store.cc:269] 0812 19:22:56.748056 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:56.755713 (+  7657us) service_pool.cc:227] Handling call
0812 19:22:58.383279 (+1627566us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54004d12d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:22:58.383414 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3291022592}
I20260812 19:22:58.435560  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:58.439204  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:22:58.440238  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:58.442248 10492 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:58.443058 10492 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:22:58.438143 10429 raft_consensus.cc:729] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:58.443719 10318 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:58.444342 10318 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:58.444876 10429 consensus_queue.cc:260] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:58.447980  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:58.449553  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:58.426364 10394 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 19:22:58.473012  6178 connection.cc:232] RPC call timeout handler was delayed by -2.2899814699776471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260812 19:22:58.478343  6354 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:58.443447 10492 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:22:58.479305  6178 connection.cc:232] RPC call timeout handler was delayed by -1.751447255956009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260812 19:22:58.479732  6178 connection.cc:232] RPC call timeout handler was delayed by -1.6758472558576614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
I20260812 19:22:58.481489  6344 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 8. Ops: []
I20260812 19:22:58.454576 10488 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:58.483474  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:58.465266 10585 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:58.464775 10559 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:58.461768 10385 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:58.485632  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:58.363314 10433 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:58.483788 10429 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:58.514961  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:58.520395  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:58.481709 10492 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:58.522183  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:58.473891 10318 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:58.481290 10435 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:22:58.528051 10385 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:58.520015 10394 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:22:58.529789  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:58.531056 10325 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:22:58.539091  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:58.539112  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 89659.1us
I20260812 19:22:58.468174 10179 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260812 19:22:58.377501 10558 consensus_queue.cc:237] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:58.546903 10435 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:58.554164  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1567) took 1067 ms. Trace:
I20260812 19:22:58.560457  6464 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260812 19:22:58.515944 10559 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:58.564443  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:58.576337  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:22:58.576867  6354 raft_consensus.cc:2396] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260812 19:22:58.577023  6352 raft_consensus.cc:595] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:22:58.565744  6359 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:22:58.523000 10488 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:58.572732  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:58.574091  6350 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:58.575664  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1623) took 1065 ms. Trace:
W20260812 19:22:58.581987  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 299107us
I20260812 19:22:58.562209 10298 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:58.574638  6229 rpcz_store.cc:276] 0812 19:22:57.486297 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:57.986237 (+499940us) service_pool.cc:227] Handling call
0812 19:22:57.986556 (+   319us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:58.270877 (+284321us) raft_consensus.cc:1520] Early marking committed up to index 2
0812 19:22:58.279083 (+  8206us) log.cc:842] Serialized 14 byte log entry
0812 19:22:58.438067 (+158984us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:58.454513 (+ 16446us) log.cc:842] Serialized 26 byte log entry
0812 19:22:58.454681 (+   168us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:58.454716 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:58.454784 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:58.553854 (+ 99070us) raft_consensus.cc:1671] finished
0812 19:22:58.553886 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:58.554084 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":190668,"prepare.queue_time_us":8599,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":237014,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":17403,"thread_start_us":157912,"threads_started":1,"wal-append.queue_time_us":187917}
I20260812 19:22:58.599711  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:58.586140  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1629) took 1050 ms. Trace:
I20260812 19:22:58.587203  6344 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:58.607795  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:58.615190  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 131006us
I20260812 19:22:58.616245  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:58.576223 10435 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:58.621014  6349 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
I20260812 19:22:58.623535  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:58.581642 10559 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:58.563011 10114 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:58.592782 10232 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 19:22:58.694424  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 54997.3us
I20260812 19:22:58.625895  6230 rpcz_store.cc:276] 0812 19:22:57.535969 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:58.185809 (+649840us) service_pool.cc:227] Handling call
0812 19:22:58.186275 (+   466us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:22:58.186854 (+   579us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:58.186892 (+    38us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:22:58.187665 (+   773us) log.cc:842] Serialized 52 byte log entry
0812 19:22:58.328663 (+140998us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:58.579191 (+250528us) log.cc:842] Serialized 14 byte log entry
0812 19:22:58.585628 (+  6437us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:58.585836 (+   208us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:58.585882 (+    46us) raft_consensus.cc:1671] finished
0812 19:22:58.585892 (+    10us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:58.586085 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27325,"prepare.queue_time_us":46782,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":8932,"raft.run_cpu_time_us":559,"raft.run_wall_time_us":16424,"thread_start_us":354163,"threads_started":2,"wal-append.queue_time_us":235632}
I20260812 19:22:58.696822 10161 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:58.699347 10385 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:58.592283 10462 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.091s
W20260812 19:22:58.703145  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 87008.7us
I20260812 19:22:58.704383  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:58.707047  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:22:58.688896 10598 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260812 19:22:58.707312 10602 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260812 19:22:58.709239  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1612) took 1203 ms. Trace:
I20260812 19:22:58.709580  6224 rpcz_store.cc:276] 0812 19:22:57.506194 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:58.015154 (+508960us) service_pool.cc:227] Handling call
0812 19:22:58.029309 (+ 14155us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:58.220623 (+191314us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:58.220653 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:58.221180 (+   527us) log.cc:842] Serialized 26 byte log entry
0812 19:22:58.328395 (+107215us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:22:58.328451 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:58.328553 (+   102us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:22:58.709019 (+380466us) raft_consensus.cc:1671] finished
0812 19:22:58.709040 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:58.709179 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":178054,"raft.queue_time_us":246363,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":3926,"thread_start_us":106781,"threads_started":1,"wal-append.queue_time_us":260895}
I20260812 19:22:58.711001 10433 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:58.713296  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:58.716423  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:58.718045 10323 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260812 19:22:58.718946 10556 consensus_meta.cc:287] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.579s	user 0.004s	sys 0.008s
I20260812 19:22:58.719439 10556 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:22:58.722373  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:58.723143  6344 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:58.725555 10492 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:58.731366  6344 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:22:58.623531 10120 raft_consensus.cc:3032] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
W20260812 19:22:58.734845  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 111395us
I20260812 19:22:58.740772  6350 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:22:58.741228  6350 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:58.689110 10585 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:22:58.625626 10318 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:58.602370 10308 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.128s
I20260812 19:22:58.688544 10265 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:22:58.769167  6359 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:22:58.761451  6350 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:58.770608  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 240023us
I20260812 19:22:58.584678  6235 rpcz_store.cc:276] 0812 19:22:57.510159 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:58.064655 (+554496us) service_pool.cc:227] Handling call
0812 19:22:58.118961 (+ 54306us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:58.126056 (+  7095us) raft_consensus.cc:1520] Early marking committed up to index 3
0812 19:22:58.147929 (+ 21873us) log.cc:842] Serialized 14 byte log entry
0812 19:22:58.573962 (+426033us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:22:58.575388 (+  1426us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:22:58.575437 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:58.575500 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:22:58.575606 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7212,"prepare.queue_time_us":22253,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":4962,"raft.queue_time_us":8561,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":2194,"thread_start_us":418059,"threads_started":1}
I20260812 19:22:58.784693  6238 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260812 19:22:58.787415  6350 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:22:58.739048 10287 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:58.736727 10120 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:58.683931 10488 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:58.792424  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:58.799229  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:58.799003 10120 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:58.799960  6474 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:22:58.800398 10120 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:58.803051  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:58.793831  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:58.796653  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:58.797029  6482 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:58.805629  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:59.138679  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:59.149495  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:58.805663  6464 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:22:58.798099  6238 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:59.117584  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:59.150450  6354 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:22:59.175554 10492 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:58.783967 10318 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:59.190811 10619 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
W20260812 19:22:59.191124 10610 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
I20260812 19:22:59.191421 10619 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:59.192431 10619 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:59.193789 10619 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:58.805835 10287 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:59.197281 10287 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:59.190898  6474 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7. Ops: []
I20260812 19:22:59.187342 10114 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:59.203131 10318 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:22:59.203261 10608 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
W20260812 19:22:59.205695 10157 consensus_meta.cc:287] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.765s	user 0.002s	sys 0.010s
W20260812 19:22:59.141291 10613 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.309s	user 0.000s	sys 0.000s
I20260812 19:22:59.190104  6342 raft_consensus.cc:2379] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:59.207741  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:59.208215  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:59.208514  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:22:59.209034  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:59.209200  7607 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:22:59.209527  6342 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:22:59.228255  6238 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:59.233856  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:59.234414  6179 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:22:59.140179 10607 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.308s	user 0.000s	sys 0.000s
W20260812 19:22:59.247136  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 74462.1us
I20260812 19:22:59.251015  6416 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:59.129810 10483 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:59.256556  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:59.262143  6474 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:22:59.258958  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:59.265241  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:59.267984  6238 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:22:59.232100 10308 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:59.275089  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:59.278970  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:59.279510  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:59.273340  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:22:59.286038  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:59.286897  6474 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:59.258365 10587 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:59.264642  9974 consensus_meta.cc:287] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.828s	user 0.009s	sys 0.003s
I20260812 19:22:59.284431  6473 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
W20260812 19:22:59.273335 10429 consensus_meta.cc:287] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.000s
W20260812 19:22:59.331900  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 52496.1us
I20260812 19:22:59.332775  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:59.319559  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:59.301141 10620 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:22:59.310213 10433 consensus_meta.cc:287] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.003s
I20260812 19:22:59.342150  6238 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7. Ops: []
I20260812 19:22:59.356146  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:59.358021  6470 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 1. Current term is 2. Ops: []
I20260812 19:22:59.358832  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:59.359138  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:59.319923 10618 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:59.366161  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:22:59.343696 10435 consensus_meta.cc:287] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.654s	user 0.007s	sys 0.004s
I20260812 19:22:59.360802  6359 raft_consensus.cc:2396] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260812 19:22:59.361229  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:59.359916  6238 raft_consensus.cc:2379] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 3: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:59.363197  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:59.372463  6236 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:22:59.372668  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:59.373857  6238 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:59.280341 10483 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:59.340368 10488 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:59.387470  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:59.383862  6242 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:22:59.392179 10431 consensus_meta.cc:287] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.932s	user 0.011s	sys 0.000s
I20260812 19:22:59.393008  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:22:59.393541  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:59.394429  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:22:59.482461  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 207448us
I20260812 19:22:59.482851  6230 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:22:59.404765 10606 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260812 19:22:59.484679  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 126031us
I20260812 19:22:59.354797 10620 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:59.405884  6470 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:59.306142 10587 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:59.411957 10623 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260812 19:22:59.417014 10483 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:59.290015 10308 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:59.384589 10622 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:22:59.430318  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:22:59.512197  6483 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:22:59.430454  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:59.432941 10323 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:22:59.436645  6474 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
W20260812 19:22:59.515414  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 241261us
I20260812 19:22:59.450371  6349 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:22:59.517022  6353 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:22:59.458804 10462 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:22:59.459685 10157 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:22:59.483353  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:59.497004  6235 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:22:59.505174  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:59.526093  6342 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:22:59.526455  6342 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:59.507742 10558 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:59.509907  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:22:59.390851 10435 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:59.527577  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 44319.8us
I20260812 19:22:59.533097  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:22:59.537514  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:22:59.541608  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:22:59.544032  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 271512us
I20260812 19:22:59.532691  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260812 19:22:59.516795 10323 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:59.529758 10394 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:59.498245 10431 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:59.564029  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:22:59.566955  6352 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:22:59.515482 10161 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:22:59.570137  6345 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: []
I20260812 19:22:59.527611 10631 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:59.605409 10161 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:59.606226 10631 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:59.536409 10622 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.088s
I20260812 19:22:59.625793 10161 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:59.626076 10631 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:59.607282 10431 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:22:59.608387 10577 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:59.627662 10577 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:59.629727 10577 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:59.572960 10323 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:59.610248  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:22:59.559090 10492 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:22:59.633304  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:59.633755 10492 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:22:59.634169 10492 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:22:59.634263 10120 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:22:59.634797 10120 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:59.635231 10120 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:22:59.619832 10620 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:59.553033 10558 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:59.622570 10587 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:59.572065 10433 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:59.564373 10429 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:59.623381 10325 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:22:59.610687 10624 consensus_queue.cc:1046] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:59.660949 10624 raft_consensus.cc:3032] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:22:59.661319 10624 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:59.634892 10622 consensus_queue.cc:1046] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:22:59.663244 10622 raft_consensus.cc:3032] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:22:59.663581 10622 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:22:59.664415 10622 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:59.664683 10325 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:22:59.669883  6342 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:59.671811  6342 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 7
I20260812 19:22:59.649014  6464 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:22:59.652076  6483 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:22:59.658778 10587 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:22:59.660135 10617 raft_consensus.cc:979] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:22:59.635093 10577 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260812 19:22:59.613765 10308 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:22:59.677220 10622 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:22:59.682732 10318 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:22:59.664821  6345 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260812 19:22:59.626215 10641 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:59.647022  9974 raft_consensus.cc:2741] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260812 19:22:59.696251  6350 consensus_meta.cc:287] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.908s	user 0.013s	sys 0.001s
I20260812 19:22:59.699398  6350 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260812 19:22:59.699846  6350 pending_rounds.cc:76] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 3
I20260812 19:22:59.685912 10617 raft_consensus.cc:1067] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:22:59.700148  6350 pending_rounds.cc:97] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260812 19:22:59.708931  6350 raft_consensus.cc:2866] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:22:59.717144  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 322036us
I20260812 19:22:59.668411 10433 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:59.662204 10624 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:59.701154  6347 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.011s	sys 0.003s
W20260812 19:22:59.743891  6347 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.012s	sys 0.003s
I20260812 19:22:59.701323 10577 consensus_queue.cc:1225] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260812 19:22:59.750409  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1374) took 1136 ms. Trace:
I20260812 19:22:59.753774  6350 rpcz_store.cc:276] 0812 19:22:58.614544 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:58.628199 (+ 13655us) service_pool.cc:227] Handling call
0812 19:22:58.691520 (+ 63321us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:22:59.750162 (+1058642us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:59.750352 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:22:59.740471 10483 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:22:59.779132  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:59.782469  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:22:59.754207 10433 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:59.775934 10576 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.244s	user 0.008s	sys 0.025s
I20260812 19:22:59.794273  6350 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260812 19:22:59.795885  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:59.801277  6345 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: []
I20260812 19:22:59.700385 10641 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:59.783290 10624 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:22:59.762864 10409 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260812 19:22:59.785183 10298 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:22:59.784996 10232 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:22:59.789740 10483 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:22:59.801430 10576 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.270s	user 0.010s	sys 0.025s
I20260812 19:22:59.788000 10435 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:22:59.841470  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 266889us
I20260812 19:22:59.830842  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:22:59.865442  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 284751us
I20260812 19:22:59.824261 10645 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election won for term 8
W20260812 19:22:59.863585  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 218397us
I20260812 19:22:59.802968 10655 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election won for term 6
W20260812 19:22:59.999168  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 132468us
W20260812 19:23:00.019536 10659 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260812 19:23:00.020305 10651 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.270s	user 0.000s	sys 0.000s
I20260812 19:22:59.991925 10658 raft_consensus.cc:3032] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:00.021078 10394 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:22:59.995149 10488 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:00.036527  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:00.011597 10646 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:00.023442  6354 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260812 19:23:00.040113  6354 pending_rounds.cc:76] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 3
I20260812 19:23:00.040467  6354 pending_rounds.cc:97] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260812 19:23:00.040812  6354 raft_consensus.cc:2866] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:00.037503  6477 raft_consensus.cc:2396] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260812 19:23:00.037931  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:00.031031  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:22:59.866621 10558 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:22:59.842214 10298 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.039355 10287 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.005s
I20260812 19:23:00.037102 10265 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260812 19:23:00.045920 10232 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:23:00.046794  9627 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:00.062574  9627 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:00.063089  9627 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:00.063925 10641 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:00.059078 10660 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260812 19:23:00.046043  6060 catalog_manager.cc:5495] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 3 to 4, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2), no longer has a pending config: VOTER a1541d11be514114966dc1e92a345298 (127.3.253.1), VOTER 54f83319db6b49929cc8f18a66a66975 (127.3.253.2), VOTER bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3), NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 4 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:00.066738 10298 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:00.048400 10323 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:00.036646 10625 log.cc:924] Time spent T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.691s	user 0.007s	sys 0.000s
I20260812 19:22:59.999013 10325 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:00.069288 10323 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:00.042784 10157 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:22:59.993508 10639 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:00.071473 10639 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:22:59.993731 10409 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:00.024536 10619 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:00.072788 10619 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:00.072978 10488 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.073704 10619 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.074949 10619 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:00.075080 10488 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:00.075620 10577 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:00.076085 10577 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.077253 10618 raft_consensus.cc:979] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
W20260812 19:23:00.077545  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46623.5us
I20260812 19:23:00.043015  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:23:00.021680 10585 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:00.078315  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:00.079000 10435 raft_consensus.cc:1067] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:23:00.078955 10585 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.077771 10618 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 19:23:00.098492  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46191.6us
I20260812 19:23:00.036136 10658 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:00.102950  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:00.108747  6477 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:23:00.104444  6483 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:00.103000  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:00.105296  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 82275.4us
I20260812 19:23:00.112054  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:00.114270  6235 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260812 19:23:00.115409  6477 raft_consensus.cc:2354] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5.
I20260812 19:23:00.121618  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:00.129029  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:00.101361 10651 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260812 19:23:00.034482 10574 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260812 19:23:00.131182  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:00.133998  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:00.135022  6236 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:53178
I20260812 19:23:00.138250  6242 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:23:00.138586  6236 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:23:00.138969  6236 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:00.136992  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:00.141342  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:00.139597  6232 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:23:00.142333  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:00.143141  7607 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:00.107931 10622 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:00.039578 10394 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.144708 10618 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:23:00.157366 10394 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:00.158238 10631 consensus_queue.cc:1046] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:23:00.159188 10631 raft_consensus.cc:3032] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:00.159536 10631 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:00.160910  6473 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:23:00.161705  6230 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:23:00.150892 10265 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:00.152953  6342 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:00.154845  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:00.138882  9627 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:00.150229  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:00.108192 10645 raft_consensus.cc:686] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:00.163285  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:00.165743  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1612) took 1638 ms. Trace:
I20260812 19:23:00.169374  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:00.170836  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:00.171118  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:00.178239  6352 raft_consensus.cc:2396] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:23:00.082544 10646 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.409674  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:00.228212  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:00.326452  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:00.218245  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:00.271914  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 201) took 1088 ms. Trace:
I20260812 19:23:00.079840  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:00.323016  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:00.178557  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:00.332306  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1387) took 1030 ms. Trace:
I20260812 19:23:00.333806  7607 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:23:00.315115  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:00.426795  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:00.421593  6354 rpcz_store.cc:276] 0812 19:22:59.301640 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:59.301798 (+   158us) service_pool.cc:227] Handling call
0812 19:23:00.023077 (+721279us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:00.069909 (+ 46832us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:00.332079 (+262170us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54001bfdd0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:00.332233 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1618649856}
I20260812 19:23:00.443059  6350 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:00.415293  6474 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
W20260812 19:23:00.286541 10120 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.004s
I20260812 19:23:00.229357 10622 raft_consensus.cc:686] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:00.449319  6359 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260812 19:23:00.450464  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 127582us
W20260812 19:23:00.332643 10492 consensus_meta.cc:287] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.697s	user 0.007s	sys 0.004s
W20260812 19:23:00.330067 10559 consensus_meta.cc:287] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.638s	user 0.000s	sys 0.017s
I20260812 19:23:00.363049 10483 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:00.461259  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:00.370705 10668 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:00.624184  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:00.610358 10559 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.626541  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:00.522518 10287 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:00.524773  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:00.659507  6477 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:00.451308 10435 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:00.346767 10576 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:00.588496 10617 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:00.539633  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 224648us
I20260812 19:23:00.540953  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:00.368764 10325 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:00.217254 10265 raft_consensus.cc:686] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:00.167645 10655 raft_consensus.cc:686] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:00.227656 10409 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:23:00.310611 10667 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260812 19:23:00.522589  6359 pending_rounds.cc:76] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 3
I20260812 19:23:00.687215  6359 pending_rounds.cc:97] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260812 19:23:00.687525  6359 raft_consensus.cc:2866] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:00.286738  9627 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:00.355584 10179 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:00.315025 10660 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:23:00.330418 10672 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260812 19:23:00.610751  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:00.412708  6347 rpcz_store.cc:276] 0812 19:22:58.527086 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:58.527212 (+   126us) service_pool.cc:227] Handling call
0812 19:22:58.527557 (+   345us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:58.769719 (+242162us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:58.769756 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:58.798112 (+ 28356us) log.cc:842] Serialized 26 byte log entry
0812 19:22:59.744405 (+946293us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:22:59.744459 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:59.744552 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:00.165530 (+420978us) raft_consensus.cc:1671] finished
0812 19:23:00.165552 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:00.165684 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":359930,"raft.run_cpu_time_us":4497,"raft.run_wall_time_us":168519,"thread_start_us":919062,"threads_started":2,"wal-append.queue_time_us":968145}
I20260812 19:23:00.661963 10585 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:00.419358  6482 rpcz_store.cc:276] 0812 19:22:59.183081 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:59.183204 (+   123us) service_pool.cc:227] Handling call
0812 19:22:59.183587 (+   383us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:59.232949 (+ 49362us) raft_consensus.cc:1520] Early marking committed up to index 6
0812 19:22:59.268943 (+ 35994us) log.cc:842] Serialized 14 byte log entry
0812 19:22:59.458439 (+189496us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b180033e8c0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f47d34ca 00007f98fdea8f99 00007f98fb620bcf 00007f98f485c7b6 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d
0812 19:22:59.553482 (+ 95043us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:59.564362 (+ 10880us) log.cc:842] Serialized 26 byte log entry
0812 19:22:59.564489 (+   127us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:22:59.564524 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:59.564595 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:00.271524 (+706929us) raft_consensus.cc:1671] finished
0812 19:23:00.271627 (+   103us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:00.271826 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15347,"prepare.queue_time_us":39775,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":4693,"raft.queue_time_us":69372,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":19221,"spinlock_wait_cycles":20426496,"thread_start_us":246003,"threads_started":1,"wal-append.queue_time_us":412114}
I20260812 19:23:00.656284  6481 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260812 19:23:00.312317  9974 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:00.666937 10703 consensus_queue.cc:1046] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:23:00.666548  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:00.604580 10411 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:00.667688 10559 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:00.167279 10631 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.667758 10429 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:00.705624 10646 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:00.705410 10429 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.706641 10265 consensus_queue.cc:237] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.707835 10429 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:00.459609 10624 consensus_meta.cc:287] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.622s	user 0.006s	sys 0.004s
W20260812 19:23:00.665586 10619 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.003s
I20260812 19:23:00.604115 10492 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.710629  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1649) took 1332 ms. Trace:
I20260812 19:23:00.668217 10435 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.711650  6224 rpcz_store.cc:276] 0812 19:22:59.377941 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:59.378101 (+   160us) service_pool.cc:227] Handling call
0812 19:22:59.385208 (+  7107us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:59.646098 (+260890us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:59.646140 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:59.668979 (+ 22839us) log.cc:842] Serialized 26 byte log entry
0812 19:22:59.868922 (+199943us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:22:59.868957 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:59.869036 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:00.710404 (+841368us) raft_consensus.cc:1671] finished
0812 19:23:00.710424 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:00.710571 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":191013,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":44500,"thread_start_us":431491,"threads_started":2,"wal-append.queue_time_us":409948}
I20260812 19:23:00.713208 10435 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:00.702390 10703 raft_consensus.cc:3032] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:00.714449 10703 raft_consensus.cc:729] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:00.668068 10645 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:00.714877 10622 consensus_queue.cc:237] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:00.714466 10618 consensus_meta.cc:287] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.000s
I20260812 19:23:00.716506 10618 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:23:00.717187  6352 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:00.657524 10287 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:23:00.691071 10686 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260812 19:23:00.704627 10411 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:00.228729 10658 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.703784  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:00.726521  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:00.703989  9974 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:00.724046  6236 consensus_meta.cc:287] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.000s
I20260812 19:23:00.730535  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:00.733079  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:00.733877  6344 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:00.728267  6236 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.735837  6230 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:23:00.722805 10287 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:00.761274  6482 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:23:00.660102 10668 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:00.711310 10492 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:00.554558 10120 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.763219  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:00.770800  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:00.767936 10703 consensus_queue.cc:260] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:00.772209 10703 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:00.775123  6236 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:00.780906  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:00.902738  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1648) took 1539 ms. Trace:
I20260812 19:23:00.768303  6352 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:23:00.685534 10325 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:00.690004 10409 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.678397 10576 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:00.692471 10179 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:00.791078 10411 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.969511 10179 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:00.795996 10655 consensus_queue.cc:237] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.798851  9974 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:00.783957 10688 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260812 19:23:00.785995 10677 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:00.692725 10660 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.808143  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:00.814404  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:01.022018  6464 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.007s	sys 0.026s
I20260812 19:23:00.830420 10639 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:00.840041  6477 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2.
W20260812 19:23:01.030993  6464 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.008s	sys 0.026s
I20260812 19:23:01.031579  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:00.873551  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:00.885598  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:01.032922  6473 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:00.889365  6344 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:00.898172 10546 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:23:00.901343  6179 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:00.772218  6474 raft_consensus.cc:2379] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:00.683070 10617 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:00.903223 10120 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:00.903678 10709 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:01.038973  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:23:01.049371  6228 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.014s	sys 0.026s
W20260812 19:23:01.049698  6228 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.014s	sys 0.026s
W20260812 19:23:00.903605  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 122788us
I20260812 19:23:00.904155 10492 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:23:00.906347 10662 log.cc:924] Time spent T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.615s	user 0.001s	sys 0.009s
I20260812 19:23:00.926239  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:01.059156  6236 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:00.916218  6238 rpcz_store.cc:276] 0812 19:22:59.376416 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:59.376732 (+   316us) service_pool.cc:227] Handling call
0812 19:22:59.377229 (+   497us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:22:59.699592 (+322363us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:59.699621 (+    29us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:22:59.732192 (+ 32571us) log.cc:842] Serialized 52 byte log entry
0812 19:23:00.028715 (+296523us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:23:00.028771 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:00.900745 (+871974us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b54000f50d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:00.900789 (+    44us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:00.900837 (+    48us) raft_consensus.cc:1671] finished
0812 19:23:00.900850 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:00.902667 (+  1817us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":207467,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":92620672,"thread_start_us":514295,"threads_started":2,"wal-append.queue_time_us":390609}
I20260812 19:23:01.060133  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:01.060298  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:00.938874  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:00.939957  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:00.947009  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:00.948041  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:00.956583 10409 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:00.960621 10325 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:00.964255 10576 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:00.966995  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:00.778287 10287 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:01.072862 10287 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:00.885087 10645 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:01.073058  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1603) took 1649 ms. Trace:
I20260812 19:23:01.073625 10645 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:01.076067 10645 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:01.020516  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:01.077649  6353 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:00.824359 10668 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:01.023039  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:01.024163  6345 raft_consensus.cc:3032] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:01.026966  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:01.081068  6345 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:23:01.081583  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 54744.9us
I20260812 19:23:01.081857  6345 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:01.082578  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:01.042136  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:01.039990  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 138730us
I20260812 19:23:01.055193  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:01.058112  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:01.062836  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:01.065229 10179 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:01.066015 10650 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.333s	user 0.008s	sys 0.013s
I20260812 19:23:01.067303  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:01.068974  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:01.097169  6236 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:01.118018  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:01.113812  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:01.119331  6482 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:01.038112 10556 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:01.097038  6353 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
W20260812 19:23:01.113499  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 50816.6us
I20260812 19:23:01.127803  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:01.051929 10639 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:23:01.073594  6481 rpcz_store.cc:276] 0812 19:22:59.424177 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:59.426386 (+  2209us) service_pool.cc:227] Handling call
0812 19:22:59.427018 (+   632us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:00.696071 (+1269053us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:01.072767 (+376696us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400272754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:01.072986 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2826258816}
I20260812 19:23:01.128034  6236 raft_consensus.cc:2396] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260812 19:23:01.129838  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:01.120563  6474 raft_consensus.cc:2379] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:01.041383 10559 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:23:01.128521  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 446418us
I20260812 19:23:01.131985  6477 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:23:01.133213  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:01.146309  6228 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 4: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:01.131980  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:01.143240  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1608) took 1007 ms. Trace:
I20260812 19:23:01.134953  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:01.085413  6345 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:01.140381  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:01.130983  6481 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:01.142556  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:01.169785  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:01.171202  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:01.148510  6464 rpcz_store.cc:276] 0812 19:23:00.135468 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:00.135633 (+   165us) service_pool.cc:227] Handling call
0812 19:23:00.163254 (+ 27621us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:00.163474 (+   220us) raft_consensus.cc:1520] Early marking committed up to index 3
0812 19:23:00.238669 (+ 75195us) log.cc:842] Serialized 14 byte log entry
0812 19:23:01.141918 (+903249us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:01.142956 (+  1038us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:01.143006 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:01.143076 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:01.143183 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16692,"prepare.queue_time_us":107258,"prepare.run_cpu_time_us":148,"prepare.run_wall_time_us":941,"raft.queue_time_us":33520,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":960721,"threads_started":3}
I20260812 19:23:01.175352  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:01.176014  6236 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 7
I20260812 19:23:01.176137  6483 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:01.177670  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:01.178316  6353 raft_consensus.cc:2379] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:01.185325 10156 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:01.185689 10660 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:01.125783 10668 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:01.186014 10559 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:01.186575 10668 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:01.187011 10668 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:01.188357 10559 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:01.126379 10179 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:01.042928 10677 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:01.190925 10325 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election won for term 6
W20260812 19:23:01.191145  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 46920.3us
I20260812 19:23:01.190927  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:01.192865  6464 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:01.195163  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:01.215421  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:01.216295  6474 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:01.212206  6236 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:23:01.048344 10709 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:23:01.220954  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 50564us
I20260812 19:23:01.116648 10409 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:01.221910  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:01.134887 10587 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:01.085546 10120 consensus_queue.cc:1046] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260812 19:23:01.220148  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:01.230909  6483 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:01.084683 10492 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:01.147814 10639 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:01.143339 10556 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:01.259641  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:01.325498  6242 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 5
W20260812 19:23:01.249274  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 71723.4us
I20260812 19:23:01.327165  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:01.236034  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1593) took 1099 ms. Trace:
I20260812 19:23:01.328472  6230 rpcz_store.cc:276] 0812 19:23:00.136420 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:00.162497 (+ 26077us) service_pool.cc:227] Handling call
0812 19:23:00.162856 (+   359us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:00.736194 (+573338us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:01.235796 (+499602us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b540013ef54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:01.235976 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1317345664}
I20260812 19:23:01.329653  6353 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:01.272925  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1329) took 1276 ms. Trace:
I20260812 19:23:01.233521  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:01.223207 10585 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:23:01.174187 10641 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:01.295727  6473 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:23:01.266211  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:01.243266  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:01.348397  6236 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:01.264714  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:01.235240  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:01.229460  6477 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:23:01.349609  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 114444us
I20260812 19:23:01.263164  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:01.353250  6483 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
W20260812 19:23:01.319942  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 92985.6us
I20260812 19:23:01.178013 10576 raft_consensus.cc:2741] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260812 19:23:01.247017  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:01.234176  7552 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.010s	sys 0.023s
I20260812 19:23:01.254508  6470 pending_rounds.cc:76] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 1
I20260812 19:23:01.371681  6470 pending_rounds.cc:97] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260812 19:23:01.335474  6482 raft_consensus.cc:2396] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260812 19:23:01.355249  6483 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:01.360460  6236 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:01.360591  6473 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:01.372359  6470 raft_consensus.cc:2866] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:01.233683 10156 raft_consensus.cc:686] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:01.319351  9974 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:01.373816  6473 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 19:23:01.249300 10660 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:01.250252 10620 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:23:01.235291  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1604) took 1810 ms. Trace:
I20260812 19:23:01.359997  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:01.261469 10708 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:01.231600 10709 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:01.369740  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:01.394805  6344 raft_consensus.cc:2396] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260812 19:23:01.234030 10179 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:01.291620  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:01.249423 10325 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:01.376917  6482 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260812 19:23:01.280501 10677 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:01.378762  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:01.379423  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 295715us
I20260812 19:23:01.407094  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:01.330607  6465 rpcz_store.cc:276] 0812 19:22:59.997041 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:59.997231 (+   190us) service_pool.cc:227] Handling call
0812 19:23:00.021819 (+ 24588us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:00.022252 (+   433us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:00.022312 (+    60us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:00.035333 (+ 13021us) log.cc:842] Serialized 26 byte log entry
0812 19:23:00.168639 (+133306us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:01.272019 (+1103380us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b1800434980. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f4859155 00007f98fb14d167 00007f98f7782807 00007f98f7791f0f
0812 19:23:01.272209 (+   190us) log.cc:842] Serialized 14 byte log entry
0812 19:23:01.272434 (+   225us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:01.272524 (+    90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:01.272580 (+    56us) raft_consensus.cc:1671] finished
0812 19:23:01.272700 (+   120us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:01.272856 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":187906,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":391,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":11049,"spinlock_wait_cycles":5561216,"thread_start_us":253413,"threads_started":2,"wal-append.queue_time_us":302708}
W20260812 19:23:01.380690  7552 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.190s	user 0.010s	sys 0.030s
I20260812 19:23:01.386992  6464 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:01.386741  9974 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:01.396489 10660 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:01.414088 10639 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:01.415189 10556 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:01.409621  6474 consensus_queue.cc:237] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:23:01.415755  9974 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:01.415413 10660 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:01.391969  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:01.391542 10576 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:01.352926 10559 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:23:01.352166 10641 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:01.359979 10712 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:01.362151 10120 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:01.390035  6475 rpcz_store.cc:276] 0812 19:22:59.424955 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:59.427278 (+  2323us) service_pool.cc:227] Handling call
0812 19:22:59.427845 (+   567us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:22:59.495333 (+ 67488us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:22:59.495378 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:22:59.513761 (+ 18383us) log.cc:842] Serialized 26 byte log entry
0812 19:22:59.847370 (+333609us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:22:59.847410 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:22:59.847485 (+    75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:00.905781 (+1058296us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:01.235004 (+329223us) raft_consensus.cc:1671] finished
0812 19:23:01.235025 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:01.235232 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":38910,"raft.queue_time_us":76567,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7696,"spinlock_wait_cycles":38019968,"thread_start_us":288320,"threads_started":1,"wal-append.queue_time_us":614667}
I20260812 19:23:01.412801 10585 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:01.279023 10409 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:01.239358 10587 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:01.271842 10617 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:01.398113 10232 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260812 19:23:01.386065  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:01.465226  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 79243.6us
I20260812 19:23:01.469944  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:01.257383 10658 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:01.428561 10325 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:01.429524 10576 raft_consensus.cc:686] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:01.414234 10156 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:01.430696 10732 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:01.445698  6242 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:01.452601  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:01.389947 10620 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:01.455927 10641 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:01.498875 10641 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:01.457129 10585 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:01.462121  6345 raft_consensus.cc:1261] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260812 19:23:01.470497  6350 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:23:01.511209  6350 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:01.397650 10708 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:01.450377 10265 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:01.520864 10265 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:01.476603  6353 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:01.464787 10120 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:01.539880 10433 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260812 19:23:01.502184 10635 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.080s
I20260812 19:23:01.475816 10677 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:01.770905 10677 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:01.771325 10677 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:01.497370 10179 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:01.771904 10179 raft_consensus.cc:686] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:01.772852 10179 consensus_queue.cc:237] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:01.465075 10712 raft_consensus.cc:686] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:01.775434 10712 consensus_queue.cc:237] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:01.515215  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:01.779197  6345 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:01.495270  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:01.760852 10708 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:01.766793  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:01.767606  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 440525us
I20260812 19:23:01.709190  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 193) took 1519 ms. Trace:
I20260812 19:23:01.670295  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:01.757606  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 277587us
I20260812 19:23:01.767284 10492 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:01.664016 10709 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:01.797537  6349 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:01.795820  6241 rpcz_store.cc:276] 0812 19:23:00.189773 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:01.273430 (+1083657us) service_pool.cc:227] Handling call
0812 19:23:01.273916 (+   486us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:01.274165 (+   249us) raft_consensus.cc:1520] Early marking committed up to index 7
0812 19:23:01.274450 (+   285us) log.cc:842] Serialized 14 byte log entry
0812 19:23:01.708720 (+434270us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:01.708802 (+    82us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:01.708868 (+    66us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:01.708955 (+    87us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:01.709113 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":436,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":66699,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":1595,"thread_start_us":433862,"threads_started":2}
I20260812 19:23:01.821049 10585 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:01.714251 10265 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:01.839314  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1615) took 1555 ms. Trace:
W20260812 19:23:01.840448  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 349851us
I20260812 19:23:01.840346  6481 rpcz_store.cc:276] 0812 19:23:00.284344 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:01.221057 (+936713us) service_pool.cc:227] Handling call
0812 19:23:01.324030 (+102973us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:01.324249 (+   219us) raft_consensus.cc:1520] Early marking committed up to index 3
0812 19:23:01.357796 (+ 33547us) log.cc:842] Serialized 14 byte log entry
0812 19:23:01.794540 (+436744us) log.cc:842] Serialized 14 byte log entry
0812 19:23:01.838750 (+ 44210us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:01.838823 (+    73us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:01.838892 (+    69us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:01.838971 (+    79us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:01.839246 (+   275us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":136019,"prepare.queue_time_us":57805,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"thread_start_us":298893,"threads_started":1}
I20260812 19:23:01.841550  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:01.647933 10576 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:01.853977 10577 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:01.846997 10655 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 19:23:01.863336  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 67338.9us
I20260812 19:23:01.870040  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:01.870428 10738 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:01.848299 10409 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:01.855086 10587 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:01.901134  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:01.895676 10709 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:01.898862 10120 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:02.000851 10325 consensus_queue.cc:1046] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260812 19:23:01.933632 10646 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:23:01.901468 10738 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:02.047515 10668 consensus_meta.cc:287] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.860s	user 0.014s	sys 0.002s
I20260812 19:23:01.973243 10744 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:02.050464 10622 raft_consensus.cc:3032] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:02.051030 10622 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:23:02.051407 10755 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260812 19:23:02.051945 10622 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.053117 10622 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:02.055347  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1654) took 1140 ms. Trace:
I20260812 19:23:02.056998  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1401) took 1647 ms. Trace:
I20260812 19:23:02.057389  6352 rpcz_store.cc:276] 0812 19:23:00.409665 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:00.445077 (+ 35412us) service_pool.cc:227] Handling call
0812 19:23:02.056788 (+1611711us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b5400407ed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:02.056910 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":109357952}
I20260812 19:23:02.058688  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:02.060083  6352 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: []
W20260812 19:23:02.063414 10749 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260812 19:23:02.072711  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 138583us
I20260812 19:23:02.076982  6238 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260812 19:23:02.078771  6242 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260812 19:23:02.081140  6224 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:53178
I20260812 19:23:02.081696  6224 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:23:02.082034  6224 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:02.083310  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.083819  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.084672  6238 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:02.088001  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.088186  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:02.088406 10758 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260812 19:23:02.088795  6230 raft_consensus.cc:2379] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:02.084138  6236 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:02.082110  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:02.087060  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.096580  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:02.101276  6522 heartbeater.cc:644] Failed to heartbeat to 127.3.253.62:46555 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.3.253.62:46555 timed out after 15.000s (SENT)
I20260812 19:23:02.107125  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.107985  6475 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:02.055769  6232 rpcz_store.cc:276] 0812 19:23:00.915114 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:00.915272 (+   158us) service_pool.cc:227] Handling call
0812 19:23:00.915697 (+   425us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:01.076774 (+161077us) raft_consensus.cc:1520] Early marking committed up to index 3
0812 19:23:01.077049 (+   275us) log.cc:842] Serialized 14 byte log entry
0812 19:23:01.359698 (+282649us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:01.359751 (+    53us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:01.359792 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:02.055065 (+695273us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54000f4bd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:02.055116 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:02.055263 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23406,"prepare.queue_time_us":3262,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":51983,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":10259,"spinlock_wait_cycles":369764224,"thread_start_us":245845,"threads_started":1,"wal-append.queue_time_us":369876}
I20260812 19:23:02.117364 10318 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:02.140311 10318 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:02.140726 10318 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:02.135588  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:02.143767 10768 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260812 19:23:02.035274 10492 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260812 19:23:02.144162  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.144224  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.150424  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.149935  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.144711  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.138068  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 254) took 1414 ms. Trace:
I20260812 19:23:02.136442  6477 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:23:02.134337  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1349) took 1307 ms. Trace:
I20260812 19:23:02.152787  6483 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:02.152761  6359 rpcz_store.cc:276] 0812 19:23:00.724144 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:00.724257 (+   113us) service_pool.cc:227] Handling call
0812 19:23:00.760698 (+ 36441us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:00.961362 (+200664us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:00.961409 (+    47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:00.961473 (+    64us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:00.961524 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:02.137852 (+1176328us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54004119d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:02.137897 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:02.138011 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":460827008}
I20260812 19:23:02.154058  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.154832  6483 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:23:02.155735  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.156499  6483 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:02.159125  6477 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260812 19:23:02.159480  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.162500  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.158418  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:02.149577  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.072499 10677 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.164170  6229 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:23:02.071419 10744 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:02.166527  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:02.168011  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.169616  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:02.170264  6474 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:02.171716  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.172962  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.173589  6481 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:02.174876  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.175658  7606 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:02.175617  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.153203  6470 rpcz_store.cc:276] 0812 19:23:00.827305 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:01.253774 (+426469us) service_pool.cc:227] Handling call
0812 19:23:01.254247 (+   473us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:01.383619 (+129372us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:01.383661 (+    42us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:01.395736 (+ 12075us) log.cc:842] Serialized 52 byte log entry
0812 19:23:01.647331 (+251595us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:01.695976 (+ 48645us) log.cc:842] Serialized 14 byte log entry
0812 19:23:01.892432 (+196456us) log.cc:842] Serialized 14 byte log entry
0812 19:23:01.898286 (+  5854us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:01.898469 (+   183us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:02.134105 (+235636us) raft_consensus.cc:1671] finished
0812 19:23:02.134125 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:02.134274 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":232428,"prepare.queue_time_us":226949,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":89,"raft.queue_time_us":207616,"raft.run_cpu_time_us":394,"raft.run_wall_time_us":10296,"thread_start_us":259838,"threads_started":2,"wal-append.queue_time_us":479030}
I20260812 19:23:02.182869  6359 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:02.184281  6242 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:02.184903  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.192338  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:02.109572  6473 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:02.169690 10744 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:02.169166 10385 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:02.203403 10385 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.206215 10385 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:02.208197 10677 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:02.194330  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:02.080906 10668 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.212522 10325 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:02.213253 10738 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:02.217002  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:02.218186  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:02.174818 10660 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:02.219343  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:02.266031  6353 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:02.220894 10631 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:02.232474  6060 catalog_manager.cc:5495] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 2 to 4, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 4 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:23:02.235220 10743 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.092s	user 0.000s	sys 0.002s
W20260812 19:23:02.238711 10641 consensus_meta.cc:287] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.739s	user 0.013s	sys 0.000s
I20260812 19:23:02.213325  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:02.272372  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 59134.5us
I20260812 19:23:02.273438  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:02.241421  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:02.249540  6350 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.271842  6224 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.274528  6344 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
W20260812 19:23:02.262706  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 421214us
I20260812 19:23:02.278362  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:02.267146  6345 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 19:23:02.281263  6350 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:02.282248  6474 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:23:02.288460  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:02.292335  6354 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:02.293241  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:02.292375  6224 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:02.295485  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:02.395313  6224 raft_consensus.cc:3032] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:02.336758  6354 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:02.298099  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:02.395561  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 100391us
I20260812 19:23:02.317606  6345 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:02.311555  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:02.346817  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.407933  6224 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:02.296252  6350 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:23:02.331180  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:02.414645  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 116708us
I20260812 19:23:02.414837  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:02.415848  6470 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 7
I20260812 19:23:02.413164  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:02.417814  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:02.400079 10617 raft_consensus.cc:3032] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:02.422298  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.422921  6483 raft_consensus.cc:2354] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7.
I20260812 19:23:02.274274 10576 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:02.410357  6465 raft_consensus.cc:2362] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4. Re-sending same reply.
W20260812 19:23:02.339347 10658 consensus_meta.cc:287] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.856s	user 0.011s	sys 0.002s
I20260812 19:23:02.270473 10492 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:02.413105  6224 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:02.431510  6224 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:02.418555  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:02.311626 10411 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:02.298540 10677 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:02.270754 10385 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:02.435449  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:02.291779 10433 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:02.297518  9974 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:02.424639 10577 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:02.311750 10438 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:02.438807  6483 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:23:02.393537 10784 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:02.270674 10325 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.439733  6473 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260812 19:23:02.442466  6474 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:23:02.467401  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.420723 10298 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:02.428790  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:02.298825 10645 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.134s
I20260812 19:23:02.421686 10617 raft_consensus.cc:729] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:02.426605 10709 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:02.468286  6483 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 3.
I20260812 19:23:02.434861 10639 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:02.445145 10656 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:02.479112  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:02.434625 10677 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:02.515472 10677 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:02.435138 10411 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:02.296923 10660 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:02.471830  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:02.479718 10784 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:02.504158 10787 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260812 19:23:02.445142  9974 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:02.541071  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:02.542073  6465 raft_consensus.cc:2396] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260812 19:23:02.504884 10785 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260812 19:23:02.505796 10325 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:02.506157 10668 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:02.510883  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:02.510854 10656 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:23:02.511263 10646 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:23:02.512513  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:02.531054 10411 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:02.536291 10665 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:02.462805 10658 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 19:23:02.537791  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 95727.6us
I20260812 19:23:02.459507 10576 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260812 19:23:02.545336  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.435889 10492 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.552699  6344 raft_consensus.cc:2396] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 7 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:23:02.514680  6345 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:02.459467 10385 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:02.466470 10678 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.073s
I20260812 19:23:02.564324  9969 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:02.574437  7606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 331) took 1161 ms. Trace:
I20260812 19:23:02.555985  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:02.575014  7606 rpcz_store.cc:276] 0812 19:23:01.413255 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:01.413488 (+   233us) service_pool.cc:227] Handling call
0812 19:23:01.440519 (+ 27031us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:02.178350 (+737831us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:02.574077 (+395727us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b54002e95d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:02.574325 (+   248us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1690209152}
I20260812 19:23:02.575922  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:02.577064  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:02.543818  9974 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:02.578531 10746 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:02.566639  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1640) took 1304 ms. Trace:
I20260812 19:23:02.584447  6354 rpcz_store.cc:276] 0812 19:23:01.261876 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:01.264445 (+  2569us) service_pool.cc:227] Handling call
0812 19:23:02.566463 (+1302018us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b54001ce3d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:02.566581 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2168448256}
I20260812 19:23:02.571025  6347 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260812 19:23:02.571547  6359 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:02.574214  9969 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:02.577924  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:02.578606  6060 catalog_manager.cc:5495] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:02.520525 10639 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.469693 10744 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.556738  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.582522 10746 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:02.595062  6475 raft_consensus.cc:2379] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:02.595213  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:02.598093  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.598909  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:02.599522  6474 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:02.600447  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.601183  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.593308  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:02.603744 10668 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:23:02.603971  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:02.604689  6473 raft_consensus.cc:2362] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 2. Re-sending same reply.
W20260812 19:23:02.605116 10786 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260812 19:23:02.605334  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:02.606633  6350 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260812 19:23:02.606431 10433 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:23:02.607508 10587 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:23:02.609010  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:02.607607  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:02.609745  6481 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:02.610108 10325 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:02.611593  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:02.612588 10325 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:02.613045 10325 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:02.613478 10325 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:02.604223 10668 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:02.615331 10668 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:23:02.617581  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:02.619212  6464 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260812 19:23:02.622814 10120 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:23:02.555847 10617 consensus_queue.cc:260] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.631124  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:02.587172 10795 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:02.632200 10795 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:02.632259  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:02.632611 10795 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:02.632874  6359 raft_consensus.cc:3032] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:02.633177  6359 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:02.605544  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:02.635078  6473 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:02.644862  6464 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260812 19:23:02.647761  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:02.649155  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:02.651386  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:02.583901 10708 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:02.664110  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.652235  6473 raft_consensus.cc:2354] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7.
I20260812 19:23:02.665678  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.633891  6359 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.666757  6359 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:02.557710 10665 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:02.655824  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.656829  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:02.629160 10587 consensus_queue.cc:1046] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260812 19:23:02.659435 10776 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:02.659667  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.660732  6354 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:23:02.678787  6241 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:02.682456  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:02.566449 10318 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.684032  6236 raft_consensus.cc:2354] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7.
I20260812 19:23:02.684453  6060 catalog_manager.cc:5495] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:02.654527  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:02.664773  6465 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:23:02.595770 10746 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:02.651896 10781 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:02.669677 10645 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:23:02.689771  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.668658  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:02.690951 10660 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:02.680981 10232 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:02.686915  6224 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:02.726222 10232 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.729671 10784 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:02.731673 10744 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:02.692643 10781 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:02.733440 10781 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:02.669379 10641 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260812 19:23:02.771013  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 272917us
W20260812 19:23:02.782761  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 115100us
W20260812 19:23:02.801712  6417 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e0797ad50cb46cfb10b4a38cc815917. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:23:02.801697  6465 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260812 19:23:02.693791  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:02.694695  7606 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:23:02.812143  6354 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260812 19:23:02.698254 10792 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260812 19:23:02.705437  6060 catalog_manager.cc:5495] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 2 to 3, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:02.711150  6482 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:02.696019  6236 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:23:02.816812  6359 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:02.818384  6481 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
W20260812 19:23:02.812582  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 124404us
I20260812 19:23:02.819671  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:02.821211  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:02.822142  6470 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:02.822444  6224 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260812 19:23:02.822558  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:02.822984  6474 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:02.824563 10585 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:02.816984  6298 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:02.792268 10635 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:02.829783  6060 catalog_manager.cc:5495] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:02.816201 10732 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:23:02.840783  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 57034.8us
I20260812 19:23:02.836496  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.837196  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.842778  6232 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:02.835512  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.842834  6236 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:02.843536  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:02.850445  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:02.814134 10433 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:02.851863  6228 raft_consensus.cc:1261] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260812 19:23:02.833796 10678 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:02.825992 10179 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:02.825661 10656 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:02.831030 10776 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:02.832357 10645 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:02.833796 10622 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:02.855206  6060 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260812 19:23:02.891734  6058 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 231) took 15702 ms (client timeout 15000 ms). Trace:
I20260812 19:23:02.892468 10776 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:02.892088  6060 catalog_manager.cc:5495] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:02.892992 10776 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.893577 10298 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:02.856585  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1408) took 1386 ms. Trace:
I20260812 19:23:02.894853 10639 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:02.895187 10776 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:02.847774 10684 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:02.850495  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.901455  6475 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260812 19:23:02.851863  6235 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260812 19:23:02.872118 10709 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:02.832121 10784 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:02.875571  6236 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260812 19:23:02.875500  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.876803  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:02.879025  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:02.879417  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:02.910028  6465 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:02.914040  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:02.915879  6236 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260812 19:23:02.914856  6354 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:23:02.894891  6352 rpcz_store.cc:276] 0812 19:23:01.470298 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:02.060757 (+590459us) service_pool.cc:227] Handling call
0812 19:23:02.061064 (+   307us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:02.169019 (+107955us) raft_consensus.cc:1520] Early marking committed up to index 3
0812 19:23:02.342808 (+173789us) log.cc:842] Serialized 14 byte log entry
0812 19:23:02.473323 (+130515us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:02.473809 (+   486us) log.cc:842] Serialized 26 byte log entry
0812 19:23:02.473938 (+   129us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:02.473969 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:02.474041 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:02.856379 (+382338us) raft_consensus.cc:1671] finished
0812 19:23:02.856399 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:02.856528 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":109308,"prepare.queue_time_us":275790,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":112314,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":15721,"spinlock_wait_cycles":24271104,"thread_start_us":229924,"threads_started":2,"wal-append.queue_time_us":161358}
I20260812 19:23:02.880043  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:02.881057 10761 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:02.886498 10795 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.886994 10492 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:02.834216 10744 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:02.879216 10678 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.876499 10433 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.890880 10656 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:02.889778  6228 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:23:02.952859  6347 raft_consensus.cc:2354] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7.
I20260812 19:23:02.953329 10801 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:02.908700 10684 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.933213 10784 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:02.955307 10684 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:02.954993 10784 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.930629 10223 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260812 19:23:02.956141 10433 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:02.947069  9969 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:02.933954  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:02.934399 10318 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:02.922930 10287 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260812 19:23:02.952960 10776 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:02.860441 10665 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:02.954630 10781 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.960182 10776 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:02.903180  6470 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:23:02.960747  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:02.960717 10776 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:02.961550  6238 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:23:02.874490 10585 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:23:02.895895 10325 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.964205 10656 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:02.964493 10776 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:02.894276 10298 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.004s
W20260812 19:23:02.927270  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 48336us
I20260812 19:23:02.942099 10761 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:02.965570 10656 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:02.965587  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:02.966316 10656 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:02.887867 10438 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260812 19:23:02.967018 10678 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:02.967080  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:02.904943 10622 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:02.968703 10761 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:02.969013 10622 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:02.945590 10668 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.964670  6230 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:02.946372 10677 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.887624 10646 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260812 19:23:02.968158 10656 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.969583 10622 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:02.971122 10668 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:02.971297  6242 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:02.971472 10622 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:02.971686 10668 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:02.971966 10622 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:02.972210  6483 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:02.972383 10622 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:02.971138 10646 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:02.960824  6232 pending_rounds.cc:76] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 7
I20260812 19:23:02.973342 10646 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:02.948182 10645 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.974200 10646 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:02.975483 10646 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:02.973484  6232 pending_rounds.cc:97] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260812 19:23:02.964571 10325 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:02.976545  6232 raft_consensus.cc:2866] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:23:02.925776  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 45821.1us
I20260812 19:23:02.894151  6060 catalog_manager.cc:5495] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 4 to 5, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 5 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:02.958703  6465 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:02.978513  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:02.979056  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:02.979349  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46895.2us
W20260812 19:23:02.892151  6058 rpcz_store.cc:269] 0812 19:22:47.092968 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:47.093227 (+   259us) service_pool.cc:227] Handling call
0812 19:23:02.784221 (+15690994us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:22:54.228857 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:22:54.448108 (+219251us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:22:54.448150 (+    42us) write_op.cc:435] Acquired schema lock
0812 19:22:54.448162 (+    12us) tablet.cc:660] Decoding operations
0812 19:22:54.487502 (+ 39340us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:22:54.509824 (+ 22322us) write_op.cc:641] Partition lock acquired for write op
0812 19:22:54.516027 (+  6203us) tablet.cc:683] Acquiring locks for 8 operations
0812 19:22:54.679675 (+163648us) tablet.cc:699] Row locks acquired
0812 19:22:54.679694 (+    19us) write_op.cc:260] PREPARE: finished
0812 19:22:54.698563 (+ 18869us) write_op.cc:270] Start()
0812 19:22:54.725131 (+ 26568us) write_op.cc:276] Timestamp: P: 1786562574692532 usec, L: 0
0812 19:22:54.725152 (+    21us) op_driver.cc:331] REPLICATION: starting
0812 19:22:54.875547 (+150395us) log.cc:842] Serialized 3210 byte log entry
0812 19:22:55.517272 (+641725us) op_driver.cc:444] REPLICATION: finished
0812 19:22:56.037257 (+519985us) write_op.cc:301] APPLY: starting
0812 19:22:56.045168 (+  7911us) tablet.cc:1365] starting BulkCheckPresence
0812 19:22:56.082743 (+ 37575us) tablet.cc:1368] finished BulkCheckPresence
0812 19:22:56.094162 (+ 11419us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:22:56.149379 (+ 55217us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:22:56.149847 (+   468us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0812 19:22:56.149992 (+   145us) write_op.cc:312] APPLY: finished
0812 19:22:56.153122 (+  3130us) log.cc:842] Serialized 65 byte log entry
0812 19:22:56.198232 (+ 45110us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:56.252618 (+ 54386us) write_op.cc:454] Released schema lock
0812 19:22:56.264267 (+ 11649us) write_op.cc:341] FINISH: Updating metrics
0812 19:22:56.273893 (+  9626us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:22:56.279974 (+  6081us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87740,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":501351,"apply.run_cpu_time_us":22552,"apply.run_wall_time_us":266352,"num_ops":8,"prepare.queue_time_us":221231,"prepare.run_cpu_time_us":55662,"prepare.run_wall_time_us":873738,"raft.queue_time_us":220045,"raft.run_cpu_time_us":72721,"raft.run_wall_time_us":408617,"replication_time_us":783603,"thread_start_us":909803,"threads_started":4,"wal-append.queue_time_us":267676,"wal-append.run_cpu_time_us":71979,"wal-append.run_wall_time_us":2164993}]]}
W20260812 19:23:02.980615  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 92316.3us
I20260812 19:23:02.982916  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:02.905547 10385 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:02.981923  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:02.985453  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:02.983565  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:02.987251  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:02.998531  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:02.999662  6297 leader_election.cc:398] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7.
I20260812 19:23:03.000221  6297 leader_election.cc:401] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260812 19:23:03.001394  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:02.890038 10641 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260812 19:23:02.952419 10795 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:03.013149  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:02.986806 10585 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:02.994428 10744 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:23:03.012073  6060 catalog_manager.cc:5495] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 4, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 4 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:03.018146  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:02.995086 10325 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:03.025935  6470 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:23:03.006788 10576 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:03.033973 10438 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:03.037703 10576 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:03.038136 10576 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:03.038965 10781 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:02.952826 10411 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:03.042872  6224 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:03.034184  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:03.007592 10120 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7.
I20260812 19:23:02.972225 10668 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:03.014952 10560 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:03.048947  6060 catalog_manager.cc:5495] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 3 to 4, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 4 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:02.993247  9974 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:03.017740  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:03.053274 10585 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:03.031425 10784 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:03.034544 10795 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:03.075587  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:03.073391 10684 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:03.023730 10620 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:03.082237 10684 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:03.079715 10795 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:03.084023 10795 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:03.047686 10325 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:03.084489 10684 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:03.081453 10703 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260812 19:23:03.097826  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 62973.8us
I20260812 19:23:03.099510  6060 catalog_manager.cc:5495] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 4 to 5, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 5 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:23:03.128240  6060 catalog_manager.cc:5495] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 4, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 4 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:03.017331 10761 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260812 19:23:03.054509 10732 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:03.087200 10677 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:03.087605 10411 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:03.085906 10325 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:03.088912 10746 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:03.090101 10798 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260812 19:23:03.058264 10560 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:03.054157 10438 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:03.103832 10585 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:03.130898  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:03.139701 10668 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:03.141189  9974 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:03.141806 10622 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:03.086141 10703 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:03.148805  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:03.149103  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:03.158880  6350 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:03.151726  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:03.160830  6344 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:03.151679  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:03.152613  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:03.160102  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:03.163764  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:03.164078  6350 raft_consensus.cc:2396] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260812 19:23:03.165076  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:03.165829  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:03.168586  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:03.169832 10746 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:03.169853  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:03.149765 10560 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:03.170939  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:03.171582  6342 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:03.173470  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:03.174288 10411 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:03.174682  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:03.178952  6359 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:03.187310  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:03.191901  6350 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:03.199229  6060 catalog_manager.cc:5495] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:03.177111 10677 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260812 19:23:03.205614  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 204315us
I20260812 19:23:03.250135  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:03.251106  6236 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:03.254019  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:03.262341  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 47124.4us
W20260812 19:23:03.263229  6178 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.557s (SENT)
I20260812 19:23:03.263726  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:03.174691 10411 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:03.266906  6178 leader_election.cc:334] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.559s (SENT)
I20260812 19:23:03.265832  6060 catalog_manager.cc:5495] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 2, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 2 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:23:03.267549  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:03.269032  6060 catalog_manager.cc:5495] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 2, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:03.271353  6060 catalog_manager.cc:5495] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 2 to 3, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:03.273564  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:03.181733 10703 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:03.208063  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:03.178022 10732 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:03.153002 10767 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260812 19:23:03.281234  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:03.204547 10645 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:03.204490 10806 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:03.283339  6352 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:03.285094 10807 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260812 19:23:03.285983 10709 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:03.291695 10576 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:03.298074 10438 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:03.299386  6178 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.564s (SENT)
I20260812 19:23:03.355077  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:03.356309  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 56979.8us
W20260812 19:23:03.357148  6178 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.648s (SENT)
I20260812 19:23:03.357650  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:03.299571 10617 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:03.300115 10646 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:23:03.300705 10678 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:03.243486 10776 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260812 19:23:03.302845 10622 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:03.303035 10620 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:03.207872 10738 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:03.185792 10784 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:03.309564  6060 catalog_manager.cc:5495] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 5, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 5 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:03.339149 10577 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260812 19:23:03.314375  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:03.396039  6236 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:03.315124  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:03.397322  6354 raft_consensus.cc:2354] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7.
I20260812 19:23:03.319259  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:03.321875  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:03.328032  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:03.336732  6347 raft_consensus.cc:1261] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:23:03.209687 10677 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:03.273277 10411 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:03.364102 10265 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:03.349377  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:03.350773  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:03.300715 10656 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:03.336818 10732 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:03.359634  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:03.347625 10645 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:23:03.366211  6178 leader_election.cc:334] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.760s (SENT)
I20260812 19:23:03.371316  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:03.327143 10560 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:03.355237 10709 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:03.384415  6060 catalog_manager.cc:5495] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 2 to 3, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:23:03.311929  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 105187us
I20260812 19:23:03.360544 10808 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:03.454209  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:03.348626  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:03.468341  6235 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
W20260812 19:23:03.405093  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55848.3us
I20260812 19:23:03.409348  6230 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
W20260812 19:23:03.415176  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 49016.1us
I20260812 19:23:03.469874  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:23:03.470111  6178 leader_election.cc:334] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.770s (SENT)
I20260812 19:23:03.470752  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:03.415170  6352 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:03.353673 10806 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:03.383599 10784 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:03.412264 10732 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:03.433245 10645 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:03.440375 10576 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:03.442528 10819 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260812 19:23:03.432706  6474 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "04c512eaceae43d2a378065361eb4854"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:23:03.508880  6474 raft_consensus.cc:595] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:03.509510  6474 raft_consensus.cc:603] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260812 19:23:03.509791  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 43738.8us
I20260812 19:23:03.403890  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:03.472136  6416 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:03.511586 10385 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:03.410175 10738 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 19:23:03.484753  6178 leader_election.cc:334] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.775s (SENT)
I20260812 19:23:03.406909 10677 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:03.498718  6297 leader_election.cc:398] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7.
I20260812 19:23:03.500649 10560 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:03.500772 10806 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:03.484097 10807 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:03.502818 10808 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:03.483440 10622 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:03.492865 10784 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:03.517452  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:03.514562  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:03.516350  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:03.531322  6354 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:03.529371  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:03.512013 10385 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:03.545605  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60900.6us
I20260812 19:23:03.547243  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:03.497686 10325 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260812 19:23:03.497110 10744 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260812 19:23:03.574946  6354 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:23:03.582715 10795 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:03.596271 10818 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:23:03.523236 10825 consensus_queue.cc:1046] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260812 19:23:03.538990 10265 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:03.584537  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:03.573962  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:03.595558  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:03.595517 10703 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:03.528014 10806 consensus_queue.cc:1046] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260812 19:23:03.545966 10385 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:03.583702 10826 ts_tablet_manager.cc:927] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:03.536947  9974 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260812 19:23:03.586550 10646 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:03.646275  6349 raft_consensus.cc:595] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Received request to transfer leadership to TS f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:03.662995  6349 raft_consensus.cc:603] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:03.591255 10622 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:03.536990 10668 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260812 19:23:03.670930 10744 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:03.671567 10744 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:03.672580 10744 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:03.675503 10842 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260812 19:23:03.667986 10646 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:03.676123 10646 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:23:03.680928 10839 log.cc:924] Time spent T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260812 19:23:03.646409  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 61988.4us
W20260812 19:23:03.687320  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 175435us
W20260812 19:23:03.688511  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 114645us
I20260812 19:23:03.691036  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:03.691793  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:03.692085  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:03.692500  6228 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:03.692751  6232 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:03.691803  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:03.693668  6482 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:23:03.694556  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:03.694788  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:03.695055  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:03.695605  6464 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:03.695999  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:03.696110  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:03.696415  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:03.696606  6481 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 7
I20260812 19:23:03.697201  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:03.697786  6238 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:03.698635  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:03.699654  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:03.703610  6481 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:03.661100 10680 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:03.707950  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:03.713810  6224 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:03.691738  6477 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:03.709327  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:03.714632  6473 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:03.711779  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:03.716320  6236 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 8
I20260812 19:23:03.717054  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:03.716202  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:03.718158  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:03.718463  6235 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:23:03.718592  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:03.720160  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:03.721616  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:03.722090  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:03.718699  6474 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:03.724679  6230 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:23:03.668018 10795 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:03.729079  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:03.732993  6241 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:03.734781  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:03.738801  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:03.742163 10832 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:03.742782 10832 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:03.743659 10832 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:03.741921  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:03.748492  6230 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:03.748291 10732 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:03.750308 10732 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:03.750839 10658 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:23:03.752058  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:03.754701  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:03.756110  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:03.758344  6481 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260812 19:23:03.761263  6482 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:23:03.759057  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:03.752643  6349 raft_consensus.cc:595] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:03.765995  6464 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:03.766275  6474 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:03.768186  6473 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:03.716809 10703 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:03.769012  9974 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:03.780129 10764 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:03.767720  6236 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:03.771684  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:03.783735  6482 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:03.786878  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 272917us
I20260812 19:23:03.787626  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:03.788897  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:03.721158 10265 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:03.789955  6238 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
W20260812 19:23:03.797169  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 62520.1us
I20260812 19:23:03.731732 10635 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:23:03.798046  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:03.806609  6482 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:03.807498  6241 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:03.763728 10795 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:03.723901 10668 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260812 19:23:03.813153  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:03.813459  6228 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:03.817552 10866 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:03.794014 10587 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:03.829175  6230 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:03.822269  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:03.832471  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:03.806926 10776 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:03.809465 10546 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:03.807880 10635 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:23:03.840373  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 81373.9us
I20260812 19:23:03.818223 10646 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:03.844478  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:03.888302  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1380) took 1307 ms. Trace:
I20260812 19:23:03.899580  6483 rpcz_store.cc:276] 0812 19:23:02.580457 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:02.580752 (+   295us) service_pool.cc:227] Handling call
0812 19:23:02.972040 (+391288us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:02.972663 (+   623us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:03.888029 (+915366us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54001310d0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:03.888222 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":899051904}
I20260812 19:23:03.904958  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:03.906123  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:03.841158 10844 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260812 19:23:03.924345  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 79939.3us
I20260812 19:23:03.925483  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:03.928059 10658 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 19:23:03.931197  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 122502us
I20260812 19:23:03.932097  6416 leader_election.cc:398] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7.
I20260812 19:23:03.836494 10656 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:03.932394  6416 leader_election.cc:401] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:23:03.872746 10325 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:03.847472 10635 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:03.933626  6352 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260812 19:23:03.868026 10546 raft_consensus.cc:686] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:23:03.873693 10855 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260812 19:23:03.954730  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:03.940217  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:03.901130 10232 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:03.915679 10767 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:23:03.838908 10587 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:03.845721 10761 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:04.012806 10318 raft_consensus.cc:3032] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:03.865212 10298 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.147s
I20260812 19:23:03.889967 10411 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:04.012620 10709 consensus_meta.cc:287] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.002s
I20260812 19:23:03.972796  6232 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
W20260812 19:23:04.013952  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 59370.3us
I20260812 19:23:04.012658 10886 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7.
I20260812 19:23:04.068892  6235 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 3.
I20260812 19:23:04.069370 10587 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:04.142956 10587 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:04.069551 10546 consensus_queue.cc:237] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:04.071708 10646 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:04.144215 10680 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 19:23:04.076047 10784 consensus_meta.cc:287] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.000s
I20260812 19:23:04.146281 10784 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.147624  6470 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:04.021549 10807 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 19:23:04.079725 10677 consensus_meta.cc:287] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.002s
I20260812 19:23:04.149823  6224 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:04.161019  6224 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:03.934365 10668 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:04.127900  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:04.081703 10318 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:04.128823 10265 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:23:04.128870 10492 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:23:04.132794  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:04.132306 10709 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.127553 10438 raft_consensus.cc:2741] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
W20260812 19:23:04.079766 10620 consensus_meta.cc:287] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.000s
I20260812 19:23:04.130434 10411 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:04.092788 10385 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:04.190707  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:04.162240  6224 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:04.191854  6224 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:04.143702 10587 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:04.170908  6464 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: [3.2-7.4]
I20260812 19:23:04.171321  6483 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260812 19:23:04.172806  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:04.195713  6473 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:03.934949 10878 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.284s
I20260812 19:23:04.196589  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:04.196981  6228 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:04.197361  6473 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:04.198243  6345 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:04.198877  6178 leader_election.cc:398] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7.
W20260812 19:23:04.154184 10645 consensus_meta.cc:287] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.654s	user 0.011s	sys 0.000s
I20260812 19:23:04.149742 10784 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:04.167418 10678 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:04.181752  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:04.156548 10876 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:04.177417 10886 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:04.153007 10635 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.189828  6359 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:04.141835 10622 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:04.191064  6242 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:23:04.192212  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:04.193475  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:04.194360  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:04.154311 10807 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:04.198819  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:04.198339  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:04.199436  6178 leader_election.cc:401] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260812 19:23:04.200757  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:04.202383  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:04.206338  6465 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:04.207738  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:04.174041 10677 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:04.379079  6241 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:04.381443  6473 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:04.191640  9974 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:04.191478 10680 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:04.316519 10668 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:04.317705  6353 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:04.395645  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:04.211899  6235 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260812 19:23:04.318740  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:04.403951  6464 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:23:04.404305  6483 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:04.401610  6229 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:23:04.406068  6464 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260812 19:23:04.387465  6228 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:23:04.396602  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 197843us
I20260812 19:23:04.396180  6347 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:04.418493  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:04.394851  6473 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:04.312565 10678 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.428876 10678 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:04.210891 10318 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:23:04.431972 10318 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:04.432873  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 240) took 1014 ms. Trace:
I20260812 19:23:04.433305  6475 rpcz_store.cc:276] 0812 19:23:03.417961 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:03.418087 (+   126us) service_pool.cc:227] Handling call
0812 19:23:03.419083 (+   996us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:03.525573 (+106490us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:03.525610 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:03.525661 (+    51us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:03.525709 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:04.432610 (+906901us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540044ff54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:04.432679 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:04.432808 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":244341120}
I20260812 19:23:04.433990 10709 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:04.407207  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 199563us
I20260812 19:23:04.445549  6483 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:04.447594 10678 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:04.446025  6241 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:04.459120  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:04.207417 10645 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.409400 10298 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7.
I20260812 19:23:04.461549  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:04.210371 10646 consensus_queue.cc:1046] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.236s
I20260812 19:23:04.441632 10492 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:04.410799 10680 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.401611  9974 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.395727 10807 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.315522 10876 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.496618 10776 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:04.466252 10886 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:04.464643 10806 consensus_queue.cc:1046] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260812 19:23:04.462523 10761 consensus_queue.cc:1046] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260812 19:23:04.518828 10492 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:23:04.568454  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 106988us
I20260812 19:23:04.583081 10899 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:04.583410 10385 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:04.584028 10898 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260812 19:23:04.584215 10680 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:04.583920 10899 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:04.588824 10807 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:04.588932 10677 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:04.589800 10899 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:04.572799  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 118849us
I20260812 19:23:04.575021  6241 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:04.458523 10587 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.613364  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:04.565838 10776 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:04.595201 10492 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:04.493094 10668 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.648030 10645 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:04.631543 10776 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:04.652431  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:04.632975 10635 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:04.671687 10899 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:04.672639 10899 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.679155 10899 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:04.684834 10899 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:04.645644 10905 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:04.649627 10876 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:04.709057 10744 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.053s	sys 0.079s
I20260812 19:23:04.709717 10899 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.696655 10807 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:04.695415 10635 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:04.717636 10924 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260812 19:23:04.718467 10905 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:04.735817  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 102565us
I20260812 19:23:04.760181  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:04.763778  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:04.757845 10807 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.765712 10922 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:23:04.766379 10899 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:04.767372 10807 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:04.767536 10318 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:23:04.768890  6230 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:04.774016  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:04.774466 10921 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:04.774941 10921 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:23:04.775985  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.538s (SENT) [suppressed 15 similar messages]
I20260812 19:23:04.775810 10921 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:04.777026 10921 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:04.768049 10807 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260812 19:23:04.751319 10744 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.053s	sys 0.080s
I20260812 19:23:04.816270  6230 pending_rounds.cc:76] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 5
I20260812 19:23:04.817646  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1632) took 1098 ms. Trace:
I20260812 19:23:04.822999  6230 pending_rounds.cc:97] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260812 19:23:04.823788  6230 raft_consensus.cc:2866] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:04.823033  6229 rpcz_store.cc:276] 0812 19:23:03.719083 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:03.719468 (+   385us) service_pool.cc:227] Handling call
0812 19:23:03.756364 (+ 36896us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:04.404825 (+648461us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:04.817395 (+412570us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54000f55d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:04.817584 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1483309824}
W20260812 19:23:04.832607  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 56651.4us
I20260812 19:23:04.810403 10318 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:04.760685 10635 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.825822 10905 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:04.986640  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 204038us
I20260812 19:23:04.780998 10492 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:04.816275 10938 consensus_queue.cc:1046] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.157s
W20260812 19:23:05.016211  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.099s	user 0.006s	sys 0.006s
I20260812 19:23:05.022408  6224 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260812 19:23:05.000777 10924 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
W20260812 19:23:05.036777  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.120s	user 0.006s	sys 0.007s
W20260812 19:23:05.037405  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 1.13127e+06us
I20260812 19:23:05.038309  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:05.003084 10897 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:05.001421 10680 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:05.015224 10318 raft_consensus.cc:686] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:05.013319 10877 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:05.050104 10927 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260812 19:23:05.059454 10744 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:05.086169 10795 raft_consensus.cc:3032] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:05.088306 10795 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:05.089136 10795 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.091693  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1441) took 1160 ms. Trace:
I20260812 19:23:05.092362  6359 rpcz_store.cc:276] 0812 19:23:03.931013 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:03.931432 (+   419us) service_pool.cc:227] Handling call
0812 19:23:03.931949 (+   517us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:04.319029 (+387080us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:05.090596 (+771567us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54001bfdd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:05.091585 (+   989us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":592544512}
I20260812 19:23:05.096228 10576 raft_consensus.cc:3032] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:05.096796 10576 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:05.098131 10576 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.078790 10886 raft_consensus.cc:3032] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:05.100150 10886 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:05.079476 10318 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.101212 10492 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:05.101522 10886 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.103472 10886 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:05.080909  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49464 (request call id 35) took 1329 ms. Trace:
I20260812 19:23:05.105185  6349 rpcz_store.cc:276] 0812 19:23:03.751780 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:03.751907 (+   127us) service_pool.cc:227] Handling call
0812 19:23:05.080341 (+1328434us) spinlock_profiling.cc:243] Waited 83.6 ms on lock 0x7b5400476e20. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f770ddc0 00007f98f77729c2 00007f98fc6bc81a 00007f98f5dbbd04 00007f98f5dbbc92 00007f98f5dbbbc1 00007f98f5dbbb3c 00007f98f5dbadf2 00007f98f5bae94c 00007f98f5badd86
0812 19:23:05.080690 (+   349us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":192233216}
I20260812 19:23:05.104744 10877 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:05.083387 10656 raft_consensus.cc:3032] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:05.106798 10656 raft_consensus.cc:729] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:05.067029 10265 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:05.108063 10656 consensus_queue.cc:260] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.085359 10798 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:23:05.109109 10265 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.098840 10635 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:05.061178 10680 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:05.045871  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:05.129562  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 83807.3us
I20260812 19:23:05.130544  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:05.105530 10576 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:05.094519 10744 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:05.153522  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:05.169344  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "545108632fab48129db7f032619a1e55"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:05.170246  6349 raft_consensus.cc:595] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:05.170708  6349 raft_consensus.cc:603] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:05.145715 10325 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:05.200320 10646 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:05.212034 10587 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:23:05.156718 10635 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:05.164855 10899 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election won for term 6
W20260812 19:23:05.204748 10927 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260812 19:23:05.045677 10897 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.222854 10680 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:05.228400 10925 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:05.273798  6473 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260812 19:23:05.223376 10646 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.228598 10635 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:05.290017 10776 consensus_meta.cc:287] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.008s
W20260812 19:23:05.307238  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 94577.6us
I20260812 19:23:05.319766 10801 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:05.314376 10921 consensus_meta.cc:287] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.012s
I20260812 19:23:05.320493 10801 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.328029 10877 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:05.330489 10301 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:23:05.278753 10925 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.240741 10744 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.342326  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:05.356856 10646 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:05.315348 10265 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:05.358202 10897 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:05.359608 10897 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:23:05.361682 10925 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:05.353441 10899 raft_consensus.cc:686] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:05.370828 10635 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:05.370177 10899 consensus_queue.cc:237] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.380502 10635 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:05.381456 10635 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:05.385921  6470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1651) took 1695 ms (client timeout 1610 ms). Trace:
W20260812 19:23:05.386457  6470 rpcz_store.cc:269] 0812 19:23:03.690831 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:03.690960 (+   129us) service_pool.cc:227] Handling call
0812 19:23:05.385663 (+1694703us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b5400000d54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:05.385834 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":977457408}
I20260812 19:23:05.387943 10635 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:05.388846 10746 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:05.389394 10746 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:05.308421 10776 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.380544 10801 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:05.391192 10801 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:05.391469 10738 raft_consensus.cc:3032] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:05.391928 10738 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:05.391738 10801 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:05.392258 10776 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:05.392779 10738 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.393765 10801 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:05.394300 10801 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:05.367340 10946 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:05.380563  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:05.395622 10856 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 1.651s	user 0.007s	sys 0.011s
I20260812 19:23:05.404587  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:05.399916 10946 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.405383 10963 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:05.394773 10801 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:05.404019 10325 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:05.410144 10963 raft_consensus.cc:3032] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
W20260812 19:23:05.552649  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 211778us
I20260812 19:23:05.450968  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 245) took 1719 ms. Trace:
I20260812 19:23:05.565901  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:05.566269  6465 rpcz_store.cc:276] 0812 19:23:03.752795 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:03.752939 (+   144us) service_pool.cc:227] Handling call
0812 19:23:03.753229 (+   290us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:04.395696 (+642467us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:05.450490 (+1054794us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54001045d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:05.450850 (+   360us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1041620736}
I20260812 19:23:05.460104  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:05.568202  6349 raft_consensus.cc:595] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:05.568749  6349 raft_consensus.cc:603] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:05.517249 10784 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:05.565194 10963 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:05.578223 10963 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.580103 10963 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:05.517292 10587 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:05.583158 10587 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.608348  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:05.605789 10917 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:05.610690 10917 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:05.411779 10232 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:05.619881  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:05.547230 10298 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:05.537832 10656 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:23:05.530408 10951 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260812 19:23:05.650360  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:05.651299  6232 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:05.622520  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:05.646317  6228 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:05.529079 10946 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:05.648806  6241 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:05.444059 10635 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:05.652992  6349 raft_consensus.cc:595] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:05.654971  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:05.659801  6465 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:05.661676  6349 raft_consensus.cc:603] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:05.614481 10917 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:05.614900 10660 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:05.615252 10576 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:05.628991 10767 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:05.677680  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260812 19:23:05.684507  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:23:05.685189  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:05.627990  9974 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:05.642513 10298 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:23:05.672596 10832 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.926s	user 0.012s	sys 0.026s
I20260812 19:23:05.614886 10152 consensus_queue.cc:1046] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260812 19:23:05.668646 10808 raft_consensus.cc:465] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260812 19:23:05.673241 10946 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:05.677696 10776 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:05.677994 10635 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:05.824442  6465 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:23:06.116972  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:06.289175  6235 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:06.252478  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1659) took 2522 ms. Trace:
I20260812 19:23:06.280407  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:06.267298  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:06.187557  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:06.290987  6481 rpcz_store.cc:276] 0812 19:23:03.730226 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:03.730402 (+   176us) service_pool.cc:227] Handling call
0812 19:23:03.730881 (+   479us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:03.771353 (+ 40472us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:06.251361 (+2480008us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b5400074ed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:06.252397 (+  1036us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":56711424}
I20260812 19:23:05.834378  6228 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260812 19:23:05.896687  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.120227  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:05.913609  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.293063  6474 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260812 19:23:06.302624  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.303445  6481 raft_consensus.cc:2396] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260812 19:23:06.300901  6464 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:06.305337  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:05.894097  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:06.292680  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:05.853503  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:05.841339  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.007244  6232 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:05.692620 10438 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:06.321764  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:05.806488 10832 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.060s	user 0.015s	sys 0.037s
I20260812 19:23:06.395898  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:06.196518 10993 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.344s	user 0.000s	sys 0.002s
I20260812 19:23:06.396245  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.395975  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:06.310475  6470 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:06.310118  6464 raft_consensus.cc:2379] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:06.398249  6353 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:06.413002  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:06.313294  6347 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260812 19:23:06.403728  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.404246  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:06.414228  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:06.403682  6228 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:23:05.725652 10732 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:06.215283 10988 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:06.437249  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:06.437929  6482 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:06.257591 10746 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:06.438707  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.439340  6464 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:06.413719  6347 pending_rounds.cc:76] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 2
I20260812 19:23:06.440125  7600 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260812 19:23:06.440322  6347 pending_rounds.cc:97] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260812 19:23:05.814383 10684 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:06.413638  6345 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:06.310715  6465 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:23:05.725456 10761 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:05.720750 10677 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:06.271690 10899 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:05.657065 10232 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:05.972792 10917 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:06.416477  6344 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:06.418464  6481 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:06.415970  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:06.414286  6475 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:06.492843  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:06.435412  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:06.493525  6481 raft_consensus.cc:2362] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5. Re-sending same reply.
I20260812 19:23:06.493808  6342 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:23:06.416388  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.494597  6470 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:06.115583 10738 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:23:05.863988 10826 thread.cc:636] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 1.861s	user 0.021s	sys 0.061s
I20260812 19:23:05.813681 10576 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:05.678133 10660 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:06.521569 10660 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:06.036100  9974 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:06.440618  6347 raft_consensus.cc:2866] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:06.527009  9974 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:06.530027  9974 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:06.393014 10708 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.009s	sys 0.016s
W20260812 19:23:06.530910 10708 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.010s	sys 0.021s
I20260812 19:23:06.531726 10708 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:06.532291 10708 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.533116  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:06.533783  6470 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:06.413684  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:05.897895 10646 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:06.538882 10646 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.067762 10968 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:06.440145  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.113698 10934 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:06.113647 10947 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:06.213763 10876 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:05.852239 10658 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:06.445251  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:06.058969 10680 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:06.401889  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:06.254967 10976 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:06.068212 10897 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:06.255375 10969 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:06.468075  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:06.472487  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:06.478822  6482 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:23:06.396723 10645 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:06.494511  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:05.720732 10767 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:06.480443 10959 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.023s	sys 0.034s
I20260812 19:23:06.509438  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:06.300544 10776 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:05.814165 10325 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.518841  6345 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:06.469153 10746 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:06.313400 10946 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:05.925189 10298 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.411294 10438 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.467999 10684 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.442538 10732 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.479763 10761 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.449658 10988 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:06.513056 10826 thread.cc:602] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 2.615s	user 0.024s	sys 0.068s
I20260812 19:23:06.489506 10677 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.949399 10976 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.949991 10826 tablet_copy_client.cc:316] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.3:42599
I20260812 19:23:06.950855 10947 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.951747 10677 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:06.499446 10917 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.953951 10767 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:06.954734 10897 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:06.954833 10680 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.956113  6236 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:06.956733 10761 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:06.927660  6470 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:06.958374  6481 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:06.958480  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.959586  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.959797  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.592379  9974 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:06.960843  9974 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:06.922848 11008 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:06.961364  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.721128 10576 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.962364  6470 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:06.969571 10876 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.970376  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.970904 10746 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:06.971733  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.972913 10746 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:06.973301  6470 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:23:06.962080 11008 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.801648 10708 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:06.973946 10976 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:06.974509  6483 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:23:06.916008 10635 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:06.975306 11008 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:06.853814 10985 log.cc:924] Time spent T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.588s	user 0.001s	sys 0.000s
I20260812 19:23:06.487136 10899 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.963137 10298 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:06.963562  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.806872 11005 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:06.964325 10968 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:06.913033  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.000s	sys 0.011s
I20260812 19:23:06.964424 10969 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.965055 10946 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:06.594306 10940 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.563s	user 0.004s	sys 0.000s
I20260812 19:23:06.965962  6465 raft_consensus.cc:2362] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5. Re-sending same reply.
W20260812 19:23:06.632979 11002 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.124s	user 0.001s	sys 0.001s
W20260812 19:23:06.926343  6413 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.004s	sys 0.008s
W20260812 19:23:07.185072  6413 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.146s	user 0.005s	sys 0.009s
W20260812 19:23:06.949227 10959 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.029s	sys 0.045s
I20260812 19:23:06.961645 10934 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.965472 10658 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:06.917377 11014 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:06.954484 10917 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:06.967646 10684 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:06.968209  9974 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:06.957175 10680 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:06.963239 10645 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:07.166692  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.183s	user 0.001s	sys 0.013s
I20260812 19:23:06.957257 10897 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:06.695039 10678 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:07.117370 10587 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.008s	sys 0.012s
I20260812 19:23:06.959484 10988 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:06.891772 10646 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:06.961263 10438 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:06.954527 10947 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.109601 11008 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:07.128001 10761 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:07.197307 10987 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.601s	user 0.001s	sys 0.000s
W20260812 19:23:07.224200 11010 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260812 19:23:07.201921 11014 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:07.225298 10963 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.645s	user 0.017s	sys 0.003s
I20260812 19:23:07.225816 10776 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:07.208658 10587 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.008s	sys 0.012s
W20260812 19:23:07.227324 11004 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
I20260812 19:23:07.227952 11014 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.191250 10946 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:07.223646 10761 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:07.229446 10946 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:07.230933 10761 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.204674 11021 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 19:23:07.232656 10656 consensus_meta.cc:287] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.562s	user 0.011s	sys 0.004s
W20260812 19:23:07.223699 10660 consensus_meta.cc:287] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.003s
I20260812 19:23:07.233502 10808 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:07.233461 10660 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:07.233878 11008 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:23:07.234387 10808 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:07.211747 11020 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:07.217767 10969 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.205030 10917 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:07.237110 10917 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:07.237614 11008 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:07.238116 10946 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:07.232450 10876 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.239996 10917 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:07.241111 11001 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.440s	user 0.000s	sys 0.003s
I20260812 19:23:07.241410 10658 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.241488 10660 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.178726 11005 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:07.236027 11020 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:07.245409 11005 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:07.228662 10899 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.245733 11020 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:07.208448 10678 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:07.247195 10784 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:07.248029 10784 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:23:07.226567 10998 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
I20260812 19:23:07.266043 10932 raft_consensus.cc:3032] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:07.258843 10938 raft_consensus.cc:3032] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:07.266494 10932 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:07.266849 10938 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:07.267500 10932 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:07.268473 10994 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 1.155s	user 0.009s	sys 0.020s
I20260812 19:23:07.268080 10938 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:07.269574 10938 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:23:07.271921 10992 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.297s	user 0.009s	sys 0.020s
I20260812 19:23:07.262744 10968 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:06.965819  6235 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
W20260812 19:23:06.924547  6178 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.001s	sys 0.009s
W20260812 19:23:07.392552  6178 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.442s	user 0.003s	sys 0.009s
W20260812 19:23:07.393260  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 1.44336e+06us
W20260812 19:23:06.948984  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.001s	sys 0.010s
W20260812 19:23:07.395248  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.001s	sys 0.010s
I20260812 19:23:07.308907  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 230) took 2090 ms. Trace:
W20260812 19:23:07.310061  6296 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.003s	sys 0.026s
I20260812 19:23:06.966583  6350 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:07.405193 11012 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:06.895362  6417 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.027s	sys 0.046s
I20260812 19:23:07.192695  6465 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:06.967679  6464 raft_consensus.cc:2396] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260812 19:23:07.107067  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1668) took 1189 ms. Trace:
I20260812 19:23:06.581329  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 263) took 1207 ms. Trace:
W20260812 19:23:07.409965  6417 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.381s	user 0.027s	sys 0.047s
I20260812 19:23:07.412719  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1412) took 1064 ms. Trace:
I20260812 19:23:07.411566  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1669) took 1493 ms. Trace:
I20260812 19:23:06.547926  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:06.969118  6475 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:07.412420  6470 rpcz_store.cc:276] 0812 19:23:05.918001 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:06.972833 (+1054832us) service_pool.cc:227] Handling call
0812 19:23:06.973141 (+   308us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:07.106635 (+133494us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.106982 (+   347us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:07.415709  6296 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.004s	sys 0.027s
I20260812 19:23:07.153002  6482 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:07.417510 10870 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:07.418888  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 910327us
I20260812 19:23:07.418429 10870 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:07.419662  6482 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:07.420495  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1675) took 1423 ms. Trace:
W20260812 19:23:07.137458  6415 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.006s	sys 0.019s
I20260812 19:23:07.313427  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1658) took 3597 ms. Trace:
I20260812 19:23:07.223390 10645 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.320523 10678 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:07.421850  6415 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.007s	sys 0.019s
I20260812 19:23:07.326609  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.200281  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.264398 10801 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:07.215651 10732 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:07.230327 10934 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.429965 10795 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:07.377079  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:07.432170  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 235) took 1794 ms. Trace:
I20260812 19:23:07.432878  6230 rpcz_store.cc:276] 0812 19:23:05.638094 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:05.638367 (+   273us) service_pool.cc:227] Handling call
0812 19:23:05.674298 (+ 35931us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:06.519200 (+844902us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:06.519247 (+    47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:06.519310 (+    63us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:06.519358 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.431505 (+912147us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b54002fab54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:07.431591 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:07.431891 (+   300us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1942589184}
I20260812 19:23:07.347388  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.360636 10991 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:07.413281  6464 rpcz_store.cc:276] 0812 19:23:06.348376 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:06.439929 (+ 91553us) service_pool.cc:227] Handling call
0812 19:23:07.412412 (+972483us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:07.435956 10991 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:07.371374  6229 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.365s	user 0.002s	sys 0.022s
I20260812 19:23:07.271968 10808 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.374986 10941 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:07.381726  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.383595  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.390839  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.402765  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.399257  6224 rpcz_store.cc:276] 0812 19:23:05.218092 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:05.218321 (+   229us) service_pool.cc:227] Handling call
0812 19:23:05.232762 (+ 14441us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:05.237090 (+  4328us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:05.237119 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:05.620416 (+383297us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b2c0006c608. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:23:05.620893 (+   477us) log.cc:842] Serialized 26 byte log entry
0812 19:23:05.850703 (+229810us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:05.850756 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:05.850866 (+   110us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:07.307293 (+1456427us) raft_consensus.cc:1671] finished
0812 19:23:07.307389 (+    96us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:07.308469 (+  1080us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":9919,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":23845,"spinlock_wait_cycles":2910592,"thread_start_us":172525,"threads_started":1,"wal-append.queue_time_us":859536}
I20260812 19:23:07.403870  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.403327  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1678) took 1005 ms. Trace:
I20260812 19:23:07.456305  6354 rpcz_store.cc:276] 0812 19:23:06.397992 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:06.398856 (+   864us) service_pool.cc:227] Handling call
0812 19:23:06.399150 (+   294us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:06.970492 (+571342us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:06.970525 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:06.970568 (+    43us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:06.970598 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.402470 (+431872us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54002d0fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:07.402572 (+   102us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:07.402999 (+   427us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1313527040}
I20260812 19:23:07.459340 10941 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:07.462293 10941 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:07.405438  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1645) took 1192 ms. Trace:
I20260812 19:23:07.408123 11012 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:07.413403  6465 rpcz_store.cc:276] 0812 19:23:05.918396 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:07.192023 (+1273627us) service_pool.cc:227] Handling call
0812 19:23:07.192472 (+   449us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:07.410901 (+218429us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.411303 (+   402us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:07.412618  6473 rpcz_store.cc:276] 0812 19:23:05.373635 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:05.397505 (+ 23870us) service_pool.cc:227] Handling call
0812 19:23:05.397836 (+   331us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:05.398138 (+   302us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:05.398169 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:05.407078 (+  8909us) log.cc:842] Serialized 26 byte log entry
0812 19:23:05.512801 (+105723us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:05.512854 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:05.512961 (+   107us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:06.581100 (+1068139us) raft_consensus.cc:1671] finished
0812 19:23:06.581121 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:06.581263 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":2676,"thread_start_us":72679,"threads_started":1,"wal-append.queue_time_us":266814}
I20260812 19:23:07.420900  6482 rpcz_store.cc:276] 0812 19:23:05.996832 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:07.418469 (+1421637us) service_pool.cc:227] Handling call
0812 19:23:07.419048 (+   579us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:07.420186 (+  1138us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.420404 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:07.445854  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1679) took 1026 ms. Trace:
I20260812 19:23:07.421725 10870 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.408968 10576 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:07.447219 10232 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:07.437932  6464 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:07.497802  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1408) took 1150 ms. Trace:
I20260812 19:23:07.498260  6464 rpcz_store.cc:276] 0812 19:23:06.347130 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:07.437047 (+1089917us) service_pool.cc:227] Handling call
0812 19:23:07.437539 (+   492us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:07.497414 (+ 59875us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.497707 (+   293us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:07.500063  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:07.500631  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1425) took 1056 ms. Trace:
I20260812 19:23:07.501034  6464 rpcz_store.cc:276] 0812 19:23:06.443792 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:07.499225 (+1055433us) service_pool.cc:227] Handling call
0812 19:23:07.499840 (+   615us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:07.500256 (+   416us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:07.500280 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:07.500348 (+    68us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:23:07.500380 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.500438 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:07.500558 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:07.466959  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1674) took 1147 ms. Trace:
I20260812 19:23:07.503273  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:07.463865  7594 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:07.471359  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:07.470973 11039 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:07.504896  6345 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:07.422531  6477 rpcz_store.cc:276] 0812 19:23:03.715468 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:03.715654 (+   186us) service_pool.cc:227] Handling call
0812 19:23:03.715951 (+   297us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:03.716288 (+   337us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:03.716319 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:03.716734 (+   415us) log.cc:842] Serialized 26 byte log entry
0812 19:23:05.388400 (+1671666us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b180025e8e0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:23:05.516819 (+128419us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:05.516859 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:05.523502 (+  6643us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:07.271079 (+1747577us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:07.312578 (+ 41499us) raft_consensus.cc:1671] finished
0812 19:23:07.312632 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:07.313029 (+   397us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":658,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":12077,"spinlock_wait_cycles":28866688,"thread_start_us":128205,"threads_started":1,"wal-append.queue_time_us":2087992}
I20260812 19:23:07.471678 10744 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:07.473665 10577 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:07.475039 10732 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:23:07.476609  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:07.506546  6465 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260812 19:23:07.476948  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:23:07.457172  6229 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.478s	user 0.002s	sys 0.023s
I20260812 19:23:07.482501  6352 rpcz_store.cc:276] 0812 19:23:06.412052 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:06.412216 (+   164us) service_pool.cc:227] Handling call
0812 19:23:06.412584 (+   368us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:07.382548 (+969964us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:07.382611 (+    63us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:07.382719 (+   108us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:07.382757 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.437884 (+ 55127us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54004088d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:07.437946 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:07.438115 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2112962944}
W20260812 19:23:07.503633 10818 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.100s	user 0.015s	sys 0.030s
I20260812 19:23:07.473527  6350 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:23:07.481246  6236 rpcz_store.cc:276] 0812 19:23:06.266712 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:06.266922 (+   210us) service_pool.cc:227] Handling call
0812 19:23:07.376617 (+1109695us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54000f4bd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:07.405148 (+ 28531us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1527171328}
W20260812 19:23:07.496932  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 102613us
I20260812 19:23:07.504459 10576 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:07.405187  7600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 348) took 3609 ms. Trace:
I20260812 19:23:07.518405  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1415) took 1166 ms. Trace:
I20260812 19:23:07.519001  6465 rpcz_store.cc:276] 0812 19:23:06.349318 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:07.493798 (+1144480us) service_pool.cc:227] Handling call
0812 19:23:07.497584 (+  3786us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:07.515277 (+ 17693us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.515566 (+   289us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:07.522204  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1635) took 1877 ms. Trace:
I20260812 19:23:07.522645  6229 rpcz_store.cc:276] 0812 19:23:05.644482 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:05.644726 (+   244us) service_pool.cc:227] Handling call
0812 19:23:05.673550 (+ 28824us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:05.682096 (+  8546us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:05.682140 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:05.726860 (+ 44720us) log.cc:842] Serialized 26 byte log entry
0812 19:23:07.520943 (+1794083us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:07.521466 (+   523us) log.cc:842] Serialized 14 byte log entry
0812 19:23:07.521766 (+   300us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.521876 (+   110us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:07.521914 (+    38us) raft_consensus.cc:1671] finished
0812 19:23:07.521924 (+    10us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:07.522129 (+   205us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":153,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":32558,"thread_start_us":1560152,"threads_started":1,"wal-append.queue_time_us":1434248}
I20260812 19:23:07.530236 11012 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:07.530362  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1696) took 1128 ms. Trace:
I20260812 19:23:07.529989 10744 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:07.530797  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1673) took 1191 ms. Trace:
I20260812 19:23:07.530838  6242 rpcz_store.cc:276] 0812 19:23:06.401740 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:06.401891 (+   151us) service_pool.cc:227] Handling call
0812 19:23:06.402283 (+   392us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:06.952193 (+549910us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:06.952237 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:06.952717 (+   480us) log.cc:842] Serialized 26 byte log entry
0812 19:23:07.356957 (+404240us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:23:07.357059 (+   102us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.529785 (+172726us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54001649d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:07.529833 (+    48us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:07.529910 (+    77us) raft_consensus.cc:1671] finished
0812 19:23:07.529924 (+    14us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:07.530193 (+   269us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1264103680,"thread_start_us":403551,"threads_started":1,"wal-append.queue_time_us":304291}
I20260812 19:23:07.532802 10744 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.533883 10991 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:07.535342  6235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1647) took 1251 ms (client timeout 1590 ms). Trace:
I20260812 19:23:07.536048 10577 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:07.540215 10818 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.263s	user 0.016s	sys 0.030s
I20260812 19:23:07.540522  6298 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:07.542765  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1416) took 1193 ms. Trace:
I20260812 19:23:07.543223  6473 rpcz_store.cc:276] 0812 19:23:06.349606 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:07.495603 (+1145997us) service_pool.cc:227] Handling call
0812 19:23:07.541913 (+ 46310us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:07.542301 (+   388us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:07.542329 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:07.542394 (+    65us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:23:07.542447 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.542514 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:07.542707 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:07.516996  7600 rpcz_store.cc:276] 0812 19:23:03.795457 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:03.795629 (+   172us) service_pool.cc:227] Handling call
0812 19:23:03.814671 (+ 19042us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:06.442585 (+2627914us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.404517 (+961932us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b54004d12d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:07.404944 (+   427us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6037329792}
I20260812 19:23:07.544936  6473 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:07.502807  6359 rpcz_store.cc:276] 0812 19:23:06.303011 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:06.303201 (+   190us) service_pool.cc:227] Handling call
0812 19:23:06.303495 (+   294us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:06.950803 (+647308us) raft_consensus.cc:1520] Early marking committed up to index 3
0812 19:23:06.951080 (+   277us) log.cc:842] Serialized 14 byte log entry
0812 19:23:07.313970 (+362890us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:07.314126 (+   156us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:07.314319 (+   193us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.400418 (+ 86099us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b5400180454. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:07.400463 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:07.450360 (+ 49897us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":570,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":31851,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":342,"spinlock_wait_cycles":1488069504,"thread_start_us":362040,"threads_started":1,"wal-append.queue_time_us":301757}
W20260812 19:23:07.535857  6235 rpcz_store.cc:269] 0812 19:23:06.288353 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:06.290066 (+  1713us) service_pool.cc:227] Handling call
0812 19:23:07.534936 (+1244870us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b540001d954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:07.535135 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1272164608}
I20260812 19:23:07.548751 10577 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:07.531344  6349 rpcz_store.cc:276] 0812 19:23:06.302641 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:06.302800 (+   159us) service_pool.cc:227] Handling call
0812 19:23:06.303148 (+   348us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:06.917615 (+614467us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:06.917644 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:07.105935 (+188291us) log.cc:842] Serialized 26 byte log entry
0812 19:23:07.360174 (+254239us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:23:07.360256 (+    82us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.361439 (+  1183us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:07.455457 (+ 94018us) raft_consensus.cc:1671] finished
0812 19:23:07.455474 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:07.494343 (+ 38869us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":228034,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":103,"thread_start_us":466692,"threads_started":2,"wal-append.queue_time_us":237813}
I20260812 19:23:07.569404 11020 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:07.569913  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.579455  6500 tablet_copy_service.cc:140] P bdfa5579d4534c618c00db6b4a841c81: Received BeginTabletCopySession request for tablet 7e0797ad50cb46cfb10b4a38cc815917 from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:33386)
I20260812 19:23:07.580518  6500 tablet_copy_service.cc:161] P bdfa5579d4534c618c00db6b4a841c81: Beginning new tablet copy session on tablet 7e0797ad50cb46cfb10b4a38cc815917 from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:33386: session id = f4ef77b3328a44e8a21dd902b370e25a-7e0797ad50cb46cfb10b4a38cc815917
I20260812 19:23:07.583582 11032 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:07.584571 11032 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:07.585958  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.596658  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.596977  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.597267  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.598639  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.600883 10576 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.505075 11039 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:07.607205 11032 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:07.605655  6483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1665) took 1706 ms (client timeout 1869 ms). Trace:
I20260812 19:23:07.562273 10744 raft_consensus.cc:2741] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260812 19:23:07.608101  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:07.615612  6242 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:07.615658  6229 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 19:23:07.616941  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:07.617689  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 140940us
W20260812 19:23:07.610774  6483 rpcz_store.cc:269] 0812 19:23:05.879284 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:05.879544 (+   260us) service_pool.cc:227] Handling call
0812 19:23:07.555231 (+1675687us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b5400450954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:07.585958 (+ 30727us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1546157312}
I20260812 19:23:07.620443  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:07.631850 11039 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.632709 10932 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:07.634400 10738 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.116s	user 0.011s	sys 0.007s
I20260812 19:23:07.650218  6481 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:07.650770 10732 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:07.651297 10732 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:07.652894  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.654348  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1429) took 1185 ms. Trace:
I20260812 19:23:07.654794  6481 rpcz_store.cc:276] 0812 19:23:06.469283 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:06.959342 (+490059us) service_pool.cc:227] Handling call
0812 19:23:07.654104 (+694762us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54003eeed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:07.654281 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1585820032}
I20260812 19:23:07.663702  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:07.665059  6229 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:07.665596  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:07.666281  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:07.636507 10967 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:07.668474 10967 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:07.639010  6475 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:07.670142  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1414) took 1321 ms. Trace:
I20260812 19:23:07.669556 10784 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:07.670478  6475 rpcz_store.cc:276] 0812 19:23:06.349030 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:06.509106 (+160076us) service_pool.cc:227] Handling call
0812 19:23:07.670057 (+1160951us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:07.640331  6236 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:07.672428  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:07.673241  6236 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:07.674201  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:07.643852  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:07.645478  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:07.645915  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:07.678800  6230 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:07.645982  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:07.647480  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:07.680866  6232 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:07.648358  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:07.666481  6354 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:07.682034  6228 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:07.683131  6241 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:07.684940 10732 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:07.667435  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:07.708817  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 88474.9us
I20260812 19:23:07.688158  6236 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:07.700824  6344 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:23:07.693364  6345 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:07.635547  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1409) took 1261 ms. Trace:
I20260812 19:23:07.723932  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:07.711637  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:07.739431  6474 rpcz_store.cc:276] 0812 19:23:06.347444 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:07.457682 (+1110238us) service_pool.cc:227] Handling call
0812 19:23:07.458208 (+   526us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:07.471616 (+ 13408us) raft_consensus.cc:1520] Early marking committed up to index 1
0812 19:23:07.471674 (+    58us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:07.472512 (+   838us) log.cc:842] Serialized 52 byte log entry
0812 19:23:07.555693 (+ 83181us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:23:07.555736 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.555800 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:07.603453 (+ 47653us) raft_consensus.cc:1671] finished
0812 19:23:07.603472 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:07.608974 (+  5502us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12716,"raft.queue_time_us":14926,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":247,"thread_start_us":82686,"threads_started":1,"wal-append.queue_time_us":127368}
I20260812 19:23:07.744872  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:07.745674  6474 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:07.747797  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:07.750941  6349 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:07.754987  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:07.755106  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:07.756063  6483 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:23:07.757091  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:07.758849  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:07.758231  6054 catalog_manager.cc:5495] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 3 to 6, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 6 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:07.761214  6054 catalog_manager.cc:5495] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:07.709177 11032 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:07.762961 11032 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:07.763417 11032 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:07.763124  6054 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 4 to 6, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 6 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:07.765370  6054 catalog_manager.cc:5495] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:07.685688 10784 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:07.747820  6475 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:07.758453  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:07.778529  6349 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:07.692319 10967 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.780853  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:07.780855  6354 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:07.788291  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:07.800697  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:07.800372  6416 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:07.807039  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:07.810777  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:07.812194  6344 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:07.812453 10938 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:07.812899 10938 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:07.813392 10938 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:07.814946  6474 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:07.810945  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1698) took 1372 ms. Trace:
I20260812 19:23:07.807832  6349 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:07.815804  6238 rpcz_store.cc:276] 0812 19:23:06.405082 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:06.437467 (+ 32385us) service_pool.cc:227] Handling call
0812 19:23:06.437804 (+   337us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:06.493255 (+ 55451us) raft_consensus.cc:1520] Early marking committed up to index 1
0812 19:23:06.493292 (+    37us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:07.534401 (+1041109us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b2c0006c608. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:23:07.535338 (+   937us) log.cc:842] Serialized 52 byte log entry
0812 19:23:07.592193 (+ 56855us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:23:07.592253 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.602075 (+  9822us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:07.767853 (+165778us) raft_consensus.cc:1671] finished
0812 19:23:07.767875 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:07.777790 (+  9915us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":11237,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":19695,"spinlock_wait_cycles":4018944,"thread_start_us":30046,"threads_started":1,"wal-append.queue_time_us":222223}
I20260812 19:23:07.822520  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:07.823206 10732 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:07.827713  6474 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 19:23:07.844458  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:07.836531  6054 catalog_manager.cc:5495] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:07.797538 10784 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260812 19:23:07.846530  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1673) took 1864 ms. Trace:
I20260812 19:23:07.848924  6349 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:07.818490 11039 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:07.858820 10738 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:07.858994 10576 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:07.859051  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:07.844264 10732 raft_consensus.cc:686] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:07.859386 10738 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:07.850175  6470 rpcz_store.cc:276] 0812 19:23:05.976903 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:07.415763 (+1438860us) service_pool.cc:227] Handling call
0812 19:23:07.416494 (+   731us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:07.421780 (+  5286us) raft_consensus.cc:1520] Early marking committed up to index 3
0812 19:23:07.549129 (+127349us) log.cc:842] Serialized 14 byte log entry
0812 19:23:07.839635 (+290506us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:07.839681 (+    46us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:07.839707 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:07.841546 (+  1839us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:07.841659 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":209323,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":24245,"thread_start_us":375328,"threads_started":2}
I20260812 19:23:07.869308  6344 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:07.850863 10795 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:07.859651 10744 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:07.860149  6178 connection.cc:232] RPC call timeout handler was delayed by -1.529950083931908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
I20260812 19:23:07.853363  6500 tablet_copy_source_session.cc:205] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 19:23:07.870893  6054 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 4 to 5, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 5 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:07.890748 10795 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:07.892438  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:07.893002 10795 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:07.894048  6350 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260812 19:23:07.894124  6349 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:07.893108  6347 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:07.894744 10576 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:07.895330  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:07.896380  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:07.901098  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:07.898921  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2865579109638929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260812 19:23:07.903036  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2724177539348602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260812 19:23:07.903295  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1713579108472914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
W20260812 19:23:07.903592  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1654500840231776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
W20260812 19:23:07.903882  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1654500840231776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
W20260812 19:23:07.904150  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1632579108700156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260812 19:23:07.904377  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1632579108700156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260812 19:23:07.904644  6178 connection.cc:232] RPC call timeout handler was delayed by -1.0726177538745105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
W20260812 19:23:07.904922  6178 connection.cc:232] RPC call timeout handler was delayed by -1.0578970939386636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
I20260812 19:23:07.868088 10738 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:07.908413  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:07.911247  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:07.911875  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:07.900858 10576 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:07.919612  6344 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:07.887805 10744 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:07.887430 11039 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:07.916627  6054 catalog_manager.cc:5495] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 5 to 6, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 6 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:07.934525  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:07.928857  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:07.936928  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:07.947491  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 49969.5us
I20260812 19:23:07.949081  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:07.953372 10991 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:23:07.955412 10991 consensus_queue.cc:1046] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:23:07.956410 10818 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:07.956598 11012 raft_consensus.cc:3032] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:07.957043 10818 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:07.947650  6354 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:23:07.949180 10576 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:07.957183 11012 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:07.928553  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:07.962798  7598 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:07.956439 10991 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260812 19:23:07.957749 10818 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:07.961743 10576 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:07.971969 11039 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.963894  6344 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:07.964949  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:07.983940  6345 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
W20260812 19:23:07.991755  6060 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38512 (request call id 227) took 19685 ms (client timeout 15000 ms). Trace:
I20260812 19:23:07.979925 10576 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:07.982793  6054 catalog_manager.cc:5495] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 3 to 8, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 8 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:07.995355  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.001848  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:07.995223  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:08.007335  6345 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:07.998010 10744 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:07.961206 10732 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:08.154903  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 134490us
I20260812 19:23:08.063083  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.137998  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.142685  6054 catalog_manager.cc:5495] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 2 to 4, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 4 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:23:08.158299  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.159309  6345 raft_consensus.cc:2396] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260812 19:23:08.159695  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.160068  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:08.160583  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 312010us
I20260812 19:23:08.159051  6054 catalog_manager.cc:5495] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:08.161512  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.162483  6342 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:08.126328  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.170995  6350 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:08.172070  6345 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 7. Current term is 8. Ops: []
W20260812 19:23:07.992364  6060 rpcz_store.cc:269] 0812 19:22:48.305942 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:48.306684 (+   742us) service_pool.cc:227] Handling call
0812 19:23:07.991419 (+19684735us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:03.927817 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:03.928692 (+   875us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:03.928774 (+    82us) write_op.cc:435] Acquired schema lock
0812 19:23:03.928801 (+    27us) tablet.cc:660] Decoding operations
0812 19:23:03.933332 (+  4531us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:04.012072 (+ 78740us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:04.018888 (+  6816us) tablet.cc:683] Acquiring locks for 19 operations
0812 19:23:04.075219 (+ 56331us) tablet.cc:699] Row locks acquired
0812 19:23:04.075265 (+    46us) write_op.cc:260] PREPARE: finished
0812 19:23:04.075485 (+   220us) write_op.cc:270] Start()
0812 19:23:04.075660 (+   175us) write_op.cc:276] Timestamp: P: 1786562584075408 usec, L: 0
0812 19:23:04.075719 (+    59us) op_driver.cc:331] REPLICATION: starting
0812 19:23:04.076584 (+   865us) log.cc:842] Serialized 7393 byte log entry
0812 19:23:05.072699 (+996115us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18000964c0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:23:05.381372 (+308673us) op_driver.cc:444] REPLICATION: finished
0812 19:23:06.604559 (+1223187us) write_op.cc:301] APPLY: starting
0812 19:23:06.689462 (+ 84903us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:06.907324 (+217862us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:06.907362 (+    38us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:07.246433 (+339071us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:07.247345 (+   912us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0812 19:23:07.247461 (+   116us) write_op.cc:312] APPLY: finished
0812 19:23:07.248411 (+   950us) log.cc:842] Serialized 132 byte log entry
0812 19:23:07.429285 (+180874us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:07.429870 (+   585us) write_op.cc:454] Released schema lock
0812 19:23:07.430047 (+   177us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:07.516457 (+ 86410us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:07.518790 (+  2333us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2854975,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":1115365,"apply.run_cpu_time_us":45575,"apply.run_wall_time_us":1002571,"num_ops":19,"prepare.queue_time_us":41736,"prepare.run_cpu_time_us":12114,"prepare.run_wall_time_us":483305,"raft.queue_time_us":299885,"raft.run_cpu_time_us":17615,"raft.run_wall_time_us":295831,"replication_time_us":1305520,"spinlock_wait_cycles":23889280,"thread_start_us":900574,"threads_started":5,"wal-append.queue_time_us":543508,"wal-append.run_cpu_time_us":20403,"wal-append.run_wall_time_us":1167639}]]}
I20260812 19:23:08.177410  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:08.177721  6353 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:08.178155  6235 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:08.180202  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:08.186452  6229 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:08.187971  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:08.192121  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:08.073241 10967 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.126s
I20260812 19:23:08.199972 10795 raft_consensus.cc:3032] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:08.200506 10795 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:23:08.203591  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 242200us
I20260812 19:23:08.173331  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:08.207419 11062 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260812 19:23:08.212033  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 50769.4us
W20260812 19:23:08.226837  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 71476.3us
I20260812 19:23:08.231253  6359 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 4.
I20260812 19:23:08.162531  6054 catalog_manager.cc:5495] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:08.242687  6235 raft_consensus.cc:2396] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
W20260812 19:23:08.211582 11063 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260812 19:23:08.210850 10298 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260812 19:23:08.210510 10938 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:08.081941 10744 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:08.239146  6228 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:08.248548  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1411) took 1881 ms. Trace:
I20260812 19:23:08.248680  6054 catalog_manager.cc:5495] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:08.263868  6236 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:08.271983 10826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e0797ad50cb46cfb10b4a38cc815917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:23:08.277613  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:08.240042 10818 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.285451 10818 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:08.297123  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:08.297945  6232 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:08.302819  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:08.303932  6349 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:23:08.306710  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 58845.6us
I20260812 19:23:08.316377  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.317235  6349 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:08.222522 11032 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.256671  6482 rpcz_store.cc:276] 0812 19:23:06.348063 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:07.495459 (+1147396us) service_pool.cc:227] Handling call
0812 19:23:07.544104 (+ 48645us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:07.544717 (+   613us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:07.544755 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:07.545258 (+   503us) log.cc:842] Serialized 26 byte log entry
0812 19:23:07.838233 (+292975us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:07.852640 (+ 14407us) log.cc:842] Serialized 14 byte log entry
0812 19:23:08.131059 (+278419us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:08.131169 (+   110us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:08.228978 (+ 97809us) raft_consensus.cc:1671] finished
0812 19:23:08.229003 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:08.229186 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":16453,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":7322,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":10136,"thread_start_us":570518,"threads_started":2,"wal-append.queue_time_us":511661}
I20260812 19:23:08.338786  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:08.337598  6054 catalog_manager.cc:5495] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 1 to 2, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 2 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:08.310218 10744 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:08.341702  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:08.359113  6054 catalog_manager.cc:5495] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 2 to 4, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 4 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:08.340468 10938 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:08.367748  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:08.347755 10744 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:08.386011  6054 catalog_manager.cc:5495] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 3 to 5, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 5 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:23:08.387995  6236 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:08.331954 10795 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.381949 10744 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:08.374612 10991 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 19:23:08.393859  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 70479.2us
I20260812 19:23:08.395258  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:08.357339 10576 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.397864  6229 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260812 19:23:08.401015  6228 raft_consensus.cc:2396] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260812 19:23:08.352787 11012 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.409011  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:08.399485 10795 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:08.393967 10298 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260812 19:23:08.420722  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:08.406033 10818 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:08.441282  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.431250 10577 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:08.449569  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:08.426489 11012 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:08.450951  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:08.440495 10738 consensus_meta.cc:287] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.004s
I20260812 19:23:08.452322 10577 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:08.456588  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.461035  6359 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:08.423830 10967 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260812 19:23:08.448690 11032 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:08.448025  7598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 387) took 1111 ms. Trace:
I20260812 19:23:08.466910  6228 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:08.437906 11039 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260812 19:23:08.462714 10577 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:08.491067 10576 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:08.462954 10738 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.494771 10738 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:08.495599  6359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:08.496454  6359 raft_consensus.cc:595] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:08.507905  6232 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:08.519992  6359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "545108632fab48129db7f032619a1e55"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:08.520920  6359 raft_consensus.cc:595] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:08.521339  6359 raft_consensus.cc:603] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:08.527606 10795 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:08.528105 10795 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:08.467979  7598 rpcz_store.cc:276] 0812 19:23:07.328167 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:07.330973 (+  2806us) service_pool.cc:227] Handling call
0812 19:23:08.433465 (+1102492us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54005ae6d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:08.439484 (+  6019us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1148077952}
I20260812 19:23:08.528658 10795 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:08.529016  6359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:08.529613  6359 raft_consensus.cc:595] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:08.529937  6359 raft_consensus.cc:603] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:08.532733  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:08.534044  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.534062  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:08.535843  6229 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 3.
I20260812 19:23:08.537717  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:08.538025  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:08.538107  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:08.538947  6236 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:08.540355  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.540581 10795 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.541764  6359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:08.542934 10795 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:08.542358  6359 raft_consensus.cc:595] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:08.547245  6359 raft_consensus.cc:603] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:08.553294  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:08.554025  6349 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:08.565225  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.556493  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:08.570469  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:08.572198  6236 raft_consensus.cc:2396] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:23:08.575083  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.573945  6342 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:08.589633 10798 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:08.590284 10798 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:08.591275 10798 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:08.593503  6298 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:08.594794 10795 raft_consensus.cc:2741] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260812 19:23:08.595316  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.598766 10744 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.600865 10744 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:08.601577 11070 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:08.602126 11070 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.603617  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.604369 11070 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:08.604807  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:08.594969  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:08.607899  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:08.616541 11070 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:08.617151 11070 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.619563 11070 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:08.624464  6344 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:08.625381  6344 raft_consensus.cc:595] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:08.625878  6344 raft_consensus.cc:603] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:08.626938  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:08.627269  6416 connection.cc:232] RPC call timeout handler was delayed by -1.784923650091514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260812 19:23:08.627686  6416 connection.cc:232] RPC call timeout handler was delayed by -1.6850236500613391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
I20260812 19:23:08.629045  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:23:08.629609  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:08.631418  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:23:08.632392  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:08.635356  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:08.636451  6349 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:08.638507  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:08.636210  6229 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:08.638001 11070 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:08.642524 11075 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:08.642987 11075 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:08.636900 10738 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:08.652686  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 231997us
I20260812 19:23:08.674248  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:08.651167  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 239351us
I20260812 19:23:08.618571 10577 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.673825 10818 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:08.651727 10738 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.700562 10744 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:08.714334  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:08.724857  6347 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260812 19:23:08.725370  6347 pending_rounds.cc:76] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 2
I20260812 19:23:08.725638  6347 pending_rounds.cc:97] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260812 19:23:08.735249 11088 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:08.736191 10818 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.734315  6347 raft_consensus.cc:2866] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:08.754599  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:08.757712  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 187326us
I20260812 19:23:08.762075  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:08.700735 11075 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.772316 11075 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:08.760418 10784 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:08.764407  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:08.777002 10795 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:08.783143  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:08.763851 11070 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:08.785763  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:08.798923 11089 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:08.799664 11089 raft_consensus.cc:686] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:08.800763 11089 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:08.801627 11032 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:08.801952  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:08.802275 11032 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:08.803128 11090 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:08.803323 11032 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:08.807962  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 73129.4us
I20260812 19:23:08.808971  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:08.812561 11070 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:23:08.815089 11070 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:08.821069 11070 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:08.821478 11070 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:08.822010 11085 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:08.815531  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:08.828055  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:08.786535 10795 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:08.777097 10784 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.840325  7594 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260812 19:23:08.845830 11102 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:08.852659  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:08.853914  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:08.827322 11090 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260812 19:23:08.855989 11102 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:23:08.857470 11102 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:23:08.857843 11102 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:08.858180 11102 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:08.858824 11020 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:08.859936 10991 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:08.860297 10991 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:08.861160 10991 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.862373 10991 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:08.862804  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:08.864090  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:08.833735 10795 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:08.832345 10738 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:08.869899 10784 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:08.872025  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 55189.7us
I20260812 19:23:08.892956 10967 raft_consensus.cc:2741] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
W20260812 19:23:08.893107  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55762.8us
I20260812 19:23:08.893968  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:08.836923 10577 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:08.903045 10967 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:23:08.903852 10967 raft_consensus.cc:686] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:08.905017 10967 consensus_queue.cc:237] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.903175 11039 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260812 19:23:08.890184 11090 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:08.910851  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:08.918727  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:08.926023  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:08.926855 10818 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:08.931813 10818 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:08.934803 10818 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:08.918427 11090 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:08.901587 10784 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:08.941203 10784 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:08.927611 11032 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:08.941643 10784 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:08.941748 11032 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:08.942239 11032 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:08.941782 10585 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:08.942381  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:08.943953 11080 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:08.944368 11080 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:08.899223 11085 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:08.943948  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:08.944732 11080 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:08.939985 11090 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:08.941350 10298 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.010s
I20260812 19:23:08.920827 11070 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.961045  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:08.961444  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:08.963876  6473 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:08.959064 11075 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:08.968973  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:08.976109  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:08.979024  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:08.979377 11109 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:08.993566  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:08.996176  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:08.976840 10738 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:09.006073  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.006568 10738 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:08.973785 11075 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:09.019855  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.021174 11075 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:08.999127 11085 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.042870  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.021462 11032 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.048329 11032 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:09.050122 11070 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:09.050956 10738 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:09.051640 11105 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260812 19:23:09.061359 11108 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
I20260812 19:23:09.055917 11090 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.072193 11090 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:09.072494  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 60327us
I20260812 19:23:09.055070 10298 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:09.073086  6238 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260812 19:23:09.073098 10298 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:09.073817 10298 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:09.071625 10784 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:23:09.074183  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:09.078975  6475 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:09.101562  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.102485  6470 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:09.055303 11102 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.104188  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.105376 11102 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:09.075004 11018 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260812 19:23:09.105692 10298 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:09.106539  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.085244 11075 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:09.108178  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.108593 11075 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:09.108747  6482 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:09.099452 11090 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:09.110802  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.109931  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.113113  6475 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 4: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:09.081226 10826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60772 (request call id 369) took 6044 ms. Trace:
I20260812 19:23:09.076095 10784 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:09.139218  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 65165.2us
I20260812 19:23:09.083906 10818 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.140707  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:09.141573 11090 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:09.141786 10818 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:09.141978  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:09.142560  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 146524us
I20260812 19:23:09.144212  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:09.146878  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.151152  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:09.151926  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:09.147509  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:09.147744  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.154016  6470 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:09.147214  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.160780  6349 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260812 19:23:09.161458  6236 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:09.163260  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:09.164220 11075 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:09.164688 11075 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:09.165109 11075 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:09.167187  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:09.167850  6342 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:23:09.169422  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:09.169975  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:09.171037  6347 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:09.171370  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:09.172027  6344 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:09.152709  6350 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:09.170889  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:09.179049  6359 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:09.170006  6354 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:09.179529  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.175369  6236 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:09.180385  6473 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:09.203053  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:09.204157  6232 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:09.149428 11080 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.208742 11080 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:09.119988 10826 rpcz_store.cc:276] 0812 19:23:03.058878 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:03.059186 (+   308us) service_pool.cc:227] Handling call
0812 19:23:03.663284 (+604098us) ts_tablet_manager.cc:928] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
0812 19:23:05.283897 (+1620613us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f483e5fe 00007f98fd669a39 00007f98f485b8bb 00007f98f485862a 00007f98f4858552 00007f98fc669691
0812 19:23:08.018503 (+2734606us) tablet_copy_client.cc:361] Tablet copy session begun
0812 19:23:08.797124 (+778621us) tablet_metadata.cc:641] Metadata flushed
0812 19:23:08.797522 (+   398us) tablet_copy_client.cc:490] Wrote new tablet metadata
0812 19:23:09.080118 (+282596us) tablet_copy_client.cc:411] Wrote new consensus metadata
0812 19:23:09.080434 (+   316us) tablet_replica.cc:205] Creating consensus instance
0812 19:23:09.080760 (+   326us) ts_tablet_manager.cc:983] Replica registered.
0812 19:23:09.080951 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":239,"spinlock_wait_cycles":55899520,"tablet-copy.queue_time_us":387729,"thread_start_us":3342557,"threads_started":2}
I20260812 19:23:09.212540  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:09.212596 10826 tablet_copy_client.cc:791] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:23:09.211853  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:09.201582 10818 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:09.213673 10826 tablet_copy_client.cc:655] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:23:09.213948 10818 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:09.214767  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:09.216250  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:09.146791 11120 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:09.214413 10818 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:09.217423 11120 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:09.218755  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:09.219842  6347 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:09.220955  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:09.222518  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:09.223315 10784 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:09.224076 11109 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:09.224388  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:09.224463 11109 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:09.224843 11130 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:09.225049 11109 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:09.225329 11130 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:09.225706 11130 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:09.226161  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:09.226836 10784 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:09.228154  6241 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:09.216298  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:09.233672  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 91771.2us
I20260812 19:23:09.236721  6353 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260812 19:23:09.232622  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:09.243547  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:09.146629 10795 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.197798 11089 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:09.247418  6241 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:09.246765 10784 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:09.259991  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:09.246908 10298 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:09.263571  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:09.263724 11039 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:23:09.257756 11080 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:09.267356 11080 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:09.262425 11120 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.267741 11080 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:09.267951  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:09.268762 10738 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:09.269385 10738 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:09.243219 10938 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260812 19:23:09.271334  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:09.272171 10738 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:09.273761  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:09.274487 10738 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:09.275591  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:09.274712  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:09.279893  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.280467  6238 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:09.248881 11089 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:09.291913 10826 tablet_copy_client.cc:531] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:23:09.293169 11075 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.294229  6229 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:09.272202 11120 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:09.294739 10738 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:09.289610  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:09.297489 10795 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:09.299232  6238 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:09.303093 11088 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:09.305128 11088 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:09.305565 11088 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:09.302147  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:09.300912 11080 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.309839  6359 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
W20260812 19:23:09.313562  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 89228.3us
I20260812 19:23:09.290756 11089 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:09.319640  6238 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:09.317433  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.328604  6235 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:09.330008  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:09.334985  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:09.313024 10732 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:09.335968 10818 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.316485 11090 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:09.345417 11018 consensus_queue.cc:1046] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:23:09.347841 11080 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:09.348434  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:09.349289 10577 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 19:23:09.350943  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 61406.4us
I20260812 19:23:09.352339  6238 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:09.341451  6235 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:09.375138 10795 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:09.375535  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:09.377432  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:09.378250 11039 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:09.378736 10577 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:09.379638 11039 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:09.380172 11039 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:09.380451 11018 raft_consensus.cc:3032] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:09.380862 11018 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:09.381775 11018 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:09.384130  6350 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:09.385780  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:09.386094 10784 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:09.385784  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.386817  6473 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:09.387794  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:09.378837 11085 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:09.391995  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.389878  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.395936  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:09.386930 11109 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.384277 10818 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:09.394695 11085 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:09.349272 11089 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.397866 11085 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:09.397938  6474 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:09.397893  6232 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:09.399168 11109 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:09.399600 11089 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:09.400161 11075 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:09.400389  6054 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 108) took 11014 ms. Trace:
I20260812 19:23:09.400267 11032 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:23:09.401052 11020 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:23:09.402678  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.403507  6470 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:09.405058  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:09.405604  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.400916  6054 rpcz_store.cc:276] 0812 19:22:58.386132 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:22:58.386555 (+   423us) service_pool.cc:227] Handling call
0812 19:23:09.400299 (+11013744us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:08.741349 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:08.741977 (+   628us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:08.742039 (+    62us) write_op.cc:435] Acquired schema lock
0812 19:23:08.742060 (+    21us) tablet.cc:660] Decoding operations
0812 19:23:08.743789 (+  1729us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:08.743910 (+   121us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:08.743937 (+    27us) tablet.cc:683] Acquiring locks for 15 operations
0812 19:23:08.745474 (+  1537us) tablet.cc:699] Row locks acquired
0812 19:23:08.745519 (+    45us) write_op.cc:260] PREPARE: finished
0812 19:23:08.745707 (+   188us) write_op.cc:270] Start()
0812 19:23:08.745886 (+   179us) write_op.cc:276] Timestamp: P: 1786562588745622 usec, L: 0
0812 19:23:08.745931 (+    45us) op_driver.cc:331] REPLICATION: starting
0812 19:23:08.788462 (+ 42531us) log.cc:842] Serialized 5809 byte log entry
0812 19:23:09.097235 (+308773us) op_driver.cc:444] REPLICATION: finished
0812 19:23:09.255435 (+158200us) write_op.cc:301] APPLY: starting
0812 19:23:09.255550 (+   115us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:09.255829 (+   279us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:09.255956 (+   127us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:09.262390 (+  6434us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:09.262792 (+   402us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0812 19:23:09.278860 (+ 16068us) write_op.cc:312] APPLY: finished
0812 19:23:09.342276 (+ 63416us) log.cc:842] Serialized 107 byte log entry
0812 19:23:09.342460 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:09.342629 (+   169us) write_op.cc:454] Released schema lock
0812 19:23:09.342705 (+    76us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:09.343006 (+   301us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:09.343039 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":105569,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":157838,"apply.run_cpu_time_us":5410,"apply.run_wall_time_us":88064,"num_ops":15,"prepare.queue_time_us":130684,"prepare.run_cpu_time_us":22628,"prepare.run_wall_time_us":180187,"raft.queue_time_us":33923,"raft.run_cpu_time_us":55447,"raft.run_wall_time_us":140151,"replication_time_us":351179,"thread_start_us":363483,"threads_started":4,"wal-append.queue_time_us":162613}]]}
I20260812 19:23:09.406564  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.406904  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:09.367405 11090 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:09.410974 11020 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:09.411082  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:09.412006  6470 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260812 19:23:09.412267  6482 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:09.413049 11102 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:09.415747  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.454993  6232 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:09.396176 10967 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:09.437398  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:09.437909  6359 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260812 19:23:09.437177  6055 catalog_manager.cc:5495] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 2 to 4, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 4 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:09.458871  6347 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:09.375557 10795 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:09.439227  6344 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:09.461334 10795 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:09.446604 10732 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:09.462246 10732 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.464423 10732 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:09.439601  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:09.448259 10826 tablet_bootstrap.cc:492] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:23:09.441216  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:09.450567 11130 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.447438  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:09.470041  6359 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:23:09.470605  6238 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:09.470741  6232 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:23:09.472584 11130 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:09.454033 11020 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:09.475056 11020 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:09.451355 11090 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:09.449374  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:09.457073  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:09.457594 10967 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:09.453969 11102 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:09.460150  6055 catalog_manager.cc:5495] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 5 to 6, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 6 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:09.457828  6350 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:09.465457  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:09.466112  6347 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:09.451125 11018 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:09.469537  6349 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:09.442793  6342 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260812 19:23:09.484575  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:09.477677  6178 leader_election.cc:334] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.538s (SENT)
I20260812 19:23:09.479027  6354 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:09.483525  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:09.480573 10967 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:09.484123 10818 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:09.501745 10991 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:09.502599  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:09.503019  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.503602  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:09.502384 10818 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:09.491997 10577 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260812 19:23:09.505635 10991 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:09.506597 10585 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:09.506896 10991 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:09.507102 10585 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:09.507512 10585 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:09.479715 11032 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:09.508606 11032 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:09.485721 11102 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:09.506107 10818 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:09.520447 11155 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 19:23:09.521433  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 43807.9us
W20260812 19:23:09.522137  6178 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.639s (SENT)
I20260812 19:23:09.517318 11032 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:09.522526  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:09.527953 11130 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:09.528930  7598 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260812 19:23:09.529158  6178 leader_election.cc:334] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.800s (SENT)
I20260812 19:23:09.530532 11130 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:23:09.534199 11039 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:09.536118  6178 leader_election.cc:334] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.801s (SENT)
I20260812 19:23:09.543843  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:09.537436 11085 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.516867  6055 catalog_manager.cc:5495] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:09.519240  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:09.552654  6473 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260812 19:23:09.558161  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:09.562012  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:09.563027  6342 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:09.562738  6055 catalog_manager.cc:5495] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 4 to 5, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 5 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:09.569636  6350 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:09.572093  6474 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260812 19:23:09.574538  6055 catalog_manager.cc:5495] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 5 to 7, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 7 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:09.560456 10732 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:09.554766 11130 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:23:09.554977 10738 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:09.573151 11068 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election won for term 5
W20260812 19:23:09.589813  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 59416.7us
I20260812 19:23:09.595530  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:09.596143  6474 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:09.596724  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:09.597386  6232 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:09.597461  6236 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:09.598440  6344 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260812 19:23:09.599050  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:09.545284 11088 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.604172  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:09.604868  6238 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260812 19:23:09.602828  6055 catalog_manager.cc:5495] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 4 to 5, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 5 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:09.607834  6473 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
I20260812 19:23:09.604902  6229 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:09.610217  6228 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:09.610785  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:09.611037  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:09.605325  6238 pending_rounds.cc:76] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 3
I20260812 19:23:09.611950  6238 pending_rounds.cc:97] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260812 19:23:09.612185  6238 raft_consensus.cc:2866] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:09.613042  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:09.613103  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:09.613828  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:09.613042  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:09.599321 10577 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:09.618005  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:09.624795  6235 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260812 19:23:09.625356  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:09.627211  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.635247  6232 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:09.638615  6241 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:23:09.639227  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:09.639863  6228 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:09.655056 11088 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:09.592571 10738 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.653861  6055 catalog_manager.cc:5495] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 3 to 4, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 4 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:09.661594 11068 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:09.620055 10577 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:09.665639  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.670784 11039 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:09.672001  6055 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:09.676939  6224 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:09.677146  6473 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:09.686445 11085 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:09.688024  6470 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:09.695201 10577 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.723436  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.724326  6235 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:09.724824  6230 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:09.725344  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.726115  6224 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:09.674196 10795 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.732643  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.733475  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:09.734521  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 159959us
I20260812 19:23:09.735129  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.735914  6241 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:09.736876  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:09.737231  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:09.737795  6470 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:09.738179 11171 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:09.675040 11068 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.750065  6055 catalog_manager.cc:5495] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 3 to 4, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 4 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:09.755473 11177 consensus_queue.cc:1046] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:23:09.730067 10577 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:09.757112  6224 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260812 19:23:09.761029  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:09.728945 10732 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:09.762529  6055 catalog_manager.cc:5495] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 5 to 8, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 8 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:09.858902  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.726336 11032 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:09.860816  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 97743.5us
I20260812 19:23:09.872396  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:09.875751  6473 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:09.869221  6241 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260812 19:23:09.861380  6055 catalog_manager.cc:5495] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 2 to 5, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 5 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:09.869889  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.884162  6224 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:09.891464  6055 catalog_manager.cc:5495] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 3 to 4, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 4 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:09.898710  6228 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 3. Current term is 4. Ops: []
W20260812 19:23:09.913203 11162 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260812 19:23:09.761423 10818 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:09.893711 11098 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260812 19:23:09.883725 11165 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:09.859664 11102 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:09.931195  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 322690us
I20260812 19:23:09.933432  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.909366 11032 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:09.940627  6224 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:09.938954  6055 catalog_manager.cc:5495] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 4 to 5, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 5 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:09.948134  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:09.952251  6178 leader_election.cc:334] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.935s (SENT)
I20260812 19:23:09.952719  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:09.952751  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:09.955724  6055 catalog_manager.cc:5495] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 4 to 5, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 5 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:09.959007  6473 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:09.962301  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:09.971215 10738 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:09.973021 11102 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:09.974627 10818 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:09.955451 11039 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:09.969297 11090 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.978142 11090 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:09.950953 11171 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:09.967504  6055 catalog_manager.cc:5495] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 4 to 5, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 5 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:09.989099  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:09.998734  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:09.998186  6055 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 4 to 5, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 5 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:23:09.995959  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 257479us
I20260812 19:23:10.000761  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:09.974356 10585 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.004319  6055 catalog_manager.cc:5495] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 3 to 4, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 4 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:10.005539  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:09.960948 10577 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260812 19:23:09.989903 11085 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:23:10.007114  6482 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:09.940613 11165 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:10.007215  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 55005.9us
I20260812 19:23:10.009322  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:10.016004  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:10.010954  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:10.017190 11186 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:10.017757 11186 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:09.979568 11171 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:09.994416 10795 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:10.007476  6055 catalog_manager.cc:5495] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 4 to 8, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 8 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:23:10.041070  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:10.020419 11090 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.029s
I20260812 19:23:10.044106 11090 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:10.045439 11177 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:10.046671 11177 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:10.046998 11177 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:10.047170  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:10.048000 11177 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:10.048882  6465 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:23:10.049731 11177 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:10.049955  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:09.985893 10732 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.004522 10818 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:10.048035  6481 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:10.054361  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:10.003713 11039 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:10.064924  6483 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260812 19:23:10.065476  6473 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:23:10.060047  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.982s (SENT) [suppressed 11 similar messages]
I20260812 19:23:10.065845  6055 catalog_manager.cc:5495] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 4 to 5, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 5 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } }
I20260812 19:23:10.075114  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:10.065488  6474 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:10.087596  6055 catalog_manager.cc:5495] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:23:10.140895 11189 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.081s	user 0.001s	sys 0.001s
I20260812 19:23:10.022015 11168 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260812 19:23:10.019271 11161 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:10.053967 11186 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:10.174623  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 115577us
W20260812 19:23:10.183274  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 123250us
I20260812 19:23:10.186928  6055 catalog_manager.cc:5495] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 2 to 5, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 5 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:23:10.187875  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 171946us
I20260812 19:23:10.190933  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:10.182823  6470 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:10.191625  6235 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:10.192571  6228 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:10.194638  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:10.189982  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:10.199193  6224 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:10.200037 11168 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:10.200510 11168 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:10.204885  6473 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
W20260812 19:23:10.183482 10967 consensus_meta.cc:287] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.678s	user 0.012s	sys 0.001s
W20260812 19:23:10.183214 10991 consensus_meta.cc:287] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.676s	user 0.013s	sys 0.004s
I20260812 19:23:10.172398 11070 raft_consensus.cc:3032] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:10.207398  6055 catalog_manager.cc:5495] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 2 to 4, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 4 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:23:10.242826  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 55726.7us
W20260812 19:23:10.238497  6178 leader_election.cc:334] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.065s (SENT)
I20260812 19:23:10.179008 11102 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 19:23:10.193959 11018 consensus_meta.cc:287] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.004s
I20260812 19:23:10.260030  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:10.257725  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:10.262199  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:10.264588  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:10.252017 11178 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.493s	user 0.002s	sys 0.005s
I20260812 19:23:10.245622 11168 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:10.188912 11170 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260812 19:23:10.248334 11070 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:10.280752 11186 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:10.253057 10991 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.272243 10577 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260812 19:23:10.270462 10585 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:10.276993 11088 consensus_queue.cc:1046] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260812 19:23:10.246804 10967 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.285408 11199 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260812 19:23:10.219329 11039 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260812 19:23:10.287966  6354 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:10.316577  6354 raft_consensus.cc:595] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:10.265942 11032 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election won for term 4
W20260812 19:23:10.285749 11020 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.810s	user 0.005s	sys 0.007s
I20260812 19:23:10.371048  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:10.372601  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 104919us
I20260812 19:23:10.300659  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:10.375453  6475 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:10.305589  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:10.309710  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:10.310561  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 72125.8us
I20260812 19:23:10.311313 11199 raft_consensus.cc:3032] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
W20260812 19:23:10.383381  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 64236.2us
I20260812 19:23:10.311007 10818 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:23:10.320201  6464 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260812 19:23:10.269973 11181 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:10.249032 11161 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260812 19:23:10.369993  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:10.290900 11186 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:10.384212  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:10.376152  6229 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:10.291765 11195 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:10.304481 11085 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:10.316047 10967 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:10.405076  6230 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:23:10.439137  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46262us
W20260812 19:23:10.488724  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 183282us
I20260812 19:23:10.505241  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:10.508361 11210 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260812 19:23:10.508852  6482 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:10.509770  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:10.509989  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:10.511042  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:10.511950  6465 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:10.512470  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:10.513027  6229 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:10.513665 11090 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:23:10.383462 11199 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:10.385182 11165 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:10.515377 11199 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.516664  6482 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:10.516739 11199 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:10.443120 10738 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:10.396001 11032 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:10.511178  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:10.519022 11032 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:10.521373 11205 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260812 19:23:10.522279  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:10.524396 11181 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:10.524657  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:10.524963 11181 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:10.522310  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:10.527720  6238 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:10.527655  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:10.396009 11186 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:10.449416 11070 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.537005  6229 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:10.537418 11170 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:10.538038 11170 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.538404  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:10.539207  6483 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
W20260812 19:23:10.540518  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 156414us
I20260812 19:23:10.534415  6236 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:10.410467 11085 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.540643  6475 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260812 19:23:10.552192  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:10.553021  6349 raft_consensus.cc:595] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:10.553447  6349 raft_consensus.cc:603] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:10.555948  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:10.557029  6345 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:10.559487  6347 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:10.559949  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:10.390765 11020 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.526057 11181 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.551519 11165 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:10.564167 10795 raft_consensus.cc:3032] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:23:10.566277  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:10.575203  6344 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:10.568432  6354 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:10.569106  6352 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:10.490491 10577 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:10.573571  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:10.574223  6238 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:10.551725 11161 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:10.407426 10585 consensus_queue.cc:1046] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.155s
I20260812 19:23:10.549391 11170 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:10.593386  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:10.591465  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:10.586756  6477 raft_consensus.cc:2379] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:10.574721 10795 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:10.589821 10577 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.670746 10577 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:10.671829 11206 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260812 19:23:10.675079  6178 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.202s (SENT)
I20260812 19:23:10.675751  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:10.678586  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 45155.9us
I20260812 19:23:10.679819  6230 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:10.567945 11090 consensus_queue.cc:1046] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260812 19:23:10.586253 11165 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:10.633195 11181 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:10.626094 11039 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.074s
I20260812 19:23:10.678681 10991 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:10.717350  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 56587us
I20260812 19:23:10.747510 10784 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:10.748292 10784 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.639977 11161 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260812 19:23:10.740828  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 149472us
I20260812 19:23:10.694828  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:10.760399  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:10.762984  6349 raft_consensus.cc:595] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:10.765878  6178 connection.cc:232] RPC call timeout handler was delayed by -1.4386655872222036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3166s for a response
W20260812 19:23:10.766335  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2201015101745725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30870000000000003s for a response
I20260812 19:23:10.765089  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:10.766731  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1632469559554011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.319s for a response
W20260812 19:23:10.735677 11216 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260812 19:23:10.722049 11177 consensus_meta.cc:287] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.005s
I20260812 19:23:10.715365 11020 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:10.694384 10585 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:10.722523 11170 raft_consensus.cc:3032] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:10.786034  6474 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:10.751359 10784 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:10.773438 11102 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:10.707775 11165 raft_consensus.cc:686] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:10.775163 11039 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:10.768030 11090 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:10.727021 10665 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:10.778402  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:10.715823 11085 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:10.775642  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:10.717626 11214 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:10.791571 11102 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:10.796886 11165 consensus_queue.cc:237] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.797469 10665 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:10.750982 10795 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.787936 10585 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:10.799528 11088 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:10.800958  6349 raft_consensus.cc:595] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:10.808074  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:10.786438 11170 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:23:10.817354  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 110983us
I20260812 19:23:10.818540  6349 raft_consensus.cc:603] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:10.819730  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:10.824090  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:10.827256 11169 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:10.820254 11211 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260812 19:23:10.827764 11169 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:10.828785 11211 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:23:10.828624 11169 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.829890 11169 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:10.811169 11039 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:10.832005 11102 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:10.832180 10665 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:10.820406 10991 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:10.833150 11161 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:10.818248 11088 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:10.839519 11070 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:10.839633 11088 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.841107 10795 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:10.813540 11090 raft_consensus.cc:686] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:10.847448 11090 consensus_queue.cc:237] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:10.840066  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:10.873724  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:10.824633 11228 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:10.887624  6232 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:23:10.875412  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:10.900089  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1695) took 1508 ms. Trace:
I20260812 19:23:10.900853  6481 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:10.900687  6477 rpcz_store.cc:276] 0812 19:23:09.391582 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:09.392436 (+   854us) service_pool.cc:227] Handling call
0812 19:23:10.899851 (+1507415us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400272254. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:10.900012 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2706171648}
I20260812 19:23:10.899765  6354 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:23:10.913504  6238 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260812 19:23:10.917269  6473 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260812 19:23:10.922879  6230 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260812 19:23:10.923060  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:10.871411 10784 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260812 19:23:10.924435  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:10.871951 11214 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:10.926910  6224 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 4. Current term is 5. Ops: []
W20260812 19:23:10.928871 11224 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.109s	user 0.001s	sys 0.001s
I20260812 19:23:10.929275  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:10.931147  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:10.931358 11102 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:10.897298 11169 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260812 19:23:10.931440  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:11.036629 11220 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:11.037096 11240 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260812 19:23:11.037869 10585 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:10.904543 11161 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:11.040498 11161 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:11.043006  6344 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:11.043529 11169 raft_consensus.cc:3032] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:11.043840  6344 raft_consensus.cc:595] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:10.931798  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:11.044328  6344 raft_consensus.cc:603] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:11.037464 11220 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:11.044982  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 115812us
I20260812 19:23:10.980338  6352 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 19:23:10.982548  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:10.932307  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:11.045818  6349 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:11.050717  6236 raft_consensus.cc:2396] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260812 19:23:10.925321  6235 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:10.952113  6350 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
W20260812 19:23:10.942049  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 116252us
I20260812 19:23:10.942720  6232 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 19:23:11.055358 11092 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:10.903520 11186 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.055840 11092 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:10.932606 10738 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.124s
I20260812 19:23:10.903175  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:11.057821  6359 raft_consensus.cc:2396] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260812 19:23:11.057621  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:11.056370 11092 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:11.044046 11169 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:11.042533 11214 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:23:10.987708 11247 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260812 19:23:11.071645  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260812 19:23:11.071930  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 231917us
I20260812 19:23:11.072886  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:11.081583  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:11.081790  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:23:11.082525  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:11.026926 10577 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:10.943027 10991 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:11.105343  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:11.093153 11039 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:11.010692 11020 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:11.070562 11228 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:11.115826  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:11.083287 11214 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:11.095465 10818 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:11.068723 11102 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.131495  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:11.158756  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:11.161355  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:11.153533 10585 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:11.147867 11161 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:11.104138 10991 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:11.168720  6349 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:11.173687 11223 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:11.174484 11161 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:11.174814 11181 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:11.177232 11220 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:11.111969 10577 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:11.180783  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 83849.2us
I20260812 19:23:11.184721  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:10.933718 11170 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.165671 11070 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:11.125402 11020 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:11.186221 11168 consensus_meta.cc:287] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.895s	user 0.014s	sys 0.000s
I20260812 19:23:11.130625 11228 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.203840  6354 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:23:11.199584  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 115653us
I20260812 19:23:11.148020 11169 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.207501  6417 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:11.210485  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:11.193342 11161 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:11.185169 11177 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260812 19:23:11.194669 11181 raft_consensus.cc:686] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:11.174233 11232 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260812 19:23:11.240190  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:11.237327  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:11.237668  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:11.241855  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:11.218520 10738 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:11.221966  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:11.179016 11207 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260812 19:23:11.224480 11070 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:11.204844 11168 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.210559 10585 consensus_queue.cc:1046] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260812 19:23:11.227119 11186 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:11.251156  6232 raft_consensus.cc:3032] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:11.264086  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:11.236336 10818 raft_consensus.cc:686] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:11.308315 11181 consensus_queue.cc:237] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.312541  6232 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:11.235836 11243 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:11.248185 11195 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:11.327404  6347 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:11.310052 11207 consensus_queue.cc:1225] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260812 19:23:11.336297  6232 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.337395  6232 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:11.338091 10732 raft_consensus.cc:3032] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Stepping down as leader of term 6
W20260812 19:23:11.332433 10826 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260812 19:23:11.247937 10738 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:11.338564 10732 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:11.235890 11039 raft_consensus.cc:686] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:11.267623 10577 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:11.315600 11130 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:11.369202 10991 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:11.329372 11199 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.812s	user 0.013s	sys 0.003s
W20260812 19:23:11.357549  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 115762us
I20260812 19:23:11.360198  6232 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260812 19:23:11.371243 11020 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:11.371556  6232 pending_rounds.cc:76] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 3
I20260812 19:23:11.371860  6232 pending_rounds.cc:97] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260812 19:23:11.372087  6232 raft_consensus.cc:2866] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:11.372236 11168 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:11.373818  6178 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:11.316591 11186 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:11.347354 11195 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:23:11.389134  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 141506us
I20260812 19:23:11.360590 10738 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:11.393061  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:11.376833 11223 raft_consensus.cc:686] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:11.395833 11195 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:11.391861 11130 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:11.487939  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:11.484861  6235 pending_rounds.cc:76] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 1
I20260812 19:23:11.490485  6235 pending_rounds.cc:97] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260812 19:23:11.490830  6235 raft_consensus.cc:2866] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:11.326521 11262 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.161s
I20260812 19:23:11.493234  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:11.497459  6344 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
W20260812 19:23:11.494382  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 89341.1us
I20260812 19:23:11.498031  6344 pending_rounds.cc:76] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 2
I20260812 19:23:11.498703  6344 pending_rounds.cc:97] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260812 19:23:11.499042  6344 raft_consensus.cc:2866] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:11.495967  6232 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:11.494741  6352 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260812 19:23:11.501271  6352 pending_rounds.cc:76] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 3
I20260812 19:23:11.501432  6352 pending_rounds.cc:97] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260812 19:23:11.501565  6352 raft_consensus.cc:2866] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:11.381312 11186 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.479187 11102 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:11.506138  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:11.507421  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:11.551641  6344 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:11.552075  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:11.554850  6352 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:11.489048 10991 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:11.493811 11263 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:11.378878 11161 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:11.558902  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 66263.3us
I20260812 19:23:11.563908  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:11.512633 10784 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:11.508996 11039 consensus_queue.cc:237] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.579371  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:11.581499  6350 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:11.582062 11170 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:11.585278 10826 tablet_bootstrap.cc:492] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 19:23:11.586723 11266 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:11.485441 10818 consensus_queue.cc:237] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.597257  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1737) took 1009 ms. Trace:
I20260812 19:23:11.597750  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:11.506789 11270 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260812 19:23:11.567608 11102 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:11.634873  6347 rpcz_store.cc:276] 0812 19:23:10.587859 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:10.593040 (+  5181us) service_pool.cc:227] Handling call
0812 19:23:11.597006 (+1003966us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b540036d154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:11.597192 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1608893184}
I20260812 19:23:11.591197 10826 tablet_bootstrap.cc:492] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:23:11.573568 11228 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:11.651484  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:11.554008 11032 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260812 19:23:11.494930 10732 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.598398 11219 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:11.654775  6232 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260812 19:23:11.667567  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 457106us
I20260812 19:23:11.669457  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:11.671021 11228 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:11.640700 11266 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:11.681643  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:11.684609  6224 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:11.654211 11261 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:11.687199 11088 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:11.685884  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:11.691807  6230 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:11.658970 11070 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:11.692664 11192 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:11.693156 11192 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:23:11.695441  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 189409us
W20260812 19:23:11.696389  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 491478us
I20260812 19:23:11.576696 10991 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.701910  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:11.694103 11192 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.704097 11192 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:11.570858 11263 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.347071 11243 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:11.724056  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:11.724731  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:11.707563 10826 ts_tablet_manager.cc:1397] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 2.260s	user 0.041s	sys 0.034s
I20260812 19:23:11.724996  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:11.725466  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:11.725910  6230 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:11.724084  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:11.727020  6228 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:11.729183  6224 raft_consensus.cc:3032] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:11.729562  6224 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:11.695372 11266 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:11.652223 11102 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.740655  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:11.729746  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 90947.5us
I20260812 19:23:11.736028  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:11.769520  6481 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:11.764240  6475 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260812 19:23:11.770293  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:11.771569  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:11.766639  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:11.767563  6349 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260812 19:23:11.773847  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 77647.9us
I20260812 19:23:11.774605  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:11.779122  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:11.780963  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:11.792179  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:11.793267  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:11.794360  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:11.795257  6473 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:11.769541  6224 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.799722  6224 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:11.726182 11070 raft_consensus.cc:686] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:11.735984 11261 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:11.811647  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:11.808372 11254 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.027s	sys 0.048s
I20260812 19:23:11.808650  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:11.804287 11130 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:11.780053 11039 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:11.766613 11266 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:11.680855 11282 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.140s
I20260812 19:23:11.813323  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:11.822150 11254 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.027s	sys 0.048s
I20260812 19:23:11.840327  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:11.706964 11268 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
I20260812 19:23:11.801317 11168 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:11.686730 11223 consensus_queue.cc:237] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.812959 11090 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
W20260812 19:23:11.856793  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45242.4us
I20260812 19:23:11.860540  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:11.836442 11219 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:11.863016  6230 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:11.864836  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:11.852895 11068 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:11.875084  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:11.859880 11186 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:11.883293  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:11.885401  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:11.870054 11168 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:11.887616  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:11.873621 11092 consensus_meta.cc:287] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.779s	user 0.013s	sys 0.000s
I20260812 19:23:11.890229  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:11.869553 11243 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:11.873257 11199 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:11.903316 11199 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:11.903805 11199 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:23:11.905767 11275 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260812 19:23:11.840814 11039 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.873029 11219 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:11.907800 11219 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:23:11.886389 11274 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:11.926225 11274 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:11.926710 11274 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:11.909191 11092 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:11.932080 11092 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:11.838466 11261 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:11.938779 11261 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:11.942472 11214 consensus_meta.cc:287] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.788s	user 0.013s	sys 0.000s
I20260812 19:23:11.901398 11102 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:11.876644 11161 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:11.943166 11214 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.908427 11219 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 19:23:11.978775  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 88645.3us
I20260812 19:23:11.911213 11285 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:11.895478 11090 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:11.980103 11090 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.980773  6236 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:11.899444 11211 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:11.982939 11228 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:11.871284 11263 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:11.983364 11228 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:11.983750 11228 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:11.916857 10991 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:11.983922  6238 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260812 19:23:11.909636 11168 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.988623 11168 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:11.920984 10826 raft_consensus.cc:348] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a [term 7 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.922402 11299 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:11.875787 11070 consensus_queue.cc:237] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.908427 11039 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:11.943570 11161 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:12.018028  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:12.014199 11299 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:12.018954  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:12.019277 11161 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:11.871369 11068 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:12.019945 11068 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:12.020277 11299 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:12.020458 11169 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:12.020897 11299 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:12.021158  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:12.021364 11299 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:12.022369  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:11.947224 11220 raft_consensus.cc:3032] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:12.026877 11220 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:12.027654 10826 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:23:11.971145 11195 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:11.977747 11274 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:11.978439 10738 consensus_meta.cc:287] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.005s
I20260812 19:23:11.991549  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:12.102365  6238 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:11.992166  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:12.103752  6475 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:11.993718  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:11.996893  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:12.000706  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:12.107197  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 106627us
I20260812 19:23:12.109758  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:12.008703  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:11.982126 11266 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:12.114200  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:12.121060  6232 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7. Ops: []
W20260812 19:23:12.127880  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 242534us
I20260812 19:23:12.100916 11263 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:12.128947  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:12.132957  6481 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260812 19:23:12.027915 11220 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:12.136736  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:12.112434 11161 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:12.138248  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:12.139281  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 348361us
I20260812 19:23:12.123330 11257 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:12.146013  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:12.162853  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:12.164425  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:12.170825  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:12.172276  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:12.173190  6359 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:12.161059  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:12.182432  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:12.138319 11165 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:12.188019  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:12.193909  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:12.195492  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:12.109898 10738 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:12.119984 11039 consensus_queue.cc:1046] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260812 19:23:12.190611  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:12.141007 11285 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:12.187048  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:12.203213  6345 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260812 19:23:12.216805  6345 pending_rounds.cc:76] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 1
I20260812 19:23:12.145315 11261 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:12.210675  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:12.210990  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:12.209772  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:12.213179  6229 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 5: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:12.028546 10826 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:23:12.217048  6345 pending_rounds.cc:97] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260812 19:23:12.227380  6345 raft_consensus.cc:2866] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:12.226926  6359 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:12.210371  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:12.160174 11168 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:12.226958  6349 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:12.228737  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:12.160223 11214 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:12.230983  6352 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:12.274922  6417 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:12.179843 11232 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:12.230561  6344 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:12.185026 11161 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:12.196668 11259 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:12.188895 11219 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:12.141110 11181 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260812 19:23:12.280988  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:12.192735 11177 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:12.144071 11263 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:12.288712  6465 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:12.291918  6298 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:12.352056  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:12.373121  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:12.357333  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:12.224751 11224 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260812 19:23:12.187698 11273 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.120s
I20260812 19:23:12.320070 11211 consensus_queue.cc:1046] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.212s
I20260812 19:23:12.510828 11214 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:12.291925 11223 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:12.349918 11279 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:12.534677  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:12.216336 11285 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:12.540886  6230 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260812 19:23:12.540979  6178 connection.cc:232] RPC call timeout handler was delayed by -1.4560737679712474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260812 19:23:12.542104 11219 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:23:12.476414 11192 consensus_meta.cc:287] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.772s	user 0.009s	sys 0.003s
I20260812 19:23:12.307464 10795 raft_consensus.cc:3032] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
W20260812 19:23:12.548095  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 81548.3us
I20260812 19:23:12.549597  6359 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 8
I20260812 19:23:12.550053  6342 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:23:12.552577  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 179687us
I20260812 19:23:12.642860  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:12.219097 11085 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.320s
I20260812 19:23:12.292034 11262 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.256s
I20260812 19:23:12.290045 11261 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:12.600696  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 308863us
W20260812 19:23:12.605446  6178 connection.cc:232] RPC call timeout handler was delayed by -1.4389737681485713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
W20260812 19:23:12.658411  6178 connection.cc:232] RPC call timeout handler was delayed by -1.3723737681284547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260812 19:23:12.658861  6178 connection.cc:232] RPC call timeout handler was delayed by -1.3057737681083381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260812 19:23:12.659214  6178 connection.cc:232] RPC call timeout handler was delayed by -1.06907376809977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260812 19:23:12.659502  6178 connection.cc:232] RPC call timeout handler was delayed by -1.0177737681660801s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
I20260812 19:23:12.351032 11299 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:12.548437 11169 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:12.603925  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:12.648854  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:12.572497 10784 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:12.670544  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:12.671072 10784 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:12.671496 10784 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:12.671738  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:12.646929 11219 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:12.676635 11361 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 19:23:12.671798 11315 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260812 19:23:12.584565 11274 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:12.597465 11195 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:12.607759 11259 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:12.596956  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:12.552161 11177 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:12.632746 11285 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:12.649633 10795 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:12.801098 10795 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:12.691481 10585 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:12.692103 11265 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:12.692530  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 91005us
I20260812 19:23:12.693020 11324 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:12.832453 11335 raft_consensus.cc:3032] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:12.832937 11335 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:12.832635 11324 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:12.693626 11039 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:12.651065 11279 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:12.834739 11039 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:12.835368 11279 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:12.837837 11265 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:12.584103 10818 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.096s
I20260812 19:23:12.720218 11266 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:12.720031 11259 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:12.637579 11223 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:12.600697 11214 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:12.723240 11290 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:12.276134  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:12.856647  6229 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:12.857120  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1776) took 1377 ms. Trace:
W20260812 19:23:12.746995 11330 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260812 19:23:12.684736 11299 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260812 19:23:12.858834  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1704) took 1181 ms. Trace:
I20260812 19:23:12.857482  6242 rpcz_store.cc:276] 0812 19:23:11.479451 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:11.479596 (+   145us) service_pool.cc:227] Handling call
0812 19:23:11.479930 (+   334us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:11.836031 (+356101us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:11.836060 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:11.848566 (+ 12506us) log.cc:842] Serialized 26 byte log entry
0812 19:23:11.941750 (+ 93184us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b48001110d8. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fc61f7f1 00007f98fc6168e7 00007f98fc61677a 00007f98fc70a95f 00007f98fc70a627 00007f98fc71eb2c 00007f98fc71ead8 00007f98fc71ea58 00007f98fc71ea13 00007f98fc71dcbc 00007f98fb69fbe6
0812 19:23:12.312356 (+370606us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:12.312415 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:12.312514 (+    99us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:12.856807 (+544293us) raft_consensus.cc:1671] finished
0812 19:23:12.856828 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:12.857058 (+   230us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":78987,"raft.run_cpu_time_us":3461,"raft.run_wall_time_us":374531,"spinlock_wait_cycles":9687808,"thread_start_us":792828,"threads_started":2,"wal-append.queue_time_us":992607}
I20260812 19:23:12.859164  6241 rpcz_store.cc:276] 0812 19:23:11.677772 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:11.677915 (+   143us) service_pool.cc:227] Handling call
0812 19:23:11.700712 (+ 22797us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:11.730674 (+ 29962us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:11.730721 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:11.768703 (+ 37982us) log.cc:842] Serialized 26 byte log entry
0812 19:23:12.126870 (+358167us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:12.126928 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:12.127027 (+    99us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:12.858607 (+731580us) raft_consensus.cc:1671] finished
0812 19:23:12.858625 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:12.858777 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23063,"raft.queue_time_us":13641,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":35145,"thread_start_us":288831,"threads_started":1,"wal-append.queue_time_us":742294}
I20260812 19:23:12.853677 11211 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:12.863773 11211 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:12.864647 11211 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:12.818882 10585 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:23:12.725062 10738 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:12.822539 11327 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.296s	user 0.000s	sys 0.000s
I20260812 19:23:12.870342  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1726) took 1135 ms. Trace:
W20260812 19:23:12.823750 11322 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.600s	user 0.001s	sys 0.001s
I20260812 19:23:12.873215  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1729) took 1137 ms. Trace:
I20260812 19:23:12.873646  6483 rpcz_store.cc:276] 0812 19:23:11.736128 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:11.769682 (+ 33554us) service_pool.cc:227] Handling call
0812 19:23:11.809092 (+ 39410us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:11.831170 (+ 22078us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:11.831201 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:11.845441 (+ 14240us) log.cc:842] Serialized 26 byte log entry
0812 19:23:12.006921 (+161480us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:23:12.006980 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:12.007088 (+   108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:12.873016 (+865928us) raft_consensus.cc:1671] finished
0812 19:23:12.873034 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:12.873155 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23055,"raft.queue_time_us":22001,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":6657,"thread_start_us":130074,"threads_started":1,"wal-append.queue_time_us":278050}
I20260812 19:23:12.823588 11130 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:12.875914 11130 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:12.682345 11272 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.602s
I20260812 19:23:12.831434  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:12.878265  6232 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:12.878368 11272 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:12.878950 11272 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:12.842875  6298 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:12.879834 11272 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:12.881191 11272 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:12.882962 11363 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:12.833978 11335 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:12.898187  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1733) took 1160 ms. Trace:
I20260812 19:23:12.898726  6465 rpcz_store.cc:276] 0812 19:23:11.737300 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:11.739774 (+  2474us) service_pool.cc:227] Handling call
0812 19:23:12.897964 (+1158190us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b5400364a54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:12.898109 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1140019072}
W20260812 19:23:12.853327 11341 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.301s	user 0.000s	sys 0.003s
W20260812 19:23:12.914956 11358 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
I20260812 19:23:12.870713  6474 rpcz_store.cc:276] 0812 19:23:11.735157 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:11.737661 (+  2504us) service_pool.cc:227] Handling call
0812 19:23:11.738081 (+   420us) raft_consensus.cc:1457] Updating replica for 4 ops
0812 19:23:11.801384 (+ 63303us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:11.801416 (+    32us) raft_consensus.cc:1525] Triggering prepare for 4 ops
0812 19:23:11.809601 (+  8185us) log.cc:842] Serialized 104 byte log entry
0812 19:23:12.143635 (+334034us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:12.550720 (+407085us) log.cc:842] Serialized 14 byte log entry
0812 19:23:12.553395 (+  2675us) log.cc:842] Serialized 14 byte log entry
0812 19:23:12.583346 (+ 29951us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:12.583434 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:12.717429 (+133995us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b180038bae0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c764 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:23:12.870082 (+152653us) raft_consensus.cc:1671] finished
0812 19:23:12.870112 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:12.870263 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":98283,"prepare.queue_time_us":70632,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":83,"raft.queue_time_us":106576,"raft.run_cpu_time_us":560,"raft.run_wall_time_us":53054,"spinlock_wait_cycles":18255744,"thread_start_us":617964,"threads_started":2,"wal-append.queue_time_us":393317}
W20260812 19:23:12.966804  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 306788us
I20260812 19:23:12.912848 11177 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:12.938779 11335 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:23:12.967831  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 125056us
I20260812 19:23:12.975754  6345 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260812 19:23:12.978078  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:12.968209  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:12.986044  6232 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:12.659716  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:12.987473  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:12.966939 11220 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:12.967393 11290 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:13.025473  6359 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
W20260812 19:23:13.041986  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 44218.9us
I20260812 19:23:13.030073  6229 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:13.043058  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:13.045547  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:13.042253  6224 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.011s	sys 0.010s
W20260812 19:23:13.054240  6224 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.011s	sys 0.010s
I20260812 19:23:13.054785  6228 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:12.989907 10577 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:13.057502  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:12.990026 11243 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:13.004588 11254 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:12.995095 11195 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:13.075346  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:13.008770 10732 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:13.087754  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:13.088702  6482 raft_consensus.cc:2396] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260812 19:23:13.088801  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:13.089670  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:13.091167  6474 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
W20260812 19:23:13.066303  6417 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.000s	sys 0.019s
W20260812 19:23:13.093031  6417 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.000s	sys 0.020s
W20260812 19:23:13.093752  6475 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.007s	sys 0.028s
W20260812 19:23:13.094102  6475 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.007s	sys 0.028s
W20260812 19:23:13.094707  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 819816us
I20260812 19:23:13.097007  6483 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:13.076793  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1730) took 1340 ms. Trace:
I20260812 19:23:13.079394  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:13.081648  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:13.093989  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:13.061528 11085 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260812 19:23:13.100944  6236 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.015s	sys 0.027s
I20260812 19:23:13.102049  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:13.152478  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.036s	sys 0.030s
W20260812 19:23:13.152978  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.036s	sys 0.031s
W20260812 19:23:13.152256  6236 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.030s	sys 0.037s
I20260812 19:23:13.145046  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:13.153319  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 620775us
I20260812 19:23:13.059595 11320 raft_consensus.cc:2741] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260812 19:23:13.102667  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:13.167268  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:13.171905  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:13.079802 11088 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:13.170161  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:13.172674  6474 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:13.080035 11192 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:13.082477 11270 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:13.185282  6473 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
W20260812 19:23:13.195714  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 93135.9us
I20260812 19:23:13.098619  6464 rpcz_store.cc:276] 0812 19:23:11.736450 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:11.738734 (+  2284us) service_pool.cc:227] Handling call
0812 19:23:11.791511 (+ 52777us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:11.791758 (+   247us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:23:12.105749 (+313991us) log.cc:842] Serialized 14 byte log entry
0812 19:23:12.564670 (+458921us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b180037f120. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff57b
0812 19:23:12.604219 (+ 39549us) log.cc:842] Serialized 14 byte log entry
0812 19:23:12.801783 (+197564us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b180037f120. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:23:13.076440 (+274657us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:13.076488 (+    48us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:13.076534 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:13.076620 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:13.076736 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":60991,"prepare.queue_time_us":374413,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":78,"raft.queue_time_us":103864,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":8564,"spinlock_wait_cycles":39414784,"thread_start_us":836110,"threads_started":3,"wal-append.queue_time_us":247191}
I20260812 19:23:13.100833 11130 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:13.100767 11039 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:13.151198 11195 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:13.161870 10585 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:13.089193 11230 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:13.062218 11290 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.151412 11356 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:13.041393 11357 consensus_queue.cc:1046] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.180s
I20260812 19:23:13.154464 11266 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:13.156014 11214 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:13.155682 11265 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:13.073312 10577 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.227921 11363 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:13.233245 11363 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.233418 11356 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.233946 10577 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:13.233206 11288 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260812 19:23:13.235719 11356 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:13.236352 10826 ts_tablet_manager.cc:1428] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 1.511s	user 0.011s	sys 0.019s
W20260812 19:23:13.236712 10826 ts_tablet_manager.cc:1460] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: Tablet startup took 1511ms
I20260812 19:23:13.092329 11259 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:13.215016  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:13.077584 11243 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.220733  6347 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:13.220829  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:13.191418 11324 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:13.248562 11228 consensus_meta.cc:287] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.264s	user 0.015s	sys 0.003s
I20260812 19:23:13.249084 11228 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.249646 11363 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:13.213361  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:13.175215 11223 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:13.177227 11261 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:13.223731  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:13.175391 11361 consensus_queue.cc:1046] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.081s
I20260812 19:23:13.224457  6464 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:13.257838  6464 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260812 19:23:13.257844 11243 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:13.259227  6464 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260812 19:23:13.224678  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:13.260660 11223 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:13.261147  6345 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:13.226063  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:13.261253 11223 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.261974  6482 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:13.263358 11223 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:13.267061 10784 consensus_meta.cc:287] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.595s	user 0.017s	sys 0.024s
I20260812 19:23:13.230270 11266 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.267585 10784 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.268535  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1724) took 1078 ms. Trace:
I20260812 19:23:13.268975 11266 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:13.269490 11290 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:13.268901  6236 rpcz_store.cc:276] 0812 19:23:12.189724 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:12.217518 (+ 27794us) service_pool.cc:227] Handling call
0812 19:23:12.217951 (+   433us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:12.218249 (+   298us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:12.218284 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:12.218860 (+   576us) log.cc:842] Serialized 26 byte log entry
0812 19:23:13.153489 (+934629us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:13.153524 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:13.153589 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:13.268326 (+114737us) raft_consensus.cc:1671] finished
0812 19:23:13.268349 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:13.268477 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":819036,"threads_started":1,"wal-append.queue_time_us":976522}
W20260812 19:23:13.270403 11161 consensus_meta.cc:287] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.761s	user 0.006s	sys 0.013s
I20260812 19:23:13.272050  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:13.207022 11320 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260812 19:23:13.286641  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 59677.9us
W20260812 19:23:13.208971 11165 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.021s	sys 0.041s
I20260812 19:23:13.229658  6228 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:13.225747 11039 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:13.292300  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:13.293042  6236 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
W20260812 19:23:13.231850 11304 log.cc:924] Time spent T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260812 19:23:13.232759  6241 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260812 19:23:13.214305  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:13.204954 11263 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:13.243664 11211 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:13.244827  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:13.247532 11199 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.343s	user 0.013s	sys 0.008s
W20260812 19:23:13.284384  6342 consensus_meta.cc:287] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.009s
I20260812 19:23:13.283844 11161 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:13.286209  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:13.269555 10784 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:13.284559  6481 raft_consensus.cc:2354] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8.
I20260812 19:23:13.290926  6465 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
W20260812 19:23:13.295573  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 53105.3us
I20260812 19:23:13.297904  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:13.276317  6482 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:13.304111  6238 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79"
dest_uuid: "a1541d11be514114966dc1e92a345298"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:35414
I20260812 19:23:13.321455  6238 raft_consensus.cc:595] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:13.304857  6342 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
W20260812 19:23:13.270342 11068 consensus_meta.cc:287] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.250s	user 0.013s	sys 0.006s
I20260812 19:23:13.299940  6474 raft_consensus.cc:2362] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6. Re-sending same reply.
I20260812 19:23:13.325471  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:13.271376 11230 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:13.091933 11254 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.298856 11309 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260812 19:23:13.311693 11361 raft_consensus.cc:3032] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:13.312351  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:13.313148  6483 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260812 19:23:13.345959  6473 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:13.314054  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:13.313160  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1786) took 1144 ms. Trace:
I20260812 19:23:13.346912  6224 rpcz_store.cc:276] 0812 19:23:12.169111 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:12.169226 (+   115us) service_pool.cc:227] Handling call
0812 19:23:12.169567 (+   341us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:12.192393 (+ 22826us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:12.192415 (+    22us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:12.204672 (+ 12257us) log.cc:842] Serialized 52 byte log entry
0812 19:23:13.055020 (+850348us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:23:13.055075 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:13.055167 (+    92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:13.312892 (+257725us) raft_consensus.cc:1671] finished
0812 19:23:13.312923 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:13.313088 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22361,"raft.queue_time_us":22513,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":14273,"thread_start_us":694236,"threads_started":1,"wal-append.queue_time_us":1001135}
I20260812 19:23:13.292009 10795 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:13.212092 11192 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:13.322175  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 161720us
I20260812 19:23:13.322322  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:13.356149  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:13.357033  6349 raft_consensus.cc:595] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:13.348800 11228 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:13.362641  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1759) took 1195 ms. Trace:
W20260812 19:23:13.363930 11383 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260812 19:23:13.366967 11192 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:13.222069 11130 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260812 19:23:13.367019 11161 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:13.367996 11161 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:13.318892  6345 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:13.314791 11199 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.368870 11161 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.372557 11254 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:13.324824  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:13.375938  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:13.377347 11228 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:13.200222 11088 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:13.326292  6465 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:13.328758  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1499) took 1112 ms. Trace:
I20260812 19:23:13.401394  6482 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260812 19:23:13.316563 11263 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:13.367142  6229 raft_consensus.cc:3032] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:13.401571  6342 rpcz_store.cc:276] 0812 19:23:12.210142 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:12.210970 (+   828us) service_pool.cc:227] Handling call
0812 19:23:13.322321 (+1111351us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:13.424338  6229 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:13.317312 11039 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.326411  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:13.363117  6350 rpcz_store.cc:276] 0812 19:23:12.167000 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:12.186385 (+ 19385us) service_pool.cc:227] Handling call
0812 19:23:12.214120 (+ 27735us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:12.599406 (+385286us) raft_consensus.cc:1520] Early marking committed up to index 1
0812 19:23:12.599454 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:12.600033 (+   579us) log.cc:842] Serialized 26 byte log entry
0812 19:23:12.839741 (+239708us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b18003d9300. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:23:13.083556 (+243815us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:23:13.083607 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:13.178672 (+ 95065us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b540034f654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:13.178730 (+    58us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:13.362338 (+183608us) raft_consensus.cc:1671] finished
0812 19:23:13.362368 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:13.362565 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":67558,"raft.queue_time_us":72528,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":16614,"spinlock_wait_cycles":777444096,"thread_start_us":243609,"threads_started":1,"wal-append.queue_time_us":680992}
I20260812 19:23:13.379514  6179 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:13.343041 11361 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:23:13.512723  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 127252us
W20260812 19:23:13.514724  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 135289us
I20260812 19:23:13.515980  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:13.517125  6342 raft_consensus.cc:595] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:13.346729 11320 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:13.310112 11165 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.022s	sys 0.041s
I20260812 19:23:13.517781  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:13.522430  6224 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:13.523662  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:13.524333  6481 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:13.525120  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:13.519335  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:13.424373  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:13.525720  6481 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:13.526299  6465 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:13.444782  6229 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.370406 11199 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:13.333297 11068 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:13.736446  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 217154us
I20260812 19:23:13.533027  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:13.604540  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:13.646833  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:13.663359  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:13.752522  6232 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:13.571772  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:13.574257  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:13.750711  6224 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:13.679502  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:13.574981  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:13.573295  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 59766.4us
I20260812 19:23:13.755080  6474 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:13.543435  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260812 19:23:13.753813  6473 raft_consensus.cc:2396] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260812 19:23:13.615603  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:13.757625  6230 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:13.526578  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:13.758945  6481 raft_consensus.cc:2396] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260812 19:23:13.609869  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:13.761039  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 114322us
I20260812 19:23:13.761786  6241 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:13.761929  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:13.762051  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:13.760130 11085 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:23:13.768293  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 194172us
I20260812 19:23:13.769632  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:13.690238 11272 consensus_meta.cc:287] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.809s	user 0.011s	sys 0.001s
I20260812 19:23:13.617810 10577 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.164s
I20260812 19:23:13.787638  6242 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260812 19:23:13.788082  6242 pending_rounds.cc:76] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 2
I20260812 19:23:13.788307  6242 pending_rounds.cc:97] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260812 19:23:13.788537  6242 raft_consensus.cc:2866] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:23:13.694913 10732 consensus_meta.cc:287] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.005s
I20260812 19:23:13.787676 11261 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:13.444053 11263 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.682289 11039 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:13.702375 11220 consensus_meta.cc:287] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.000s
W20260812 19:23:13.635651 11219 consensus_meta.cc:287] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.962s	user 0.021s	sys 0.021s
W20260812 19:23:13.661046 11285 consensus_meta.cc:287] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.906s	user 0.016s	sys 0.000s
I20260812 19:23:13.783047  6477 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:13.543572 11254 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:13.400657 11228 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:13.783767  6474 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:13.772068 10738 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:13.665001 11243 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:13.788929 11288 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260812 19:23:13.609979 11388 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260812 19:23:13.676378 11088 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:13.699101 11214 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:13.694577 11165 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:13.759954 11335 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:13.534099 11390 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:13.574509 11279 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:13.760113 11309 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:13.814414  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:13.802536  6232 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:13.815418  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:13.936771  6483 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:13.818908  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:13.937573  6473 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:13.818643  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:13.938669  6230 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:13.808053 11298 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:13.816412  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:13.943507  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 127190us
I20260812 19:23:13.812170  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:13.771121 11356 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:13.824808  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:13.806568 11263 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:13.781764 11085 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.804598 11261 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:13.805392 11068 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:13.660646 11090 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.156s
I20260812 19:23:13.532549 10818 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.284s
I20260812 19:23:13.830188  6470 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:13.617556 11257 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.199s
I20260812 19:23:13.978119  6230 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:13.543056 11363 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.284s
I20260812 19:23:13.833536 11285 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:13.836971 11211 consensus_meta.cc:287] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.000s
I20260812 19:23:13.567062 11230 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:13.837671 11219 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:13.237007 10826 ts_tablet_manager.cc:1462] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: Trace:
0812 19:23:03.058878 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:03.059186 (+   308us) service_pool.cc:227] Handling call
0812 19:23:03.663284 (+604098us) ts_tablet_manager.cc:928] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
0812 19:23:05.283897 (+1620613us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f483e5fe 00007f98fd669a39 00007f98f485b8bb 00007f98f485862a 00007f98f4858552 00007f98fc669691
0812 19:23:08.018503 (+2734606us) tablet_copy_client.cc:361] Tablet copy session begun
0812 19:23:08.797124 (+778621us) tablet_metadata.cc:641] Metadata flushed
0812 19:23:08.797522 (+   398us) tablet_copy_client.cc:490] Wrote new tablet metadata
0812 19:23:09.080118 (+282596us) tablet_copy_client.cc:411] Wrote new consensus metadata
0812 19:23:09.080434 (+   316us) tablet_replica.cc:205] Creating consensus instance
0812 19:23:09.080760 (+   326us) ts_tablet_manager.cc:983] Replica registered.
0812 19:23:09.080951 (+   191us) inbound_call.cc:173] Queueing success response
0812 19:23:09.265783 (+184832us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b180040af20. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:23:09.447895 (+182112us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0812 19:23:11.725506 (+2277611us) ts_tablet_manager.cc:1429] Starting tablet replica
0812 19:23:11.873795 (+148289us) tablet_replica.cc:259] Starting instrumentation
0812 19:23:11.919196 (+ 45401us) tablet_replica.cc:278] Starting consensus
Metrics: {"dns_us":239,"mutex_wait_us":233771,"raft.queue_time_us":171922,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":31891,"spinlock_wait_cycles":58600064,"tablet-copy.queue_time_us":387729,"tablet-download-pool.queue_time_us":24670,"tablet-download-pool.run_cpu_time_us":1104,"tablet-download-pool.run_wall_time_us":25279,"thread_start_us":3342557,"threads_started":2}
I20260812 19:23:13.532330 11320 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.856474  6229 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:13.967797 11261 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:13.888345  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:23:13.897581  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:13.999406  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:13.888346  6060 catalog_manager.cc:5495] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 3 to 7, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 7 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:23:13.852216 11288 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:13.617900 11361 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.922926 11279 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.902727 11165 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.849318 11254 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.926875  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1744) took 1738 ms. Trace:
I20260812 19:23:13.855880 11243 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.900168 11335 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:13.935889  6242 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
W20260812 19:23:13.957593  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 145540us
I20260812 19:23:14.021064  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:13.943991 11309 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.971433  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:14.022851  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:14.026770  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:14.027433  6242 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:14.023602  6359 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:14.011730 11288 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:13.981416  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:13.976472  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:13.983996  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:13.944727 11368 raft_consensus.cc:2741] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260812 19:23:13.986027  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:13.986277  6344 raft_consensus.cc:2396] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260812 19:23:13.987205  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:13.992920  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1743) took 1805 ms. Trace:
I20260812 19:23:14.048997  6470 rpcz_store.cc:276] 0812 19:23:12.187617 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:12.187766 (+   149us) service_pool.cc:227] Handling call
0812 19:23:13.992722 (+1804956us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54000221d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:13.992850 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3763423488}
I20260812 19:23:13.904831 11214 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:13.998108  6228 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:13.849591 11228 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:14.003974  6060 catalog_manager.cc:5495] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 3 to 5, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 5 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:13.968367 11356 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:14.009524  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:14.006753  6229 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260812 19:23:13.977710 11266 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:14.011391  6236 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:13.974840 11088 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260812 19:23:14.011973  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 248717us
I20260812 19:23:14.013556  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:14.059049  6241 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:13.982542 11068 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:14.016615  6232 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260812 19:23:14.016161  6475 rpcz_store.cc:276] 0812 19:23:12.188281 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:12.188428 (+   147us) service_pool.cc:227] Handling call
0812 19:23:12.188682 (+   254us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:12.188843 (+   161us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:12.188858 (+    15us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:12.189168 (+   310us) log.cc:842] Serialized 26 byte log entry
0812 19:23:13.094633 (+905465us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:13.094688 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:13.094766 (+    78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:13.926638 (+831872us) raft_consensus.cc:1671] finished
0812 19:23:13.926679 (+    41us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:13.926812 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":799683,"threads_started":1,"wal-append.queue_time_us":1084325}
I20260812 19:23:14.060647  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:14.019512  6298 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:14.028326  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:13.980713  6055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 191) took 11118 ms. Trace:
I20260812 19:23:13.981666  6224 raft_consensus.cc:2396] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260812 19:23:14.062848  6242 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:14.032998  6350 raft_consensus.cc:2354] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9.
W20260812 19:23:14.039762  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 63406.4us
I20260812 19:23:14.069316  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:14.069495  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:14.031224  6473 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:14.049095  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:13.996779  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:14.069949  6229 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:14.008435 11290 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260812 19:23:14.024935 11335 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:13.947566 11298 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:14.067571  6060 catalog_manager.cc:5495] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 4 to 6, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 6 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:14.082721  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:14.083362  6242 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:14.080631  6473 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260812 19:23:14.083642  6060 catalog_manager.cc:5495] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 5 to 6, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 6 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:14.086143  6470 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260812 19:23:14.087169  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 67742.3us
I20260812 19:23:14.087968  6298 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:14.062836  6055 rpcz_store.cc:276] 0812 19:23:02.858561 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:02.858889 (+   328us) service_pool.cc:227] Handling call
0812 19:23:13.976674 (+11117785us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:10.681948 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:10.769233 (+ 87285us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:10.771334 (+  2101us) write_op.cc:435] Acquired schema lock
0812 19:23:10.771357 (+    23us) tablet.cc:660] Decoding operations
0812 19:23:10.783825 (+ 12468us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:10.783893 (+    68us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:10.783922 (+    29us) tablet.cc:683] Acquiring locks for 22 operations
0812 19:23:10.785361 (+  1439us) tablet.cc:699] Row locks acquired
0812 19:23:10.785383 (+    22us) write_op.cc:260] PREPARE: finished
0812 19:23:10.785532 (+   149us) write_op.cc:270] Start()
0812 19:23:10.785656 (+   124us) write_op.cc:276] Timestamp: P: 1786562590785481 usec, L: 0
0812 19:23:10.785681 (+    25us) op_driver.cc:331] REPLICATION: starting
0812 19:23:10.799713 (+ 14032us) log.cc:842] Serialized 8535 byte log entry
0812 19:23:11.309688 (+509975us) op_driver.cc:444] REPLICATION: finished
0812 19:23:11.706423 (+396735us) write_op.cc:301] APPLY: starting
0812 19:23:11.706523 (+   100us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:11.708905 (+  2382us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:11.709050 (+   145us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:11.874341 (+165291us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:11.922607 (+ 48266us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0812 19:23:11.922678 (+    71us) write_op.cc:312] APPLY: finished
0812 19:23:11.923136 (+   458us) log.cc:842] Serialized 152 byte log entry
0812 19:23:11.923302 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:11.923526 (+   224us) write_op.cc:454] Released schema lock
0812 19:23:11.923622 (+    96us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:11.923959 (+   337us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:11.923993 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1234,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":379191,"apply.run_cpu_time_us":6972,"apply.run_wall_time_us":218056,"num_ops":22,"prepare.queue_time_us":190128,"prepare.run_cpu_time_us":17397,"prepare.run_wall_time_us":199978,"raft.queue_time_us":361043,"raft.run_cpu_time_us":15361,"raft.run_wall_time_us":439357,"replication_time_us":481973,"thread_start_us":806093,"threads_started":4,"wal-append.queue_time_us":68401,"wal-append.run_cpu_time_us":15618,"wal-append.run_wall_time_us":2068191}]]}
I20260812 19:23:14.094038  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:14.094969  6060 catalog_manager.cc:5495] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:23:14.096712  6060 catalog_manager.cc:5495] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 3 to 5, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 5 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:14.098667  6060 catalog_manager.cc:5495] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 4 to 6, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 6 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:14.109824  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:14.110584  6242 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:14.056088 11365 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:14.052726 10784 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:14.118299  6060 catalog_manager.cc:5495] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 4 to 7, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 7 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:14.114140  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:14.124775  6230 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:14.119418  6347 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260812 19:23:14.125021  6060 catalog_manager.cc:5495] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 2 to 5, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 5 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:14.131567  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:14.132392  6241 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 8
W20260812 19:23:14.071051 11195 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260812 19:23:14.065339 11088 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:14.141088  6464 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260812 19:23:14.056308 11259 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260812 19:23:14.095424 11368 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:14.104573 11257 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:14.108664 10577 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election won for term 9
W20260812 19:23:14.193955  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 244879us
I20260812 19:23:14.123641 11365 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:14.202971  6060 catalog_manager.cc:5495] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 1 to 4, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 4 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:14.131767 11219 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:14.136441 11192 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:23:14.207810  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 145785us
I20260812 19:23:14.071792 11266 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:14.213424  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1769) took 1233 ms. Trace:
I20260812 19:23:14.113623 10738 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260812 19:23:14.243424  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:14.244804  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:14.245805  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:14.239903  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:14.239331  6344 rpcz_store.cc:276] 0812 19:23:12.979787 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:12.987143 (+  7356us) service_pool.cc:227] Handling call
0812 19:23:14.213215 (+1226072us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54001bfdd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:14.213367 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2294685056}
I20260812 19:23:14.229038  6060 catalog_manager.cc:5495] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 6 to 7, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 7 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:14.070444 11068 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:14.238348  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:14.147814 11088 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:14.249336  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:14.257405  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:14.259876  6235 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:14.191375 11412 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:14.202824 11090 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:14.311265  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:14.312112  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 72319.2us
I20260812 19:23:14.238198 11365 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:14.317886  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:14.320930  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:23:14.322221  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 62592us
I20260812 19:23:14.322808  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:14.238977 11415 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 19:23:14.347636  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 259729us
W20260812 19:23:14.348265  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 90967.9us
I20260812 19:23:14.349109  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:14.261884 11085 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:14.306257 11366 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:14.250829 11192 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:14.315536 10577 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:14.328620  6500 tablet_copy_service.cc:342] P bdfa5579d4534c618c00db6b4a841c81: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-7e0797ad50cb46cfb10b4a38cc815917 received from {username='slave'} at 127.0.0.1:33386
I20260812 19:23:14.330803 11285 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:14.348444 11320 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:14.360016 10784 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:14.387850 10784 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:14.388273 10784 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:14.361948 10818 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:14.389109 10818 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:14.389461 10818 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:14.363862 11366 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:14.391176 11366 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:23:14.364336  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 43557.2us
I20260812 19:23:14.361418 11165 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:14.367874 11039 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:14.396073 11039 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:14.398155 11039 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:14.370834 11085 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:14.372689  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:14.400904  6344 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:14.401401  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:14.382800  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 168581us
I20260812 19:23:14.364516  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:14.364735  6298 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:14.258710 11356 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:14.407526  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:14.420936  6347 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:14.337110 11090 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:14.436885  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 72241.8us
I20260812 19:23:14.454800  6344 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:14.378628  6500 tablet_copy_service.cc:433] P bdfa5579d4534c618c00db6b4a841c81: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-7e0797ad50cb46cfb10b4a38cc815917 on tablet 7e0797ad50cb46cfb10b4a38cc815917 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:14.386075 11243 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:14.399696 11254 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:14.406065 10738 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:14.350931 11220 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260812 19:23:14.483318  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 50129.6us
I20260812 19:23:14.482635  6241 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:14.347330 11412 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:14.431571 11320 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:14.438110 11085 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 19:23:14.502293  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 137831us
I20260812 19:23:14.535916  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:14.441725 11039 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:14.636466  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:14.537801 11262 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260812 19:23:14.539331 11430 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260812 19:23:14.541108 11407 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
W20260812 19:23:14.541759 11419 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260812 19:23:14.543828 11192 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:14.544337 11214 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:14.545281 11068 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:14.546108 11090 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:14.529469 11220 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:14.549270 10577 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:14.534933 11309 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:14.457021 11442 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:14.373303 11415 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:14.368983 11434 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election won for term 6
W20260812 19:23:14.474970 11413 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
W20260812 19:23:14.475560 11409 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
W20260812 19:23:14.602945  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 200678us
I20260812 19:23:14.632731  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:14.536586 10738 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:14.553009 10784 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:14.434897 11279 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:14.655256  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 90644.7us
W20260812 19:23:14.666952  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 259779us
W20260812 19:23:14.660602  6342 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.001s	sys 0.020s
W20260812 19:23:14.670089  6242 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.009s	sys 0.015s
W20260812 19:23:14.830312  6342 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.001s	sys 0.027s
W20260812 19:23:14.830390  6242 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.012s	sys 0.017s
W20260812 19:23:14.836031  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 203435us
W20260812 19:23:14.769378  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 420330us
I20260812 19:23:14.838274  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:14.846128  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:14.850930  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:14.852775  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:14.652451 11262 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:14.855257  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:14.659024 11039 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:14.835690 10738 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:14.834376 11220 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:14.859711  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:14.857030  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:14.827682 11415 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:14.843379 11195 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:23:14.550267 10818 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:14.870278  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:14.850190 11434 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:14.869184 11415 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:14.875516  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:14.860581 11309 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:14.860358 11262 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:14.839980 11165 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260812 19:23:14.655145 11320 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:14.898910 11039 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:14.899991  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 44800.1us
W20260812 19:23:14.901010  6172 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.000s	sys 0.009s
W20260812 19:23:14.958762  6172 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.000s	sys 0.010s
I20260812 19:23:14.902016 11412 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:14.959291  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:14.845233 11380 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260812 19:23:14.960146  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:14.960834  6242 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
W20260812 19:23:14.961014  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 49339.7us
W20260812 19:23:14.908000 11335 consensus_meta.cc:287] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.786s	user 0.010s	sys 0.000s
W20260812 19:23:14.909885 11088 consensus_meta.cc:287] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
W20260812 19:23:14.913200  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 62134.5us
I20260812 19:23:14.895310 11440 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:14.906606 10784 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:14.895395 11279 raft_consensus.cc:2741] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260812 19:23:14.971524  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:14.962538  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 47591.9us
W20260812 19:23:14.915407 11228 consensus_meta.cc:287] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.843s	user 0.011s	sys 0.002s
I20260812 19:23:14.962157  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:14.976456  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:14.913631 11068 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:14.966112  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:14.917774 11288 consensus_meta.cc:287] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.862s	user 0.007s	sys 0.004s
I20260812 19:23:15.003556  6228 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:14.916065 11467 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:15.027019  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:14.961647 11309 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:15.012979  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:14.913761 11254 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260812 19:23:14.964396 11458 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:15.033273  6178 leader_election.cc:398] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8.
I20260812 19:23:14.996694 11068 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:14.975069 11228 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:14.994942 11243 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260812 19:23:14.991833 11466 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:15.032835 10577 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:15.028568 11279 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:14.969318 11335 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:14.992100 10784 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:15.094895  6178 leader_election.cc:401] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260812 19:23:15.095526  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 133477us
I20260812 19:23:14.963171 11488 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:15.074182 11380 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:15.098505 11489 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260812 19:23:14.969092 11088 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:14.969645 11440 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:15.022496 11288 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:15.130105  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:15.130703  6353 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260812 19:23:14.991274 11356 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:15.100757 11257 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:15.105968 11068 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:15.091777 11357 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:23:15.141295  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 119334us
W20260812 19:23:15.164299  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 69551.2us
I20260812 19:23:15.165247  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:15.166451  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:15.134338 11366 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.743s	user 0.005s	sys 0.006s
I20260812 19:23:15.144241  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:15.145556  6229 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:15.169229  6354 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:15.170282  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:15.172254  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:15.133409 11486 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260812 19:23:15.175477 11088 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:15.176193  6235 pending_rounds.cc:76] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 2
I20260812 19:23:15.176644  6235 pending_rounds.cc:97] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260812 19:23:15.176936  6235 raft_consensus.cc:2866] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:15.177470 11320 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:15.178478 11357 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:15.179499 11480 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260812 19:23:15.179378 11309 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:15.182161 11457 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260812 19:23:15.111179 11434 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:15.163853 11214 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:15.191109 11228 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:15.191423 11214 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:15.035048 11467 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:15.192953 11290 raft_consensus.cc:979] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:23:15.194162 11214 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:15.176285  6350 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:15.135241 11279 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8.
I20260812 19:23:15.129997 11488 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:15.194399 11290 raft_consensus.cc:1067] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Signalling peer bdfa5579d4534c618c00db6b4a841c81 to start an election
W20260812 19:23:15.207887  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 63754.8us
I20260812 19:23:15.217252  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:15.218204  6230 raft_consensus.cc:2396] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260812 19:23:15.220113  6464 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260812 19:23:15.220471  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:15.220893  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:15.125515 10577 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:15.195768 11412 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:15.135933 10784 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:15.225215  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:15.226097 11261 consensus_meta.cc:287] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.213s	user 0.012s	sys 0.000s
W20260812 19:23:15.226804 11365 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.879s	user 0.012s	sys 0.000s
I20260812 19:23:15.226935  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:15.155184 11356 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:15.216236 11228 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:15.228390 11320 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:23:15.230459 11288 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:15.222378  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:15.288254  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 65939.5us
I20260812 19:23:15.289047  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:15.195704 11366 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:15.290450  6416 leader_election.cc:398] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9.
I20260812 19:23:15.291450 11366 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:15.215153 11488 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:15.222595  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:15.194190 11467 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:15.268703  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:15.197729 11243 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:15.141247 11380 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:15.147696 11165 consensus_queue.cc:1046] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.076s
I20260812 19:23:15.227734 11492 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:15.104856 11458 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:15.281337  6228 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:15.282742 11365 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:15.283733 11356 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:15.284307  6241 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:15.284986  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:15.328382  6230 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:15.120633 11466 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:15.286224 11228 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:15.169005 11130 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:15.292107 11507 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:15.295948  6224 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:15.296063  6470 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:15.235507 11257 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
W20260812 19:23:15.304299  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 210480us
I20260812 19:23:15.223093 10818 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:15.307368  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:15.355917  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 48672.6us
I20260812 19:23:15.356786  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:15.292271 11366 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:15.235750 11420 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260812 19:23:15.345091  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:15.349056  6352 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:15.361438  6474 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
W20260812 19:23:15.358626  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 321265us
I20260812 19:23:15.320019 11243 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:15.319566 11288 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:15.321677 11440 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:15.346036 11228 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:15.282553 11261 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:15.404511  6224 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
W20260812 19:23:15.419008  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 127755us
I20260812 19:23:15.380544 10818 consensus_queue.cc:1046] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:15.357961 11257 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:15.365571 11290 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:15.381853  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1510) took 1629 ms. Trace:
I20260812 19:23:15.382727  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:15.382920 11357 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:15.441735  6342 rpcz_store.cc:276] 0812 19:23:13.752004 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:13.752162 (+   158us) service_pool.cc:227] Handling call
0812 19:23:13.788302 (+ 36140us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:14.018251 (+229949us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:14.018281 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:14.022228 (+  3947us) log.cc:842] Serialized 26 byte log entry
0812 19:23:14.831082 (+808854us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:14.831137 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:14.831244 (+   107us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:15.381610 (+550366us) raft_consensus.cc:1671] finished
0812 19:23:15.381633 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:15.381780 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4567,"raft.queue_time_us":40786,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":16271,"thread_start_us":926111,"threads_started":2,"wal-append.queue_time_us":1315691}
I20260812 19:23:15.383822 11365 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:15.384611 10784 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:15.385257 11505 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260812 19:23:15.386958 11380 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:15.346570 11492 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:15.466974 11492 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:15.388288 10738 consensus_meta.cc:287] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.002s
I20260812 19:23:15.360702 11335 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:15.392189 11466 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:15.363638 11243 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:15.393093 11412 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:15.369844 11262 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:15.395516 11415 consensus_meta.cc:287] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.003s
I20260812 19:23:15.395843 11458 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:15.379606 11493 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:15.364396 11165 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:15.344641 11486 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260812 19:23:15.442337  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:23:15.369549  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 155157us
I20260812 19:23:15.421243 11440 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:15.419004 11220 consensus_meta.cc:287] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.003s
W20260812 19:23:15.473136  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 79520us
I20260812 19:23:15.431473 11356 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:15.485911  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 103259us
I20260812 19:23:15.419016 11254 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:15.421399 11039 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:16.150789  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:15.489699 11509 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:23:15.497640 10795 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.300s	user 0.011s	sys 0.025s
I20260812 19:23:15.492280 10738 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.247928  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:15.536744  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 94492.9us
W20260812 19:23:16.344589  7552 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.021s	sys 0.038s
W20260812 19:23:16.156550  6224 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.005s	sys 0.005s
I20260812 19:23:16.393482  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1779) took 1175 ms. Trace:
I20260812 19:23:16.210988  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:16.091629 11068 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.896s	user 0.012s	sys 0.000s
I20260812 19:23:16.394047  6475 rpcz_store.cc:276] 0812 19:23:15.218565 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:15.218809 (+   244us) service_pool.cc:227] Handling call
0812 19:23:15.228131 (+  9322us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:15.228482 (+   351us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:15.228516 (+    34us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:15.229018 (+   502us) log.cc:842] Serialized 52 byte log entry
0812 19:23:15.468418 (+239400us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:15.502953 (+ 34535us) log.cc:842] Serialized 14 byte log entry
0812 19:23:15.504035 (+  1082us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:15.504111 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:16.393262 (+889151us) raft_consensus.cc:1671] finished
0812 19:23:16.393281 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:16.393418 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":837,"prepare.queue_time_us":38579,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":7119,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":20840832,"thread_start_us":238964,"threads_started":1,"wal-append.queue_time_us":1160410}
I20260812 19:23:15.904424 11380 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:15.612867 11214 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:16.389070 11520 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:16.389429 11368 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:15.503137 11290 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:16.372416 11509 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:15.537107 11493 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:16.419911  6352 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1778) took 2423 ms (client timeout 3085 ms). Trace:
I20260812 19:23:16.428933 11368 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:16.421164 11068 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:23:16.430756 11493 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:16.431144  6350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1784) took 2193 ms (client timeout 1780 ms). Trace:
I20260812 19:23:15.727052 11390 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:16.434055  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:16.360911 11465 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.000s	sys 0.012s
W20260812 19:23:16.371189  6224 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.010s	sys 0.005s
W20260812 19:23:15.591869 11502 log.cc:924] Time spent T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260812 19:23:15.494347 11412 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:15.574292  6477 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:23:16.426452  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 58198.9us
I20260812 19:23:15.623804 11262 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:16.428263 11290 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:16.429536  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1759) took 2905 ms. Trace:
W20260812 19:23:16.421391  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 60366.3us
I20260812 19:23:16.392907 10738 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:16.431542  6350 rpcz_store.cc:269] 0812 19:23:14.237888 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:14.238058 (+   170us) service_pool.cc:227] Handling call
0812 19:23:16.430946 (+2192888us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b54004088d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:16.431074 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2110143744}
W20260812 19:23:16.429324  6352 rpcz_store.cc:269] 0812 19:23:13.996133 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:13.996503 (+   370us) service_pool.cc:227] Handling call
0812 19:23:16.419669 (+2423166us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001ccad4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:16.419820 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2937901440}
I20260812 19:23:16.389952 11039 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:15.903627 11442 raft_consensus.cc:979] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower bdfa5579d4534c618c00db6b4a841c81 to start an election
W20260812 19:23:16.370579  7552 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.023s	sys 0.040s
I20260812 19:23:16.433773 11068 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:16.436630  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:16.437740  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:16.417631 11266 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:16.439579 11465 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.000s	sys 0.014s
W20260812 19:23:16.351996 11243 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.846s	user 0.012s	sys 0.000s
I20260812 19:23:16.423393  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:16.205025 11220 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:15.746891 11366 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:15.592085 10577 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:15.788486 10784 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:15.683822 11357 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:15.995469 11506 raft_consensus.cc:3032] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
W20260812 19:23:16.424706 10795 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.230s	user 0.019s	sys 0.052s
I20260812 19:23:16.297698 10818 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:15.711611 11165 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:16.417632 11298 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:15.710754 11130 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:15.586494 11257 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:15.527004 11365 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:16.092967 11288 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:16.030323 11484 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:16.470547  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:16.448827  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:16.431614 11368 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:16.435181  6238 raft_consensus.cc:2396] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260812 19:23:16.421207 11219 raft_consensus.cc:979] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: : Instructing follower 54f83319db6b49929cc8f18a66a66975 to start an election
I20260812 19:23:15.593194 11261 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:15.788194 11263 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:15.507835 11415 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.491201  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:16.523612  6242 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 7
I20260812 19:23:16.506011  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:16.524006  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:16.524932  6236 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:15.560479 11466 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:16.490525 11529 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:16.527747  6359 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
W20260812 19:23:16.383873 11228 consensus_meta.cc:287] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.964s	user 0.012s	sys 0.002s
I20260812 19:23:16.203749 11440 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.466753 11290 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:16.399158 11254 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.570274 10577 raft_consensus.cc:1067] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Signalling peer bdfa5579d4534c618c00db6b4a841c81 to start an election
W20260812 19:23:16.696291 11546 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260812 19:23:16.696623  6354 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1779) took 2687 ms (client timeout 2246 ms). Trace:
W20260812 19:23:16.697100  6354 rpcz_store.cc:269] 0812 19:23:14.008852 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:14.009254 (+   402us) service_pool.cc:227] Handling call
0812 19:23:16.696376 (+2687122us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400350554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:16.696543 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2545377536}
I20260812 19:23:16.697937 10577 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:16.449297  6465 rpcz_store.cc:276] 0812 19:23:13.524289 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:13.526982 (+  2693us) service_pool.cc:227] Handling call
0812 19:23:13.572933 (+ 45951us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:13.806984 (+234051us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:23:14.076050 (+269066us) log.cc:842] Serialized 14 byte log entry
0812 19:23:14.836782 (+760732us) log.cc:842] Serialized 14 byte log entry
0812 19:23:14.836941 (+   159us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:14.836981 (+    40us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:14.837034 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:16.429312 (+1592278us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b540003c0d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:16.429357 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:16.429479 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":64636,"prepare.queue_time_us":36579,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":3449,"raft.queue_time_us":363929,"raft.run_cpu_time_us":460,"raft.run_wall_time_us":58331,"spinlock_wait_cycles":537682304,"thread_start_us":967633,"threads_started":3,"wal-append.queue_time_us":361598,"wal-append.run_cpu_time_us":2452,"wal-append.run_wall_time_us":1451463}
I20260812 19:23:16.699134  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 319) took 1225 ms. Trace:
I20260812 19:23:16.698401  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:16.654436  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:16.700345  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:16.527012 11524 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:16.435673 11380 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:16.441004 11390 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.561712 11266 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:16.267720 11434 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:16.434293 11520 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.532090 11243 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.400143 11356 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:16.438525 11214 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.700726  6475 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:16.700990  6354 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:16.699604  6224 rpcz_store.cc:276] 0812 19:23:15.473959 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:15.474119 (+   160us) service_pool.cc:227] Handling call
0812 19:23:15.474600 (+   481us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:15.474854 (+   254us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:15.474904 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:15.475485 (+   581us) log.cc:842] Serialized 26 byte log entry
0812 19:23:16.439987 (+964502us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:16.440051 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:16.440145 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:16.698904 (+258759us) raft_consensus.cc:1671] finished
0812 19:23:16.698928 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:16.699066 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":933773,"threads_started":1,"wal-append.queue_time_us":940604}
I20260812 19:23:16.702122  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:16.654800  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:16.703675  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 233218us
I20260812 19:23:16.536640 11366 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.534523 11309 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:16.537633 10784 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.535405 11506 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:16.780246  6352 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:16.699473  6230 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:16.788452  6465 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:38150
I20260812 19:23:16.858017  6236 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:16.790110 11552 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:16.789903 11266 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:16.790979  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:16.869552  6350 raft_consensus.cc:2354] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7.
I20260812 19:23:16.654820 11130 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.786703 11263 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.796155 11440 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:16.779035 11529 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:16.778795 11288 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.799427 11220 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:16.539181 11412 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.801189 11380 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:16.802704 11390 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:16.803856 11535 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
W20260812 19:23:16.656088 11488 consensus_meta.cc:287] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.328s	user 0.004s	sys 0.010s
I20260812 19:23:16.715636 10577 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:16.809782 11290 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:16.810724 11536 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.510s	user 0.001s	sys 0.000s
I20260812 19:23:16.811765 11039 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:16.812119 11544 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260812 19:23:16.813804 11254 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:16.835985  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:16.844985  6464 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:16.537935 11357 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.848116  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:16.572760 11298 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:16.850137  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:16.855708  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:16.567169 11509 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.022264  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:16.789453 11484 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:16.861980  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 416791us
I20260812 19:23:16.867807  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:16.947760 11380 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:16.874442  6354 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:16.566560 11165 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:16.877417  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:16.884074  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:16.887112  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:16.703125 11228 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.894021  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:16.895179 11440 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:16.779577 11365 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:16.862684 11368 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:16.821920 11434 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.927485 11565 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:16.864370 11309 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.011147  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:16.782225 11524 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.927556 11261 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:16.937139 10795 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:17.072928  6342 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:17.023969  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:17.084091  6464 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:23:16.943588 11482 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.707s	user 0.013s	sys 0.031s
I20260812 19:23:17.036530  6352 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:16.563284 10818 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:16.941184 11417 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:17.039134  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1782) took 1819 ms. Trace:
I20260812 19:23:17.115435  6477 rpcz_store.cc:276] 0812 19:23:15.219712 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:15.221605 (+  1893us) service_pool.cc:227] Handling call
0812 19:23:17.038941 (+1817336us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540003d4d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:17.039077 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":663422208}
I20260812 19:23:17.043447  6475 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:17.060948 11440 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:17.045796  6238 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
W20260812 19:23:17.045807  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 151856us
W20260812 19:23:17.045630  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 209728us
I20260812 19:23:17.121838  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:17.121943  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:17.110846 11570 raft_consensus.cc:1067] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Signalling peer 54f83319db6b49929cc8f18a66a66975 to start an election
I20260812 19:23:17.019856 11220 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:17.023362 11039 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:17.036095 11254 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:17.068012 10784 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:17.072578  6345 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:16.863544  6230 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:17.038726 11298 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:16.963436 11488 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.148324 11559 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:17.111624  6352 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:17.045848 11380 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:16.959378 11390 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:17.064224 11368 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:16.956916 11412 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:17.089520 11243 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:17.131719  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 49787.3us
I20260812 19:23:17.108561 11415 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:17.164070  6417 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.713s (SENT) [suppressed 6 similar messages]
I20260812 19:23:17.076179 11261 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:17.069453 11565 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:17.081173 10795 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:17.171391  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:17.120198 11266 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.119361 11520 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:17.126844 11130 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:16.949687 11506 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.191483  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:17.090102 11482 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.862s	user 0.014s	sys 0.031s
I20260812 19:23:17.165983  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:17.121198 11417 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:17.161845 11558 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:17.189050 11356 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.267935  6230 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:17.268450  6475 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 9: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:17.242354  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1802) took 3266 ms. Trace:
I20260812 19:23:17.269719  6229 rpcz_store.cc:276] 0812 19:23:13.976335 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:14.107328 (+130993us) service_pool.cc:227] Handling call
0812 19:23:14.107700 (+   372us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:15.169361 (+1061661us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:17.242022 (+2072661us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002fd854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:17.242247 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2375554944}
I20260812 19:23:17.263077  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:17.205358  6465 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:23:17.273542  6465 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:17.270267  6242 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:17.332278  6464 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
W20260812 19:23:17.206960 11498 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.867s	user 0.010s	sys 0.026s
I20260812 19:23:17.187289 11288 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:17.216336 11403 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 3.019s	user 0.004s	sys 0.030s
I20260812 19:23:17.280902  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:17.186429 11220 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:17.186618 11263 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:17.212440 11585 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260812 19:23:17.271487  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:17.434413  6229 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:17.375917  6475 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260812 19:23:17.377532  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 255764us
I20260812 19:23:17.437031  6178 leader_election.cc:398] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7.
I20260812 19:23:17.437404  6178 leader_election.cc:401] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:23:17.438485  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:17.338732  6473 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:17.206559 11586 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:17.384852 11498 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.153s	user 0.013s	sys 0.030s
I20260812 19:23:17.218803 11165 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.205291 11298 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:17.224047 11434 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.231949 11309 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.336134 11243 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.121s
I20260812 19:23:17.219875 11290 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.225471 11524 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.214004 11570 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:17.266067 11558 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.215448 11357 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:17.491950 11403 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260812 19:23:17.241165 11088 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:23:17.421907 11220 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:17.492090 11434 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 7
I20260812 19:23:17.417845 11356 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:17.188265 11254 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:17.428836 11593 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:17.210278 11582 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:17.229717 11574 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:17.443961  6465 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.273824 11484 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:17.432047 11556 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.637s	user 0.003s	sys 0.000s
I20260812 19:23:17.210590 11578 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:17.273653 11228 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.280086 11130 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:17.203918 11365 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.186007 11039 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.218166 10818 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.272699 10577 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.442027  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1516) took 1034 ms. Trace:
I20260812 19:23:17.547726  6359 rpcz_store.cc:276] 0812 19:23:16.407138 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:17.042528 (+635390us) service_pool.cc:227] Handling call
0812 19:23:17.042910 (+   382us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:17.043130 (+   220us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:17.043157 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:17.047265 (+  4108us) log.cc:842] Serialized 26 byte log entry
0812 19:23:17.148498 (+101233us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:17.148539 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:17.148624 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:17.441746 (+293122us) raft_consensus.cc:1671] finished
0812 19:23:17.441773 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:17.441953 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":71859,"threads_started":1,"wal-append.queue_time_us":198787}
I20260812 19:23:17.448571  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:17.505148 11558 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.335498 11506 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:17.267694 11361 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:17.274279 11529 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.272733 11440 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.200480 11577 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:17.272583  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:17.331920 11559 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.502120 11570 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:17.503474 11309 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:17.586699 11309 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:17.588081 11380 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.588380 11309 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.590195 11368 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.446146 11288 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:17.591650 11288 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.335523 11390 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:17.518471 11582 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.532799 11488 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:17.533689 11417 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.501642 11524 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260812 19:23:17.209869 11569 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:17.558853 11589 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:17.560334 11254 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.575380 11220 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.617671 11366 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:17.581631  6354 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 19:23:17.537719 11498 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:17.585188 11565 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.553779 11130 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.601854 11434 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7.
I20260812 19:23:17.520812 11356 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.526599 11593 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:17.608456 11569 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:17.528283 11574 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.613294 11589 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:17.453894 11586 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.641871 11586 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.597155 11570 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:17.643378 11517 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 2.179s	user 0.012s	sys 0.003s
I20260812 19:23:17.645438 11589 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:17.624974 11039 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.551405 11578 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.603613 11577 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:17.627523 11498 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:17.658113 11574 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.633100 11390 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.651528 11288 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:17.699813 11451 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 2.875s	user 0.008s	sys 0.020s
I20260812 19:23:17.736522 11569 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.768975 11593 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.775636 11498 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:17.777923 11515 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.960s	user 0.000s	sys 0.015s
W20260812 19:23:17.806080 11552 consensus_meta.cc:287] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.919s	user 0.007s	sys 0.007s
I20260812 19:23:17.821492 11552 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260812 19:23:17.823056 11411 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 3.625s	user 0.000s	sys 0.028s
I20260812 19:23:17.823943 11214 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.810094 11578 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.816184 11261 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.826994 11467 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:17.827749 11467 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:23:17.829742 11412 consensus_meta.cc:287] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.008s
I20260812 19:23:17.830161 11589 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.808082 11582 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.834177 11589 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.836285 11577 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.829224 11467 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.843243 11467 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:17.844573 10795 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:17.845178 11130 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.866285 11356 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.880394 11559 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:17.883280 11484 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:17.884200 11484 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:17.887194 11484 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:17.550200  6229 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:17.559826  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1765) took 1123 ms. Trace:
I20260812 19:23:17.936708  6350 raft_consensus.cc:2396] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260812 19:23:17.926811  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1818) took 2754 ms. Trace:
I20260812 19:23:17.927795  6242 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
W20260812 19:23:18.063745 11442 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.533s	user 0.011s	sys 0.004s
W20260812 19:23:18.057401  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.022s	sys 0.059s
I20260812 19:23:18.076066  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1768) took 3856 ms. Trace:
W20260812 19:23:18.077520  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.101s	sys 0.185s
W20260812 19:23:18.077508 11442 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.550s	user 0.011s	sys 0.004s
W20260812 19:23:18.082729  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.023s	sys 0.060s
I20260812 19:23:18.069311  6344 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
W20260812 19:23:18.088714  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.101s	sys 0.185s
W20260812 19:23:18.105545  6345 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.007s	sys 0.005s
W20260812 19:23:18.109028  7551 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.016s	sys 0.026s
W20260812 19:23:18.109439  6345 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.008s	sys 0.006s
W20260812 19:23:18.115602  6236 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.015s	sys 0.016s
W20260812 19:23:18.116154  6236 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.015s	sys 0.016s
I20260812 19:23:17.888973 11570 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:18.109630  7551 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.016s	sys 0.026s
I20260812 19:23:18.010470  6235 rpcz_store.cc:276] 0812 19:23:15.171586 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:15.171726 (+   140us) service_pool.cc:227] Handling call
0812 19:23:15.176017 (+  4291us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:15.177411 (+  1394us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:15.177438 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:15.177861 (+   423us) log.cc:842] Serialized 26 byte log entry
0812 19:23:15.367607 (+189746us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:23:15.367642 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:15.367709 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:17.664847 (+2297138us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:17.925417 (+260570us) raft_consensus.cc:1671] finished
0812 19:23:17.925517 (+   100us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:17.926391 (+   874us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":46160768,"thread_start_us":188698,"threads_started":1,"wal-append.queue_time_us":329717}
I20260812 19:23:18.147531  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:18.148976  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.023s	sys 0.037s
I20260812 19:23:18.149569  6230 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:18.081509  6241 rpcz_store.cc:276] 0812 19:23:16.436555 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:16.436749 (+   194us) service_pool.cc:227] Handling call
0812 19:23:16.449390 (+ 12641us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:16.449648 (+   258us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:16.449675 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:16.450106 (+   431us) log.cc:842] Serialized 26 byte log entry
0812 19:23:16.558606 (+108500us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:16.558665 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:16.558749 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:17.430343 (+871594us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:17.559432 (+129089us) raft_consensus.cc:1671] finished
0812 19:23:17.559456 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:17.559728 (+   272us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":26445568,"thread_start_us":108182,"threads_started":1,"wal-append.queue_time_us":243073}
I20260812 19:23:18.151396  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:18.155515  6417 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.007s	sys 0.011s
W20260812 19:23:18.156046  6417 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.007s	sys 0.011s
W20260812 19:23:18.156669  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 992565us
W20260812 19:23:18.136142  6228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1816) took 2881 ms (client timeout 1683 ms). Trace:
I20260812 19:23:18.148006  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:18.118788  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 1.08265e+06us
W20260812 19:23:18.149580  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.023s	sys 0.037s
W20260812 19:23:18.158591  6228 rpcz_store.cc:269] 0812 19:23:15.169848 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:15.170007 (+   159us) service_pool.cc:227] Handling call
0812 19:23:18.007942 (+2837935us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400120cd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:18.050994 (+ 43052us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":252996992}
W20260812 19:23:18.174896  6224 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.033s	user 0.005s	sys 0.030s
I20260812 19:23:18.207297  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1758) took 2987 ms. Trace:
I20260812 19:23:18.207481  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:18.208181 11492 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:18.209370  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1773) took 4240 ms. Trace:
I20260812 19:23:18.209223 11492 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:18.209759  6353 rpcz_store.cc:276] 0812 19:23:13.968575 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:13.968784 (+   209us) service_pool.cc:227] Handling call
0812 19:23:13.969159 (+   375us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:15.143290 (+1174131us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.208637 (+3065347us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400408dd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:18.209091 (+   454us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2670575872}
W20260812 19:23:18.210748  6295 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.007s	sys 0.029s
W20260812 19:23:18.211336  6295 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.250s	user 0.007s	sys 0.029s
I20260812 19:23:18.211524  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:18.213472  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:18.214766  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:18.084290  6481 rpcz_store.cc:276] 0812 19:23:14.083071 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:14.083203 (+   132us) service_pool.cc:227] Handling call
0812 19:23:14.120705 (+ 37502us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:14.207338 (+ 86633us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:23:14.258739 (+ 51401us) log.cc:842] Serialized 14 byte log entry
0812 19:23:14.562974 (+304235us) log.cc:842] Serialized 14 byte log entry
0812 19:23:14.580239 (+ 17265us) log.cc:842] Serialized 14 byte log entry
0812 19:23:14.583296 (+  3057us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:14.583982 (+   686us) log.cc:842] Serialized 26 byte log entry
0812 19:23:14.584142 (+   160us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:14.584188 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:15.903462 (+1319274us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b18003dda40. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:23:16.779401 (+875939us) spinlock_profiling.cc:243] Waited 86.2 ms on lock 0x7b5400271854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:16.779459 (+    58us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:17.447910 (+668451us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b18003dda40. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fc61f7f1 00007f98fc6168e7 00007f98fc61677a 00007f98fc70a95f
0812 19:23:17.650556 (+202646us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b4800110358. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fc61f7f1 00007f98fc6168e7 00007f98fc61677a 00007f98fc70a95f 00007f98fc70a627 00007f98fc71eb2c 00007f98fc71ead8 00007f98fc71ea58 00007f98fc71ea13 00007f98fc71dcbc 00007f98fb69fbe6
0812 19:23:17.659469 (+  8913us) spinlock_profiling.cc:243] Waited 7.7 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:17.938452 (+278983us) raft_consensus.cc:1671] finished
0812 19:23:17.938509 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:17.938976 (+   467us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":587937,"prepare.queue_time_us":215326,"prepare.run_cpu_time_us":165,"prepare.run_wall_time_us":20782,"raft.queue_time_us":831871,"raft.run_cpu_time_us":37306,"raft.run_wall_time_us":2848169,"spinlock_wait_cycles":244647296,"thread_start_us":299708,"threads_started":2,"wal-append.queue_time_us":427285}
I20260812 19:23:18.215732  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:18.217267  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:18.219731  7554 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.008s	sys 0.012s
W20260812 19:23:18.220290  7554 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.008s	sys 0.012s
I20260812 19:23:18.220454  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1786) took 1576 ms. Trace:
W20260812 19:23:18.221848  6224 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.006s	sys 0.030s
W20260812 19:23:18.222720  6172 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.237s	user 0.007s	sys 0.020s
W20260812 19:23:18.223182  6172 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.284s	user 0.007s	sys 0.020s
I20260812 19:23:18.225214 11570 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:18.225574  6347 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.365s	user 0.004s	sys 0.024s
W20260812 19:23:18.225984  6347 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.410s	user 0.004s	sys 0.024s
I20260812 19:23:18.228101  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1517) took 1801 ms. Trace:
I20260812 19:23:18.228551  6350 rpcz_store.cc:276] 0812 19:23:16.427037 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:16.877034 (+449997us) service_pool.cc:227] Handling call
0812 19:23:18.227827 (+1350793us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b540003f7d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:18.228020 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2051354368}
W20260812 19:23:18.222563  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 1.04925e+06us
I20260812 19:23:18.230945  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:18.231170  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:18.232255  6230 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:18.232560 11356 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:18.233150 11440 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:18.233476 11356 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:18.234055 11440 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:18.234256  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1832) took 1047 ms. Trace:
W20260812 19:23:18.235040  6344 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1793) took 2085 ms (client timeout 1683 ms). Trace:
I20260812 19:23:18.235890 11440 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:18.237371  6238 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1769) took 1761 ms (client timeout 1769 ms). Trace:
W20260812 19:23:18.237869  6238 rpcz_store.cc:269] 0812 19:23:16.475774 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:16.855334 (+379560us) service_pool.cc:227] Handling call
0812 19:23:18.236944 (+1381610us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b540027c4d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:18.237175 (+   231us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":53507968}
I20260812 19:23:18.207185 11533 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:18.248955 11356 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:18.249220  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:18.233731  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:18.214771  6470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1775) took 3355 ms (client timeout 2049 ms). Trace:
I20260812 19:23:18.215485  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:18.242950  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1770) took 4159 ms. Trace:
W20260812 19:23:18.235584  6344 rpcz_store.cc:269] 0812 19:23:16.149759 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:16.149912 (+   153us) service_pool.cc:227] Handling call
0812 19:23:18.234754 (+2084842us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b540036db54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:18.234916 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3538476288}
I20260812 19:23:18.239327  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:18.239923 11257 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:18.220994  6474 rpcz_store.cc:276] 0812 19:23:16.644494 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:16.644795 (+   301us) service_pool.cc:227] Handling call
0812 19:23:16.704745 (+ 59950us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:16.939997 (+235252us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:16.940028 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:16.940068 (+    40us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:16.940090 (+    22us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.219834 (+1279744us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54002d2654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:18.219909 (+    75us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:18.220210 (+   301us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":540498176}
I20260812 19:23:18.247782  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:18.247087  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1523) took 1798 ms. Trace:
W20260812 19:23:18.243747  6342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1515) took 1837 ms (client timeout 1889 ms). Trace:
I20260812 19:23:18.245743  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1780) took 3026 ms. Trace:
I20260812 19:23:18.250759  6229 rpcz_store.cc:276] 0812 19:23:17.186811 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:18.010977 (+824166us) service_pool.cc:227] Handling call
0812 19:23:18.234184 (+223207us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:18.215747  6235 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:18.264036  6242 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
W20260812 19:23:18.253360  6470 rpcz_store.cc:269] 0812 19:23:14.859279 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:14.859437 (+   158us) service_pool.cc:227] Handling call
0812 19:23:18.214065 (+3354628us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b5400213754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:18.214381 (+   316us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":985578880}
I20260812 19:23:18.270052  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1833) took 1080 ms. Trace:
I20260812 19:23:18.279762  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1842) took 1004 ms. Trace:
I20260812 19:23:18.280314  6235 rpcz_store.cc:276] 0812 19:23:17.264134 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:18.214154 (+950020us) service_pool.cc:227] Handling call
0812 19:23:18.268644 (+ 54490us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:18.282275  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1827) took 1131 ms. Trace:
I20260812 19:23:18.260336  6354 rpcz_store.cc:276] 0812 19:23:16.448414 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:17.050053 (+601639us) service_pool.cc:227] Handling call
0812 19:23:17.050341 (+   288us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:17.621086 (+570745us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.246540 (+625454us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b540025f654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:18.246882 (+   342us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1219254016}
I20260812 19:23:18.282833  6230 rpcz_store.cc:276] 0812 19:23:17.150781 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:18.233253 (+1082472us) service_pool.cc:227] Handling call
0812 19:23:18.282195 (+ 48942us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:18.260815  6342 rpcz_store.cc:269] 0812 19:23:16.406776 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:16.847025 (+440249us) service_pool.cc:227] Handling call
0812 19:23:18.243235 (+1396210us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b54001ccfd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:18.243521 (+   286us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":67748608}
I20260812 19:23:18.278442  6242 rpcz_store.cc:276] 0812 19:23:17.189620 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:18.248835 (+1059215us) service_pool.cc:227] Handling call
0812 19:23:18.269964 (+ 21129us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:18.261567  6473 rpcz_store.cc:276] 0812 19:23:15.218977 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:15.219116 (+   139us) service_pool.cc:227] Handling call
0812 19:23:15.278480 (+ 59364us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:17.446485 (+2168005us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.245259 (+798774us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54002d2154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:18.245570 (+   311us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4737450240}
I20260812 19:23:18.206297  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:18.218307 10938 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:18.301149  6241 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:18.312811  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1824) took 1158 ms. Trace:
I20260812 19:23:18.317472  6241 rpcz_store.cc:276] 0812 19:23:17.150042 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:18.150869 (+1000827us) service_pool.cc:227] Handling call
0812 19:23:18.307984 (+157115us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:18.320513  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1830) took 1152 ms. Trace:
I20260812 19:23:18.320973  6241 rpcz_store.cc:276] 0812 19:23:17.167892 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:18.319204 (+1151312us) service_pool.cc:227] Handling call
0812 19:23:18.319718 (+   514us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:18.320109 (+   391us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:18.320143 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:18.320200 (+    57us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:18.320225 (+    25us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.320304 (+    79us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:18.320436 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:18.322356  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:18.309768  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:18.332599  6481 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:18.327330  6238 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:18.334209  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1834) took 1137 ms. Trace:
I20260812 19:23:18.341231  6238 rpcz_store.cc:276] 0812 19:23:17.197005 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:18.238861 (+1041856us) service_pool.cc:227] Handling call
0812 19:23:18.334144 (+ 95283us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:18.342861  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:18.344839  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1831) took 1167 ms. Trace:
I20260812 19:23:18.345360  6241 rpcz_store.cc:276] 0812 19:23:17.171907 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:18.321964 (+1150057us) service_pool.cc:227] Handling call
0812 19:23:18.322434 (+   470us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:18.331019 (+  8585us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:18.331062 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:18.338396 (+  7334us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:18.338451 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.338529 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:18.338684 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:18.207948  6232 rpcz_store.cc:276] 0812 19:23:15.219848 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:15.219964 (+   116us) service_pool.cc:227] Handling call
0812 19:23:15.277873 (+ 57909us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:15.296970 (+ 19097us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:15.297017 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:15.297555 (+   538us) log.cc:842] Serialized 26 byte log entry
0812 19:23:15.470763 (+173208us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:15.470801 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.167574 (+2696773us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b5400163ad4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:18.174182 (+  6608us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:18.174303 (+   121us) raft_consensus.cc:1671] finished
0812 19:23:18.174328 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:18.207050 (+ 32722us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":697,"raft.queue_time_us":847,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":22631,"spinlock_wait_cycles":42735360,"thread_start_us":124710,"threads_started":1,"wal-append.queue_time_us":826663,"wal-append.run_cpu_time_us":4094,"wal-append.run_wall_time_us":1962569}
I20260812 19:23:18.254019  6483 rpcz_store.cc:276] 0812 19:23:14.083628 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:14.084720 (+  1092us) service_pool.cc:227] Handling call
0812 19:23:14.085044 (+   324us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:14.374898 (+289854us) raft_consensus.cc:1520] Early marking committed up to index 3
0812 19:23:14.384436 (+  9538us) log.cc:842] Serialized 14 byte log entry
0812 19:23:14.677079 (+292643us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:14.810921 (+133842us) log.cc:842] Serialized 52 byte log entry
0812 19:23:14.811124 (+   203us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:14.811169 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.242031 (+3430862us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54001310d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:18.242101 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:18.242217 (+   116us) raft_consensus.cc:1671] finished
0812 19:23:18.242336 (+   119us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:18.242710 (+   374us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":46661,"prepare.queue_time_us":9762,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":518351,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":30635,"spinlock_wait_cycles":543730048,"thread_start_us":306124,"threads_started":2,"wal-append.queue_time_us":514227,"wal-append.run_cpu_time_us":2164,"wal-append.run_wall_time_us":1004005}
I20260812 19:23:18.355212  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:18.357685  6475 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:18.365463  6464 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:18.359846  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:18.344817  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:18.383630  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:18.395329  6474 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:23:18.393867  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.024s	sys 0.028s
I20260812 19:23:18.414736  6235 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:18.421546  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1836) took 1169 ms. Trace:
I20260812 19:23:18.422036  6235 rpcz_store.cc:276] 0812 19:23:17.252174 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:18.290848 (+1038674us) service_pool.cc:227] Handling call
0812 19:23:18.421470 (+130622us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:18.426992  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.025s	sys 0.028s
I20260812 19:23:18.433527  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1823) took 1276 ms. Trace:
I20260812 19:23:18.441751  6242 rpcz_store.cc:276] 0812 19:23:17.149734 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:18.310845 (+1161111us) service_pool.cc:227] Handling call
0812 19:23:18.358811 (+ 47966us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:18.409116 (+ 50305us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:18.409145 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:18.409186 (+    41us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:18.426061 (+ 16875us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.426156 (+    95us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:18.426323 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:18.438011  6229 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:18.354285 10938 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:18.453413 11486 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:18.459030 11068 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:18.464772  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
W20260812 19:23:18.465472 11629 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.347s	user 0.000s	sys 0.004s
I20260812 19:23:18.465926  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:18.468421  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1772) took 3523 ms. Trace:
I20260812 19:23:18.444931  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1839) took 1183 ms. Trace:
I20260812 19:23:18.503762  6229 rpcz_store.cc:276] 0812 19:23:17.261945 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:18.268034 (+1006089us) service_pool.cc:227] Handling call
0812 19:23:18.444853 (+176819us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:18.478207  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1828) took 1299 ms. Trace:
I20260812 19:23:18.504643  6228 rpcz_store.cc:276] 0812 19:23:17.151008 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:18.305010 (+1154002us) service_pool.cc:227] Handling call
0812 19:23:18.373895 (+ 68885us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:18.450126 (+ 76231us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:18.450169 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:18.450231 (+    62us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:18.450277 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.450365 (+    88us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:18.450520 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:18.451220  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 993083us
I20260812 19:23:18.512308  6353 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:18.531754  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1837) took 1271 ms. Trace:
I20260812 19:23:18.540472  6238 rpcz_store.cc:276] 0812 19:23:17.260927 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:18.342039 (+1081112us) service_pool.cc:227] Handling call
0812 19:23:18.397807 (+ 55768us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:18.512571 (+114764us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:18.512606 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:18.531413 (+ 18807us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:18.531469 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.531551 (+    82us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:18.531693 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":16423}
I20260812 19:23:18.537636  6342 raft_consensus.cc:595] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:18.498157 11486 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:18.558255  6342 raft_consensus.cc:603] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:18.407219 11533 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:18.566992  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:18.574311  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:18.587841  6465 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:18.588629  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:38150 (request call id 1788) took 1903 ms. Trace:
I20260812 19:23:18.556582 11492 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:18.589004  6465 rpcz_store.cc:276] 0812 19:23:16.699151 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:16.701544 (+  2393us) service_pool.cc:227] Handling call
0812 19:23:18.206478 (+1504934us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54003a9154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f776fda7 00007f98fc6bbee0 00007f98f5db9784 00007f98f5db9712 00007f98f5db9641 00007f98f5db95bc 00007f98f5db8872 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:18.588499 (+382021us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":798821248}
I20260812 19:23:18.605100  6354 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:23:18.611482  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 57649.9us
I20260812 19:23:18.503352  6482 rpcz_store.cc:276] 0812 19:23:14.847993 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:14.848161 (+   168us) service_pool.cc:227] Handling call
0812 19:23:14.848557 (+   396us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:14.863117 (+ 14560us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:14.863166 (+    49us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:14.868709 (+  5543us) log.cc:842] Serialized 52 byte log entry
0812 19:23:17.625991 (+2757282us) spinlock_profiling.cc:243] Waited 8.82 ms on lock 0x7b180037f000. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411
0812 19:23:17.626209 (+   218us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:18.151131 (+524922us) log.cc:842] Serialized 14 byte log entry
0812 19:23:18.318458 (+167327us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.341443 (+ 22985us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:18.350054 (+  8611us) raft_consensus.cc:1671] finished
0812 19:23:18.354732 (+  4678us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:18.371240 (+ 16508us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":94103,"prepare.queue_time_us":576598,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":223624,"raft.run_cpu_time_us":744,"raft.run_wall_time_us":87364,"spinlock_wait_cycles":20276480,"thread_start_us":553946,"threads_started":3,"wal-append.queue_time_us":261342,"wal-append.run_cpu_time_us":2265,"wal-append.run_wall_time_us":1122973}
I20260812 19:23:18.615890  6344 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:18.641070  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1821) took 1500 ms. Trace:
W20260812 19:23:18.661685  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 351271us
I20260812 19:23:18.663157  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:18.664143  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:18.665410 10795 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:18.665879 11417 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election won for term 9
W20260812 19:23:18.666263  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 185695us
I20260812 19:23:18.667264 11607 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:18.668110 11607 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:18.672394  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:18.665962 10795 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:18.673477 11506 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:18.673799 10795 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:18.677991 11467 consensus_meta.cc:287] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.804s	user 0.008s	sys 0.019s
I20260812 19:23:18.668051 11417 raft_consensus.cc:686] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:23:18.680218 11636 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260812 19:23:18.680066 11417 consensus_queue.cc:237] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:18.680820 11607 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:18.684875 11506 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:18.686409 11506 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:18.692572  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:18.715399  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 45571.6us
W20260812 19:23:18.699613  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 94020.9us
I20260812 19:23:18.726151  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:18.729215  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 77455.4us
I20260812 19:23:18.728310  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1822) took 1599 ms. Trace:
I20260812 19:23:18.651160  6236 rpcz_store.cc:276] 0812 19:23:17.125355 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:17.125876 (+   521us) service_pool.cc:227] Handling call
0812 19:23:17.132792 (+  6916us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:17.132953 (+   161us) raft_consensus.cc:1520] Early marking committed up to index 2
0812 19:23:18.116982 (+984029us) log.cc:842] Serialized 14 byte log entry
0812 19:23:18.568596 (+451614us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:18.589153 (+ 20557us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:23:18.604149 (+ 14996us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.604251 (+   102us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:18.625911 (+ 21660us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":191740,"prepare.queue_time_us":536799,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":202308,"spinlock_wait_cycles":3247872,"thread_start_us":1181303,"threads_started":2,"wal-append.queue_time_us":438624}
I20260812 19:23:18.704813 11607 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:18.738881  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:18.622864 11068 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:18.741461  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:18.720214 10938 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:18.731542  6230 rpcz_store.cc:276] 0812 19:23:17.125692 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:18.294389 (+1168697us) service_pool.cc:227] Handling call
0812 19:23:18.367042 (+ 72653us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:18.413609 (+ 46567us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:23:18.414154 (+   545us) log.cc:842] Serialized 14 byte log entry
0812 19:23:18.724313 (+310159us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:18.724372 (+    59us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:18.724426 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.724494 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:18.724617 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":4456,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":9403,"raft.queue_time_us":6213,"thread_start_us":279991,"threads_started":1}
I20260812 19:23:18.735455 11607 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:18.764909  6344 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:18.797210  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:18.752611 11607 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:23:18.796993  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 56235.5us
I20260812 19:23:18.828702  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:18.829723  6483 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:18.830870  6354 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:18.830951  6477 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:38150
I20260812 19:23:18.842813  6477 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:23:18.842989 11068 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:18.843402  6477 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:18.844195  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1530) took 1954 ms. Trace:
I20260812 19:23:18.842634  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:18.844259  6344 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260812 19:23:18.850106  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:18.893527  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.111691  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.111971  6470 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:19.113241  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.114390  6470 raft_consensus.cc:2354] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7.
I20260812 19:23:19.110119  6473 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260812 19:23:18.894018  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:18.952759  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:19.001718  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 99545.6us
I20260812 19:23:18.844811  6345 rpcz_store.cc:276] 0812 19:23:16.890097 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:17.199261 (+309164us) service_pool.cc:227] Handling call
0812 19:23:17.199703 (+   442us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:17.507731 (+308028us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:23:18.154838 (+647107us) log.cc:842] Serialized 14 byte log entry
0812 19:23:18.665018 (+510180us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:18.665108 (+    90us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:18.665196 (+    88us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.843875 (+178679us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b540009ddd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:18.843934 (+    59us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:18.844130 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":305668,"prepare.queue_time_us":1114734,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":64,"raft.queue_time_us":306998,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":155,"spinlock_wait_cycles":709423104,"thread_start_us":811950,"threads_started":2,"wal-append.queue_time_us":423705}
W20260812 19:23:19.076382  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 149505us
I20260812 19:23:18.952850  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.118399  6477 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:18.994139  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 66998.9us
I20260812 19:23:19.139599 10795 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:19.148039  6477 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:19.149109  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.145898  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.150395  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:19.152907  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.154464  6342 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:19.118275 11533 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:19.161643  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:19.155673  6483 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:23:19.155076 11068 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:19.165422  6482 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:23:19.175822 11635 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.956s	user 0.006s	sys 0.000s
I20260812 19:23:19.178604  6475 raft_consensus.cc:2354] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7.
I20260812 19:23:19.183495 11486 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:19.184805 11646 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260812 19:23:19.158174 11356 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:19.187289 11356 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:19.188833 11638 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.529s	user 0.001s	sys 0.014s
I20260812 19:23:19.154081 10795 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:19.193789  6354 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:19.171841  6473 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:19.164345 11068 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:19.178691 11648 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260812 19:23:19.212878  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:19.218264  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:18.942322 11309 consensus_queue.cc:1046] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.459s
I20260812 19:23:19.218992  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.220767 11068 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:19.235633  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.238607  6482 raft_consensus.cc:2396] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260812 19:23:19.237357  6465 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
W20260812 19:23:19.240556 11417 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.041s	sys 0.089s
I20260812 19:23:19.244578 11570 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
W20260812 19:23:19.247592 11417 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.041s	sys 0.090s
I20260812 19:23:19.273734  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:19.273366  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1795) took 3023 ms. Trace:
I20260812 19:23:19.287997  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:19.291090 11650 log.cc:924] Time spent T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.448s	user 0.006s	sys 0.012s
I20260812 19:23:19.275863  6347 rpcz_store.cc:276] 0812 19:23:16.246021 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:16.246223 (+   202us) service_pool.cc:227] Handling call
0812 19:23:16.246702 (+   479us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:16.815013 (+568311us) raft_consensus.cc:1520] Early marking committed up to index 3
0812 19:23:16.815429 (+   416us) log.cc:842] Serialized 14 byte log entry
0812 19:23:18.359575 (+1544146us) log.cc:842] Serialized 14 byte log entry
0812 19:23:18.669598 (+310023us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:18.669715 (+   117us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:18.669784 (+    69us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:19.266422 (+596638us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b540034f654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:19.266484 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:19.269642 (+  3158us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":267071,"prepare.queue_time_us":433524,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":98,"raft.queue_time_us":267198,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":168,"spinlock_wait_cycles":1346322816,"thread_start_us":1541481,"threads_started":2,"wal-append.queue_time_us":1843994}
I20260812 19:23:19.298060  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.303615  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.303854  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.306695  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.295073 11356 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:19.314340  6473 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260812 19:23:19.314483  6465 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:19.314319  6475 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 19:23:19.324156  6464 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:19.324105  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:19.322171 11506 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.023s	sys 0.059s
W20260812 19:23:19.331352 11506 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.023s	sys 0.059s
I20260812 19:23:19.391098  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:19.393393  6298 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.021s	sys 0.062s
W20260812 19:23:19.393853  6298 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.021s	sys 0.062s
I20260812 19:23:19.395502  6350 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:45970
I20260812 19:23:19.394382  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:19.394186  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 769974us
W20260812 19:23:19.403158  6352 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.044s	sys 0.068s
W20260812 19:23:19.403752  6352 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.045s	sys 0.069s
I20260812 19:23:19.397010  6464 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:19.408910  6350 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:23:19.412676  6350 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:19.395236 11484 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:19.413260  6483 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:19.419693  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:19.420536  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.424180  6475 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:19.427789  6352 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:19.434034  6465 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:19.439042  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.442528  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.447743  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.449349  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.450178  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.446936  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.451713  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.452406  6352 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:19.455734  6482 raft_consensus.cc:2379] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:19.481894  6475 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:19.483124  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.483968  6483 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 2.
I20260812 19:23:19.478876 11506 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:19.491237  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.492130  6483 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:19.499514  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.507016  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.508351  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.509065  6345 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:19.509398  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:19.511591 11612 log.cc:924] Time spent T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.851s	user 0.005s	sys 0.011s
I20260812 19:23:19.518350  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.520351  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.487707 11506 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:19.526998  6350 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:19.532578  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 312047us
I20260812 19:23:19.538801  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.541435  6350 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:19.544495  6483 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:19.546942  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.545722  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:19.549659  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.551136  6347 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
W20260812 19:23:19.551482 11641 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.891s	user 0.012s	sys 0.004s
W20260812 19:23:19.552152 11640 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.699s	user 0.006s	sys 0.002s
W20260812 19:23:19.552445  6297 connection.cc:232] RPC call timeout handler was delayed by -2.0506586609408259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
I20260812 19:23:19.553783  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.555765  6236 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260812 19:23:19.544313 11607 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.648s	user 0.013s	sys 0.000s
I20260812 19:23:19.557739  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:19.558099 11559 raft_consensus.cc:3032] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:19.559342  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1820) took 2434 ms. Trace:
I20260812 19:23:19.558876  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.560130  6342 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:19.565017  6483 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:19.564960  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:19.565716  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.565761  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:19.566411  6475 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:19.563701  6224 rpcz_store.cc:276] 0812 19:23:17.124558 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:17.124739 (+   181us) service_pool.cc:227] Handling call
0812 19:23:17.125091 (+   352us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:18.222811 (+1097720us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:18.222868 (+    57us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:18.223658 (+   790us) log.cc:842] Serialized 26 byte log entry
0812 19:23:18.359357 (+135699us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:18.359398 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:18.365250 (+  5852us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:19.500360 (+1135110us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:19.552753 (+ 52393us) raft_consensus.cc:1671] finished
0812 19:23:19.552772 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:19.559278 (+  6506us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":92691,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":226,"spinlock_wait_cycles":40516864,"thread_start_us":1232095,"threads_started":2,"wal-append.queue_time_us":436043}
I20260812 19:23:19.567775  6229 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:19.568641 11506 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:19.561453 11559 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:19.569253  6353 raft_consensus.cc:2396] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260812 19:23:19.570113 11559 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:19.571789 11559 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:23:19.558472 11651 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260812 19:23:19.575371  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.559648 11417 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:19.576982  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:19.579380  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.580339  6235 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:19.581350  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.581446  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.582556  6230 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:19.583382  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:19.580227  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.585690  6465 raft_consensus.cc:2396] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260812 19:23:19.587361  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.588536 11417 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:19.563678 11607 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:19.655258  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:19.591337  6474 raft_consensus.cc:2354] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7.
I20260812 19:23:19.655431  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.660454  6464 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:19.656955 11090 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:19.661502  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:19.661715  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:19.662356 11658 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.085s	user 0.003s	sys 0.013s
I20260812 19:23:19.661751  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.665416  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:19.668985  6354 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:19.668071 11607 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:19.670513  6347 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:19.672339  6477 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:19.672050  6242 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 5: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:19.674136  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:19.673751 11442 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:19.675662  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:19.676663  6241 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 8
I20260812 19:23:19.675444 11090 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:19.676895  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:19.677718  7593 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:19.678577  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.678712 11090 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:19.682083  6470 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:19.682273  6465 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:19.684939  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:19.687649  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:19.694201  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:19.689415 11257 consensus_meta.cc:287] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.389s	user 0.014s	sys 0.007s
I20260812 19:23:19.694691  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:19.696053  6475 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:19.696657  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:19.689168 11442 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:19.709903  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:19.711211 11442 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:19.713783 11417 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:19.718026  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.719204  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:19.724341  6347 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:19.726109  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:19.720546  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:19.730084  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:19.728286  6229 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
W20260812 19:23:19.754391  6178 connection.cc:232] RPC call timeout handler was delayed by -1.5305642818566412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260812 19:23:19.755035  6178 connection.cc:232] RPC call timeout handler was delayed by -1.5161642818711698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260812 19:23:19.755506  6178 connection.cc:232] RPC call timeout handler was delayed by -1.5044642819557339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260812 19:23:19.755851  6178 connection.cc:232] RPC call timeout handler was delayed by -1.4954642818775028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260812 19:23:19.756206  6178 connection.cc:232] RPC call timeout handler was delayed by -1.4954642818775028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260812 19:23:19.756686  6178 connection.cc:232] RPC call timeout handler was delayed by -1.4792642819229513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260812 19:23:19.757041  6178 connection.cc:232] RPC call timeout handler was delayed by -1.4765642818529159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260812 19:23:19.757400  6178 connection.cc:232] RPC call timeout handler was delayed by -1.418064281810075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260812 19:23:19.757754  6178 connection.cc:232] RPC call timeout handler was delayed by -1.4126642819028348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260812 19:23:19.759114  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:19.760257  6178 connection.cc:232] RPC call timeout handler was delayed by -1.4126642819028348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260812 19:23:19.761189  6178 connection.cc:232] RPC call timeout handler was delayed by -1.3829642818309367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260812 19:23:19.761623  6178 connection.cc:232] RPC call timeout handler was delayed by -1.355964281829074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260812 19:23:19.761981  6178 connection.cc:232] RPC call timeout handler was delayed by -1.3433642818126827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
I20260812 19:23:19.762177  6241 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
W20260812 19:23:19.762409  6178 connection.cc:232] RPC call timeout handler was delayed by -1.190364281879738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
I20260812 19:23:19.752599 11309 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:19.758980 11484 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:19.758543  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:19.763487  6349 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:19.759692  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:19.767622  6230 raft_consensus.cc:2396] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260812 19:23:19.770925  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:19.786374  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:19.774444 11288 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:19.787873 11288 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:19.776237  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:19.813360  6342 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:19.813156  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:19.815954  6349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1514) took 3409 ms (client timeout 1642 ms). Trace:
I20260812 19:23:19.763512 11484 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:19.763432 11309 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:19.923870  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 190919us
W20260812 19:23:19.872782  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 109041us
I20260812 19:23:19.925639  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:19.824568  6353 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:19.818913 11417 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:19.884135 11068 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:19.825627  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:19.828990  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:19.824394  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:19.816591 11673 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.002s
W20260812 19:23:19.816514  6349 rpcz_store.cc:269] 0812 19:23:16.406342 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:16.448532 (+ 42190us) service_pool.cc:227] Handling call
0812 19:23:19.815657 (+3367125us) spinlock_profiling.cc:243] Waited 3 s on lock 0x7b54004092d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:19.815832 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6890323840}
I20260812 19:23:19.934003  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:19.935540  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:19.823598 11288 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:19.940467  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:19.898200 11664 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260812 19:23:19.821161 11484 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:19.944643  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 235965us
I20260812 19:23:19.946779  6238 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:19.943662  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:19.949743  6241 raft_consensus.cc:2396] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260812 19:23:19.952595  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:19.956532  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 225099us
I20260812 19:23:19.957942  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:19.958092  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:19.965193 11068 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:19.966754 11068 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:19.968089 11309 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:19.968089 11288 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:19.968952 11288 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:19.971835 11288 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:19.972164  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:19.995923  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:19.995525 11688 raft_consensus.cc:3032] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:19.999899  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.000267 11688 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:20.001591 11688 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:19.995532 11068 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:20.003538 11068 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:20.004082 11068 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:20.004588  6178 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.550s (SENT)
I20260812 19:23:20.005131  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:20.006014 11484 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:20.006466 11288 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:20.008230  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.009866  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.022171  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:20.063621  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:20.097616  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 106233us
W20260812 19:23:20.099753  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 77728.6us
W20260812 19:23:20.099395  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 101733us
I20260812 19:23:20.014823  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.103482 11689 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:20.104017 11689 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:20.104420 11689 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:20.098306  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.105746 11688 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:20.106209  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.011897  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.015717  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.103062  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.107456  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:20.034602  6058 catalog_manager.cc:5495] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:20.014259  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:20.110618  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:20.163810  6417 leader_election.cc:334] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.713s (SENT)
I20260812 19:23:20.240811  7603 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:20.238363  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.136984  6242 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82"
dest_uuid: "a1541d11be514114966dc1e92a345298"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:35414
I20260812 19:23:20.242359  6242 raft_consensus.cc:595] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:20.242687  6242 raft_consensus.cc:603] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:20.015237  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.145354 11689 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:20.247351  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:20.249039 11689 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:20.249684 11689 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:20.250052 11689 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:20.250414 11689 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:20.246984 11257 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:20.253818 11257 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:20.116642 11068 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:20.255069 11257 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:20.111613  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:20.251420  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 144056us
I20260812 19:23:20.245436  7593 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
W20260812 19:23:20.252408  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 88676.1us
I20260812 19:23:20.127669 11484 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:20.259815 11484 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:20.262205 11484 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:20.108283  6178 leader_election.cc:334] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.550s (SENT)
I20260812 19:23:20.256596 11068 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:20.266642  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:20.016451  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.270936 11309 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:20.279383  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.275003  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.275950  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.281096  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.281853  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.276235  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.276827  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.276973  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.277335  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.277745  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.273747  6350 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c59df69987ce4bc38077cd7681552414"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:20.270156  7603 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:20.282505  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.285220  6350 raft_consensus.cc:595] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:20.286242  6350 raft_consensus.cc:603] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260812 19:23:20.287220  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 178991us
I20260812 19:23:20.287670  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260812 19:23:20.290560 11288 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:20.291430  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:23:20.291777  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.292290  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:20.289194  6058 catalog_manager.cc:5495] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 8 to 9, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 9 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:20.295862  6058 catalog_manager.cc:5495] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 7 to 8, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 8 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:23:20.313930  6058 catalog_manager.cc:5495] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 4 to 5, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 5 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:20.334295  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.337438  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:23:20.337647  6060 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 232) took 11561 ms (client timeout 15000 ms). Trace:
I20260812 19:23:20.346783  7600 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:20.355975 11309 consensus_queue.cc:1046] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:23:20.357622 11309 raft_consensus.cc:3032] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:20.358073 11309 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:20.359278 11309 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:20.361771 11309 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:20.369096  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.375916 11689 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:20.379859  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:23:20.339730  6060 rpcz_store.cc:269] 0812 19:23:08.776689 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:08.776890 (+   201us) service_pool.cc:227] Handling call
0812 19:23:08.904925 (+128035us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b5400002dd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fdaf0 00007f98f7780f2a 00007f98fd6d2d6c 00007f98fd7ccc3e 00007f98fbadefb4 00007f98fbadef42 00007f98fbadee71 00007f98fbadedec 00007f98fbade0a2 00007f98f5bae94c 00007f98f5badd86
0812 19:23:20.337438 (+11432513us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:15.118327 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:15.229256 (+110929us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:15.229288 (+    32us) write_op.cc:435] Acquired schema lock
0812 19:23:15.229299 (+    11us) tablet.cc:660] Decoding operations
0812 19:23:15.230368 (+  1069us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:15.230430 (+    62us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:15.230460 (+    30us) tablet.cc:683] Acquiring locks for 11 operations
0812 19:23:15.291484 (+ 61024us) tablet.cc:699] Row locks acquired
0812 19:23:15.291500 (+    16us) write_op.cc:260] PREPARE: finished
0812 19:23:15.291713 (+   213us) write_op.cc:270] Start()
0812 19:23:15.291830 (+   117us) write_op.cc:276] Timestamp: P: 1786562595291640 usec, L: 0
0812 19:23:15.291846 (+    16us) op_driver.cc:331] REPLICATION: starting
0812 19:23:15.370589 (+ 78743us) log.cc:842] Serialized 4341 byte log entry
0812 19:23:18.248378 (+2877789us) op_driver.cc:444] REPLICATION: finished
0812 19:23:19.135010 (+886632us) write_op.cc:301] APPLY: starting
0812 19:23:19.158719 (+ 23709us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:19.179174 (+ 20455us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:19.179333 (+   159us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:19.249533 (+ 70200us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:19.299660 (+ 50127us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0812 19:23:19.299735 (+    75us) write_op.cc:312] APPLY: finished
0812 19:23:19.300315 (+   580us) log.cc:842] Serialized 83 byte log entry
0812 19:23:19.552541 (+252226us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f483e5fe 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb
0812 19:23:19.740813 (+188272us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:19.741128 (+   315us) write_op.cc:454] Released schema lock
0812 19:23:19.741195 (+    67us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:19.750784 (+  9589us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:19.752387 (+  1603us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":230480,"reported_tablets":50,"spinlock_wait_cycles":106568576,"child_traces":[["op",{"apply.queue_time_us":703751,"apply.run_cpu_time_us":20470,"apply.run_wall_time_us":778874,"num_ops":11,"prepare.queue_time_us":649609,"prepare.run_cpu_time_us":23550,"prepare.run_wall_time_us":1455015,"raft.queue_time_us":1105255,"raft.run_cpu_time_us":63003,"raft.run_wall_time_us":291949,"replication_time_us":2956354,"spinlock_wait_cycles":337368832,"thread_start_us":2300681,"threads_started":5,"wal-append.queue_time_us":1463013,"wal-append.run_cpu_time_us":65643,"wal-append.run_wall_time_us":2015320}]]}
I20260812 19:23:20.380137 11689 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:20.391471  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 144232us
W20260812 19:23:20.399405  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 48136.7us
W20260812 19:23:20.449631  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47707.2us
W20260812 19:23:20.479475  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 185409us
I20260812 19:23:20.479744 11257 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:23:20.486884  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:20.496356 11688 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:20.490671  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:20.496865 11688 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:20.497428 11688 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:23:20.498799  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 48124us
I20260812 19:23:20.500380  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:20.502543  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 107821us
I20260812 19:23:20.504524 11309 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:20.504493 11697 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:20.505592 11697 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:20.506529 11697 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:20.507711 11697 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:20.507205 11688 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:20.508122  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:20.513077 11309 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:20.513526 11309 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:20.513933 11309 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:20.514485  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:20.514843 11288 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:20.515573 11068 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:20.524384 11068 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:20.524881 11068 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:20.527458 11595 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:20.528072 11595 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:20.530617 11595 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:20.535100 11288 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:20.535611 11288 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:20.540885  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:20.541687  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:20.547420  6417 leader_election.cc:334] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.817s (SENT)
I20260812 19:23:20.516631  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:20.521307 11688 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:20.522229 11309 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:20.565704  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 49176.1us
I20260812 19:23:20.568439 11309 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:20.534336 11068 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:20.569665  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:20.569339 11688 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260812 19:23:20.574824  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 74549.1us
I20260812 19:23:20.572399 11688 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:20.581254  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:20.574398 11309 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:20.590948 11309 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:20.591382 11309 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:20.599994  6417 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:20.601066 11691 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:20.600246 11068 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:20.603636  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:20.583274 11688 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:20.613966 11701 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:20.626220  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:20.634907  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:20.638234  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:20.639549 11484 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:20.640050 11484 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:20.640470 11484 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:20.616194  6298 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:20.618466  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:20.647559 11068 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:20.648208 11068 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:20.648494  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:20.649319 11068 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:20.651924 11691 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:20.652446 11691 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:20.652832 11691 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:20.661549 11309 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:20.614598 11711 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:20.666010  6058 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 109) took 9456 ms. Trace:
I20260812 19:23:20.664544  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:20.669581  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 43481.2us
W20260812 19:23:20.670380  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 57508.9us
I20260812 19:23:20.675338  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:20.676276 11698 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:20.677996  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:20.677879 11698 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260812 19:23:20.671130  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 55460.2us
I20260812 19:23:20.666596 11288 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:20.684343 11697 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:20.670205 11710 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:20.670547 11703 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:20.672531  6058 rpcz_store.cc:276] 0812 19:23:11.209114 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:11.222020 (+ 12906us) service_pool.cc:227] Handling call
0812 19:23:12.042882 (+820862us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b5400002dd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fdaf0 00007f98f7780f2a 00007f98fd6d2d6c 00007f98fd7ccc3e 00007f98fbadefb4 00007f98fbadef42 00007f98fbadee71 00007f98fbadedec 00007f98fbade0a2 00007f98f5bae94c 00007f98f5badd86
0812 19:23:20.665938 (+8623056us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:20.372293 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:20.373629 (+  1336us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:20.373682 (+    53us) write_op.cc:435] Acquired schema lock
0812 19:23:20.373714 (+    32us) tablet.cc:660] Decoding operations
0812 19:23:20.376067 (+  2353us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:20.376175 (+   108us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:20.376200 (+    25us) tablet.cc:683] Acquiring locks for 4 operations
0812 19:23:20.376670 (+   470us) tablet.cc:699] Row locks acquired
0812 19:23:20.376709 (+    39us) write_op.cc:260] PREPARE: finished
0812 19:23:20.376890 (+   181us) write_op.cc:270] Start()
0812 19:23:20.383563 (+  6673us) write_op.cc:276] Timestamp: P: 1786562600376835 usec, L: 0
0812 19:23:20.383591 (+    28us) op_driver.cc:331] REPLICATION: starting
0812 19:23:20.428201 (+ 44610us) log.cc:842] Serialized 1662 byte log entry
0812 19:23:20.505206 (+ 77005us) op_driver.cc:444] REPLICATION: finished
0812 19:23:20.573909 (+ 68703us) write_op.cc:301] APPLY: starting
0812 19:23:20.575332 (+  1423us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:20.611113 (+ 35781us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:20.615606 (+  4493us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:20.635056 (+ 19450us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:20.635383 (+   327us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0812 19:23:20.635468 (+    85us) write_op.cc:312] APPLY: finished
0812 19:23:20.635847 (+   379us) log.cc:842] Serialized 41 byte log entry
0812 19:23:20.636105 (+   258us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:20.636271 (+   166us) write_op.cc:454] Released schema lock
0812 19:23:20.636333 (+    62us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:20.636726 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:20.636761 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":161067,"reported_tablets":14,"spinlock_wait_cycles":862479744,"child_traces":[["op",{"apply.queue_time_us":66874,"apply.run_cpu_time_us":3872,"apply.run_wall_time_us":64713,"num_ops":4,"prepare.queue_time_us":14130,"prepare.run_cpu_time_us":4339,"prepare.run_wall_time_us":83016,"replication_time_us":120254,"thread_start_us":85612,"threads_started":2}]]}
I20260812 19:23:20.695555  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:20.695565  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46008.8us
I20260812 19:23:20.668612 11711 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:20.694553  6298 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:20.697983 11710 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:20.701426 11710 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:20.662616 11484 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:20.711266 11257 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:20.697921 11703 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:20.712996  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:20.713402 11703 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:20.715745  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:20.716425 11724 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:20.716876 11724 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:20.717226 11724 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:20.725251  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:20.726052  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:20.726678  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:20.727535 11698 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:20.728233 11257 raft_consensus.cc:686] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:20.726454 11484 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:20.729290 11257 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:20.729864 11484 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:20.730430 11484 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:20.730947 11484 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:20.730857  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:20.732563  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:20.734617 11698 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:20.735036 11698 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:20.735539 11698 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:20.736928 11691 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:20.702823 11711 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:20.709649 11697 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:20.759528  6054 catalog_manager.cc:5495] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:20.761556  6054 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 7 to 8, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 8 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:20.743278 11595 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:20.698738 11688 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:20.767877 11688 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:20.767534  6054 catalog_manager.cc:5495] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 5 to 6, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 6 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:20.769835 11595 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:20.770280 11595 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:20.769584  6054 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 5 to 6, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 6 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:20.771255  6054 catalog_manager.cc:5495] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 4 to 5, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 5 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:20.778177  6054 catalog_manager.cc:5495] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 6 to 7, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 7 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:20.781812 11595 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:20.783164  6054 catalog_manager.cc:5495] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:20.797083  6054 catalog_manager.cc:5495] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 3 to 7, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 7 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:20.783998 11697 raft_consensus.cc:686] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:20.798192  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:20.799142 11697 consensus_queue.cc:237] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:20.796876 11595 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:20.751367 11417 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260812 19:23:20.851873  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 100742us
W20260812 19:23:20.853350  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 188929us
I20260812 19:23:20.853904  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:20.854832  6350 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:20.855939  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:20.855960  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:20.836555 11417 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:20.867551  6242 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:20.869966  6228 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:20.875746  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:20.877023  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:20.855526  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 123068us
I20260812 19:23:20.875631  6054 catalog_manager.cc:5495] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:20.878005  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:20.869429 11417 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:23:20.878723  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:20.871500 11691 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:20.886546  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:20.888845  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:20.886346 11711 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:20.892889 11711 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:20.884330 11738 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:20.895140 11738 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:20.877437 11309 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:20.902808  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:20.907158  6054 catalog_manager.cc:5495] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:20.910022  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:20.910279  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:20.912565  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:20.913146  6230 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 7
I20260812 19:23:20.910928  6344 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:20.911362  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:20.915041  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:20.915797 11729 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:20.916365  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:20.917006  6236 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:20.918512 11698 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:20.920845  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:20.881440 11288 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:20.922102  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:20.922297  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:20.923324  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:20.924086  6235 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:20.924824 11484 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:20.926967  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:20.927625  6242 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:20.895529 11738 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:20.853355 11703 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:20.935439  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:20.936457 11703 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:20.937201  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:20.911979  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:20.910935  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:20.938961  6238 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:20.940615 11724 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:20.921671  6354 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:20.938338  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:20.939065  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:20.939007  6224 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:20.912196  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:20.951347  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:20.914413  6349 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:20.943333  6228 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:20.965708  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:20.930066 11710 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:20.970389  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:20.971709  6238 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:20.972393  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:20.972726  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:20.973311  6242 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 8
I20260812 19:23:20.974967  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:20.907109 11711 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:20.979471  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:20.980706  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:20.981325 11484 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:20.952577 11698 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:20.981827  6354 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:20.983623 11710 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:20.979411  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:20.942621 11724 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:20.997424  6058 catalog_manager.cc:5495] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:21.002384  6060 catalog_manager.cc:5495] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 5 to 8, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 8 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:21.013522  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:20.985638 11711 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:21.016309 11710 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:21.017287 11732 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:21.018625 11710 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:21.017925  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:21.019631 11710 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.020494 11711 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:21.021509 11738 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.008697 11703 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260812 19:23:21.026520  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 167909us
W20260812 19:23:21.023487  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 141498us
I20260812 19:23:21.016324  6060 catalog_manager.cc:5495] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 6 to 7, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 7 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:21.028518  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:21.024767 11288 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260812 19:23:21.031754  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 63141.9us
I20260812 19:23:21.026911 11703 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:21.041316  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:21.036669  6060 catalog_manager.cc:5495] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 3 to 4, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 4 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:21.043071  6060 catalog_manager.cc:5495] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 5 to 6, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 6 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } }
I20260812 19:23:21.050420  6236 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:21.044269  6060 catalog_manager.cc:5495] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 5 to 6, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 6 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:21.053536  6060 catalog_manager.cc:5495] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:21.032112 11706 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:21.054770  6060 catalog_manager.cc:5495] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 7 to 8, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 8 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:21.060819  6060 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 6 to 8, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 8 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:21.062727  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:21.062870  6060 catalog_manager.cc:5495] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 4 to 6, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 6 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:21.063650  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:21.047437 11703 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:21.064736  6060 catalog_manager.cc:5495] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 4 to 5, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 5 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:23:21.099332  6416 connection.cc:232] RPC call timeout handler was delayed by -2.3727813910227269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260812 19:23:21.099902  6416 connection.cc:232] RPC call timeout handler was delayed by -2.2323813908733428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
W20260812 19:23:21.100208  6416 connection.cc:232] RPC call timeout handler was delayed by -2.1297813910059631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260812 19:23:21.100600  6416 connection.cc:232] RPC call timeout handler was delayed by -2.0523813909385353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260812 19:23:21.100988  6416 connection.cc:232] RPC call timeout handler was delayed by -2.0226813910994679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
I20260812 19:23:21.062107 11288 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260812 19:23:21.102160  6054 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38512 (request call id 228) took 11471 ms (client timeout 15000 ms). Trace:
I20260812 19:23:21.067492 11697 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260812 19:23:21.105232 11691 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:21.108531 11691 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:21.110863 11691 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:21.104990 11732 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:21.112833  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:21.117125  6416 connection.cc:232] RPC call timeout handler was delayed by -2.0217813909985125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260812 19:23:21.117738  6416 connection.cc:232] RPC call timeout handler was delayed by -1.922781391069293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
W20260812 19:23:21.118064  6416 connection.cc:232] RPC call timeout handler was delayed by -1.8363813909236342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
W20260812 19:23:21.118463  6416 connection.cc:232] RPC call timeout handler was delayed by -1.8219813909381628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
W20260812 19:23:21.118856  6416 connection.cc:232] RPC call timeout handler was delayed by -1.7976813910063356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
I20260812 19:23:21.064693 11688 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:21.102614  6054 rpcz_store.cc:269] 0812 19:23:09.631056 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:09.631265 (+   209us) service_pool.cc:227] Handling call
0812 19:23:21.102092 (+11470827us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:20.923095 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:20.923662 (+   567us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:20.923710 (+    48us) write_op.cc:435] Acquired schema lock
0812 19:23:20.923722 (+    12us) tablet.cc:660] Decoding operations
0812 19:23:20.924749 (+  1027us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:20.924814 (+    65us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:20.924841 (+    27us) tablet.cc:683] Acquiring locks for 10 operations
0812 19:23:20.925683 (+   842us) tablet.cc:699] Row locks acquired
0812 19:23:20.925703 (+    20us) write_op.cc:260] PREPARE: finished
0812 19:23:20.925859 (+   156us) write_op.cc:270] Start()
0812 19:23:20.925975 (+   116us) write_op.cc:276] Timestamp: P: 1786562600925811 usec, L: 0
0812 19:23:20.925994 (+    19us) op_driver.cc:331] REPLICATION: starting
0812 19:23:20.926581 (+   587us) log.cc:842] Serialized 3974 byte log entry
0812 19:23:20.931073 (+  4492us) op_driver.cc:444] REPLICATION: finished
0812 19:23:20.931639 (+   566us) write_op.cc:301] APPLY: starting
0812 19:23:20.931751 (+   112us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:20.931992 (+   241us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:20.932101 (+   109us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:20.933219 (+  1118us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:20.933500 (+   281us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0812 19:23:20.933564 (+    64us) write_op.cc:312] APPLY: finished
0812 19:23:20.933973 (+   409us) log.cc:842] Serialized 77 byte log entry
0812 19:23:20.934161 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:20.934329 (+   168us) write_op.cc:454] Released schema lock
0812 19:23:20.934388 (+    59us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:20.952424 (+ 18036us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:20.967168 (+ 14744us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":109311,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":288,"apply.run_cpu_time_us":3654,"apply.run_wall_time_us":42717,"num_ops":10,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":3780,"prepare.run_wall_time_us":3936,"replication_time_us":4959}]]}
W20260812 19:23:21.127920  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 69011.7us
W20260812 19:23:21.136117  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 73485.7us
I20260812 19:23:21.137295  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:21.141122 11288 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:21.144615 11692 consensus_queue.cc:1046] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:23:21.146761  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:21.146842 11689 raft_consensus.cc:3032] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:21.147352 11689 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:21.147608 11731 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:21.148061 11731 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:21.148399 11731 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:21.148242 11689 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.151649 11689 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:21.152292  6242 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:21.158160 11729 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:21.158293  6475 raft_consensus.cc:1226] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:21.158818 11729 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.161286  6465 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:21.162745 11738 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:21.168450  6353 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:21.169608  6242 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:21.148485 11417 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:21.170850 11729 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:21.171489  6354 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 2. Current term is 3. Ops: []
I20260812 19:23:21.172004  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:21.172448 11417 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:21.173090 11417 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:21.141390 11688 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:21.173667  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:21.175498 11688 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:21.176306  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:21.176926  6347 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:21.178010  6230 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:21.179572  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:21.179869  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:21.180076  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:21.181813  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:21.182417  6353 raft_consensus.cc:2362] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8. Re-sending same reply.
I20260812 19:23:21.183322  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:21.183827 11288 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:21.184875  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:21.186542  6060 catalog_manager.cc:5495] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:21.190428  6060 catalog_manager.cc:5495] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 4 to 6, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 6 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:21.191941  6060 catalog_manager.cc:5495] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 3 to 5, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 5 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:21.193624  6060 catalog_manager.cc:5495] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 5 to 7, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 7 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:21.198608 11703 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.203408  6060 catalog_manager.cc:5495] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:21.200294 11711 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.201197 11738 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:21.204782 11738 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.205564 11731 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:21.206542  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 59891.6us
W20260812 19:23:21.217350  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 43762.2us
I20260812 19:23:21.218323  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:21.207016 11738 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:21.219889  6347 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:21.223810 11417 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:21.228546  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:21.231137 11417 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:21.231791 11417 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:21.232393 11417 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:21.230098 11731 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:21.238009 11711 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:21.221489 11729 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260812 19:23:21.244177  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:21.245915 11689 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:21.248605  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:21.250799 11703 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:21.258859  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:21.259742  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:21.260195  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:21.261068 11732 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:21.261032  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:21.261852 11732 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:21.261984  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:21.263021 11732 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:21.262928  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:21.264546  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:21.264676  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:21.265367 11732 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:21.257920 11731 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:21.268985  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:21.269819 11689 consensus_queue.cc:1046] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:23:21.270766 11689 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:21.270814 11731 raft_consensus.cc:3032] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:21.271750 11731 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:21.272751 11731 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.274422 11731 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:21.275964  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:21.280288  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:21.280885 11711 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:21.281070 11689 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:21.281523  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:21.282382 11689 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:21.282794 11689 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:21.283164 11689 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:21.293239  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:21.293859  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:21.295380 11729 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:21.295619  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:21.299814 11711 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:21.284770  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:21.302965 11741 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:21.304862  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:21.307595  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.308058  6230 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:21.308367  6465 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:21.308082  7603 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260812 19:23:21.309250  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:21.309569  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:21.310052  6242 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:21.312295  6465 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260812 19:23:21.312696  6465 pending_rounds.cc:76] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 3
I20260812 19:23:21.312362 11689 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:21.313369 11741 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:23:21.313472 11765 consensus_queue.cc:1046] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:23:21.312974  6465 pending_rounds.cc:97] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260812 19:23:21.314849  6465 raft_consensus.cc:2866] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:21.315021 11779 raft_consensus.cc:3032] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:21.314622 11689 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:21.330078 11779 raft_consensus.cc:729] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:21.331388  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:21.315070  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:21.333407  6178 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:21.334837 11729 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:21.334450 11755 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:21.335652 11755 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:21.336037 11755 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:21.341743  6241 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:21.316538 11765 consensus_queue.cc:1046] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260812 19:23:21.318531  6230 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:21.327414  6347 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:21.344815  6055 catalog_manager.cc:5495] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 5 to 7, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 7 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:21.362562  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:21.364419  6232 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:21.365483 11765 raft_consensus.cc:3032] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:21.365871 11765 raft_consensus.cc:729] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:21.366740 11765 consensus_queue.cc:260] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:21.368077 11765 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:21.369133  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.369722  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:21.347033  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:21.371737  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.371771  6236 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:21.372432  6477 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:21.373555  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.316484 11417 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.349143  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.374245  6477 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:21.374763  6465 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:21.350852  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:21.349362 11755 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:21.353477  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.375722  6228 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:21.376933  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:21.377713  6230 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:21.355517  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:21.346483  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:21.379485  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:21.380568 11417 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:21.382030  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:21.382764 11738 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:21.331581 11779 consensus_queue.cc:260] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:21.377063 11755 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:21.379220  6224 raft_consensus.cc:2396] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:23:21.384606 11729 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:21.385139  6228 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:21.358319  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.387549  6473 raft_consensus.cc:2396] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260812 19:23:21.387813 11779 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:21.390365  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.396334  6178 leader_election.cc:398] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7.
I20260812 19:23:21.396732  6178 leader_election.cc:401] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:23:21.398368 11755 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7.
I20260812 19:23:21.400144 11729 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:21.400569  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:21.403157  6475 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:21.406059 11755 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:21.406548  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:21.408104 11729 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:21.408512 11729 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:21.409699 11729 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:21.409204  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:21.413692 11755 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:21.414141 11755 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:21.414551 11755 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:21.356541  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:21.421274  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 64853.4us
I20260812 19:23:21.422327  6475 raft_consensus.cc:1226] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:21.424284 11731 raft_consensus.cc:2741] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260812 19:23:21.430357 11755 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.435416 11755 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:21.436585  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:21.440297  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:21.441257  6241 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:21.442566 11738 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:21.443094 11738 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:21.443466 11738 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:21.443583 11417 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:23:21.447901  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.449824  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.450433  6473 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:21.450364  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.451228  6470 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:21.451606  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.452919  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.453154  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.453454  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.454041  6477 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:21.454202  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.454583  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.453626  6475 raft_consensus.cc:2379] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:21.454936  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.456058  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.456475 11770 consensus_queue.cc:1046] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 19:23:21.457687 11625 raft_consensus.cc:3032] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:21.458073 11625 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:21.459043 11625 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:21.462997  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.463410 11625 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:21.463661  6483 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:21.464848  6464 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:21.467237  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:21.467357 11770 consensus_queue.cc:1046] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 19:23:21.467895  6345 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:21.468724 11733 raft_consensus.cc:3032] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:23:21.469105 11733 raft_consensus.cc:729] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:21.469971 11733 consensus_queue.cc:260] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:21.475620  6345 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:21.477494  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:21.478081  6474 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:21.459496 11738 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.478801  6464 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260812 19:23:21.480288 11738 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:21.481293  6474 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:21.482196  6354 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:21.482714  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:21.490051  6359 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:21.490250  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.483425  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:21.483554  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:21.493979  6475 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:21.494117  6228 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:21.496026  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.484644  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.366531  6055 catalog_manager.cc:5495] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 7 to 8, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 8 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:21.485095  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.500803  6473 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:21.502318  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.499969  6470 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:21.486577 11733 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:23:21.486536  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.507395  6477 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:21.508906  6241 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260812 19:23:21.513470 11770 consensus_queue.cc:1046] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:23:21.514806 11765 raft_consensus.cc:3032] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:21.514927  6228 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:21.531819  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.515296 11765 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:21.532956  6481 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:21.518211  6477 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:21.519294  6473 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:21.509310  6241 pending_rounds.cc:76] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 3
I20260812 19:23:21.536024  6241 pending_rounds.cc:97] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260812 19:23:21.535811 11765 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:21.487607  6345 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:21.527017  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:21.527359  6242 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260812 19:23:21.538728  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.530227  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.536401  6241 raft_consensus.cc:2866] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:21.541882  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:21.542465  6242 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 9
I20260812 19:23:21.542631 11765 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:21.546263  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:21.547431 11738 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:21.549098  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:21.550011 11738 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:21.551424  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:21.553577 11770 consensus_queue.cc:1046] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:23:21.530912 11729 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.556250  6224 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260812 19:23:21.556984  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.557906  6481 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:21.552150  6242 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:21.510413  6055 catalog_manager.cc:5495] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 4 to 5, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 5 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:21.553654  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.570495  6483 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:21.555330 11701 raft_consensus.cc:3032] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:21.575371 11701 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:21.581261 11701 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:21.587059 11729 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:21.579851  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:21.599587  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:21.600679 11755 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:21.601109 11701 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:21.601734 11755 raft_consensus.cc:686] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:21.607312 11309 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:21.612205 11309 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:21.572359 11738 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:21.617192 11752 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:23:21.604894 11755 consensus_queue.cc:237] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.619107 11733 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Stepping down as leader of term 5
W20260812 19:23:21.620322  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 60814.8us
I20260812 19:23:21.620601 11733 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:21.621570  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:21.623805 11733 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:21.628477 11733 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:21.635663  6242 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260812 19:23:21.638053 11729 consensus_queue.cc:1046] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:21.646135  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.647799  6481 raft_consensus.cc:2362] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9. Re-sending same reply.
I20260812 19:23:21.655019  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:21.674084  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:21.678622  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.682966  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:21.690917  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.692075  6464 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:21.696108  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.699708  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.701757  6464 raft_consensus.cc:2396] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260812 19:23:21.702665  6481 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:21.706604 11738 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:21.707823 11738 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.620378 11309 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.714527  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.715662  6464 raft_consensus.cc:2354] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8.
I20260812 19:23:21.717800  6242 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:21.718308 11794 raft_consensus.cc:3032] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:21.718771 11794 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:21.719718 11794 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.721197 11794 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:23:21.723003  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 54808us
I20260812 19:23:21.724205 11484 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:21.724687 11484 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:21.725450 11484 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:21.729450  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 74648.9us
I20260812 19:23:21.732862  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:21.739509  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.739864  6477 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:21.742072  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.744808 11729 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:21.747648 11729 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:21.748199 11729 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:21.753500  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:21.756002  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.757556  6477 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 8
I20260812 19:23:21.665162  6055 catalog_manager.cc:5495] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:21.765816  6058 catalog_manager.cc:5495] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 4 to 5, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 5 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:23:21.770193  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.775902  6481 raft_consensus.cc:2396] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 10 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260812 19:23:21.756896 11417 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:21.784365  6483 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
W20260812 19:23:21.855695  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 100874us
I20260812 19:23:21.858361  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.862257  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:21.821261 11417 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:21.865316  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 88757.3us
I20260812 19:23:21.866201  6477 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:21.868752  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.869793  6477 raft_consensus.cc:2379] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:21.871886  6224 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260812 19:23:21.830502 11729 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:21.873289  6228 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:21.874909  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.879087 11729 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:21.879472 11770 consensus_queue.cc:1046] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:23:21.880896 11752 raft_consensus.cc:3032] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:21.881364 11752 raft_consensus.cc:729] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:21.882984  6483 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:21.882409 11752 consensus_queue.cc:260] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:21.885648  6464 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260812 19:23:21.890595  6464 pending_rounds.cc:76] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 3
I20260812 19:23:21.890992  6464 pending_rounds.cc:97] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.4
I20260812 19:23:21.891415  6464 raft_consensus.cc:2894] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Aborting config change with OpId 6.4: Aborted: Op aborted by new leader
I20260812 19:23:21.887768  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.889667  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.890028  6465 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260812 19:23:21.892997  6464 raft_consensus.cc:2866] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:21.887050 11770 consensus_queue.cc:1046] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260812 19:23:21.891528  6474 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:21.892194  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.896515 11770 raft_consensus.cc:3032] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:21.896759  6477 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:21.892130  6473 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:21.897262  6470 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260812 19:23:21.887645  6481 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0715e834130d426f8038cf97eecb0687"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:23:21.897573  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:33372 (request call id 9) took 21174 ms. Trace:
I20260812 19:23:21.867228 11417 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:21.898031  6464 rpcz_store.cc:276] 0812 19:23:00.729256 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:01.395921 (+666665us) service_pool.cc:227] Handling call
0812 19:23:01.418519 (+ 22598us) log.cc:842] Serialized 492 byte log entry
0812 19:23:21.897457 (+20478938us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":152013,"raft.queue_time_us":265442,"raft.run_cpu_time_us":10385,"raft.run_wall_time_us":164011,"thread_start_us":268727,"threads_started":2,"wal-append.queue_time_us":401889,"wal-append.run_cpu_time_us":1916,"wal-append.run_wall_time_us":1030490}
I20260812 19:23:21.897014 11770 raft_consensus.cc:729] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:21.900774 11770 consensus_queue.cc:260] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:21.906086  6481 raft_consensus.cc:595] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:21.908313  6481 raft_consensus.cc:603] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:21.921356  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.924401  6483 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:21.948899 11710 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:21.960042  6477 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:21.975095 11484 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:21.984532 11484 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:21.987288 11752 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:21.999053  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:21.999918  6464 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:22.000753  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:22.001938  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:21.992220  6138 auto_rebalancer.cc:254] failed to send replica move request: Aborted: Op aborted by new leader
I20260812 19:23:22.003319  6470 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:22.003649  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:21.995160  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:22.007402  6345 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:22.011087  6242 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:22.007434  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:22.012761  6464 raft_consensus.cc:2362] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9. Re-sending same reply.
W20260812 19:23:22.018762  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 76949.3us
I20260812 19:23:22.020020  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:22.019987  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:22.021723  6473 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:22.039093  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:22.043002  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:22.039676  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:22.049505  6474 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:22.050123  6359 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:22.044916  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:22.045282  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:22.051604  6242 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:22.053054  6241 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:22.057622  6353 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260812 19:23:22.054581  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:22.057152  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:22.059746  6344 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:22.059818  6342 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:22.061406  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:22.062572  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:22.063179  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:22.068182  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:22.069546  6242 raft_consensus.cc:2396] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260812 19:23:22.069885  6483 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:23:22.070709  6483 raft_consensus.cc:595] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:22.072567  6349 raft_consensus.cc:2379] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:22.053169 11417 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:22.054886 11770 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:22.074203  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:22.078840  6241 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:22.085842 11810 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:22.086321 11810 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:22.086760 11810 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:22.077997  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:22.094066  6354 raft_consensus.cc:2354] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8.
I20260812 19:23:22.074605  6345 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:22.077529  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:22.100582  6347 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:22.129966 11738 raft_consensus.cc:2741] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260812 19:23:22.076978 11417 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:23:22.145871  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 68422us
I20260812 19:23:22.147231  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:22.133301 11673 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260812 19:23:22.157892  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:22.077198 11484 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260812 19:23:22.135202 11309 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:22.158960  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 120411us
I20260812 19:23:22.162930 11738 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:22.163936  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:22.149655 11417 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:22.165160  6483 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:23:22.167462  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.155069 11729 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:22.167562  6483 raft_consensus.cc:595] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:22.168550  6483 raft_consensus.cc:603] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:22.165269  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:22.173801  6474 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:22.175033  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:22.164786 11309 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.180058 11729 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:22.180581 11729 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.181203 11309 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:22.182837 11729 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:22.167565 11738 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:22.185531 11738 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:22.184510  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:22.168202 11796 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:22.178321 11816 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:22.186617 11810 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.194621 11710 consensus_queue.cc:1046] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260812 19:23:22.196781 11816 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:22.200508 11816 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:22.200850 11810 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:22.201472 11810 raft_consensus.cc:3032] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:22.201813 11810 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:22.193776 11794 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:22.176403 11802 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:22.203194 11794 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:22.203624 11794 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:22.207322  6483 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "545108632fab48129db7f032619a1e55"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:23:22.207932  6483 raft_consensus.cc:595] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:22.216132  6483 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:23:22.218012  6483 raft_consensus.cc:595] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:22.218484  6483 raft_consensus.cc:603] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260812 19:23:22.233928  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 46659.8us
I20260812 19:23:22.232285 11731 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:22.242995  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260812 19:23:22.248401  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 7e0797ad50cb46cfb10b4a38cc815917, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:22.248862  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 7e0797ad50cb46cfb10b4a38cc815917, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.251809 11816 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.253978  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:22.266753  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 91807.2us
I20260812 19:23:22.269941 11731 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:22.271368 11731 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:22.271862 11731 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:22.261673 11729 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:22.272941 11731 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.279541 11794 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.297415 11731 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:22.298430 11794 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:22.217356 11810 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.301884 11796 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:22.303198  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:23:22.303925  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260812 19:23:22.307861  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet c59df69987ce4bc38077cd7681552414, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:22.308189  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet c59df69987ce4bc38077cd7681552414, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:22.314186  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:23:22.314706  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:22.295998  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:22.321266 11823 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:22.322643  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:22.323432 11823 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:22.325235  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:22.294884  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:22.327137  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.327535 11794 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:22.328265 11794 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:22.329035  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.329380 11794 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.330616  6060 catalog_manager.cc:5495] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:22.362898 11816 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:22.365614 11417 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.370590 11823 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260812 19:23:22.371259  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46140us
W20260812 19:23:22.377674  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 0715e834130d426f8038cf97eecb0687, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:22.404940  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 0715e834130d426f8038cf97eecb0687, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.392856 11755 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 19:23:22.393983  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 59851.1us
I20260812 19:23:22.411705  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:23:22.396699  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 67737.2us
W20260812 19:23:22.399581  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 257008us
I20260812 19:23:22.412878 11810 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:22.419790  6228 raft_consensus.cc:1226] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:22.427451 11770 consensus_queue.cc:1046] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:23:22.428889 11770 raft_consensus.cc:3032] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:22.402159 11831 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:22.429380 11770 raft_consensus.cc:729] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:22.430953 11484 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:23:22.428857  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 236427us
I20260812 19:23:22.432253 11710 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:22.433833  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:22.434294 11820 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:22.435371 11820 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:22.435509 11810 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:22.435953 11810 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:22.436007 11820 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:23:22.436858 11810 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.437618 11813 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:22.438017 11813 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:22.438079 11810 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:22.430461 11770 consensus_queue.cc:260] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:22.439438 11770 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:22.439013 11813 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.440152 11813 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:22.442621 11823 raft_consensus.cc:2741] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260812 19:23:22.444057  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:22.444618  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:22.429214  6178 leader_election.cc:398] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8.
I20260812 19:23:22.446328  6178 leader_election.cc:401] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:23:22.446502 11820 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:22.446985 11755 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8.
I20260812 19:23:22.446342  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:22.448364  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.448530 11710 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:23:22.441601 11484 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:22.452951  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:22.455471  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:22.456676  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:22.460945  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:22.464955  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.475389 11848 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:22.464993  6054 catalog_manager.cc:5495] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:22.457607 11755 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:22.479894  6060 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 234) took 1059 ms. Trace:
I20260812 19:23:22.482244  6054 catalog_manager.cc:5495] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 7 to 9, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 9 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:22.483907  6054 catalog_manager.cc:5495] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 4 to 5, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 5 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:22.457329 11823 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:22.480288  6060 rpcz_store.cc:276] 0812 19:23:21.412997 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:21.413165 (+   168us) service_pool.cc:227] Handling call
0812 19:23:22.472041 (+1058876us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:22.334599 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:22.335094 (+   495us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:22.335131 (+    37us) write_op.cc:435] Acquired schema lock
0812 19:23:22.335143 (+    12us) tablet.cc:660] Decoding operations
0812 19:23:22.335439 (+   296us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:22.335493 (+    54us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:22.335516 (+    23us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:23:22.335672 (+   156us) tablet.cc:699] Row locks acquired
0812 19:23:22.335689 (+    17us) write_op.cc:260] PREPARE: finished
0812 19:23:22.335833 (+   144us) write_op.cc:270] Start()
0812 19:23:22.335926 (+    93us) write_op.cc:276] Timestamp: P: 1786562602335785 usec, L: 0
0812 19:23:22.335945 (+    19us) op_driver.cc:331] REPLICATION: starting
0812 19:23:22.379113 (+ 43168us) log.cc:842] Serialized 535 byte log entry
0812 19:23:22.381841 (+  2728us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b5400002dd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7774198 00007f98fb187ade 00007f98fb1872b8 00007f98fb18bba1 00007f98fb18bb59 00007f98fb18bae9 00007f98fb18bab1 00007f98fb18adad 00007f98fdab4204 00007f98fdab4039
0812 19:23:22.384846 (+  3005us) op_driver.cc:444] REPLICATION: finished
0812 19:23:22.385256 (+   410us) write_op.cc:301] APPLY: starting
0812 19:23:22.385359 (+   103us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:22.385490 (+   131us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:22.385526 (+    36us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:22.385796 (+   270us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:22.385993 (+   197us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:23:22.386057 (+    64us) write_op.cc:312] APPLY: finished
0812 19:23:22.386285 (+   228us) log.cc:842] Serialized 23 byte log entry
0812 19:23:22.386473 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:22.386572 (+    99us) write_op.cc:454] Released schema lock
0812 19:23:22.386619 (+    47us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:22.386964 (+   345us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:22.387012 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":109167,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":111,"apply.run_cpu_time_us":2014,"apply.run_wall_time_us":2016,"num_ops":1,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":6221,"prepare.run_wall_time_us":47461,"replication_time_us":48548,"spinlock_wait_cycles":97797632}]]}
I20260812 19:23:22.429842 11831 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.320148 11738 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.461849 11729 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 19:23:22.512741  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47851.9us
I20260812 19:23:22.513572  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.515208  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.516284  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.519274 11738 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:22.486444  6054 catalog_manager.cc:5495] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 5 to 7, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 7 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:22.461279 11817 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:22.461051 11820 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:22.521903 11820 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:22.522611 11831 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:22.522862 11820 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.509970  6055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 192) took 2233 ms. Trace:
I20260812 19:23:22.491837 11484 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260812 19:23:22.521073  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 52873.5us
I20260812 19:23:22.520110 11817 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:22.524910  6054 catalog_manager.cc:5495] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 6 to 9, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 9 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:22.525864  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:22.527236  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:22.527787  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 58604us
I20260812 19:23:22.492236 11796 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260812 19:23:22.527071  6054 catalog_manager.cc:5495] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 5 to 7, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 7 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:23:22.529317  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 72698.8us
I20260812 19:23:22.530382  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:22.530684  6054 catalog_manager.cc:5495] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:22.531585  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:22.527534 11729 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:22.520210 11841 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:22.531054  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:22.532481  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:22.524348 11794 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:22.525843 11755 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:22.527225 11817 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:22.534155  6054 catalog_manager.cc:5495] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 4 to 7, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 7 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:22.535568  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:22.536125  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.537248  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.529924 11831 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 19:23:22.533288 11731 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:22.539826 11841 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:22.530555 11484 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:22.538703 11848 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:22.540072 11309 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:22.540280 11802 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:22.541061  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.543028 11710 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:22.544029 11417 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:22.525892  6055 rpcz_store.cc:276] 0812 19:23:20.257936 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:20.258234 (+   298us) service_pool.cc:227] Handling call
0812 19:23:22.490588 (+2232354us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:21.983986 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:21.984539 (+   553us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:21.984596 (+    57us) write_op.cc:435] Acquired schema lock
0812 19:23:21.984621 (+    25us) tablet.cc:660] Decoding operations
0812 19:23:21.985333 (+   712us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:21.985381 (+    48us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:21.985415 (+    34us) tablet.cc:683] Acquiring locks for 4 operations
0812 19:23:21.985832 (+   417us) tablet.cc:699] Row locks acquired
0812 19:23:21.985852 (+    20us) write_op.cc:260] PREPARE: finished
0812 19:23:21.986003 (+   151us) write_op.cc:270] Start()
0812 19:23:21.986105 (+   102us) write_op.cc:276] Timestamp: P: 1786562601985957 usec, L: 0
0812 19:23:21.986126 (+    21us) op_driver.cc:331] REPLICATION: starting
0812 19:23:22.038389 (+ 52263us) log.cc:842] Serialized 1682 byte log entry
0812 19:23:22.233093 (+194704us) op_driver.cc:444] REPLICATION: finished
0812 19:23:22.260139 (+ 27046us) write_op.cc:301] APPLY: starting
0812 19:23:22.260217 (+    78us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:22.260359 (+   142us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:22.260464 (+   105us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:22.260894 (+   430us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:22.261057 (+   163us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0812 19:23:22.261122 (+    65us) write_op.cc:312] APPLY: finished
0812 19:23:22.261338 (+   216us) log.cc:842] Serialized 41 byte log entry
0812 19:23:22.261514 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:22.261648 (+   134us) write_op.cc:454] Released schema lock
0812 19:23:22.265307 (+  3659us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:22.265606 (+   299us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:22.265632 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":63005,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":4672,"apply.run_cpu_time_us":2298,"apply.run_wall_time_us":8583,"num_ops":4,"prepare.queue_time_us":88375,"prepare.run_cpu_time_us":3400,"prepare.run_wall_time_us":75202,"replication_time_us":239680}]]}
I20260812 19:23:22.551548 11823 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:22.552845  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:22.576752  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:22.569480 11796 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:22.577782 11710 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:22.578939 11710 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.579674 11823 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:22.580128 11823 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:22.583231  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:22.575131  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:22.577041  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:22.540342 11738 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:22.568397  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:22.588630 11841 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:22.590142  6354 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260812 19:23:22.569695 11802 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:22.591681 11794 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:22.592232 11731 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:22.592587 11843 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:22.540488 11816 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260812 19:23:22.597103 11823 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.633965 11816 raft_consensus.cc:3032] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:22.634040 11794 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.608382  6352 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:22.635021 11738 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:22.635581 11823 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:22.600464 11796 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:22.618062 11417 raft_consensus.cc:465] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260812 19:23:22.619881  6349 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:22.634398 11816 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:22.609606  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:22.617443 11817 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.637672  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:22.628273  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 97285.2us
W20260812 19:23:22.653236  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 75353.9us
I20260812 19:23:22.653988  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:22.663048  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.632086 11802 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:22.656024  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:22.636394 11794 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:22.664321 11843 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:22.636554 11796 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:22.661638 11823 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:22.636412 11484 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260812 19:23:22.652488 11309 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260812 19:23:22.672358 11810 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:22.660908 11820 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260812 19:23:22.665340 11417 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.026s
I20260812 19:23:22.700035 11823 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:22.697692 11710 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:22.666476 11850 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260812 19:23:22.683005 11855 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260812 19:23:22.678637 11843 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.688701 11816 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:22.751754 11857 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260812 19:23:22.753527 11484 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:22.754006 11484 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:22.754942 11484 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.759131 11817 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:22.763820 11816 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:22.730805 11796 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.765313 11484 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:22.728205 11710 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.767760 11794 raft_consensus.cc:3032] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:22.768219 11794 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:22.769176 11710 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:22.769069 11794 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.733096 11823 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:22.771562 11823 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.776350 11843 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:22.770452 11794 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
W20260812 19:23:22.795486  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 125445us
I20260812 19:23:22.797192  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.798575 11813 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:22.803580  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.816603 11864 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:22.820326  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.823483 11863 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:22.826773 11813 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:22.828032  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.798092 11802 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.839357 11770 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:22.847680 11826 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:22.856660 11826 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:22.856607 11770 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:22.854998  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 186691us
I20260812 19:23:22.863169  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:22.854998 11752 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:22.868981 11813 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:22.869686 11710 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:22.868983 11752 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:22.871258 11710 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:22.871775 11710 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:22.872028  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:22.872715  6349 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 3.
I20260812 19:23:22.872897 11710 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.863737 11816 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:22.887590  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:22.878878  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:22.888525  6241 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:23:22.889675  6474 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:22.878017  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:22.890933 11863 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:23:22.891718  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:22.894606  6054 catalog_manager.cc:5495] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 9 to 10, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 10 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:22.876570 11770 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:22.879729  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:22.903877  6483 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 2.
I20260812 19:23:22.888516  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.875742  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:22.887774  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:22.932031  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:22.932714  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 45025us
I20260812 19:23:22.934605  6224 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:22.931134 11813 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:22.937551 11850 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:22.934064 11770 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:23:22.937412 11813 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:22.939152 11770 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:22.939616 11770 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:22.931277 11863 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:22.940922 11813 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:22.941058 11802 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:22.909232 11856 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:22.941793 11802 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:22.877004 11816 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:22.939182 11810 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:22.874616 11710 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:22.872750 11752 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:22.876308 11826 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:22.944104  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 65960.8us
I20260812 19:23:22.947149  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:22.949604  6241 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260812 19:23:22.947273  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:22.948369 11848 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:22.949662  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:22.954973  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:22.955410 11848 raft_consensus.cc:3032] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:22.955782 11848 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:22.943051 11823 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:22.947273  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:22.950726 11871 consensus_queue.cc:1046] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260812 19:23:22.942144 11856 raft_consensus.cc:686] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:22.951894  6353 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:22.952265 11843 raft_consensus.cc:979] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:23:22.953445 11484 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:22.947696 11752 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:22.957937  6241 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:22.960089  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:22.960843  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:22.963465 11826 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:22.961470  7600 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:22.879547 11864 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:22.963960  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:22.966550  6228 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260812 19:23:22.967818  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:22.969772  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:22.970988  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:22.992571  6483 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:22.975872  6470 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:22.993023  6224 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:22.961701  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:22.971153 11817 consensus_queue.cc:1046] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260812 19:23:22.983261  6242 raft_consensus.cc:2396] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260812 19:23:22.984344  6353 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260812 19:23:22.989347  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:22.985746  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:22.978853  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:22.996076  6354 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:22.993665  6481 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:22.985008  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:22.942355 11802 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:22.999717 11823 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:23.000272 11796 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:23.000689  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:23.023247  6241 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:23.025427  6236 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260812 19:23:23.013425  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:23.015132  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:23.013096  6230 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260812 19:23:23.010723  6483 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:22.990190 11826 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:23.032152  6238 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:23.036029  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:23.050321  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:22.978745 11738 consensus_queue.cc:1046] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260812 19:23:23.000697 11882 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:22.976859 11841 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260812 19:23:23.015718 11794 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:22.978113 11484 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:22.987138 11752 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:23.046571 11826 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
W20260812 19:23:23.069041  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 55710.2us
I20260812 19:23:23.080394 11752 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:23.056748 11810 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:23.057004 11863 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:23.059650 11882 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:23.060020 11309 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:23.089856  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:23.091015  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:23.092438  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:23.100792  6228 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:23.097450  6236 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:23.047744 11813 consensus_queue.cc:1046] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260812 19:23:23.096622  6241 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:23.081631 11796 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:23.043151 11816 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.009280 11848 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.086124 11738 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:23.096652 11752 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:23.115056  6229 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260812 19:23:23.094079  6054 catalog_manager.cc:5495] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 6 to 8, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 8 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:23.115110  6470 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:23.117739  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:23.098976 11843 raft_consensus.cc:1067] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:23:23.100567 11817 raft_consensus.cc:3032] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:23.121538  6054 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 8 to 9, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 9 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:23.143360  6054 catalog_manager.cc:5495] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:23.100111 11810 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:23.095021 11882 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:23.138760  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:23.153561  6477 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:23.154413  6229 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:23.146198  6054 catalog_manager.cc:5495] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 5 to 8, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 8 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:23:23.150506  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 195592us
I20260812 19:23:23.094061 11864 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260812 19:23:23.053673 11856 consensus_queue.cc:237] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.168018  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:23.115939 11738 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:23.104228 11417 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260812 19:23:23.168783  6229 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:23.174141  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:23.180506  6473 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:23.169027  6477 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:23.176972  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:23.167258  6298 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:23.143795 11817 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:23.150704 11848 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:23.113756 11796 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:23.198071  6465 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260812 19:23:23.196647  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:23.105666 11823 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.196609  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:23.203188  6475 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260812 19:23:23.201282  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:23.156646 11813 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:23.204725  6482 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:23.200385  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:23.205940  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:23.206120  6416 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:23.206489  6473 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:23.207419  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:23.208918  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:23.149140 11841 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260812 19:23:23.215314  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:23.140332 11752 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:23.216362  6465 raft_consensus.cc:2379] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:23.217653  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:23.221809  6477 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260812 19:23:23.224617  6465 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260812 19:23:23.205472 11864 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:23.226547  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:23.227005  6482 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:23.204231 11820 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:23.235569 11794 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:23.236375  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:23.246433  6481 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:23.247411  6464 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:23.249348  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:23.236763 11898 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:23.218283 11802 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:23.268482  6352 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:23.233022 11864 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:23.243356 11820 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:23:23.279551  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 69396.5us
I20260812 19:23:23.282758  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:23.217418 11813 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.290439  6416 leader_election.cc:398] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8.
I20260812 19:23:23.274155 11729 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:23.290951  6416 leader_election.cc:401] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:23:23.277522 11802 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:23.280630 11484 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.283136 11864 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:23.286365 11843 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:23.287038 11898 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:23:23.293246 11869 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260812 19:23:23.260671 11794 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.288945 11895 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:23.291492 11417 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:23.260255 11738 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.281183 11851 consensus_queue.cc:1046] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.208s
I20260812 19:23:23.252210 11817 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.353593 11895 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.273497 11810 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.298568 11841 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.050s
I20260812 19:23:23.317593 11897 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:23.374256 11895 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.307215 11729 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.355738 11417 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:23.379989 11881 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260812 19:23:23.311224 11802 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.317637 11820 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:23.395557  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 80124.9us
I20260812 19:23:23.376056 11738 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:23.398924  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:23.444064  6352 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:23.424224 11907 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:23.454514  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:23.456810  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:23.425083 11817 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:23.390027 11770 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:23.414390 11796 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:23.414217 11908 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:23.439082 11843 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:23.454639  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:23.463092 11883 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260812 19:23:23.456245 11752 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.461426 11820 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:23.454027 11901 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:23.502427 11912 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.188s
I20260812 19:23:23.506078 11938 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8.
I20260812 19:23:23.506892 11938 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:23.507311 11938 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:23.507682 11938 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:23.507481 11918 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:23.508740 11925 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:23.515744  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:23.521977  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:23.391758 11897 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:23.497774 11851 raft_consensus.cc:3032] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:23.594331  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:23.595189  6230 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:23.515173 11902 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:23.512132 11813 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.600303  6230 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260812 19:23:23.509333 11925 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:23.576785 11851 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:23.491386 11908 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:23.602701 11921 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260812 19:23:23.590591 11871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.005s	sys 0.009s
I20260812 19:23:23.469210 11907 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.575030 11816 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:23:23.621342 11900 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260812 19:23:23.650566  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 414266us
I20260812 19:23:23.620678 11417 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:23.668591  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:23.635397 11871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.007s	sys 0.009s
I20260812 19:23:23.631937 11921 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:23.616151 11915 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:23.674006  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:23.678963  6352 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:23.651847 11802 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.683857 11851 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.686991 11851 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:23.692219  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:23.693918  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:23.694820  6349 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:23:23.697131  6230 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:23.697868  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:23.698570  6354 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:23:23.574786 11937 consensus_queue.cc:1046] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.216s
I20260812 19:23:23.701467  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:23.603747 11864 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:23.708461  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:23.705713  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:23.678547 11915 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:23.709921  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:23.710723  6236 raft_consensus.cc:2379] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 9: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:23.676872 11417 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:23.678431 11921 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:23.737555 11946 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:23.621660 11902 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:23.719966 11907 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.751940  6228 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260812 19:23:23.721531 11770 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.722625 11897 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:23.724144 11953 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:23.724432 11309 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:23.726451 11952 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260812 19:23:23.719985 11710 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.774s	user 0.011s	sys 0.002s
I20260812 19:23:23.718114 11915 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:23:23.727388 11951 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260812 19:23:23.727523 11794 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.728498 11908 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.728291 11813 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260812 19:23:23.732084 11863 consensus_meta.cc:287] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.001s
I20260812 19:23:23.733736  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:23.824519  6349 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:23:23.735509 11898 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 19:23:23.737210 11826 consensus_meta.cc:287] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.653s	user 0.003s	sys 0.008s
I20260812 19:23:23.746774 11956 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:23.730448 11864 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:23.713076 11729 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.678973 11816 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.783478  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:23.791149  7600 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:23.756707  6228 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
W20260812 19:23:23.756805  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 87530.4us
W20260812 19:23:23.786193 11848 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.004s
I20260812 19:23:23.871562  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:23.733848  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:23.873193  6354 raft_consensus.cc:2396] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260812 19:23:23.848089  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:23.849052  6347 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:23.850625  6345 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:23.816766 11309 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:23.901044 11309 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:23.907737 11817 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:23.908540 11817 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:23.909121  6228 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260812 19:23:23.749327 11417 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.911065 11417 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.911980 11817 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:23.862208  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 400059us
I20260812 19:23:23.915592 11887 raft_consensus.cc:3032] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:23.916034 11887 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:23.916805 11887 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.823873 11952 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:23.918022 11952 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:23.919275  6347 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260812 19:23:23.919708  6347 pending_rounds.cc:76] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 4
I20260812 19:23:23.920010  6347 pending_rounds.cc:97] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260812 19:23:23.920316  6347 raft_consensus.cc:2866] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:23.848644 11863 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:23.921531 11855 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:23.921950 11855 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:23.923781 11843 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:23.868034  6352 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:23:23.865753 11956 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:23.924363 11843 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:23.925019 11956 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:23.752417 11946 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.928232 11967 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:23.928771 11946 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:23.875761 11919 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.342s	user 0.002s	sys 0.000s
I20260812 19:23:23.928913 11967 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.767117 11831 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260812 19:23:23.784657 11938 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.877313 11813 consensus_queue.cc:1046] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:23.878355  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:23.855968 11826 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:23.790774 11953 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.881924 11927 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:23.882097  6236 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:23.869395 11960 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:23.883648 11950 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
W20260812 19:23:23.885454 11944 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260812 19:23:23.891494 11902 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.865006 11926 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:23:23.893694 11882 consensus_meta.cc:287] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.725s	user 0.011s	sys 0.002s
I20260812 19:23:23.932739  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:23.934623  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 56405.4us
I20260812 19:23:24.005774  6482 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 9: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:23.944242  6228 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "545108632fab48129db7f032619a1e55"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:53176
I20260812 19:23:24.006485  6228 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:23:24.006865  6228 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:23.939841  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:23.933346  6224 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260812 19:23:23.951736  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:23.952313  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:24.009683  6481 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 2 FOLLOWER]: Advancing to term 4
W20260812 19:23:24.010040  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 58410.2us
I20260812 19:23:24.011035  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:23.952415  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.012300  6464 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:23:23.954109  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:23.955628  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.013540  6483 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:23.956004  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:23.997018  6473 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260812 19:23:23.980607  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:24.000648  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.031185  6465 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:24.013482  6475 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:23:23.918176 11887 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:23.919792 11850 raft_consensus.cc:3032] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:24.036305  6230 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
W20260812 19:23:23.930629 11932 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.461s	user 0.000s	sys 0.002s
I20260812 19:23:24.041286  6481 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:23:23.936084 11826 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.949057 11843 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:23.932628 11904 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:23:24.043390  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:24.040740  6228 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:23.937642 11953 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.933797 11938 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:23.932307 11816 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.957312 11946 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:23.949680 11901 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:23.999773 11738 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:23.995569 11770 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:23.999308 11864 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260812 19:23:24.160271  6481 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:24.037108 11926 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:24.198004 11417 raft_consensus.cc:3032] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:24.198863 11417 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:24.059643  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:24.200012 11417 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.052085 11813 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:24.159274  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:24.170759  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1854) took 1209 ms. Trace:
I20260812 19:23:24.060884  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:24.048563 11850 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:23:24.170181  6241 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.015s	sys 0.018s
W20260812 19:23:24.232870  6241 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.016s	sys 0.023s
I20260812 19:23:24.201814 11417 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:24.105499 11820 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.003854 11817 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:24.036007 11856 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.119379 11898 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260812 19:23:24.105010  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:24.061740  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 121975us
I20260812 19:23:24.211227 11946 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:24.229295 11967 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.258796 11946 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:24.055279 11925 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:24.122888  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 87251.3us
I20260812 19:23:24.267578  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:24.268461  6475 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 9: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:24.049047 11851 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:24.202437 11843 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.205142 11901 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.213284  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:24.210469  6228 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:23.937986 11927 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:24.231998  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 171195us
I20260812 19:23:24.094827  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:24.164835  6473 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260812 19:23:24.105703 11826 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:23.996308 11960 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:23.997164 11855 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.222359 11770 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:24.248664 11938 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:24.262843 11926 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:24.268886  6230 raft_consensus.cc:2379] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:24.207719 11738 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.230182  6474 rpcz_store.cc:276] 0812 19:23:22.960902 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:22.961789 (+   887us) service_pool.cc:227] Handling call
0812 19:23:22.962109 (+   320us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:23.296103 (+333994us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:23.296145 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:23.296990 (+   845us) log.cc:842] Serialized 26 byte log entry
0812 19:23:23.383196 (+ 86206us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:23.383246 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:23.383337 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:24.170443 (+787106us) raft_consensus.cc:1671] finished
0812 19:23:24.170471 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:24.170681 (+   210us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":670,"raft.queue_time_us":91590,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":9094,"thread_start_us":371303,"threads_started":2,"wal-append.queue_time_us":180530}
I20260812 19:23:24.270690  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1835) took 1282 ms. Trace:
I20260812 19:23:24.270932  6465 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
W20260812 19:23:24.272338 11971 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260812 19:23:24.271824 11817 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:24.232776 11904 raft_consensus.cc:686] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:24.280364  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:24.160636 11907 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.130s
I20260812 19:23:24.281553  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:24.291570  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 196905us
I20260812 19:23:24.284663 11851 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:24.304013  6232 rpcz_store.cc:276] 0812 19:23:22.988346 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:22.988532 (+   186us) service_pool.cc:227] Handling call
0812 19:23:23.016025 (+ 27493us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:23.245033 (+229008us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:23.245079 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:23.259511 (+ 14432us) log.cc:842] Serialized 26 byte log entry
0812 19:23:23.334693 (+ 75182us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:23.334786 (+    93us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:23.334896 (+   110us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:23.929765 (+594869us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:24.237136 (+307371us) raft_consensus.cc:1671] finished
0812 19:23:24.237168 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:24.270569 (+ 33401us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9723,"raft.queue_time_us":28993,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":9189,"spinlock_wait_cycles":7295360,"thread_start_us":252976,"threads_started":2,"wal-append.queue_time_us":132273}
I20260812 19:23:24.342263  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:24.037328 11882 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:24.294440  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:24.299332  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:24.299932  6473 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260812 19:23:24.346257  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 47028.4us
W20260812 19:23:24.348152  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 67868.6us
I20260812 19:23:24.348342  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.300209  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:24.348919  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.293295 11826 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:24.295406 11816 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.344787  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:24.301046  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:24.350098  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.350207  6235 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:24.349050  6465 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:24.350700  6475 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:24.349069  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:24.349449  6236 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:24.352291  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.352909  6483 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:24.353291  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.353528  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.353722  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.269555 11820 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.349746  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.276187 11856 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.355366  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.356171  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.301936  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:24.259742 11952 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.354233  7591 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:24.387122 11952 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.300792 11942 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:24.388051 11942 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:24.390097  6354 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:24.355038  6474 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:24.391690 11925 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:24.392465 11942 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:24.393174 11942 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:24.393651 11942 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:23:24.395444 11920 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.922s	user 0.002s	sys 0.001s
I20260812 19:23:24.288309 11843 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.370496  6482 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:24.342605 11963 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.300891 11974 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.413735  7599 raft_consensus.cc:2354] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7.
I20260812 19:23:24.374495  6473 raft_consensus.cc:2379] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:24.415694  6482 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260812 19:23:24.415771  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:24.411356  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:24.417254  6350 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:24.288929 11969 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.318s
I20260812 19:23:24.369650 11938 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:24.356917 11826 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:23:24.432209  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 90071.3us
I20260812 19:23:24.411360  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1838) took 1409 ms. Trace:
I20260812 19:23:24.433516  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:24.382993 11953 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election won for term 9
W20260812 19:23:24.408481 11971 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260812 19:23:24.433257  6242 rpcz_store.cc:276] 0812 19:23:23.002085 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:23.002296 (+   211us) service_pool.cc:227] Handling call
0812 19:23:23.002620 (+   324us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:23.009488 (+  6868us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:23.009515 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:23.024738 (+ 15223us) log.cc:842] Serialized 26 byte log entry
0812 19:23:23.308557 (+283819us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:23.317992 (+  9435us) log.cc:842] Serialized 14 byte log entry
0812 19:23:23.318194 (+   202us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:23.318272 (+    78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:24.394516 (+1076244us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:24.405136 (+ 10620us) raft_consensus.cc:1671] finished
0812 19:23:24.411073 (+  5937us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:24.411281 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18814,"prepare.queue_time_us":7241,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":75260,"raft.run_cpu_time_us":423,"raft.run_wall_time_us":25437,"spinlock_wait_cycles":3568512,"thread_start_us":251783,"threads_started":1,"wal-append.queue_time_us":407611}
W20260812 19:23:24.413375 11309 consensus_meta.cc:287] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.000s
I20260812 19:23:24.400602 11897 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:24.443081  6236 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:24.429991  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:24.451694  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:24.455019  6228 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:24.455385  6232 raft_consensus.cc:2396] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260812 19:23:24.444397  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.426826  6352 raft_consensus.cc:2379] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:23:24.436285 11915 consensus_meta.cc:287] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.003s
I20260812 19:23:24.425508 11823 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.465446 11913 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:24.466061 11941 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:24.466418 11975 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260812 19:23:24.431077 11938 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:24.421057 11963 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.485625 11938 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:24.473168 11915 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:24.376368 11816 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.475486  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:24.501730  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.480187 11820 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.481633 11738 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.429097 11848 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260812 19:23:24.483590 11823 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:24.466432 11980 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260812 19:23:24.490962  7607 raft_consensus.cc:2354] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
I20260812 19:23:24.499035 11915 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:24.443986 11897 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:24.487257 11963 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:24.510576  6236 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260812 19:23:24.303066 11850 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:24.512388  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 202733us
I20260812 19:23:24.517759  6350 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:24.510222  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1866) took 1308 ms. Trace:
I20260812 19:23:24.454296 11309 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.535240  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.548357  6473 raft_consensus.cc:2396] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260812 19:23:24.484928 11960 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.506842 11484 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.507875  6228 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:24.517272 11820 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.529445 11907 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.441346 11942 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.539737  6470 rpcz_store.cc:276] 0812 19:23:23.202156 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:23.222610 (+ 20454us) service_pool.cc:227] Handling call
0812 19:23:23.237475 (+ 14865us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:23.385447 (+147972us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:23:23.663995 (+278548us) log.cc:842] Serialized 14 byte log entry
0812 19:23:23.846257 (+182262us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:23.852889 (+  6632us) log.cc:842] Serialized 52 byte log entry
0812 19:23:23.853049 (+   160us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:23.853291 (+   242us) log.cc:842] Serialized 14 byte log entry
0812 19:23:23.853600 (+   309us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:23.853678 (+    78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:24.294976 (+441298us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b180036d3c0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c764 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:23:24.509906 (+214930us) raft_consensus.cc:1671] finished
0812 19:23:24.509941 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:24.510144 (+   203us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3781,"prepare.queue_time_us":341174,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":191314,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":31598,"spinlock_wait_cycles":23876352,"thread_start_us":552235,"threads_started":3,"wal-append.queue_time_us":378138}
I20260812 19:23:24.519407 11982 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.527002 11738 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:24.537336 11897 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:24.567468  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:24.428210 11974 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.574334  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:24.503062 11941 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.588222  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:24.595459  6352 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 10
I20260812 19:23:24.459496 11904 consensus_queue.cc:237] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:24.554809 12000 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.470176 11851 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:24.564637 11921 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.827s	user 0.012s	sys 0.001s
I20260812 19:23:24.597196  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:24.503228 11913 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:24.598249  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:24.603240  6228 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:23:24.564888 11952 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:24.608103  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 174668us
I20260812 19:23:24.608186  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.609687  6473 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:23:24.603796  6236 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:24.603626  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:24.612411  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:24.587013 11770 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:24.613749  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 194434us
I20260812 19:23:24.609549  6470 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:23:24.599224 11755 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:24.615422  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:24.620826 12017 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:24.621058 12016 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 19:23:24.609638 11817 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:24.624477 11913 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:24.617446  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1843) took 1501 ms. Trace:
I20260812 19:23:24.600747 11999 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.591786 11982 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.609572 11921 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.627242 11770 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:24.652657 12010 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:24.627486 11309 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.605818 11901 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:24.627786  6236 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:24.587694 11907 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.605360 12000 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:24.654856 11973 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260812 19:23:24.655757 11941 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.655869 11907 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.568784 11484 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:24.657276 11994 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260812 19:23:24.657974 11995 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260812 19:23:24.632328  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:24.659232 11907 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:24.659905  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:24.660324 11921 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.660749 11907 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:24.662156  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:24.577416 11820 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.664625 11820 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.610565 12006 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:24.635923  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:24.665382 11956 consensus_meta.cc:287] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.740s	user 0.011s	sys 0.000s
I20260812 19:23:24.665517 12006 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:24.665982 12006 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:24.665846 11956 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:24.611599 11882 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:24.637513 11887 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.000s
I20260812 19:23:24.640446  6238 rpcz_store.cc:276] 0812 19:23:23.116429 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:23.118809 (+  2380us) service_pool.cc:227] Handling call
0812 19:23:23.143236 (+ 24427us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:23.143592 (+   356us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:23.143621 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:23.825576 (+681955us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b2c0006c608. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:23:23.839472 (+ 13896us) log.cc:842] Serialized 26 byte log entry
0812 19:23:24.184064 (+344592us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:24.184104 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:24.184186 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:24.613788 (+429602us) raft_consensus.cc:1671] finished
0812 19:23:24.613810 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:24.617377 (+  3567us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":6207,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":27415,"spinlock_wait_cycles":12565760,"thread_start_us":317071,"threads_started":1,"wal-append.queue_time_us":396413}
I20260812 19:23:24.616097 11927 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.631852 11953 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:24.651921 12020 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.652793 11770 raft_consensus.cc:686] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:24.657895 11484 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.629227 11974 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.667636  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:24.691727  7606 raft_consensus.cc:2354] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8.
I20260812 19:23:24.669164  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1848) took 1063 ms. Trace:
I20260812 19:23:24.631121  6235 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:24.670821  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:24.616926 11952 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:24.682891  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:24.692170  6241 rpcz_store.cc:276] 0812 19:23:23.605372 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:23.605538 (+   166us) service_pool.cc:227] Handling call
0812 19:23:23.631050 (+ 25512us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:24.247657 (+616607us) raft_consensus.cc:1520] Early marking committed up to index 2
0812 19:23:24.357683 (+110026us) log.cc:842] Serialized 14 byte log entry
0812 19:23:24.567010 (+209327us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:24.597615 (+ 30605us) log.cc:842] Serialized 52 byte log entry
0812 19:23:24.597759 (+   144us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:23:24.597790 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:24.597859 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:24.668864 (+ 71005us) raft_consensus.cc:1671] finished
0812 19:23:24.668893 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:24.669089 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4145,"prepare.queue_time_us":155470,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":95434,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":16039,"thread_start_us":876571,"threads_started":3,"wal-append.queue_time_us":254302}
I20260812 19:23:24.685051  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.693907  6482 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:24.687798  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.695813  6474 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:24.689275  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:24.699638  6228 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:24.690603  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.667050 11901 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:24.712244  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:24.700785  6465 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
W20260812 19:23:24.721704  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 51036.5us
I20260812 19:23:24.716125  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:24.722476  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:24.719883  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:24.720546  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 116980us
I20260812 19:23:24.725878  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:24.726539  6235 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:24.723358  6236 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:24.721875  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:24.727794  6241 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:24.674525 11907 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:24.722756  6228 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:24.635756 11755 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.730993  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:24.732196  6359 raft_consensus.cc:2379] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 8: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:24.733108  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:24.737715  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:24.739339  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:24.740365  6228 raft_consensus.cc:2379] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:24.685139 11848 consensus_queue.cc:1046] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260812 19:23:24.712188 11817 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:24.830350  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:24.831264  6347 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:24.748553  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.759711  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.733529 12010 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:24.759873  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.749064  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:24.729077 11484 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:24.793963  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:24.745309  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:24.729344 11907 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:24.745808  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:24.730377 11974 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:24.730121 11816 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.832593  6464 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:24.731346 12021 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.735390 11963 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.798038  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:24.832567  6474 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:24.760375  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:24.835417  6475 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:24.835559  6483 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:24.836776  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:24.642289 11999 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.836966  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:24.867515  6242 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:24.720424 11887 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260812 19:23:24.836107  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:24.836966  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:24.872593  6347 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:24.872741  6353 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:24.840973  6228 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:24.842100  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:24.788609 11882 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:24.733486 11309 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.112s
I20260812 19:23:24.845992  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:24.832252  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 145977us
I20260812 19:23:24.856956 12009 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:24.857386 11942 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.889403 11942 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.859391 12000 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:24.834477 11770 consensus_queue.cc:237] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:24.678121 12020 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.892771 11942 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.893471 12020 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.830339 11901 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:24.844633 11974 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:24.731973 11897 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.860693 11938 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:24.861143 11417 consensus_meta.cc:287] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.000s
I20260812 19:23:24.840384 11484 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:24.862592 12027 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.863396  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:24.875041 11882 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:24.942957  6344 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:24.863440  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:24.865744  6477 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
W20260812 19:23:24.869791  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 71877.1us
I20260812 19:23:24.870266 11913 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:24.828032 11820 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.069s
I20260812 19:23:24.844135 11907 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:24.882778 11941 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:23:24.883785  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:24.884109 12016 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260812 19:23:24.970186  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 86486.1us
I20260812 19:23:24.885389 11816 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:24.880551  6342 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:24.895748  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:24.930066 11974 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:24.979749 11999 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.982263  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:24.982949  6342 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 7
I20260812 19:23:24.862854 12021 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.863813 11956 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.939678  6483 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:24.951647  6347 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
W20260812 19:23:24.959650  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 170098us
I20260812 19:23:24.869963 11826 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:24.971354  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:24.943116 11484 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:24.870875 11963 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.977566 11982 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:24.854552 11953 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.941819 12023 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:25.002692  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:24.977522  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:24.951395 12027 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:24.986609  6350 raft_consensus.cc:2396] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260812 19:23:24.947621 11882 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:24.993913  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:24.994197  6179 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.607s (SENT) [suppressed 40 similar messages]
I20260812 19:23:24.974201 11417 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:24.977591 11952 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:25.024639  7598 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:25.025103  6344 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:25.024653  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 53400.9us
I20260812 19:23:25.019134  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:25.005980  6352 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:25.015118  6298 leader_election.cc:398] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7.
I20260812 19:23:25.082875  6298 leader_election.cc:401] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:23:25.042802  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:25.043984  6353 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:25.083702  6347 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:25.082294  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:25.085980  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:25.017720 11925 consensus_meta.cc:287] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.003s
I20260812 19:23:25.090741  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:25.091358  6353 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:25.092118  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:25.002048  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:25.090183  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:25.100256  6352 raft_consensus.cc:2396] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260812 19:23:25.017810 11887 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:25.013811 11731 raft_consensus.cc:3032] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:25.020431 11963 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:25.007248 11938 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:25.103498  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:25.111315  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 96358.3us
I20260812 19:23:25.004102 11897 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:25.105695  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 210360us
I20260812 19:23:25.007670 11755 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:25.086611 11820 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:25.114624  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:25.120576  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:25.089315 11952 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:25.112594  7597 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:25.184846 11913 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:25.022171 12021 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:25.104415 12040 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:25.144726  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:25.187240 11913 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:25.187399  6417 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:25.185856  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:25.093518 12016 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:25.188725  6475 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 8
I20260812 19:23:25.123207  6353 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:25.192682  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:25.123093  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:25.105353 11887 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:25.105144 11731 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:25.098402 11925 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:25.193643  6352 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:25.219034  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:25.147578  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:25.210294  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:25.233470  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:25.221997 11982 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:24.996464 12035 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.217s
I20260812 19:23:25.023439 12023 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:25.019337 11901 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:25.219954  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:25.251067  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 106427us
I20260812 19:23:25.251643  6475 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:25.234270  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:25.252614  6474 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:25.253588  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:25.235710  6464 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:23:25.255972  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:25.256453  6236 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260812 19:23:25.247493  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 60208.9us
I20260812 19:23:25.224938 12046 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:25.263751  6342 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:23:25.264030  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:25.195276 11897 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:25.263123  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 268921us
I20260812 19:23:25.265515  6350 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:25.189815 11755 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:25.197644 11887 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:25.223987 12037 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:25.231980 11826 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:25.292043  6474 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:23:25.319650  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:25.196812 11938 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:25.328478  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 108644us
I20260812 19:23:25.336450  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:25.199169 11892 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:25.362782  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:25.230997 12033 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:25.188529 12040 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:25.368541  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 104601us
W20260812 19:23:25.454582  7600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60760 (request call id 454) took 1803 ms (client timeout 1607 ms). Trace:
I20260812 19:23:25.475495  7603 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:26.593948  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1900) took 1340 ms. Trace:
I20260812 19:23:26.594491  6238 rpcz_store.cc:276] 0812 19:23:25.253709 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:25.254824 (+  1115us) service_pool.cc:227] Handling call
0812 19:23:26.593860 (+1339036us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:25.250757 12000 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260812 19:23:25.264492 12006 consensus_meta.cc:287] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.598s	user 0.002s	sys 0.012s
I20260812 19:23:25.255393 12009 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:23:26.401118  6172 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.136s	user 0.002s	sys 0.011s
I20260812 19:23:26.591774  6242 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 10
I20260812 19:23:25.447831  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:26.085047  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 831452us
I20260812 19:23:26.085362  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:26.421916  6353 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.007s	sys 0.003s
W20260812 19:23:25.627503  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 373131us
W20260812 19:23:26.090982  6344 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.997s	user 0.010s	sys 0.001s
W20260812 19:23:25.264812 11946 consensus_meta.cc:287] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.968s	user 0.012s	sys 0.000s
W20260812 19:23:26.599725  6345 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1851) took 3632 ms (client timeout 1795 ms). Trace:
I20260812 19:23:25.268190 11937 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260812 19:23:26.397764  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.063s	user 0.002s	sys 0.012s
W20260812 19:23:26.135581  7606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 416) took 1855 ms (client timeout 2138 ms). Trace:
I20260812 19:23:25.256584 11999 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260812 19:23:26.590473  7600 rpcz_store.cc:269] 0812 19:23:23.651147 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:23.651402 (+   255us) service_pool.cc:227] Handling call
0812 19:23:25.454333 (+1802931us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540067f054. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:25.454461 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":272509312}
I20260812 19:23:26.602975  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:26.605350  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33386 (request call id 403) took 1357 ms. Trace:
I20260812 19:23:26.591454 12033 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:26.700172  6352 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:23:26.696708  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 93831.7us
I20260812 19:23:25.483062 12069 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:25.452750 11856 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:26.686456  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.351s	user 0.004s	sys 0.012s
W20260812 19:23:26.609418  6342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1617) took 1363 ms (client timeout 1579 ms). Trace:
I20260812 19:23:25.363317 11813 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7.
I20260812 19:23:25.457523 12054 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:26.075573 12051 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:26.698244  6474 rpcz_store.cc:276] 0812 19:23:25.233702 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:25.234004 (+   302us) service_pool.cc:227] Handling call
0812 19:23:26.591043 (+1357039us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:26.230345 11887 consensus_meta.cc:287] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.789s	user 0.003s	sys 0.006s
W20260812 19:23:26.149801 12067 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260812 19:23:26.732383  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:26.046033 11907 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.058s	user 0.010s	sys 0.000s
I20260812 19:23:26.734226 11907 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.736753 11907 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:25.361289 12046 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:25.470105 11848 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:26.737633 12046 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:26.737879 11848 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.740556 11848 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:26.684489  7606 rpcz_store.cc:269] 0812 19:23:24.280397 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:24.280556 (+   159us) service_pool.cc:227] Handling call
0812 19:23:26.135232 (+1854676us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54002c5954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:26.135485 (+   253us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":780621696}
W20260812 19:23:26.709971  6172 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.455s	user 0.002s	sys 0.015s
W20260812 19:23:26.710803  6345 rpcz_store.cc:269] 0812 19:23:22.967415 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:22.967563 (+   148us) service_pool.cc:227] Handling call
0812 19:23:26.599551 (+3631988us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b54002d05d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:26.599660 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1923049216}
I20260812 19:23:26.611966 12000 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:26.742585 12000 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:26.743067  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:26.743896  6345 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1618) took 1498 ms (client timeout 1652 ms). Trace:
W20260812 19:23:26.744225  6345 rpcz_store.cc:269] 0812 19:23:25.245743 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:26.742796 (+1497053us) service_pool.cc:227] Handling call
0812 19:23:26.743839 (+  1043us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:26.745045  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:26.745824  6345 raft_consensus.cc:2396] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260812 19:23:26.746176  6345 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1616) took 1500 ms (client timeout 1777 ms). Trace:
I20260812 19:23:26.603816 11417 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:26.144375 12023 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:25.256119 11982 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.746968 11417 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:26.748413 11982 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.748065 12046 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:26.681071 11901 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.010s	sys 0.016s
W20260812 19:23:26.749101 11901 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.010s	sys 0.016s
I20260812 19:23:26.749145 11417 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:26.703526  6344 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:26.750161  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1615) took 1881 ms. Trace:
I20260812 19:23:26.750537  6344 rpcz_store.cc:276] 0812 19:23:24.868759 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:24.956851 (+ 88092us) service_pool.cc:227] Handling call
0812 19:23:26.750087 (+1793236us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:26.143162 12060 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:26.143555 12027 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:25.646152 11841 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:26.751498 12027 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:26.751601 11841 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.752101 12027 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:26.752110  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:26.716352  6417 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.005s	sys 0.009s
I20260812 19:23:26.590296 11892 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:23:25.457388 11989 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.946s	user 0.001s	sys 0.001s
I20260812 19:23:26.435647 12080 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:25.442672 12017 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:26.720572  6473 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.011s	sys 0.020s
I20260812 19:23:26.811115  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:26.811527  6473 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.011s	sys 0.020s
I20260812 19:23:26.811970  6483 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:26.812705  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1861) took 2806 ms. Trace:
I20260812 19:23:26.718263  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:26.421294 12086 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:26.715209 12100 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:25.462262 11974 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:26.720376 12076 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:26.435427 12082 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:25.447227 12045 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:26.721987  6342 rpcz_store.cc:269] 0812 19:23:25.245507 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:25.336086 (+ 90579us) service_pool.cc:227] Handling call
0812 19:23:26.609328 (+1273242us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:26.440418 11882 consensus_meta.cc:287] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 1.350s	user 0.012s	sys 0.000s
I20260812 19:23:25.508838 12016 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:26.686064 11937 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:26.726927  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:26.698778  6353 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.007s	sys 0.006s
I20260812 19:23:25.362893 11897 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.692173 11999 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:25.367599 11755 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:25.469414 12063 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260812 19:23:25.476634 12047 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
W20260812 19:23:26.746490  6345 rpcz_store.cc:269] 0812 19:23:25.245265 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:26.744799 (+1499534us) service_pool.cc:227] Handling call
0812 19:23:26.746129 (+  1330us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:26.752450  6347 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260812 19:23:25.481593 11484 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:25.411325 11953 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:26.758085 11887 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:26.754422  6230 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.004s	sys 0.032s
W20260812 19:23:26.755730  6417 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.005s	sys 0.009s
W20260812 19:23:26.715692  6350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1619) took 1469 ms (client timeout 1560 ms). Trace:
I20260812 19:23:26.712388 11826 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader election won for term 7
W20260812 19:23:26.718983  7554 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.012s	sys 0.022s
W20260812 19:23:26.897351  7554 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.012s	sys 0.023s
I20260812 19:23:26.845901 11999 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:26.898252 12094 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:26.904762  6415 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.010s	sys 0.004s
I20260812 19:23:26.788573  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:26.788573  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:26.905084  6415 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.257s	user 0.010s	sys 0.004s
I20260812 19:23:26.904902 12094 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.905454  6238 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
W20260812 19:23:26.905671 12065 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.765s	user 0.003s	sys 0.010s
I20260812 19:23:26.788820  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:26.841951 11937 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:26.712589 12033 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:26.792393  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:26.909914  6474 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:26.797073 12088 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:26.797326  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:26.798997  6229 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260812 19:23:26.839812 12102 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:26.806754  6242 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:26.786757 11892 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:26.807879 11895 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:26.829856 12086 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.917218 11895 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.918776 12086 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.918720 11999 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.919868 11895 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.809720 11794 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:26.813724  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:25.450384 12042 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:26.921106 12042 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:26.920858 11794 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.922401 11999 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.922997 12040 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:26.923379 12040 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:26.923573 11794 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.923672 12040 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:26.730242 12054 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:25.448905 11731 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:26.684973 12006 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:26.817708  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:23:26.924970  6413 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.005s	sys 0.009s
W20260812 19:23:26.925266  6413 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.005s	sys 0.009s
W20260812 19:23:26.925469  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 107846us
I20260812 19:23:26.925873 12040 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:25.413350 12037 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.757053 11907 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:26.831337  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 226971us
W20260812 19:23:26.831579  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 113418us
I20260812 19:23:26.756815 11856 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:26.932395  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:26.933579  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:26.713789 11946 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.811179 11901 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:26.937963 11946 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.938375 11901 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:26.938938 12108 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:26.939669 12108 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:26.940466 11901 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:26.757097 12051 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.942634 12051 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:26.790692 11982 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:26.943061 12037 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:26.842160 12016 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.943459 11982 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.945199 12016 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.945464 11982 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.945922 12016 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:26.840415  6352 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:23:26.830013 12017 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.847896  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:26.717402 12009 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.853673  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:26.854151 12027 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:26.789227 12060 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.852917 12069 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:26.879597 12063 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:26.879132 11953 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:26.972869 11953 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:26.832589 12082 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.978559 12060 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:26.980422 12009 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.980829 12082 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.882688 12114 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:26.981307 12069 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:26.981812 12114 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.982887 12105 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:26.983398 12105 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:26.880095  6230 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.008s	sys 0.036s
I20260812 19:23:26.810792 12080 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:26.841720 11841 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.882093 11484 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:26.880156  6350 rpcz_store.cc:269] 0812 19:23:25.245987 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:25.335222 (+ 89235us) service_pool.cc:227] Handling call
0812 19:23:26.715624 (+1380402us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:26.892925 12098 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:26.893527 11826 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:26.893918 11887 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:26.895149 11755 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.895215 11974 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:26.896847 11897 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.899173 11848 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:27.029352 11848 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.903172 12111 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:23:26.904488 12095 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260812 19:23:26.906957  6475 raft_consensus.cc:2396] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260812 19:23:26.610149 11938 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:26.786111  6344 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1620) took 1507 ms (client timeout 1864 ms). Trace:
I20260812 19:23:26.910856  6179 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:23:27.062461  6344 rpcz_store.cc:269] 0812 19:23:25.246228 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:26.751283 (+1505055us) service_pool.cc:227] Handling call
0812 19:23:26.753842 (+  2559us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:27.062822  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 152052us
W20260812 19:23:26.914878  6242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1899) took 1661 ms (client timeout 2142 ms). Trace:
W20260812 19:23:27.063455  6242 rpcz_store.cc:269] 0812 19:23:25.253385 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:25.255196 (+  1811us) service_pool.cc:227] Handling call
0812 19:23:26.914805 (+1659609us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:26.921536 12042 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:27.013928 11484 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:26.924593 12054 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:26.813175  6224 rpcz_store.cc:276] 0812 19:23:24.006817 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:24.008387 (+  1570us) service_pool.cc:227] Handling call
0812 19:23:24.008765 (+   378us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:24.031374 (+ 22609us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:24.031405 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:24.031869 (+   464us) log.cc:842] Serialized 26 byte log entry
0812 19:23:24.253612 (+221743us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:24.253648 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:24.253712 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:25.456620 (+1202908us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:26.812405 (+1355785us) raft_consensus.cc:1671] finished
0812 19:23:26.812429 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:26.812637 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33141,"raft.queue_time_us":22242,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":14698,"spinlock_wait_cycles":28272000,"thread_start_us":221461,"threads_started":1,"wal-append.queue_time_us":408274}
W20260812 19:23:27.070853  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 136801us
I20260812 19:23:26.927222  7606 raft_consensus.cc:2354] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:26.839280 11882 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:26.934834 11856 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.937126 11895 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election won for term 8
W20260812 19:23:26.946899  6352 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 438) took 1702 ms (client timeout 1947 ms). Trace:
W20260812 19:23:26.845204  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 56097.6us
I20260812 19:23:27.079877  6474 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260812 19:23:26.832996 12076 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.946833 11417 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:27.084798 11895 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:27.091255 11417 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:27.093009 12076 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:27.092597 11895 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.935076 11907 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.094475 12108 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:26.927491 12088 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.105608 12119 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:27.107025 12088 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:26.949968 12046 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.950273 11843 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:27.107713  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:27.108397  7594 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:27.109056  7594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 445) took 2120 ms. Trace:
I20260812 19:23:27.109452  7594 rpcz_store.cc:276] 0812 19:23:24.988976 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:24.992299 (+  3323us) service_pool.cc:227] Handling call
0812 19:23:27.107517 (+2115218us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b5800005498. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:23:27.108962 (+  1445us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":18837248}
I20260812 19:23:26.832612 12100 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:26.950872 12000 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.835258 12045 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:26.943086 11939 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260812 19:23:26.931448 12102 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:26.933969 12040 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:26.958642 11937 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:26.960584  6342 raft_consensus.cc:2396] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260812 19:23:26.926218 12006 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.966637  6345 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:26.969623  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:26.985451  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1897) took 1732 ms. Trace:
I20260812 19:23:26.970781 11999 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:26.994311 12094 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:26.946422 12016 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:27.136276  6464 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:27.025840  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:26.968770 11969 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:26.988523 12086 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:27.064827  6236 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:26.818588  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:26.994902 12114 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:27.073134  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:27.075666  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:27.076619  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 149953us
I20260812 19:23:27.081290  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:27.143951  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 70927.5us
I20260812 19:23:27.144163  6474 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:27.144539  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.078192 11926 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:27.083007 12109 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:27.151139  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:27.135821 11882 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:27.151888  6238 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:27.084260 11856 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:27.084470 11848 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:27.084769 11826 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:27.085819  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:27.163199  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:27.087293 12105 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:27.095680 11907 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:26.949067 12092 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:27.096271 11794 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:27.098598 11938 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:26.990257 12063 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.165160 11848 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:27.187547 12122 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:27.188076 11848 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:27.078438  6352 rpcz_store.cc:269] 0812 19:23:25.244947 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:25.249318 (+  4371us) service_pool.cc:227] Handling call
0812 19:23:26.946838 (+1697520us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:27.189569  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.190085  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:27.064875 11897 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260812 19:23:27.120435  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 49438.7us
I20260812 19:23:27.126864  6477 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:27.106238 12119 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:27.120492 11823 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:27.032168 12098 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:27.133576 12040 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.134377  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.135785 11937 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:27.135923 11999 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.059625  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1856) took 3141 ms. Trace:
W20260812 19:23:27.138011  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 168509us
I20260812 19:23:27.132547  6230 rpcz_store.cc:276] 0812 19:23:25.252689 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:25.255116 (+  2427us) service_pool.cc:227] Handling call
0812 19:23:25.319023 (+ 63907us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:25.319238 (+   215us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:25.319266 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:25.367336 (+ 48070us) log.cc:842] Serialized 26 byte log entry
0812 19:23:26.984973 (+1617637us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:26.985041 (+    68us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:26.985151 (+   110us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:26.985214 (+    63us) raft_consensus.cc:1671] finished
0812 19:23:26.985231 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:26.985380 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":1338194,"threads_started":1,"wal-append.queue_time_us":1411634}
I20260812 19:23:27.140278  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:27.242221  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:27.147715  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:27.174535 11856 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:27.257428  6345 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:27.068066 12111 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.259567 12000 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:27.151273 12135 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:27.260324 12111 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:27.149883  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:27.078140 11484 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.083494 11871 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:27.152640  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.194624 11897 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:27.155918  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1865) took 2112 ms. Trace:
I20260812 19:23:27.131770 11841 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:27.232883 12045 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:27.141413 11755 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:27.131217 12017 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:27.164784 11892 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.151628 12109 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:27.100751  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:23:27.332396  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 231813us
I20260812 19:23:27.231003 12060 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260812 19:23:27.333257  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:27.162747  6236 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:23:27.192289  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:27.188297 12122 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.217379  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:27.233237 11843 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:27.147535 12086 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.186679 12133 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:27.143615  6483 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:27.248948  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.249612  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:27.245690 12132 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:27.349026 12128 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260812 19:23:27.137053 12102 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.349551 12132 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:27.350026 12132 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:27.249481 12104 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:27.251794  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:27.290534 11484 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:27.352895  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 101170us
I20260812 19:23:27.252802 12099 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:27.253978  6465 raft_consensus.cc:3032] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:27.254978 11953 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.232378  6342 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:27.148072  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:27.140750 12016 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:27.357090  6224 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:27.191918 11939 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:27.260957  6241 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:27.257803  6229 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:27.343151 12045 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:27.231338 11794 raft_consensus.cc:686] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:27.264365 11848 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:27.270215  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 120359us
I20260812 19:23:27.155058 11926 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.156466  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:27.268406  6353 rpcz_store.cc:276] 0812 19:23:25.043346 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:25.196904 (+153558us) service_pool.cc:227] Handling call
0812 19:23:25.197258 (+   354us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:25.248283 (+ 51025us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:23:25.316249 (+ 67966us) log.cc:842] Serialized 14 byte log entry
0812 19:23:26.838946 (+1522697us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:26.849931 (+ 10985us) log.cc:842] Serialized 26 byte log entry
0812 19:23:26.850080 (+   149us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:26.850116 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:26.850182 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:27.155719 (+305537us) raft_consensus.cc:1671] finished
0812 19:23:27.155738 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:27.155863 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":50819,"prepare.queue_time_us":68796,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":161565,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":50538,"thread_start_us":1209767,"threads_started":1,"wal-append.queue_time_us":1300930}
I20260812 19:23:27.146946 11969 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:27.271306 11897 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:27.282462 11952 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:27.287432 11841 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.260605 12135 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.334935  6232 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
W20260812 19:23:27.339083  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 121860us
I20260812 19:23:27.340256 12006 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:27.343571  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.345431  6345 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:27.329128 11755 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:27.340649 11882 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:27.265388 12063 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:27.348078  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:27.346536 12109 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:27.348827 11892 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:27.349328 12017 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:27.351006  6230 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:27.240824  6349 rpcz_store.cc:276] 0812 19:23:23.917887 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:23.923692 (+  5805us) service_pool.cc:227] Handling call
0812 19:23:23.924096 (+   404us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:23.938286 (+ 14190us) raft_consensus.cc:1520] Early marking committed up to index 6
0812 19:23:24.196528 (+258242us) log.cc:842] Serialized 14 byte log entry
0812 19:23:24.279550 (+ 83022us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:24.279658 (+   108us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:23:24.279728 (+    70us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:27.059296 (+2779568us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b54001cd9d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:27.059348 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:27.059556 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3339,"prepare.queue_time_us":461527,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":4392,"raft.queue_time_us":2628,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":7940,"spinlock_wait_cycles":31940864,"thread_start_us":339260,"threads_started":2,"wal-append.queue_time_us":231005,"wal-append.run_cpu_time_us":2417,"wal-append.run_wall_time_us":1271812}
I20260812 19:23:27.353627  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:27.354691  6465 raft_consensus.cc:729] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:27.355885  6483 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:27.357311  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.359675  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:27.263252  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:27.265106 11856 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.346824 11843 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:27.267443 11871 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:27.263916 12042 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.361259  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.685034 11882 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:27.685770 12017 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.688237  6344 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:27.689970 11841 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:27.376677 11939 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.363552 12104 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:27.679250  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:27.694025  6349 raft_consensus.cc:2362] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8. Re-sending same reply.
I20260812 19:23:27.695541  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.696782  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:27.566045 12054 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.569645 12119 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:27.564868 11484 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:27.393112  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1863) took 2400 ms. Trace:
I20260812 19:23:27.684039  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:27.703778  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.703963  6230 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:27.695427  6465 consensus_queue.cc:260] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.445792 11937 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:27.684468  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.704485  6349 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:27.690884  6350 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:27.692250  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:27.693466  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 339890us
I20260812 19:23:27.569983 12122 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:27.694495  6235 raft_consensus.cc:2396] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260812 19:23:27.706874  6345 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:27.686105 11882 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:27.357424 11907 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:27.393635 12033 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.693074 12040 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:27.717236 12098 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:27.698758 12131 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:27.723755  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.726754 12088 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:27.727248 12088 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:27.705979 11826 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:27.727633 12088 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:27.727833 11826 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:27.728235 11826 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:23:27.731398  6359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 432) took 3165 ms (client timeout 1703 ms). Trace:
W20260812 19:23:27.731786  6359 rpcz_store.cc:269] 0812 19:23:24.566165 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:24.566316 (+   151us) service_pool.cc:227] Handling call
0812 19:23:27.731193 (+3164877us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400061154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:27.731331 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":331918080}
I20260812 19:23:27.732851  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.735168  6224 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:27.739125  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:27.685036  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:27.699556  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 351503us
I20260812 19:23:27.396883  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:27.394538 11999 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:27.685315 11755 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:27.706449  6353 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 4.
I20260812 19:23:27.707520  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:27.706910  6347 rpcz_store.cc:276] 0812 19:23:24.994797 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:25.098262 (+103465us) service_pool.cc:227] Handling call
0812 19:23:26.752225 (+1653963us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:26.850270 (+ 98045us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:27.392868 (+542598us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54002d0fd0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:27.393035 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3802896768}
I20260812 19:23:27.709522  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.712287  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:27.773945  6230 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:27.710073 11937 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.713784 11907 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:27.680738  6238 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:27.710757 11484 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:27.789300  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.790594  6347 raft_consensus.cc:2396] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260812 19:23:27.723611 12131 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.743146  6298 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:27.746560  6232 raft_consensus.cc:2396] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260812 19:23:27.697458  6342 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
W20260812 19:23:27.802421  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 59362.2us
I20260812 19:23:27.749298  6345 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:27.802759  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1871) took 1204 ms. Trace:
I20260812 19:23:27.751904  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.740088  6224 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:27.803668  6359 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:27.803814  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.700987 11802 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:27.395380 12100 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:27.695281 12017 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:27.697599 12006 raft_consensus.cc:686] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:23:27.774804  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 78100.4us
I20260812 19:23:27.815565  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:27.349066 12133 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:27.705013  6465 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:27.803334  6347 rpcz_store.cc:276] 0812 19:23:26.598707 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.788927 (+1190220us) service_pool.cc:227] Handling call
0812 19:23:27.802677 (+ 13750us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:27.394811 12099 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:27.811065  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:27.816200  6342 raft_consensus.cc:595] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:27.817435  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1870) took 1219 ms. Trace:
I20260812 19:23:27.921113  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 440) took 1086 ms. Trace:
I20260812 19:23:28.313047  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:28.307858  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 491627us
W20260812 19:23:28.303936  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 596435us
I20260812 19:23:27.896876  6465 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
W20260812 19:23:28.318912  6465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1582) took 3574 ms (client timeout 2073 ms). Trace:
I20260812 19:23:27.800755 11999 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:27.877813  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:27.855363  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:28.311748  6342 raft_consensus.cc:603] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260812 19:23:28.311436  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 566379us
W20260812 19:23:27.892023  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 75760.9us
I20260812 19:23:28.313452  6352 rpcz_store.cc:276] 0812 19:23:26.834962 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.816700 (+981738us) service_pool.cc:227] Handling call
0812 19:23:27.920151 (+103451us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:27.920625 (+   474us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:27.920664 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:27.920720 (+    56us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:27.920763 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:27.920840 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:27.921017 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1729,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":47159}
I20260812 19:23:28.312116  6345 rpcz_store.cc:276] 0812 19:23:26.598361 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.816525 (+1218164us) service_pool.cc:227] Handling call
0812 19:23:27.816831 (+   306us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:27.817045 (+   214us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:27.817081 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:27.817132 (+    51us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:27.817173 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:27.817247 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:27.817366 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:27.788407 11907 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:27.855214  6359 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:27.879014  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 441) took 1040 ms. Trace:
I20260812 19:23:28.320799  6230 raft_consensus.cc:2379] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:28.321138  6483 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:23:28.321417  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:28.320843  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1629) took 1347 ms. Trace:
I20260812 19:23:28.322166  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:28.319744  6465 rpcz_store.cc:269] 0812 19:23:24.744772 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:24.744941 (+   169us) service_pool.cc:227] Handling call
0812 19:23:27.253851 (+2508910us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54000c83a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7708730 00007f98f777beff 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86
0812 19:23:28.318822 (+1064971us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":312430976}
I20260812 19:23:28.322487  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:28.325006  6179 leader_election.cc:398] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:28.310403  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:27.806710 12045 raft_consensus.cc:686] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:28.407667  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49464 (request call id 53) took 1434 ms. Trace:
I20260812 19:23:27.895533 11939 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:27.808854 11802 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:28.368369  6350 rpcz_store.cc:276] 0812 19:23:26.973281 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.734362 (+761081us) service_pool.cc:227] Handling call
0812 19:23:28.320779 (+586417us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:28.370668  6232 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:28.369338  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:28.371212  6179 leader_election.cc:401] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:23:28.371338  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1872) took 1772 ms. Trace:
I20260812 19:23:28.372185  6470 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:28.369221  6347 rpcz_store.cc:276] 0812 19:23:26.838212 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.878041 (+1039829us) service_pool.cc:227] Handling call
0812 19:23:27.878411 (+   370us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:27.878604 (+   193us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:27.878641 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:27.878723 (+    82us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:23:27.878754 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:27.878821 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:27.878952 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:27.895159 11926 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:28.117678 12135 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:27.893743 11856 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:28.368664  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:27.895108 12006 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:28.410665  6342 rpcz_store.cc:276] 0812 19:23:26.935151 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.815427 (+880276us) service_pool.cc:227] Handling call
0812 19:23:28.369410 (+553983us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:28.818233  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:28.823894  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:28.367457 11738 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.006s	sys 0.031s
I20260812 19:23:28.825335  6350 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:28.819825  6353 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
W20260812 19:23:28.559252  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 237895us
I20260812 19:23:28.820978  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:28.489856  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:28.407325 11820 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:28.853895  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1625) took 1904 ms. Trace:
I20260812 19:23:28.854482  6353 rpcz_store.cc:276] 0812 19:23:26.949179 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.791058 (+841879us) service_pool.cc:227] Handling call
0812 19:23:28.853737 (+1062679us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:28.855077 11802 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:27.898973 11897 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:28.856760  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:28.319289 11863 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:28.857900  6483 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:23:27.896237 11871 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:28.859076 11831 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.005s	sys 0.010s
I20260812 19:23:28.157886 11882 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:28.372202  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:28.859647 11831 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.005s	sys 0.010s
W20260812 19:23:28.618131 11755 consensus_meta.cc:287] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.816s	user 0.008s	sys 0.003s
I20260812 19:23:28.863118 11820 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:28.863895 11755 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:28.156061 11969 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:28.866531  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1882) took 1105 ms. Trace:
I20260812 19:23:28.116991 11843 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:28.867200  6232 rpcz_store.cc:276] 0812 19:23:27.760858 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.815337 (+ 54479us) service_pool.cc:227] Handling call
0812 19:23:28.866143 (+1050806us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":30336}
I20260812 19:23:28.867785  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:28.868867  6230 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:23:28.858791 11863 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:28.186805 12080 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:27.878398 12086 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:28.366125 12107 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:28.872430  6236 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 365) took 2145 ms (client timeout 1897 ms). Trace:
W20260812 19:23:28.429811  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 58149.8us
I20260812 19:23:28.872908 12107 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:28.869511  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 373) took 1123 ms. Trace:
W20260812 19:23:27.893225 12132 consensus_meta.cc:287] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.005s
I20260812 19:23:28.489511  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:28.874979  6230 rpcz_store.cc:276] 0812 19:23:27.745887 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.428229 (+682342us) service_pool.cc:227] Handling call
0812 19:23:28.869414 (+441185us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:28.876264  6238 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:28.875721 12132 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:28.877094  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1887) took 1064 ms. Trace:
I20260812 19:23:28.877547  6238 rpcz_store.cc:276] 0812 19:23:27.812846 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.371109 (+558263us) service_pool.cc:227] Handling call
0812 19:23:28.876986 (+505877us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:28.876876  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:28.858793  6359 rpcz_store.cc:276] 0812 19:23:26.598997 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.817844 (+1218847us) service_pool.cc:227] Handling call
0812 19:23:27.839826 (+ 21982us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:28.371111 (+531285us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:28.371285 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:28.879317  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 375) took 1118 ms. Trace:
I20260812 19:23:28.879748  6230 rpcz_store.cc:276] 0812 19:23:27.760472 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.876303 (+1115831us) service_pool.cc:227] Handling call
0812 19:23:28.879248 (+  2945us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:28.880095  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:28.881057  6359 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:28.882184  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:28.608779 11484 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:28.858050  6229 raft_consensus.cc:2354] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8.
I20260812 19:23:28.883623  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:28.884970  6342 raft_consensus.cc:2396] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260812 19:23:27.923424 11794 consensus_queue.cc:237] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:28.707645 11826 consensus_meta.cc:287] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.979s	user 0.005s	sys 0.009s
I20260812 19:23:28.887346  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:28.887663 11826 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:28.890183  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:28.891244  6345 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:28.892865  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:28.894850  6359 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:28.857074  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:28.897030  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:28.898010  6353 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:28.869685  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:28.899171 11820 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:28.899228  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:28.888252  6350 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:28.914286  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1621) took 1974 ms. Trace:
I20260812 19:23:28.914479  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1592) took 2126 ms. Trace:
W20260812 19:23:28.894371  6344 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1631) took 1920 ms (client timeout 2156 ms). Trace:
W20260812 19:23:28.916095  6344 rpcz_store.cc:269] 0812 19:23:26.973772 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.144279 (+170507us) service_pool.cc:227] Handling call
0812 19:23:28.893960 (+1749681us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54001cd9d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:28.894143 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1248997248}
I20260812 19:23:28.320427 11953 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:28.917984  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:27.815399 11952 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:28.919363 11952 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:28.919962 11952 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:28.920742 12132 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:28.886310  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:28.914758  6350 rpcz_store.cc:276] 0812 19:23:26.939681 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.912966 (+1973285us) service_pool.cc:227] Handling call
0812 19:23:28.913571 (+   605us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:28.913855 (+   284us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:28.913882 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:28.913945 (+    63us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:28.913974 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:28.914070 (+    96us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:28.914196 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:28.923050  6342 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:28.924695  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1623) took 1984 ms. Trace:
I20260812 19:23:28.628829 12099 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:28.366510 12015 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260812 19:23:28.187968 12032 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 3.362s	user 0.009s	sys 0.021s
I20260812 19:23:28.714375 11907 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:28.657840 12156 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:28.906694 11882 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:28.908321 11755 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:28.911880  7607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 441) took 5235 ms (client timeout 2101 ms). Trace:
I20260812 19:23:28.538908 11937 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:28.894721  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:28.930644  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:28.931119  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:28.931258  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:28.931916 11863 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:28.942878  7593 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:28.929083  6350 rpcz_store.cc:276] 0812 19:23:26.940244 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.923120 (+1982876us) service_pool.cc:227] Handling call
0812 19:23:28.923844 (+   724us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:28.924260 (+   416us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:28.924289 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:28.924368 (+    79us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:28.924399 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:28.924464 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:28.924626 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:28.926211  6464 rpcz_store.cc:276] 0812 19:23:26.788166 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:26.788310 (+   144us) service_pool.cc:227] Handling call
0812 19:23:28.914046 (+2125736us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540003bbd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:28.914254 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":530951552}
I20260812 19:23:28.945348  6465 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 4.
I20260812 19:23:28.946307  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:28.946831  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:28.947453  6464 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:28.948597  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:28.948778  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:28.949582  6465 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:28.950133  6483 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:28.954840  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:28.956259  6483 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:28.958642  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:28.939397  7607 rpcz_store.cc:269] 0812 19:23:23.676519 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:23.679136 (+  2617us) service_pool.cc:227] Handling call
0812 19:23:28.908728 (+5229592us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54001996d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:28.909095 (+   367us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1806837632}
I20260812 19:23:28.950204  6464 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:23:28.319640 12133 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:28.952545 11897 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:28.951560  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1881) took 1698 ms. Trace:
I20260812 19:23:28.964247 12104 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:28.962395 12107 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:28.952105 12156 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:23:28.651151 12088 consensus_meta.cc:287] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.923s	user 0.013s	sys 0.000s
I20260812 19:23:29.229887 12156 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:29.230358 12088 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:29.233268 12088 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:28.962376  6465 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260812 19:23:29.437912  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 412) took 1113 ms. Trace:
I20260812 19:23:29.438326  6465 rpcz_store.cc:276] 0812 19:23:28.323985 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.960406 (+636421us) service_pool.cc:227] Handling call
0812 19:23:28.961040 (+   634us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:29.437567 (+476527us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:29.437813 (+   246us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:28.984716  7591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60760 (request call id 457) took 4942 ms (client timeout 2183 ms). Trace:
I20260812 19:23:28.985199  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:29.651904  7593 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:29.653219  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:28.993080  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:29.657042 12193 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:29.657677  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:29.657768 12193 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:28.991196  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:29.659976  7600 raft_consensus.cc:2379] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:29.660521 12193 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:29.660715 11918 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:28.987870  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:28.985767  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:29.663165  7594 raft_consensus.cc:2379] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:28.989795  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:28.983451  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:29.674018  6055 catalog_manager.cc:5495] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 6 to 7, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 7 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:29.674916 12027 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:29.676245  6055 catalog_manager.cc:5495] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:29.676626 12027 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:29.678665 12016 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:29.678994  6054 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 193) took 6609 ms. Trace:
I20260812 19:23:29.679219 12027 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:29.679270 12016 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:29.680078 12027 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:29.680751 12027 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:29.681751 12016 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:28.973047 11417 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:28.935252 11826 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:28.970985 11907 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:28.993470 12045 consensus_queue.cc:237] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:29.070966  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1854) took 5156 ms. Trace:
I20260812 19:23:29.130867  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:29.682334 12016 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:23:29.237053  6175 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.010s	sys 0.021s
W20260812 19:23:29.693771  6175 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.286s	user 0.011s	sys 0.021s
I20260812 19:23:29.692836  6354 rpcz_store.cc:276] 0812 19:23:23.914915 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:23.915105 (+   190us) service_pool.cc:227] Handling call
0812 19:23:23.915537 (+   432us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:24.390672 (+475135us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:29.070248 (+4679576us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b540034f654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:29.070704 (+   456us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1090799360}
I20260812 19:23:29.694711  6354 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:29.695504  6354 raft_consensus.cc:595] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:29.695873  6354 raft_consensus.cc:603] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:29.697353  6354 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 19:23:29.229373  6347 rpcz_store.cc:276] 0812 19:23:27.253499 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.950080 (+1696581us) service_pool.cc:227] Handling call
0812 19:23:28.950617 (+   537us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:28.951041 (+   424us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:28.951075 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:28.951155 (+    80us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:28.951247 (+    92us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:28.951324 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:28.951472 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:29.699529  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 444) took 1956 ms. Trace:
I20260812 19:23:29.699904  6347 rpcz_store.cc:276] 0812 19:23:27.742764 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:29.698501 (+1955737us) service_pool.cc:227] Handling call
0812 19:23:29.698969 (+   468us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:29.699158 (+   189us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:29.699189 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:29.699252 (+    63us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:29.699284 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:29.699343 (+    59us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:29.699452 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:29.697826  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 443) took 1955 ms. Trace:
I20260812 19:23:29.242314 12156 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:29.260658 11952 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:29.702036  6464 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:29.282294  6345 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:29.703097 12156 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:29.704409  6345 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260812 19:23:29.704969  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 446) took 1960 ms. Trace:
I20260812 19:23:29.705174  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1886) took 1332 ms. Trace:
I20260812 19:23:29.705330 11907 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:29.705295  6345 rpcz_store.cc:276] 0812 19:23:27.744505 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:29.703647 (+1959142us) service_pool.cc:227] Handling call
0812 19:23:29.704009 (+   362us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:29.704749 (+   740us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:29.704921 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:29.325367  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1872) took 1625 ms. Trace:
I20260812 19:23:29.707242  6235 rpcz_store.cc:276] 0812 19:23:27.700029 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.711721 (+ 11692us) service_pool.cc:227] Handling call
0812 19:23:28.310524 (+598803us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:28.310827 (+   303us) raft_consensus.cc:1520] Early marking committed up to index 6
0812 19:23:28.807881 (+497054us) log.cc:842] Serialized 14 byte log entry
0812 19:23:29.324479 (+516598us) log.cc:842] Serialized 14 byte log entry
0812 19:23:29.324693 (+   214us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:29.324750 (+    57us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:23:29.324827 (+    77us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:29.324922 (+    95us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:29.325117 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":830526,"prepare.queue_time_us":272899,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":2072,"raft.queue_time_us":698975,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":296,"spinlock_wait_cycles":86528,"thread_start_us":381772,"threads_started":2,"wal-append.queue_time_us":107203}
I20260812 19:23:29.700872  6354 rpcz_store.cc:276] 0812 19:23:27.741962 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:29.696609 (+1954647us) service_pool.cc:227] Handling call
0812 19:23:29.696975 (+   366us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:29.697622 (+   647us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:29.697781 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:29.709682  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:29.710386  6235 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 8
I20260812 19:23:29.329099  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1889) took 2073 ms. Trace:
I20260812 19:23:29.710785  6350 rpcz_store.cc:276] 0812 19:23:27.255968 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.944833 (+1688865us) service_pool.cc:227] Handling call
0812 19:23:28.945478 (+   645us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:28.946274 (+   796us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:28.946311 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:29.318727 (+372416us) log.cc:842] Serialized 26 byte log entry
0812 19:23:29.328744 (+ 10017us) raft_consensus.cc:1631] Marking committed up to 2
0812 19:23:29.328781 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:29.328848 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:29.328887 (+    39us) raft_consensus.cc:1671] finished
0812 19:23:29.328897 (+    10us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:29.329015 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1196,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":176,"thread_start_us":9572,"threads_started":1,"wal-append.queue_time_us":7046}
I20260812 19:23:29.341655  6359 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:29.712596  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1643) took 1241 ms. Trace:
I20260812 19:23:29.712908  6359 rpcz_store.cc:276] 0812 19:23:28.471174 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.881787 (+410613us) service_pool.cc:227] Handling call
0812 19:23:29.712538 (+830751us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:29.354300 11802 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:29.716007  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:29.716413 11802 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:29.364341  6242 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:29.718143  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1904) took 2572 ms. Trace:
I20260812 19:23:29.718463  6242 rpcz_store.cc:276] 0812 19:23:27.145310 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.146045 (+   735us) service_pool.cc:227] Handling call
0812 19:23:27.146294 (+   249us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:29.717180 (+2570886us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:29.717903 (+   723us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b54001649d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:29.718093 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5100166528}
I20260812 19:23:29.378121 11855 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:29.382457  6298 leader_election.cc:334] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.909s (SENT)
I20260812 19:23:29.722904  6298 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:29.389446  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:29.723934  6238 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 374) took 1977 ms (client timeout 2207 ms). Trace:
W20260812 19:23:29.724381  6238 rpcz_store.cc:269] 0812 19:23:27.746063 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.878448 (+1132385us) service_pool.cc:227] Handling call
0812 19:23:29.723866 (+845418us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:29.392699 12131 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:29.726102 12107 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:29.401866  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1898) took 4148 ms. Trace:
I20260812 19:23:29.703109 11952 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:29.404320  6477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1597) took 2590 ms (client timeout 1560 ms). Trace:
I20260812 19:23:29.414155  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:29.734555  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 352304us
W20260812 19:23:29.417675  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 425498us
I20260812 19:23:29.448873 11999 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:29.457340  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1873) took 5233 ms. Trace:
W20260812 19:23:28.849785  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 478995us
I20260812 19:23:28.900388  6232 raft_consensus.cc:2396] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260812 19:23:29.477788 12033 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:29.733428 12107 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:29.744601  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:29.745232 12107 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:29.745564  6242 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:29.734531 11952 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:29.746165  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1893) took 1378 ms. Trace:
W20260812 19:23:29.485363  6229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1919) took 2225 ms (client timeout 1814 ms). Trace:
W20260812 19:23:29.488592  6241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1913) took 2325 ms (client timeout 2922 ms). Trace:
I20260812 19:23:29.502755  6465 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:23:29.514462  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 442) took 2667 ms. Trace:
I20260812 19:23:29.519129  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:29.526779  6417 leader_election.cc:334] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 2.138s (SENT)
I20260812 19:23:29.528555  6475 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
W20260812 19:23:29.547334  6473 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.002s	sys 0.010s
W20260812 19:23:29.753700  6473 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.002s	sys 0.010s
I20260812 19:23:29.559335 12054 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:29.560721 12042 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:29.564684 12075 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 3.478s	user 0.011s	sys 0.018s
W20260812 19:23:29.573813  6342 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.001s	sys 0.025s
W20260812 19:23:29.580230  6352 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1634) took 1260 ms (client timeout 1562 ms). Trace:
I20260812 19:23:29.600309 11731 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:29.612578  6470 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:29.617472 11938 raft_consensus.cc:3032] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Stepping down as leader of term 7
W20260812 19:23:28.872942  6236 rpcz_store.cc:269] 0812 19:23:26.726423 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:26.726568 (+   145us) service_pool.cc:227] Handling call
0812 19:23:28.871944 (+2145376us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54002f9c54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:28.872177 (+   233us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":519625984}
W20260812 19:23:29.630321  7591 rpcz_store.cc:269] 0812 19:23:24.041867 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:24.044185 (+  2318us) service_pool.cc:227] Handling call
0812 19:23:28.984057 (+4939872us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54004d21d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:28.984419 (+   362us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":286306048}
I20260812 19:23:29.640136 11850 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:28.988651  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:23:28.990918  7603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 442) took 5110 ms (client timeout 1909 ms). Trace:
I20260812 19:23:29.662395  7606 raft_consensus.cc:2354] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8.
I20260812 19:23:29.661482 11918 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:29.668489  6060 catalog_manager.cc:5495] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:29.672807 12122 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:29.682503 12027 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:29.678056  6055 catalog_manager.cc:5495] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:29.682780  6054 rpcz_store.cc:276] 0812 19:23:23.065784 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:23.073384 (+  7600us) service_pool.cc:227] Handling call
0812 19:23:29.666496 (+6593112us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:23.250930 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:23.346951 (+ 96021us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:23.357771 (+ 10820us) write_op.cc:435] Acquired schema lock
0812 19:23:23.357799 (+    28us) tablet.cc:660] Decoding operations
0812 19:23:23.474452 (+116653us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:23.498729 (+ 24277us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:23.501334 (+  2605us) tablet.cc:683] Acquiring locks for 4 operations
0812 19:23:23.649430 (+148096us) tablet.cc:699] Row locks acquired
0812 19:23:23.649471 (+    41us) write_op.cc:260] PREPARE: finished
0812 19:23:23.672373 (+ 22902us) write_op.cc:270] Start()
0812 19:23:23.678291 (+  5918us) write_op.cc:276] Timestamp: P: 1786562603669918 usec, L: 0
0812 19:23:23.681592 (+  3301us) op_driver.cc:331] REPLICATION: starting
0812 19:23:23.724967 (+ 43375us) log.cc:842] Serialized 1682 byte log entry
0812 19:23:23.892526 (+167559us) op_driver.cc:444] REPLICATION: finished
0812 19:23:24.380685 (+488159us) write_op.cc:301] APPLY: starting
0812 19:23:24.386877 (+  6192us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:24.387087 (+   210us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:24.387291 (+   204us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:24.387932 (+   641us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:24.388194 (+   262us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0812 19:23:24.388281 (+    87us) write_op.cc:312] APPLY: finished
0812 19:23:24.388630 (+   349us) log.cc:842] Serialized 41 byte log entry
0812 19:23:24.388848 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:24.388987 (+   139us) write_op.cc:454] Released schema lock
0812 19:23:24.389042 (+    55us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:24.389410 (+   368us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:24.389447 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":239063,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":448810,"apply.run_cpu_time_us":3164,"apply.run_wall_time_us":19194,"num_ops":4,"prepare.queue_time_us":6820,"prepare.run_cpu_time_us":11484,"prepare.run_wall_time_us":492557,"replication_time_us":203800,"thread_start_us":328995,"threads_started":1}]]}
I20260812 19:23:29.693169  6230 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:29.198601 12149 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:29.700989  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:29.705637  6464 rpcz_store.cc:276] 0812 19:23:28.372809 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.962841 (+590032us) service_pool.cc:227] Handling call
0812 19:23:28.979193 (+ 16352us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:29.702381 (+723188us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:29.704967 (+  2586us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54001031d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:29.705112 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1661908352}
I20260812 19:23:29.706687 11816 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:29.311257  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 1.0002e+06us
I20260812 19:23:29.706246 11907 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:29.316216 12102 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:29.399163  6058 catalog_manager.cc:5495] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:29.725586  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:29.734740  6477 rpcz_store.cc:269] 0812 19:23:26.813316 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:26.813481 (+   165us) service_pool.cc:227] Handling call
0812 19:23:29.403864 (+2590383us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54000749d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:29.404123 (+   259us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":473535232}
W20260812 19:23:29.739934  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 326170us
I20260812 19:23:29.740913  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:29.741612 11999 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:29.736110  6481 rpcz_store.cc:276] 0812 19:23:24.223779 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:24.223978 (+   199us) service_pool.cc:227] Handling call
0812 19:23:24.245541 (+ 21563us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:24.345222 (+ 99681us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:24.345274 (+    52us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:24.345398 (+   124us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:24.345516 (+   118us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:29.456817 (+5111301us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b54001310d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:29.456883 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:29.457145 (+   262us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":159351168}
I20260812 19:23:29.733662  6228 rpcz_store.cc:276] 0812 19:23:25.253065 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:25.253908 (+   843us) service_pool.cc:227] Handling call
0812 19:23:25.254240 (+   332us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:26.399133 (+1144893us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:26.399181 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:26.419620 (+ 20439us) log.cc:842] Serialized 26 byte log entry
0812 19:23:29.392555 (+2972935us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b1800193b40. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:23:29.395422 (+  2867us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:29.395460 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:29.395565 (+   105us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:29.400185 (+  4620us) raft_consensus.cc:1671] finished
0812 19:23:29.400217 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:29.401588 (+  1371us) inbound_call.cc:173] Queueing success response
0812 19:23:29.611650 (+210062us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b1800193b40. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c764 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
Metrics: {"mutex_wait_us":49463,"raft.queue_time_us":277269,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":76578,"spinlock_wait_cycles":275693056,"thread_start_us":393236,"threads_started":2,"wal-append.queue_time_us":2974487}
W20260812 19:23:29.744051  6232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1885) took 1950 ms (client timeout 2036 ms). Trace:
I20260812 19:23:29.752888  6353 rpcz_store.cc:276] 0812 19:23:26.847225 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.898790 (+2051565us) service_pool.cc:227] Handling call
0812 19:23:29.513798 (+615008us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:29.514100 (+   302us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:29.514127 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:29.514171 (+    44us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:23:29.514199 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:29.514253 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:29.514376 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:29.769639  6417 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:30.611351 12042 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:30.612171 12042 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:30.612565 12149 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:30.615216  6342 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.685s	user 0.010s	sys 0.038s
I20260812 19:23:30.615091  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:30.615983  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:30.616053  7597 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:30.618088  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1874) took 3471 ms. Trace:
W20260812 19:23:30.035229  6113 debug-util.cc:398] Leaking SignalData structure 0x7b0800037200 after lost signal to thread 4090
I20260812 19:23:29.892463  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:30.619194  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:30.620043  6113 debug-util.cc:398] Leaking SignalData structure 0x7b08003c7040 after lost signal to thread 6116
I20260812 19:23:30.620132  6465 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:30.621366  6347 raft_consensus.cc:595] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:30.622025  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:30.622928  6470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33386 (request call id 409) took 2300 ms (client timeout 2231 ms). Trace:
I20260812 19:23:30.623219  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:29.867583  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 124205us
W20260812 19:23:29.750795  6229 rpcz_store.cc:269] 0812 19:23:27.259519 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.359428 (+ 99909us) service_pool.cc:227] Handling call
0812 19:23:29.485131 (+2125703us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400212fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:29.485294 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2702668672}
I20260812 19:23:29.818526  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1887) took 1326 ms. Trace:
I20260812 19:23:30.615888  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:29.804256  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 61340us
W20260812 19:23:30.623302  6470 rpcz_store.cc:269] 0812 19:23:28.322092 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.322236 (+   144us) service_pool.cc:227] Handling call
0812 19:23:30.622815 (+2300579us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:30.620545  6113 debug-util.cc:398] Leaking SignalData structure 0x7b0800033680 after lost signal to thread 6138
I20260812 19:23:30.630955  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:29.751602  6241 rpcz_store.cc:269] 0812 19:23:27.163357 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.189848 (+ 26491us) service_pool.cc:227] Handling call
0812 19:23:29.488204 (+2298356us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b540027ddd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:29.488393 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":161504000}
I20260812 19:23:29.884848  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1583) took 5137 ms. Trace:
W20260812 19:23:30.630843  6232 rpcz_store.cc:269] 0812 19:23:27.793320 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.869089 (+1075769us) service_pool.cc:227] Handling call
0812 19:23:29.743979 (+874890us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:29.748736  6242 rpcz_store.cc:276] 0812 19:23:28.367982 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:29.736454 (+1368472us) service_pool.cc:227] Handling call
0812 19:23:29.746084 (+  9630us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.624764 11816 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:30.626971  6352 rpcz_store.cc:269] 0812 19:23:28.319435 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.370192 (+ 50757us) service_pool.cc:227] Handling call
0812 19:23:29.580011 (+1209819us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:30.626633  6230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1888) took 2782 ms (client timeout 2121 ms). Trace:
W20260812 19:23:30.611398  7606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 425) took 1624 ms (client timeout 1814 ms). Trace:
I20260812 19:23:30.628051  6475 rpcz_store.cc:276] 0812 19:23:28.492358 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.966027 (+473669us) service_pool.cc:227] Handling call
0812 19:23:28.966546 (+   519us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:29.770204 (+803658us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:29.804894 (+ 34690us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b540003d4d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:29.818446 (+ 13552us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1291856256}
W20260812 19:23:30.672940  6113 debug-util.cc:398] Leaking SignalData structure 0x7b0800033fe0 after lost signal to thread 6272
I20260812 19:23:30.623194  6465 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:30.623510 12122 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:30.038899  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:30.686662  6113 debug-util.cc:398] Leaking SignalData structure 0x7b0800033fc0 after lost signal to thread 6273
I20260812 19:23:29.787158  6224 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
W20260812 19:23:30.632352  7603 rpcz_store.cc:269] 0812 19:23:23.880629 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:25.018709 (+1138080us) service_pool.cc:227] Handling call
0812 19:23:28.990421 (+3971712us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54004d03d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:28.990677 (+   256us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":664392576}
W20260812 19:23:30.688189  6113 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb680 after lost signal to thread 6399
W20260812 19:23:30.688800  6113 debug-util.cc:398] Leaking SignalData structure 0x7b08002efd40 after lost signal to thread 6400
W20260812 19:23:30.676465  6230 rpcz_store.cc:269] 0812 19:23:27.844250 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.880679 (+1036429us) service_pool.cc:227] Handling call
0812 19:23:30.626544 (+1745865us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:30.687772  6224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1884) took 2926 ms (client timeout 1951 ms). Trace:
I20260812 19:23:30.690235  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:30.688066  7606 rpcz_store.cc:269] 0812 19:23:28.986881 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.987225 (+   344us) service_pool.cc:227] Handling call
0812 19:23:30.611300 (+1624075us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:30.690989  6113 debug-util.cc:398] Leaking SignalData structure 0x7b08003b7d80 after lost signal to thread 6521
I20260812 19:23:30.622444  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:30.694056  7598 raft_consensus.cc:2379] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
W20260812 19:23:30.698737  6113 debug-util.cc:398] Leaking SignalData structure 0x7b08003c5260 after lost signal to thread 6522
W20260812 19:23:30.700456  6113 debug-util.cc:398] Leaking SignalData structure 0x7b080038fc40 after lost signal to thread 7647
W20260812 19:23:30.701133  6113 debug-util.cc:398] Leaking SignalData structure 0x7b08003adfa0 after lost signal to thread 11813
W20260812 19:23:30.690459  6224 rpcz_store.cc:269] 0812 19:23:27.761569 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.816300 (+ 54731us) service_pool.cc:227] Handling call
0812 19:23:29.518770 (+1702470us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b5800001898. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:23:30.687676 (+1168906us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6065024}
W20260812 19:23:30.696339  7598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 419) took 5641 ms (client timeout 2142 ms). Trace:
W20260812 19:23:30.649396 12107 consensus_meta.cc:287] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.891s	user 0.004s	sys 0.008s
I20260812 19:23:29.883074 12131 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260812 19:23:30.703224  7598 rpcz_store.cc:269] 0812 19:23:25.054872 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:25.089823 (+ 34951us) service_pool.cc:227] Handling call
0812 19:23:28.988129 (+3898306us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b5800005498. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:23:30.696266 (+1708137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9568128}
I20260812 19:23:30.618582  6342 rpcz_store.cc:276] 0812 19:23:27.147119 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.923777 (+1776658us) service_pool.cc:227] Handling call
0812 19:23:28.924245 (+   468us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:28.924586 (+   341us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:28.924622 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:28.925272 (+   650us) log.cc:842] Serialized 26 byte log entry
0812 19:23:30.617595 (+1692323us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:30.617659 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:30.617763 (+   104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:30.617811 (+    48us) raft_consensus.cc:1671] finished
0812 19:23:30.617840 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:30.617989 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":1691754,"threads_started":1,"wal-append.queue_time_us":90556,"wal-append.run_cpu_time_us":3342,"wal-append.run_wall_time_us":1007751}
I20260812 19:23:30.704754  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1914) took 1019 ms. Trace:
I20260812 19:23:30.712865  6481 rpcz_store.cc:276] 0812 19:23:29.677957 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.642709 (+964752us) service_pool.cc:227] Handling call
0812 19:23:30.697104 (+ 54395us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.704957  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1915) took 1026 ms. Trace:
I20260812 19:23:30.713967  6464 rpcz_store.cc:276] 0812 19:23:29.678269 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.614552 (+936283us) service_pool.cc:227] Handling call
0812 19:23:30.704894 (+ 90342us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.715035  6354 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260812 19:23:30.688905  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:30.649624 11938 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:30.707746  6477 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:30.707960  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:30.708226  6470 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:30.717963  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1917) took 1007 ms. Trace:
I20260812 19:23:30.718483  6470 rpcz_store.cc:276] 0812 19:23:29.710752 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.630609 (+919857us) service_pool.cc:227] Handling call
0812 19:23:30.717885 (+ 87276us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.708674  6238 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
W20260812 19:23:30.719648  6238 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1889) took 2413 ms (client timeout 1894 ms). Trace:
W20260812 19:23:30.720105  6238 rpcz_store.cc:269] 0812 19:23:28.306406 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:29.725173 (+1418767us) service_pool.cc:227] Handling call
0812 19:23:30.719555 (+994382us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.708750  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:30.709545  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:30.710359  6474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33386 (request call id 408) took 2388 ms (client timeout 1508 ms). Trace:
I20260812 19:23:29.707231 12016 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:30.723541  6232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1876) took 2989 ms (client timeout 2835 ms). Trace:
W20260812 19:23:30.723996  6232 rpcz_store.cc:269] 0812 19:23:27.726251 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.689994 (+2963743us) service_pool.cc:214] Skipping call since client already timed out
0812 19:23:30.715926 (+ 25932us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:23:30.724262  6242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1892) took 2388 ms (client timeout 2277 ms). Trace:
I20260812 19:23:30.711882  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:30.724882  6242 rpcz_store.cc:269] 0812 19:23:28.327501 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.694564 (+2367063us) service_pool.cc:214] Skipping call since client already timed out
0812 19:23:30.715929 (+ 21365us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260812 19:23:30.725407  6229 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:30.711338  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:30.715253  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:30.715169 12027 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:30.721988  6474 rpcz_store.cc:269] 0812 19:23:28.321767 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.321905 (+   138us) service_pool.cc:227] Handling call
0812 19:23:30.696687 (+2374782us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b54001036d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:30.710161 (+ 13474us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5191695232}
I20260812 19:23:30.706593 12045 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:30.729377  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:30.729621  6241 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:30.730050  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:30.734308  6464 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:30.730588  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1912) took 1053 ms. Trace:
I20260812 19:23:30.734789  6475 rpcz_store.cc:276] 0812 19:23:29.677038 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.688597 (+1011559us) service_pool.cc:227] Handling call
0812 19:23:30.730529 (+ 41932us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.735730  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:30.736430  6475 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:30.736912  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1916) took 1026 ms. Trace:
I20260812 19:23:30.737190  6475 rpcz_store.cc:276] 0812 19:23:29.710054 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.735448 (+1025394us) service_pool.cc:227] Handling call
0812 19:23:30.736857 (+  1409us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.738131  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:30.728122  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 447) took 2976 ms. Trace:
I20260812 19:23:30.738809  6354 rpcz_store.cc:276] 0812 19:23:27.751842 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:29.711245 (+1959403us) service_pool.cc:227] Handling call
0812 19:23:29.713181 (+  1936us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:30.715414 (+1002233us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:30.727878 (+ 12464us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54001b9754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:30.728058 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2295354752}
I20260812 19:23:30.726818 12027 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:30.741696 12027 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:30.727530  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:30.705649  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.2:39969 timed out after 1.864s (SENT) [suppressed 14 similar messages]
I20260812 19:23:30.633430  6473 rpcz_store.cc:276] 0812 19:23:24.746998 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:24.747169 (+   171us) service_pool.cc:227] Handling call
0812 19:23:24.747606 (+   437us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:25.105188 (+357582us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:25.105222 (+    34us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:25.193705 (+ 88483us) log.cc:842] Serialized 52 byte log entry
0812 19:23:25.439825 (+246120us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:26.812032 (+1372207us) log.cc:842] Serialized 14 byte log entry
0812 19:23:28.918026 (+2105994us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b180018baa0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f47d34ca 00007f98fdea8f99 00007f98f4697990 00007f98f4859864 00007f98f4859155 00007f98fb14d167 00007f98f7782807 00007f98f7791f0f 00007f98f7791e88
0812 19:23:28.939420 (+ 21394us) log.cc:842] Serialized 14 byte log entry
0812 19:23:29.883394 (+943974us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:29.884369 (+   975us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b5400363b54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:29.884430 (+    61us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:29.884490 (+    60us) raft_consensus.cc:1671] finished
0812 19:23:29.884507 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:29.884762 (+   255us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2603154,"prepare.queue_time_us":3483956,"prepare.run_cpu_time_us":141,"prepare.run_wall_time_us":144,"raft.queue_time_us":164616,"raft.run_cpu_time_us":722,"raft.run_wall_time_us":159939,"spinlock_wait_cycles":638555776,"thread_start_us":1774374,"threads_started":3,"wal-append.queue_time_us":1302077,"wal-append.run_cpu_time_us":4892,"wal-append.run_wall_time_us":2406565}
W20260812 19:23:30.732244  6298 leader_election.cc:334] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 2.101s (SENT)
I20260812 19:23:30.712306 12131 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:30.743938  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:30.744180  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1907) took 1095 ms. Trace:
I20260812 19:23:30.747076  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1896) took 1050 ms. Trace:
I20260812 19:23:30.747356  6464 rpcz_store.cc:276] 0812 19:23:29.648785 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.714585 (+1065800us) service_pool.cc:227] Handling call
0812 19:23:30.744119 (+ 29534us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.747457  6241 rpcz_store.cc:276] 0812 19:23:29.696809 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.693900 (+997091us) service_pool.cc:227] Handling call
0812 19:23:30.747011 (+ 53111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.744071  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:30.748939  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:30.751066  6298 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:30.754937  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1902) took 1040 ms. Trace:
I20260812 19:23:30.755456  6236 rpcz_store.cc:276] 0812 19:23:29.708073 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.698544 (+990471us) service_pool.cc:227] Handling call
0812 19:23:30.748702 (+ 50158us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:30.756585  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 59875.6us
I20260812 19:23:30.758122  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:30.742267 12027 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:30.753180  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:30.747452  6224 raft_consensus.cc:2396] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260812 19:23:30.753724  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44329us
I20260812 19:23:30.761493  6238 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
W20260812 19:23:30.762992  6359 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.013s	sys 0.024s
I20260812 19:23:30.762873  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1899) took 1065 ms. Trace:
W20260812 19:23:30.763367  6359 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.013s	sys 0.024s
I20260812 19:23:30.763499  6224 rpcz_store.cc:276] 0812 19:23:29.697855 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.702497 (+1004642us) service_pool.cc:227] Handling call
0812 19:23:30.762813 (+ 60316us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.767227  6481 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:30.767446  6470 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:30.768204  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1913) took 1090 ms. Trace:
I20260812 19:23:30.768622  6470 rpcz_store.cc:276] 0812 19:23:29.677610 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.719294 (+1041684us) service_pool.cc:227] Handling call
0812 19:23:30.768133 (+ 48839us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.715950 12107 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:30.770406  6242 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:30.768618  6230 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
W20260812 19:23:30.770949  6230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1891) took 2456 ms (client timeout 3258 ms). Trace:
I20260812 19:23:30.751956 12131 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
W20260812 19:23:30.771690  6230 rpcz_store.cc:269] 0812 19:23:28.314810 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.702756 (+2387946us) service_pool.cc:227] Handling call
0812 19:23:30.770866 (+ 68110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2304}
I20260812 19:23:30.774120  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1900) took 1076 ms. Trace:
I20260812 19:23:30.774741  6242 rpcz_store.cc:276] 0812 19:23:29.707330 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.725708 (+1018378us) service_pool.cc:227] Handling call
0812 19:23:30.774044 (+ 48336us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.771108  6465 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 4.
I20260812 19:23:30.776119  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1905) took 1128 ms. Trace:
I20260812 19:23:30.776537  6465 rpcz_store.cc:276] 0812 19:23:29.647977 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.713641 (+1065664us) service_pool.cc:227] Handling call
0812 19:23:30.776042 (+ 62401us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.777802 12045 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:30.780844 12045 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:30.783773  6474 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:30.750799 11816 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:30.784361  6464 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260812 19:23:30.785545  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1903) took 1077 ms. Trace:
I20260812 19:23:30.786682  6232 rpcz_store.cc:276] 0812 19:23:29.708393 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.727598 (+1019205us) service_pool.cc:227] Handling call
0812 19:23:30.785481 (+ 57883us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.787286  6228 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 9: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:30.787757  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1895) took 1091 ms. Trace:
I20260812 19:23:30.788128  6228 rpcz_store.cc:276] 0812 19:23:29.696489 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.689906 (+993417us) service_pool.cc:227] Handling call
0812 19:23:30.787687 (+ 97781us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.792582  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1896) took 1910 ms. Trace:
I20260812 19:23:30.793170  6474 rpcz_store.cc:276] 0812 19:23:28.879582 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.751604 (+1872022us) service_pool.cc:227] Handling call
0812 19:23:30.770418 (+ 18814us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:30.790065 (+ 19647us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:30.790323 (+   258us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.794406  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1899) took 1906 ms. Trace:
I20260812 19:23:30.795370  6464 rpcz_store.cc:276] 0812 19:23:28.880959 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.752349 (+1871390us) service_pool.cc:227] Handling call
0812 19:23:30.772610 (+ 20261us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:30.786484 (+ 13874us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:30.786892 (+   408us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.759325 12027 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:30.795320  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:30.799644  7598 raft_consensus.cc:2379] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
W20260812 19:23:30.784286  6179 connection.cc:232] RPC call timeout handler was delayed by -1.3513238141313195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
I20260812 19:23:30.770913 12042 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:30.781973 12045 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:30.805341  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 979807us
I20260812 19:23:30.785291 12149 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:30.782563 11918 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:30.813091  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1878) took 3078 ms. Trace:
I20260812 19:23:30.813537  6242 rpcz_store.cc:276] 0812 19:23:27.730378 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.775600 (+3045222us) service_pool.cc:227] Handling call
0812 19:23:30.808556 (+ 32956us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:30.808737 (+   181us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:30.808762 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:30.808794 (+    32us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:30.808826 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:30.808881 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:30.808951 (+    70us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.795642 11816 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:30.809368  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:30.816071  6241 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260812 19:23:30.819059  6228 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:30.820011  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1877) took 3093 ms. Trace:
I20260812 19:23:30.820093  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1881) took 3060 ms. Trace:
I20260812 19:23:30.820477  6230 rpcz_store.cc:276] 0812 19:23:27.726510 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.774126 (+3047616us) service_pool.cc:227] Handling call
0812 19:23:30.807576 (+ 33450us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:30.819693 (+ 12117us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:30.819721 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:30.819762 (+    41us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:30.819790 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:30.819849 (+    59us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:30.819954 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.820639  6228 rpcz_store.cc:276] 0812 19:23:27.760047 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.788860 (+3028813us) service_pool.cc:227] Handling call
0812 19:23:30.817266 (+ 28406us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:30.819764 (+  2498us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:30.820000 (+   236us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.827889  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1873) took 3091 ms. Trace:
I20260812 19:23:30.829273  6241 rpcz_store.cc:276] 0812 19:23:27.725081 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.748549 (+3023468us) service_pool.cc:227] Handling call
0812 19:23:30.798563 (+ 50014us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:30.816535 (+ 17972us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:30.816702 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:30.831537  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 53097.1us
I20260812 19:23:30.833671  6232 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:30.834558  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1879) took 3103 ms. Trace:
I20260812 19:23:30.835011  6232 rpcz_store.cc:276] 0812 19:23:27.731702 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.787389 (+3055687us) service_pool.cc:227] Handling call
0812 19:23:30.827422 (+ 40033us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:30.834221 (+  6799us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:30.834491 (+   270us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.840421  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:30.841830  6179 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:30.842368 12107 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:30.838195 11938 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:30.845484  6354 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:30.819037 11816 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:23:30.847345  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 115181us
I20260812 19:23:30.836899 12149 raft_consensus.cc:2741] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260812 19:23:30.851291  6232 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:30.852322 12122 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:30.846151  6354 raft_consensus.cc:595] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:30.854444  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1904) took 1114 ms. Trace:
I20260812 19:23:30.854791  6232 rpcz_store.cc:276] 0812 19:23:29.740362 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.835958 (+1095596us) service_pool.cc:227] Handling call
0812 19:23:30.848494 (+ 12536us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:30.851577 (+  3083us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:30.854396 (+  2819us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.857218  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:30.847518 11907 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:30.840204 12042 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:30.864295  6241 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:30.864950  6242 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:30.849470 11816 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:30.860049  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:30.869772 12016 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:30.866098  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1897) took 1169 ms. Trace:
W20260812 19:23:30.868575  6235 consensus_meta.cc:287] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.090s	user 0.011s	sys 0.000s
I20260812 19:23:30.868584  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1898) took 1171 ms. Trace:
I20260812 19:23:30.868750  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1886) took 3067 ms. Trace:
I20260812 19:23:30.870558  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1585) took 6122 ms. Trace:
I20260812 19:23:30.871366  6241 rpcz_store.cc:276] 0812 19:23:29.697529 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.829802 (+1132273us) service_pool.cc:227] Handling call
0812 19:23:30.846733 (+ 16931us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:30.868330 (+ 21597us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:30.868532 (+   202us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.871556  6242 rpcz_store.cc:276] 0812 19:23:27.801836 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.814694 (+3012858us) service_pool.cc:227] Handling call
0812 19:23:30.849916 (+ 35222us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:30.868572 (+ 18656us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:30.868710 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.874387 11938 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:30.867719  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260812 19:23:30.871205  6228 rpcz_store.cc:276] 0812 19:23:29.697144 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.829089 (+1131945us) service_pool.cc:227] Handling call
0812 19:23:30.850206 (+ 21117us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:30.865765 (+ 15559us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:30.865789 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:30.865839 (+    50us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:30.865870 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:30.865925 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:30.866044 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.871361  6235 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
W20260812 19:23:30.880743  6235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 372) took 3135 ms (client timeout 2231 ms). Trace:
W20260812 19:23:30.881199  6235 rpcz_store.cc:269] 0812 19:23:27.745665 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:29.709340 (+1963675us) service_pool.cc:227] Handling call
0812 19:23:30.880633 (+1171293us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.888489  6481 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:30.883663  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:30.891155  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:23:30.892125  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:30.895051  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1909) took 1213 ms. Trace:
I20260812 19:23:30.895480  6481 rpcz_store.cc:276] 0812 19:23:29.675488 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.713552 (+1038064us) service_pool.cc:227] Handling call
0812 19:23:30.888888 (+175336us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.899278  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:30.902705  6238 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:30.908855  6229 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:30.882632 12102 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:30.913014  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1894) took 1211 ms. Trace:
I20260812 19:23:30.912858  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1901) took 1202 ms. Trace:
I20260812 19:23:30.913657  6238 rpcz_store.cc:276] 0812 19:23:29.696148 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.720948 (+1024800us) service_pool.cc:227] Handling call
0812 19:23:30.907411 (+186463us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.913811  6229 rpcz_store.cc:276] 0812 19:23:29.707737 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.695230 (+987493us) service_pool.cc:227] Handling call
0812 19:23:30.910040 (+214810us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.871831  6482 rpcz_store.cc:276] 0812 19:23:24.748464 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:24.748581 (+   117us) service_pool.cc:227] Handling call
0812 19:23:24.748910 (+   329us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:24.955594 (+206684us) raft_consensus.cc:1520] Early marking committed up to index 3
0812 19:23:25.011835 (+ 56241us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4800110358. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fc61f7f1 00007f98fc6168e7 00007f98fc61677a 00007f98fc70a95f 00007f98fc70a627 00007f98fc71eb2c 00007f98fc71ead8 00007f98fc71ea58 00007f98fc71ea13 00007f98fc71dcbc 00007f98fb69fbe6
0812 19:23:25.102762 (+ 90927us) log.cc:842] Serialized 14 byte log entry
0812 19:23:25.265712 (+162950us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:25.316597 (+ 50885us) log.cc:842] Serialized 26 byte log entry
0812 19:23:25.316751 (+   154us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:25.316978 (+   227us) log.cc:842] Serialized 14 byte log entry
0812 19:23:25.441680 (+124702us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:25.441794 (+   114us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:29.482182 (+4040388us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b18003b3980. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:23:29.563853 (+ 81671us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:30.867978 (+1304125us) raft_consensus.cc:1671] finished
0812 19:23:30.868003 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:30.870383 (+  2380us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":390502,"prepare.queue_time_us":484913,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":102,"raft.queue_time_us":217925,"raft.run_cpu_time_us":2430,"raft.run_wall_time_us":465454,"spinlock_wait_cycles":130791808,"thread_start_us":406839,"threads_started":3,"wal-append.queue_time_us":583328}
I20260812 19:23:30.895150 12016 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:30.917023  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1874) took 3186 ms. Trace:
I20260812 19:23:30.920097 12042 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:30.920692 12042 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:30.920825 12102 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:30.925047 11999 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:30.925938 11999 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:30.926200  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:30.926681 11999 raft_consensus.cc:686] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:30.927561  6416 leader_election.cc:398] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8.
I20260812 19:23:30.927867  6416 leader_election.cc:401] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260812 19:23:30.943434 11918 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:30.928171 11999 consensus_queue.cc:237] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:30.943979 11918 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:30.945216 11918 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:30.947026 12027 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:30.918428  6236 rpcz_store.cc:276] 0812 19:23:27.725680 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.756308 (+3030628us) service_pool.cc:227] Handling call
0812 19:23:30.780916 (+ 24608us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:30.781423 (+   507us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:30.781463 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:30.782009 (+   546us) log.cc:842] Serialized 26 byte log entry
0812 19:23:30.810716 (+ 28707us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:30.810752 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:30.810997 (+   245us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:30.912369 (+101372us) raft_consensus.cc:1671] finished
0812 19:23:30.912392 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:30.912494 (+   102us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":8862,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":4724,"thread_start_us":28295,"threads_started":1,"wal-append.queue_time_us":85061}
W20260812 19:23:30.951267 12214 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260812 19:23:30.955049 12149 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:30.958325 11855 consensus_meta.cc:287] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.239s	user 0.012s	sys 0.003s
I20260812 19:23:30.960096  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:30.969475 11887 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:30.970257  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:30.971292  6349 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
W20260812 19:23:30.972141  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 53212.2us
I20260812 19:23:30.924218  6477 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:31.000946  6464 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:31.001454  6477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1911) took 1324 ms (client timeout 1765 ms). Trace:
W20260812 19:23:31.001843  6477 rpcz_store.cc:269] 0812 19:23:29.676626 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.622192 (+945566us) service_pool.cc:227] Handling call
0812 19:23:31.001394 (+379202us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:30.921167 12042 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
W20260812 19:23:31.003063  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 103960us
I20260812 19:23:30.969930 11816 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.002817  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:30.966403 12149 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8.
I20260812 19:23:31.004853  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:31.006788  6344 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260812 19:23:31.007074 12035 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:30.918355 12016 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:31.015061  6474 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:31.022778  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:30.971809 12131 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.012177  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:31.010542 11918 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.024853  6465 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:31.011674  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:31.012550  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:30.921248 12102 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:31.005568 11887 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.019394  6344 pending_rounds.cc:76] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 3
I20260812 19:23:31.031888 12102 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:31.032184  6344 pending_rounds.cc:97] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260812 19:23:31.032541  6344 raft_consensus.cc:2866] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:31.033995  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1622) took 4094 ms. Trace:
I20260812 19:23:31.034921 11851 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:31.024194 12016 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:31.025278 12035 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.031227  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:31.039549 11851 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.040853  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:31.041519  6481 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:31.042572 11851 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:31.044135  6483 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:31.045186  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1889) took 2435 ms. Trace:
I20260812 19:23:31.045511  6483 rpcz_store.cc:276] 0812 19:23:28.609395 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.958196 (+348801us) service_pool.cc:227] Handling call
0812 19:23:31.045017 (+2086821us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b54001045d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:31.045108 (+    91us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4793378560}
I20260812 19:23:31.045786 11887 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:31.041538 12035 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:31.028450 11816 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:31.034405  6344 rpcz_store.cc:276] 0812 19:23:26.939974 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.917399 (+1977425us) service_pool.cc:227] Handling call
0812 19:23:28.917959 (+   560us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:31.033056 (+2115097us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:31.033683 (+   627us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b54004088d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:31.033895 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4802741632}
I20260812 19:23:31.046757  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:31.054590  6483 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:31.042543  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:31.050591  6349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1885) took 3770 ms (client timeout 2123 ms). Trace:
W20260812 19:23:31.050803 12228 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260812 19:23:31.051824  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:31.052374  6477 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:31.055052  6475 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 9: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:31.055433  6481 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:31.055786  6474 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
W20260812 19:23:31.055366  6349 rpcz_store.cc:269] 0812 19:23:27.254794 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:27.709278 (+454484us) service_pool.cc:227] Handling call
0812 19:23:31.016410 (+3307132us) spinlock_profiling.cc:243] Waited 3.2 s on lock 0x7b54001b9254. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:31.025539 (+  9129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7353729408}
I20260812 19:23:31.060011  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1906) took 1411 ms. Trace:
I20260812 19:23:31.060319  6475 rpcz_store.cc:276] 0812 19:23:29.648423 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.737824 (+1089401us) service_pool.cc:227] Handling call
0812 19:23:31.059862 (+322038us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400213ed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:31.059964 (+   102us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":727095040}
I20260812 19:23:31.051846 11918 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:31.065507  6465 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:31.074505  6464 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:31.078370  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:31.079226  6483 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:31.079581 12131 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:31.082643 12016 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.084947 12102 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.084861 12016 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:31.088675  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:31.093156  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:31.090372  6464 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 5.
I20260812 19:23:31.097199  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:31.094836 12102 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:31.103811  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:31.104030  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:31.104535  6483 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:31.104681  6464 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
W20260812 19:23:31.105984  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 1.57924e+06us
I20260812 19:23:31.109022  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:31.109967  6465 raft_consensus.cc:2354] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:31.113895  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:31.115895  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:31.116612 12035 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:23:31.116883 12016 consensus_queue.cc:1046] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:23:31.117969 12016 raft_consensus.cc:3032] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Stepping down as leader of term 9
W20260812 19:23:31.118468  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 1.37553e+06us
I20260812 19:23:31.119144  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:31.120733  6465 raft_consensus.cc:2396] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260812 19:23:31.118074 12234 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:31.145756  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:31.155319  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 311827us
I20260812 19:23:31.157263  6179 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:31.118387 12016 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:31.164857  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:31.165757  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1875) took 3437 ms. Trace:
I20260812 19:23:31.161751 11851 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:31.171445  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:31.167927  6224 rpcz_store.cc:276] 0812 19:23:27.725993 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.764025 (+3038032us) service_pool.cc:227] Handling call
0812 19:23:30.782784 (+ 18759us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:30.783094 (+   310us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:23:30.847134 (+ 64040us) log.cc:842] Serialized 14 byte log entry
0812 19:23:31.162691 (+315557us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:31.162761 (+    70us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:31.162818 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:31.162935 (+   117us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:31.163073 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8683,"prepare.queue_time_us":126146,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":9932,"thread_start_us":332849,"threads_started":2,"wal-append.queue_time_us":287190}
I20260812 19:23:31.175379  6464 raft_consensus.cc:2396] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260812 19:23:31.180919  6464 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260812 19:23:31.181315  6464 pending_rounds.cc:76] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 4
I20260812 19:23:31.181536  6464 pending_rounds.cc:97] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260812 19:23:31.181777  6464 raft_consensus.cc:2866] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:31.161835 12102 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260812 19:23:31.186685  6417 connection.cc:232] RPC call timeout handler was delayed by -1.4292448840569705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
I20260812 19:23:31.186900  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1649) took 2368 ms. Trace:
I20260812 19:23:31.187276  6359 rpcz_store.cc:276] 0812 19:23:28.818369 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:29.713502 (+895133us) service_pool.cc:227] Handling call
0812 19:23:29.713813 (+   311us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:29.714282 (+   469us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:23:29.867268 (+152986us) log.cc:842] Serialized 14 byte log entry
0812 19:23:31.186315 (+1319047us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:31.186381 (+    66us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:31.186635 (+   254us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:31.186728 (+    93us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:31.186846 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17647,"prepare.queue_time_us":896191,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":63641,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":21877,"thread_start_us":1396198,"threads_started":3,"wal-append.queue_time_us":944160}
I20260812 19:23:31.179427 11851 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:23:31.197180 12231 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260812 19:23:31.189406 11999 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:31.203804 12035 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:31.194473 11851 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:31.205796  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1897) took 2325 ms. Trace:
I20260812 19:23:31.229657  6473 rpcz_store.cc:276] 0812 19:23:28.880030 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.751099 (+1871069us) service_pool.cc:227] Handling call
0812 19:23:30.770275 (+ 19176us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:30.805611 (+ 35336us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:30.805642 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:30.817778 (+ 12136us) log.cc:842] Serialized 26 byte log entry
0812 19:23:31.163985 (+346207us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:31.164060 (+    75us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:31.164153 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:31.205463 (+ 41310us) raft_consensus.cc:1671] finished
0812 19:23:31.205492 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:31.205707 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":35335,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":8578,"thread_start_us":326290,"threads_started":2,"wal-append.queue_time_us":346130}
I20260812 19:23:31.207775  6483 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:31.206530 12016 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.204862  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:31.185806 12102 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:31.197193  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:31.197685 12227 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260812 19:23:31.221644  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 57744.4us
I20260812 19:23:31.242322 12102 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:31.245226 12016 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:23:31.248515  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 51546.2us
I20260812 19:23:31.250097  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:31.222962 11999 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:31.251022 11999 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:31.252627 11907 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:31.253038 11907 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:31.253358 11907 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:31.242166 12227 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:31.257310 12227 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:23:31.264153  6417 leader_election.cc:334] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 2.142s (SENT)
I20260812 19:23:31.265178 12035 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:31.265648 12035 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:31.266681 12035 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.268719 12035 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:31.271225  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:31.270799  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:31.270470 11851 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.275492  6473 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260812 19:23:31.281145  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1647) took 2464 ms. Trace:
I20260812 19:23:31.286537  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:31.275884  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:31.308508  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1890) took 2994 ms. Trace:
W20260812 19:23:31.292061  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 87303us
I20260812 19:23:31.291975 12235 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:31.274626  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:31.275625  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:31.300668  6350 rpcz_store.cc:276] 0812 19:23:28.817137 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:29.712140 (+895003us) service_pool.cc:227] Handling call
0812 19:23:29.712959 (+   819us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:30.780281 (+1067322us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:23:30.780830 (+   549us) log.cc:842] Serialized 14 byte log entry
0812 19:23:30.810918 (+ 30088us) log.cc:842] Serialized 14 byte log entry
0812 19:23:30.923550 (+112632us) spinlock_profiling.cc:243] Waited 897 us on lock 0x7b18003d7f80. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:23:31.154936 (+231386us) log.cc:842] Serialized 14 byte log entry
0812 19:23:31.162847 (+  7911us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:31.162917 (+    70us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:31.162956 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:31.280929 (+117973us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001ba154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:31.280978 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:31.281091 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7609,"prepare.queue_time_us":7279,"prepare.run_cpu_time_us":154,"prepare.run_wall_time_us":157,"raft.queue_time_us":85280,"raft.run_cpu_time_us":550,"raft.run_wall_time_us":48356,"spinlock_wait_cycles":2398624256,"thread_start_us":367961,"threads_started":2,"wal-append.queue_time_us":57967}
I20260812 19:23:31.315341 12234 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:31.315380 12045 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:31.315675 12233 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:31.316007 12234 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:31.316537 12234 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:31.316673  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:31.290541 11907 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.318709  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:31.284442 12042 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.311327 12235 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:31.319725 12235 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:31.285846 12227 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.321295 12042 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:31.322296 12227 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:31.319051 11907 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:31.314980  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:31.330687 12131 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:31.331194 12131 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:31.331629 12131 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:31.331218  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:31.308986  6230 rpcz_store.cc:276] 0812 19:23:28.314450 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:30.828895 (+2514445us) service_pool.cc:227] Handling call
0812 19:23:30.854297 (+ 25402us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:30.864124 (+  9827us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:23:30.910172 (+ 46048us) log.cc:842] Serialized 14 byte log entry
0812 19:23:31.190283 (+280111us) log.cc:842] Serialized 14 byte log entry
0812 19:23:31.282859 (+ 92576us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b18001941a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:23:31.307074 (+ 24215us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:31.307132 (+    58us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:31.307180 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:31.307397 (+   217us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:31.308459 (+  1062us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":46448,"prepare.queue_time_us":138006,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":73575,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":10860,"spinlock_wait_cycles":3889920,"thread_start_us":331974,"threads_started":3,"wal-append.queue_time_us":259044}
I20260812 19:23:31.288964 11851 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:31.338109  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 125506us
I20260812 19:23:31.339994 12218 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:31.338253 11907 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:31.341428 11907 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:31.341806 11907 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:31.341981 12045 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:31.338090 12042 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:31.343093 12042 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:31.343451 12042 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:31.343887 12234 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.345649 12234 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:31.285755 12251 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260812 19:23:31.352474  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 66089.2us
I20260812 19:23:31.347183 12254 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:31.290450 12102 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.353056  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.354944  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:31.340552 12233 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:31.360401  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:31.359583  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:31.362707  7597 raft_consensus.cc:2379] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:31.354506 12254 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:31.364437 12254 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:31.368000  6060 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 114) took 1837 ms. Trace:
I20260812 19:23:31.372535  6058 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 237) took 6964 ms. Trace:
I20260812 19:23:31.374639  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:31.375375 12233 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:31.372938  6058 rpcz_store.cc:276] 0812 19:23:24.408000 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:24.408217 (+   217us) service_pool.cc:227] Handling call
0812 19:23:31.372474 (+6964257us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:31.022121 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:31.031149 (+  9028us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:31.031182 (+    33us) write_op.cc:435] Acquired schema lock
0812 19:23:31.031199 (+    17us) tablet.cc:660] Decoding operations
0812 19:23:31.031502 (+   303us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:31.031545 (+    43us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:31.031569 (+    24us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:23:31.031759 (+   190us) tablet.cc:699] Row locks acquired
0812 19:23:31.031776 (+    17us) write_op.cc:260] PREPARE: finished
0812 19:23:31.031924 (+   148us) write_op.cc:270] Start()
0812 19:23:31.032023 (+    99us) write_op.cc:276] Timestamp: P: 1786562611031872 usec, L: 0
0812 19:23:31.032042 (+    19us) op_driver.cc:331] REPLICATION: starting
0812 19:23:31.032621 (+   579us) log.cc:842] Serialized 535 byte log entry
0812 19:23:31.336581 (+303960us) op_driver.cc:444] REPLICATION: finished
0812 19:23:31.365073 (+ 28492us) write_op.cc:301] APPLY: starting
0812 19:23:31.365155 (+    82us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:31.365250 (+    95us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:31.365356 (+   106us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:31.365589 (+   233us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:31.365768 (+   179us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:23:31.365811 (+    43us) write_op.cc:312] APPLY: finished
0812 19:23:31.365972 (+   161us) log.cc:842] Serialized 23 byte log entry
0812 19:23:31.366095 (+   123us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:31.366172 (+    77us) write_op.cc:454] Released schema lock
0812 19:23:31.366201 (+    29us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":4706318,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":26858,"num_ops":1,"prepare.queue_time_us":264250,"prepare.run_cpu_time_us":2333,"prepare.run_wall_time_us":26838,"replication_time_us":295492,"threads_started":1}]]}
I20260812 19:23:31.376366 12233 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.380679 12045 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:31.380426 11999 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.382095  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:31.382997 12218 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:31.383376 12218 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:31.383700 12218 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:31.384887 11999 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:31.389556  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 114009us
I20260812 19:23:31.368404  6060 rpcz_store.cc:276] 0812 19:23:29.530811 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:29.531665 (+   854us) service_pool.cc:227] Handling call
0812 19:23:31.367905 (+1836240us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:30.871407 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:30.899235 (+ 27828us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:30.899292 (+    57us) write_op.cc:435] Acquired schema lock
0812 19:23:30.899305 (+    13us) tablet.cc:660] Decoding operations
0812 19:23:30.899722 (+   417us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:30.899814 (+    92us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:30.899849 (+    35us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:23:30.900189 (+   340us) tablet.cc:699] Row locks acquired
0812 19:23:30.900231 (+    42us) write_op.cc:260] PREPARE: finished
0812 19:23:30.900437 (+   206us) write_op.cc:270] Start()
0812 19:23:30.900583 (+   146us) write_op.cc:276] Timestamp: P: 1786562610900364 usec, L: 0
0812 19:23:30.900613 (+    30us) op_driver.cc:331] REPLICATION: starting
0812 19:23:30.901305 (+   692us) log.cc:842] Serialized 530 byte log entry
0812 19:23:31.098784 (+197479us) op_driver.cc:444] REPLICATION: finished
0812 19:23:31.332788 (+234004us) write_op.cc:301] APPLY: starting
0812 19:23:31.332900 (+   112us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:31.333031 (+   131us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:31.333164 (+   133us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:31.333493 (+   329us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:31.333784 (+   291us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:23:31.333834 (+    50us) write_op.cc:312] APPLY: finished
0812 19:23:31.363952 (+ 30118us) log.cc:842] Serialized 23 byte log entry
0812 19:23:31.364164 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:31.364248 (+    84us) write_op.cc:454] Released schema lock
0812 19:23:31.364302 (+    54us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:31.364632 (+   330us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:31.364661 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":133620,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":215783,"apply.run_cpu_time_us":2755,"apply.run_wall_time_us":32165,"num_ops":1,"prepare.queue_time_us":135662,"prepare.run_cpu_time_us":10128,"prepare.run_wall_time_us":67736,"raft.queue_time_us":220991,"raft.run_cpu_time_us":14699,"raft.run_wall_time_us":153170,"replication_time_us":195112,"thread_start_us":244105,"threads_started":4,"wal-append.queue_time_us":9878}]]}
I20260812 19:23:31.387843 11851 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:31.390980 12035 raft_consensus.cc:2741] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260812 19:23:31.399219  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:31.399554  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:31.405872  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:31.400321 11851 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:31.411145 12233 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:31.411643 12233 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:31.412124 12233 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:31.413038  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:31.414384 12016 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 19:23:31.415329 12016 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:31.417140 12016 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:31.417876 12042 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.419349  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:31.419958 12042 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:31.420099 12045 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:31.420663 12233 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.413925  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:31.409523 12035 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:31.423573 12233 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:31.424397 11918 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:23:31.422277 12035 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:31.425379 12035 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:31.425585 11918 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:31.425997 11918 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:31.431994 11816 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:31.426880 11918 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.408892 11851 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:31.432406 11816 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:31.432988 11918 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:31.433301 11816 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.428774  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:31.404547 12259 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:31.439864  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:31.441145 11855 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:31.441381 12251 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:31.441809 11855 raft_consensus.cc:686] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:31.442276 12251 raft_consensus.cc:686] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:31.442870 11855 consensus_queue.cc:237] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.434597 11816 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:31.446305 12045 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:31.446962 12045 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:31.447459 12045 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:31.443711 12259 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:31.453343 12259 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:31.454932 12102 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:31.428558 12016 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:31.457422 12016 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.418498 12131 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.458789 12251 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.460492 12131 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:31.452764  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:31.457921  6060 catalog_manager.cc:5495] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:31.463285  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.465330  6060 catalog_manager.cc:5495] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:31.470841  6060 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:31.474485  6060 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:31.435348 12218 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.476040  6060 catalog_manager.cc:5495] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:31.477661  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.472564 11999 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:31.494380  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:31.471802 11907 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.495862  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:31.496665  7598 raft_consensus.cc:2354] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
I20260812 19:23:31.497323 11907 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:31.499447  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:31.500027  6055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38512 (request call id 230) took 3927 ms. Trace:
I20260812 19:23:31.501065  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.504029  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.502161  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.502553  7591 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:31.503021  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.503185  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.503314  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.503952  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:31.501845  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.502419  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:31.503994  6055 rpcz_store.cc:276] 0812 19:23:27.572313 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:28.886085 (+1313772us) service_pool.cc:227] Handling call
0812 19:23:31.499943 (+2613858us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:31.033057 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:31.033493 (+   436us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:31.033520 (+    27us) write_op.cc:435] Acquired schema lock
0812 19:23:31.033538 (+    18us) tablet.cc:660] Decoding operations
0812 19:23:31.034098 (+   560us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:31.034155 (+    57us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:31.034186 (+    31us) tablet.cc:683] Acquiring locks for 3 operations
0812 19:23:31.034546 (+   360us) tablet.cc:699] Row locks acquired
0812 19:23:31.034570 (+    24us) write_op.cc:260] PREPARE: finished
0812 19:23:31.052856 (+ 18286us) write_op.cc:270] Start()
0812 19:23:31.056260 (+  3404us) write_op.cc:276] Timestamp: P: 1786562611049133 usec, L: 0
0812 19:23:31.058142 (+  1882us) op_driver.cc:331] REPLICATION: starting
0812 19:23:31.082107 (+ 23965us) log.cc:842] Serialized 1295 byte log entry
0812 19:23:31.407780 (+325673us) op_driver.cc:444] REPLICATION: finished
0812 19:23:31.442610 (+ 34830us) write_op.cc:301] APPLY: starting
0812 19:23:31.442733 (+   123us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:31.442888 (+   155us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:31.443061 (+   173us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:31.451049 (+  7988us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:31.451272 (+   223us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0812 19:23:31.451323 (+    51us) write_op.cc:312] APPLY: finished
0812 19:23:31.475803 (+ 24480us) log.cc:842] Serialized 35 byte log entry
0812 19:23:31.481605 (+  5802us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:31.491515 (+  9910us) write_op.cc:454] Released schema lock
0812 19:23:31.492713 (+  1198us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:31.495554 (+  2841us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:31.495588 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":511040,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":16953,"apply.run_cpu_time_us":3436,"apply.run_wall_time_us":60205,"num_ops":3,"prepare.queue_time_us":301420,"prepare.run_cpu_time_us":3526,"prepare.run_wall_time_us":49363,"replication_time_us":346692}]]}
I20260812 19:23:31.510239  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.510581  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.511006  7594 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:31.511956 11816 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:31.515249  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.515489  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:31.516621  7593 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 9
I20260812 19:23:31.518637 11907 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:31.520035 11907 raft_consensus.cc:686] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:31.521065 11907 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.521860 11999 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:23:31.518754 12213 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:31.523422 12237 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:31.523510 12213 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:31.524070 12213 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:31.530007  7593 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:31.531083  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.531543  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.531111  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.531725  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:31.532415  6178 connection.cc:232] RPC call timeout handler was delayed by -3.2055587510112673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260812 19:23:31.532845  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:31.537140  6178 connection.cc:232] RPC call timeout handler was delayed by -3.1632587509229779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
I20260812 19:23:31.506690 12235 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.535322  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:31.537647  6178 connection.cc:232] RPC call timeout handler was delayed by -3.0318587510846555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
I20260812 19:23:31.538960  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.540472  6345 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:23:31.540295  6178 connection.cc:232] RPC call timeout handler was delayed by -2.9058587509207428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260812 19:23:31.541882  6350 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:31.540742  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.542124  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.543152  6344 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:31.543705  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.543942  6352 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:31.547024  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.547413 11851 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.549207  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.549904  6350 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:31.550904  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.551113  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.551604  6359 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:31.552254  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.552685  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:31.553161  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:31.559384  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.560016  6342 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:31.535377 12218 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:31.563099  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.563830  6347 raft_consensus.cc:2354] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:31.565446  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.565961  6347 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:31.505667 12035 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.571720  6359 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:31.547842  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.578218  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:31.578583  6350 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:31.579067  6230 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:31.581756 12035 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:31.582006  6359 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260812 19:23:31.582607  6345 raft_consensus.cc:2379] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:31.583328 11816 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:31.583005 12254 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.585925  6353 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:31.600823  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:31.601745  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:31.610102  6230 raft_consensus.cc:2362] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7. Re-sending same reply.
W20260812 19:23:31.602735  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 87340.3us
I20260812 19:23:31.603960  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:31.602978  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:31.605589  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.604753  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:31.607007  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:31.612800  6242 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:31.550426 11851 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:31.607831  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:31.608187  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.610380  6224 raft_consensus.cc:2379] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:31.606467  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:31.612258  6359 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:31.607161  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:31.615340  6236 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:31.615427  6483 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:31.587380  6347 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:31.627055  6345 raft_consensus.cc:2354] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9.
I20260812 19:23:31.594358 12254 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:31.629594  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.629829  6344 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:31.629915  6342 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:31.631073  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.632469  6345 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260812 19:23:31.633240  6353 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:31.635113  6359 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:31.620656  6464 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:31.644240  6354 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:31.644817 12259 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.644604  6060 catalog_manager.cc:5495] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:31.645426  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.647358  6347 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:31.650511  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.651337  6342 raft_consensus.cc:2354] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9.
I20260812 19:23:31.646482  6354 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:31.652478  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:31.651340  6235 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:31.658459  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.659588  6359 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:31.611287 12213 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.662092 12235 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:31.663434  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:31.667152  6417 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 529ed979cd2842acb5bc24debb151b93. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:23:31.669162  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:31.671449  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 130093us
I20260812 19:23:31.672057  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:31.674050 12259 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:31.674732 12235 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:31.675390 12235 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:31.675904 12235 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:31.673882  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:31.679260 11851 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:31.679802 11851 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:31.680285 11851 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:31.683059 11816 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:31.683502 11816 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:31.683878 11816 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:31.685981  6235 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:31.691148  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.695911  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.696061  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.697814  6345 raft_consensus.cc:2379] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:23:31.697810  7553 connection.cc:232] RPC call timeout handler was delayed by -2.4556450820527971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
W20260812 19:23:31.698385  7553 connection.cc:232] RPC call timeout handler was delayed by -1.8436450820881873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260812 19:23:31.698737  7553 connection.cc:232] RPC call timeout handler was delayed by -1.8265450820326805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
W20260812 19:23:31.699023  7553 connection.cc:232] RPC call timeout handler was delayed by -1.8049450819380581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
I20260812 19:23:31.701923 12042 consensus_queue.cc:1046] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:23:31.703119 12042 raft_consensus.cc:3032] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:31.703228  6298 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:31.703568 12042 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:31.704473 12042 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.705835 12042 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:31.700825  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:31.706912 12035 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:31.707360 12035 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:31.707731 12035 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:31.705914 12213 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:31.714200  6178 connection.cc:232] RPC call timeout handler was delayed by -2.8131587509997189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260812 19:23:31.714558  6178 connection.cc:232] RPC call timeout handler was delayed by -2.6475587510503829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
W20260812 19:23:31.714876  6178 connection.cc:232] RPC call timeout handler was delayed by -2.6079587510321289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
W20260812 19:23:31.715092  6178 connection.cc:232] RPC call timeout handler was delayed by -2.5971587509848177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
I20260812 19:23:31.717072  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:31.717358 12247 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:23:31.718933  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:31.719549  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.720276  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.721410  6352 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:31.723363  6229 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:31.726663  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:31.727110  6230 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:31.727490  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.728128  6345 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:31.727140  6224 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:31.670485 12045 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.730815  6236 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260812 19:23:31.732323 12045 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:31.740061  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:31.740906  6229 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:31.738256  6359 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:31.742873  6229 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:31.743435  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.744443  6345 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:31.745872  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.746114  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:23:31.747901  6178 connection.cc:232] RPC call timeout handler was delayed by -2.4243587509263307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2404s for a response
I20260812 19:23:31.748615 12102 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:31.749167 12102 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.751312 12102 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:31.760607  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:31.762027  6178 connection.cc:232] RPC call timeout handler was delayed by -1.8004419137723744s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260812 19:23:31.762720  6178 connection.cc:232] RPC call timeout handler was delayed by -1.6359587509650737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.328s for a response
W20260812 19:23:31.763309  6178 connection.cc:232] RPC call timeout handler was delayed by -1.5853419138584286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
I20260812 19:23:31.763754 12251 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:31.763839  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:31.764202 12259 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:31.777591 12259 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.779837 12259 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:31.781436  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:31.767110 11851 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.783242  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:31.784008  6359 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:31.771689 11816 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:31.775488  6178 connection.cc:232] RPC call timeout handler was delayed by -1.5610419139266014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
I20260812 19:23:31.776494  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.785094  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.786139  6350 raft_consensus.cc:2379] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:23:31.786103  6178 connection.cc:232] RPC call timeout handler was delayed by -1.4386419139336795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
I20260812 19:23:31.777012 12251 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:31.768129 12235 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.769948 12035 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.776686  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:23:31.787180  6178 connection.cc:232] RPC call timeout handler was delayed by -1.3315419137943536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
I20260812 19:23:31.786816 12251 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:23:31.788578  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2775419137906283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
W20260812 19:23:31.789320  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2532419138588011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
W20260812 19:23:31.790156  6178 connection.cc:232] RPC call timeout handler was delayed by -1.202841913793236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
I20260812 19:23:31.792255  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:31.792309  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.792996  6229 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:31.793435  6359 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:31.794198  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:31.797608  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 108873us
I20260812 19:23:31.798728  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.850478  6352 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:31.851490  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.852298  6352 raft_consensus.cc:2354] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7.
I20260812 19:23:31.852408  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.853264  6349 raft_consensus.cc:2379] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:31.854389  6352 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:31.799507  6224 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:31.800918  6345 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:31.812320 12035 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:31.812415 12247 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:23:31.856563 12247 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:31.857015 12247 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:31.859539  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:31.813087  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.864473  6350 raft_consensus.cc:2379] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:31.825480  6353 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:31.827186  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.828032  6238 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260812 19:23:31.829389  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:31.868256  6242 raft_consensus.cc:2354] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7.
I20260812 19:23:31.829761  6236 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:31.826843  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.871634  6342 raft_consensus.cc:2379] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:31.876204  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:31.877368 12035 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:31.831763  6229 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:31.832398  6344 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260812 19:23:31.881063  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:31.833256  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:31.883863  6347 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:31.798709  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.885070  6359 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:31.887988  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.837679  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:31.888782  6359 raft_consensus.cc:2379] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 5: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:31.819981 11816 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:31.891040  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:31.892153  6229 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:31.816694  6055 catalog_manager.cc:5495] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 8 to 9, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 9 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:31.893025  6055 catalog_manager.cc:5495] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 7 to 8, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 8 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:31.894254  6055 catalog_manager.cc:5495] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:31.895401  6055 catalog_manager.cc:5495] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 7 to 8, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 8 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:31.897490  6055 catalog_manager.cc:5495] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 6 to 8, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 8 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:31.827941 12235 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:31.902045  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:31.901593  6055 catalog_manager.cc:5495] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 5 to 6, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 6 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:31.831267 11851 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:31.903882  6055 catalog_manager.cc:5495] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 6 to 8, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 8 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:31.891780 12042 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:31.906108  6359 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:31.906713  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:31.908775  6344 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:31.810113 12251 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.910730  7597 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:31.911826 12251 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:31.912833 12251 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:23:31.914708 12251 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:23:31.896318 12035 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:31.918147  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:31.918087  6347 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:31.921988  6416 leader_election.cc:398] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9.
I20260812 19:23:31.922504  6416 leader_election.cc:401] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:23:31.922312 11918 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:23:31.923460 12131 consensus_queue.cc:1046] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:23:31.924844 12131 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 9
I20260812 19:23:31.927177 12149 raft_consensus.cc:3032] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:31.927675 12149 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:31.927923 12235 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:31.928785 12235 consensus_queue.cc:1225] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:23:31.929456 11816 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:31.928987 12149 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.929833 11816 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:31.932237 11816 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.934419 12213 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:31.935545 12274 raft_consensus.cc:3032] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:31.932587 12149 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:31.941617 12260 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:31.937976  6416 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:31.945308 12102 consensus_queue.cc:1046] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 19:23:31.946899 11887 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:31.947378 11887 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:31.947817 11887 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:31.948254 12259 raft_consensus.cc:3032] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:31.948653 12259 raft_consensus.cc:729] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:31.949780 12045 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:31.907929 11851 raft_consensus.cc:2741] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260812 19:23:31.950335 12045 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.949445 12259 consensus_queue.cc:260] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:31.940317 11816 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:31.935920 12274 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:31.956717 12274 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.958143 12274 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:31.960273 12045 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:31.960980 11851 consensus_queue.cc:1046] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:31.961854 11851 consensus_queue.cc:1225] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:23:31.962437 11851 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:31.962859 11851 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:31.963915 11851 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.982105  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:31.983155  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:31.976481 12035 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:31.983357 12045 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:31.983830 12045 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:31.984052 12035 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:31.984264 12045 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:31.984488 12035 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:31.985440 12035 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:31.987018 12035 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:31.991225 12259 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:31.993127 12045 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:31.977396 12213 consensus_queue.cc:1046] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260812 19:23:31.995713 12045 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:31.996214 12213 raft_consensus.cc:3032] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:31.996762 12213 raft_consensus.cc:729] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:32.011713 11887 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:32.037168  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 54073.9us
I20260812 19:23:32.038512  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:31.997788 12213 consensus_queue.cc:260] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:32.275915  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 438288us
W20260812 19:23:32.273090  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 257983us
W20260812 19:23:32.273737  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 235294us
I20260812 19:23:32.288344  6416 leader_election.cc:398] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7.
I20260812 19:23:32.288705  6416 leader_election.cc:401] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260812 19:23:32.299204  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:32.300335 12218 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:32.287523 11918 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:32.306466  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:32.308871 12213 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:32.294749 11851 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:32.316234 12218 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7.
I20260812 19:23:32.319552 11887 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:32.294430 12045 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:32.332305 12045 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:32.333768 12045 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:32.274875 12247 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:32.338006 12247 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:32.338973  7597 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:32.327443 12289 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:32.343158 12289 raft_consensus.cc:686] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:32.344599 12289 consensus_queue.cc:237] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:32.346513 11816 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:32.347237 11816 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:32.348060 11816 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:32.348264 11918 raft_consensus.cc:686] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:32.355180  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:32.355592  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:32.355782  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:32.356055  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:32.356739  6465 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:32.357743  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:32.358533  6475 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:32.349781 11918 consensus_queue.cc:237] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:32.359500 12131 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9.
I20260812 19:23:32.363716  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:32.365000  6473 raft_consensus.cc:2396] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260812 19:23:32.366288  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:32.367090  6474 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:32.368306  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:32.368848  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:32.375005  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:32.376035  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 87845.7us
I20260812 19:23:32.375982  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:32.374930  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:32.384833  6464 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:32.377018  6477 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:32.386911  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:32.377746  6481 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:32.387807  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:32.389472  6482 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:32.389555 12235 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:32.391182  7553 leader_election.cc:398] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9.
I20260812 19:23:32.391554  7553 leader_election.cc:401] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:23:32.392679  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:32.392534 12234 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:23:32.394559 12234 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9.
I20260812 19:23:32.395453 12290 consensus_queue.cc:1046] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:23:32.395766 12295 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 19:23:32.387624  6475 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:32.395455 12234 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:32.397356 12234 raft_consensus.cc:686] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:32.397627 12295 raft_consensus.cc:3032] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:32.398061 12295 raft_consensus.cc:729] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:32.397639  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:32.398567 12234 consensus_queue.cc:237] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:32.399962 12247 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:23:32.403568  6465 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:32.420125  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:32.421051  6482 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:32.405890 11851 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:32.427531  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:32.428328  6481 raft_consensus.cc:2379] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 5: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:32.409404 12131 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260812 19:23:32.426415 11851 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:32.412425 12149 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.026s
I20260812 19:23:32.498347  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:32.500852  6481 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:32.502413 12298 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:32.507458  6483 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:32.419449 12218 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260812 19:23:32.500478 11851 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:32.529570 11887 raft_consensus.cc:3032] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:32.553833  6481 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
W20260812 19:23:32.556224  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 122758us
I20260812 19:23:32.556454  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:32.605418  6470 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:32.559917  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:32.567183  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:32.425498 12295 consensus_queue.cc:260] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:32.607405  6483 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:32.568509  6473 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:32.565999  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:32.575147 12218 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:32.553495 11887 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:23:32.611887  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 52047.9us
I20260812 19:23:32.614410  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:32.617033  6482 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:32.619554  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:32.623680  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:32.625074  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:32.627859 12131 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:32.627339 11816 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:32.629164 11816 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:32.629508 12131 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:32.629684 11816 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:32.630143 12131 raft_consensus.cc:686] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:32.610596 12218 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:32.631258 12218 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:32.629084 11887 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:32.632707  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 238818us
I20260812 19:23:32.636546  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:32.640218  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:32.638015  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:32.641773  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:32.645756  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:32.626857 12274 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:32.682521  6470 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:32.648541  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:32.653312  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:32.684960  6483 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:32.686712  7606 raft_consensus.cc:2379] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:32.641476 12035 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:32.641427 12213 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:32.647509 11887 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:32.677875 12042 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election won for term 9
W20260812 19:23:32.696585  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 77935us
I20260812 19:23:32.693099  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:32.699141  7600 raft_consensus.cc:2379] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:32.701782  6359 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:32.705806  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:32.706487  6483 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:32.708516  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:32.709375  6464 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:32.643244 12234 consensus_queue.cc:1046] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260812 19:23:32.723472  6470 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260812 19:23:32.740774  6347 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260812 19:23:32.693485 12035 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:32.743423  6481 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260812 19:23:32.695482 12213 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:32.695334  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:32.736373 12299 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260812 19:23:32.749893  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:32.731288  6483 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:23:32.752604  6465 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260812 19:23:32.756275  6347 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260812 19:23:32.751775  6470 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:32.749392 12045 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:32.753808  6464 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:23:32.748216 12035 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:23:32.786075  6417 leader_election.cc:334] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.676s (SENT)
I20260812 19:23:32.748070 12213 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:23:32.810619  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 162152us
I20260812 19:23:32.752661 12274 raft_consensus.cc:686] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:32.812194  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:32.769621  7594 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 9. Ops: []
I20260812 19:23:32.828071 12324 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:32.832711  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:23:32.836609  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 190969us
I20260812 19:23:32.841239  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:32.837667  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:32.842592  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:32.840893 12324 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:32.855629  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:32.857837  7593 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260812 19:23:32.859215 12313 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260812 19:23:32.859790 12274 consensus_queue.cc:237] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:32.864405 12307 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260812 19:23:32.867686 12317 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260812 19:23:32.831071 12235 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:23:32.873386 12045 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:32.873970 12045 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:32.876283 12045 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:32.877359 11851 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:32.884665  6417 leader_election.cc:334] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.524s (SENT)
I20260812 19:23:32.885407  6417 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:32.748593 12131 consensus_queue.cc:237] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:32.962217 12332 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:32.963052 12332 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:32.963958 12322 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:32.892302 12324 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:32.964830 12322 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:32.976207  6417 leader_election.cc:334] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.540s (SENT)
W20260812 19:23:32.977804  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 136682us
I20260812 19:23:32.978603  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:32.903893 12321 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260812 19:23:32.986006  6417 leader_election.cc:334] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.847s (SENT)
I20260812 19:23:32.968259 12316 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:32.997124  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:23:33.007417  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 162620us
I20260812 19:23:32.978336 12042 raft_consensus.cc:686] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:32.993369 12321 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:33.014613  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:23:33.014958  6417 leader_election.cc:334] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.735s (SENT)
I20260812 19:23:33.016902  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:33.019852  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:33.021639 12325 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:33.022413 12325 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:33.023607 12325 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:33.026778 12306 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.372s	user 0.004s	sys 0.001s
I20260812 19:23:33.036154 11851 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:33.037345 12335 ts_tablet_manager.cc:927] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:33.040251 12322 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:33.040911 12235 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:33.041584 12235 raft_consensus.cc:686] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:33.043272  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:33.042807 12235 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:33.014827 12316 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:33.054486 12343 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:33.056499 12343 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:33.058043 12337 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:33.059013 12337 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:32.964000 12332 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:33.017493 12321 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:23:33.081646  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 65312.9us
I20260812 19:23:33.086310 12218 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:33.088426 12321 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:33.093123 12321 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:33.094862  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:33.102512  6060 catalog_manager.cc:5495] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 5 to 7, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 7 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:33.115249 12355 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:33.121469 12355 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:33.122139 12355 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:33.125554  6055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 194) took 1313 ms. Trace:
I20260812 19:23:33.124945  6060 catalog_manager.cc:5495] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:33.115566  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:33.126405  6055 rpcz_store.cc:276] 0812 19:23:31.800822 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:31.801037 (+   215us) service_pool.cc:227] Handling call
0812 19:23:33.114353 (+1313316us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:31.923008 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:31.923501 (+   493us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:31.923540 (+    39us) write_op.cc:435] Acquired schema lock
0812 19:23:31.923558 (+    18us) tablet.cc:660] Decoding operations
0812 19:23:31.924390 (+   832us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:31.924447 (+    57us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:31.924485 (+    38us) tablet.cc:683] Acquiring locks for 7 operations
0812 19:23:31.925029 (+   544us) tablet.cc:699] Row locks acquired
0812 19:23:31.925048 (+    19us) write_op.cc:260] PREPARE: finished
0812 19:23:31.925188 (+   140us) write_op.cc:270] Start()
0812 19:23:31.925307 (+   119us) write_op.cc:276] Timestamp: P: 1786562611925145 usec, L: 0
0812 19:23:31.925326 (+    19us) op_driver.cc:331] REPLICATION: starting
0812 19:23:31.925967 (+   641us) log.cc:842] Serialized 2828 byte log entry
0812 19:23:31.965145 (+ 39178us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b18001ba360. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98fb1888a8 00007f98fb18aa78 00007f98fb18aa28 00007f98fb18a9a8 00007f98fb18a963 00007f98fb189c4c 00007f98fd781206 00007f98fd779808 00007f98f7784170
0812 19:23:31.965213 (+    68us) op_driver.cc:444] REPLICATION: finished
0812 19:23:31.967951 (+  2738us) write_op.cc:301] APPLY: starting
0812 19:23:31.968032 (+    81us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:31.968216 (+   184us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:31.968247 (+    31us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:31.969149 (+   902us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:31.969371 (+   222us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0812 19:23:31.969421 (+    50us) write_op.cc:312] APPLY: finished
0812 19:23:31.969681 (+   260us) log.cc:842] Serialized 59 byte log entry
0812 19:23:31.969877 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:31.970009 (+   132us) write_op.cc:454] Released schema lock
0812 19:23:31.970053 (+    44us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:31.970331 (+   278us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:31.970366 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":77586,"reported_tablets":20,"spinlock_wait_cycles":153600,"child_traces":[["op",{"apply.queue_time_us":2451,"apply.run_cpu_time_us":2755,"apply.run_wall_time_us":2755,"num_ops":7,"prepare.queue_time_us":2681,"prepare.run_cpu_time_us":3328,"prepare.run_wall_time_us":30983,"replication_time_us":30267,"spinlock_wait_cycles":7465216}]]}
I20260812 19:23:33.146554 12357 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:33.152559  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:33.142032 12355 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:33.157809  6178 leader_election.cc:398] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:33.158181  6178 leader_election.cc:401] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260812 19:23:33.158524 12355 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:33.158905  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:33.159181 12355 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:33.159806 12355 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:33.160588 12355 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:33.161461 12355 raft_consensus.cc:686] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:33.162609  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:33.162801 12355 consensus_queue.cc:237] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:33.167961 12358 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:33.169663 12358 consensus_queue.cc:1046] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:33.169744  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:33.141450  6060 catalog_manager.cc:5495] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 8 to 10, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 10 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:33.171351  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:33.172736  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:33.173930 12358 raft_consensus.cc:3032] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:33.170347 12357 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:33.174888 12357 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:33.174110  6060 catalog_manager.cc:5495] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:33.174387 12358 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:33.178172 12358 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:33.179656  6060 catalog_manager.cc:5495] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 7 to 8, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 8 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:33.184121 12356 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:33.196622  6229 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260812 19:23:33.187170 12358 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:33.218712  6242 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260812 19:23:33.197422 12356 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:33.249051 12364 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:33.196455 12362 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:33.198061 12366 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:33.249658 12364 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:33.251356  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:33.253091 12364 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:33.255714 12366 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:33.266943  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:33.250138 12356 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:33.271268  6235 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:33.273531  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:33.274533  6229 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
W20260812 19:23:33.276078  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 49964.9us
I20260812 19:23:33.276877  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:33.277648 12374 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:33.278240 12374 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:33.280978  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:33.282374  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:33.283289  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:33.284660  6228 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:33.285480  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:33.287045  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:33.289595  6229 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:33.289778  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:33.294034  6235 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:33.295063  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:33.295274  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:33.282403 12358 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:33.290292  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:33.296172  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:33.295724  6242 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:33.297565  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:33.298182  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:33.299331  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:33.300390  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:33.301427  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:33.302075  6242 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:33.256843 12366 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:33.298557  6241 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 11: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:33.313066  6241 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260812 19:23:33.292135  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:33.293047  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:33.316864  6224 raft_consensus.cc:2396] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260812 19:23:33.291244  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:33.317802  6228 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:33.313387  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:33.314760  6229 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260812 19:23:33.296049  6235 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:33.302739  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:33.323612  6242 raft_consensus.cc:2379] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 9: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:33.343047  6235 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
W20260812 19:23:33.343693  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 65659.1us
I20260812 19:23:33.339675 12149 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:33.344617 12362 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:33.335321 12357 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:33.388880 12374 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:33.389863 12149 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:33.400864  6228 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:33.406216 12358 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:33.407200 12149 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:33.410450 12149 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:33.422041 12357 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:33.417410 12362 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:33.415307 12358 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260812 19:23:33.456970 12335 tablet_copy_client.cc:316] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.3:42599
W20260812 19:23:33.469832  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 124426us
I20260812 19:23:33.471295  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:33.915956  6178 leader_election.cc:334] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.560s (SENT)
I20260812 19:23:33.916545  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:33.917985 12149 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:33.919812 12149 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:33.922220 12149 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:33.905017 12362 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:33.919072 12376 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:33.917985 12374 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:33.923004 12362 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:33.923158 12376 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:33.923903 12374 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:33.925330  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 910730us
I20260812 19:23:33.933411  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:23:33.932057 12324 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.013s	sys 0.028s
I20260812 19:23:33.925334 12362 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:33.941864 12149 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:33.947680  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:23:33.946722 12324 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.014s	sys 0.028s
I20260812 19:23:33.956686  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:33.952669 12362 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:33.956772 12149 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:34.034286  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:34.038933  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:34.039870  6238 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:33.991611 12361 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260812 19:23:34.044315  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 107938us
W20260812 19:23:34.044871  6178 leader_election.cc:334] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.864s (SENT)
I20260812 19:23:34.032452 12374 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:34.033493 12149 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:34.042032 12376 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:34.044519 12361 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:23:34.046876  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 83125us
W20260812 19:23:34.052712  6178 leader_election.cc:334] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.073s (SENT)
W20260812 19:23:34.056550 12131 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.027s	user 0.009s	sys 0.004s
W20260812 19:23:34.056967 12131 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.009s	sys 0.004s
I20260812 19:23:34.050612 12361 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:34.065969 12388 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260812 19:23:34.065196 12035 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.242s	user 0.016s	sys 0.001s
I20260812 19:23:34.067708 12131 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
I20260812 19:23:34.069109 12149 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260812 19:23:34.073138 12391 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260812 19:23:34.073987  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:34.077997  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:34.084097  7598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 437) took 1405 ms (client timeout 1540 ms). Trace:
W20260812 19:23:34.084463  7598 rpcz_store.cc:269] 0812 19:23:32.678821 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:32.678985 (+   164us) service_pool.cc:227] Handling call
0812 19:23:34.077828 (+1398843us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b5800005498. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:23:34.084027 (+  6199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9571584}
W20260812 19:23:34.091596 11887 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.385s	user 0.016s	sys 0.000s
I20260812 19:23:34.071306 12035 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.094216 11816 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.312669 11816 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:34.327845  6417 leader_election.cc:334] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.948s (SENT)
I20260812 19:23:34.328527  6417 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:34.330885 12361 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.331382 11851 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:34.332218 12324 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:34.332748 12324 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.333297 12361 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:34.334838 12235 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:34.335525 12235 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.338260 12235 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:34.288955 12403 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:34.349290 12404 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:34.350078 12404 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.352795 12404 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:34.353448 12404 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:34.356428 12035 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:34.357183 12035 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:34.357738 12035 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.332177 11851 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.362049 11851 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:34.408015 12361 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:34.408912 12361 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.421660 12403 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:34.422479 12403 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.425555 12403 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:34.456195 12324 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:34.459087 12035 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:34.492046  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 418108us
I20260812 19:23:34.493863  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:34.499423 12361 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:34.647250 12403 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:34.647100  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 153312us
I20260812 19:23:34.648036 12403 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:34.648700  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:34.650919  6416 leader_election.cc:398] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7.
I20260812 19:23:34.650974 12403 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:34.651592 12131 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:34.652130 12403 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:34.647104 12149 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 19:23:34.717612 12346 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.638s	user 0.005s	sys 0.029s
I20260812 19:23:34.652369  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:23:34.795902  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 143643us
I20260812 19:23:34.798319  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.799219 12308 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:34.799430  6477 raft_consensus.cc:2379] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:34.800339 12308 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:34.801628 12308 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.803815  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 455) took 2064 ms. Trace:
W20260812 19:23:34.804183  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 476379us
W20260812 19:23:34.804829  6417 connection.cc:232] RPC call timeout handler was delayed by -1.0713168049696833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
I20260812 19:23:34.804242  6359 rpcz_store.cc:276] 0812 19:23:32.739683 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:32.739810 (+   127us) service_pool.cc:227] Handling call
0812 19:23:32.740162 (+   352us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:32.903182 (+163020us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:32.903238 (+    56us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:32.983082 (+ 79844us) log.cc:842] Serialized 26 byte log entry
0812 19:23:33.423973 (+440891us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:33.424031 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:33.424128 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:34.716761 (+1292633us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:34.803391 (+ 86630us) raft_consensus.cc:1671] finished
0812 19:23:34.803422 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:34.803739 (+   317us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":80435,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":209,"spinlock_wait_cycles":238524288,"thread_start_us":568953,"threads_started":2,"wal-append.queue_time_us":83360}
I20260812 19:23:34.807087  6482 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260812 19:23:34.807030  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:34.808625  6417 leader_election.cc:334] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.509s (SENT)
I20260812 19:23:34.809067  6417 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:34.809845 12131 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:34.809970  6483 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:34.810434 12131 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.811149  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.811914  6483 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:34.812497 12131 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:34.812698  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.813031 12131 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:34.814754 12035 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:34.815227 12035 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.817082 12035 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:34.808493 12403 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:34.818542 12403 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.820386 12403 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:34.821858 12213 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.999s	user 0.018s	sys 0.009s
I20260812 19:23:34.822297 12213 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.822877  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.823288 12404 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 19:23:34.823705  6482 raft_consensus.cc:2396] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260812 19:23:34.824522  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.825232  6482 raft_consensus.cc:2396] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260812 19:23:34.825915  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.826567 12213 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:34.827644  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.827744  6483 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:34.828320  6477 raft_consensus.cc:2362] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6. Re-sending same reply.
I20260812 19:23:34.828722  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.829101  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.829288  6483 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:34.829681  6477 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:34.830098  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.830638  6483 raft_consensus.cc:2362] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8. Re-sending same reply.
I20260812 19:23:34.831104  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.831852  6474 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:34.831634  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.832650  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.832880  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.833583  6483 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:23:34.833737  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.834419  6474 raft_consensus.cc:2354] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7.
W20260812 19:23:34.835671  7554 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.825s	user 0.006s	sys 0.032s
W20260812 19:23:34.836163  7554 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.827s	user 0.007s	sys 0.033s
I20260812 19:23:34.830485  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.826406  6482 raft_consensus.cc:2362] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8. Re-sending same reply.
I20260812 19:23:34.834538  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.850335  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:34.850632  6298 connection.cc:232] RPC call timeout handler was delayed by -1.5633118450641632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260812 19:23:34.851127  6482 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
W20260812 19:23:34.851445  6298 connection.cc:232] RPC call timeout handler was delayed by -1.4679453400895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260812 19:23:34.851840  6298 connection.cc:232] RPC call timeout handler was delayed by -1.4579616389237344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
I20260812 19:23:34.852089  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.852700  6482 raft_consensus.cc:2362] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6. Re-sending same reply.
W20260812 19:23:34.855024  6298 connection.cc:232] RPC call timeout handler was delayed by -1.3522939861286432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
I20260812 19:23:34.855155  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:34.855553  6298 connection.cc:232] RPC call timeout handler was delayed by -1.2364523101132363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
W20260812 19:23:34.856014  6298 connection.cc:232] RPC call timeout handler was delayed by -1.0001771321985871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
I20260812 19:23:34.857560  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.858619  6474 raft_consensus.cc:2396] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260812 19:23:34.860488  6477 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:34.861109  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.862320  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.862402 12131 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:34.862775  6359 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260812 19:23:34.857470 12289 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.299s	user 0.020s	sys 0.057s
I20260812 19:23:34.863602  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:34.866977  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:34.867746  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.866977  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:34.868373  6483 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:23:34.868503  6344 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:34.868530  6242 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:34.869232  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.870302  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.871315  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:34.871824 12289 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.314s	user 0.020s	sys 0.057s
I20260812 19:23:34.872309  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.873560  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:34.874157  6354 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:34.878180  6344 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:34.862797  6238 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:23:34.880416 12131 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:34.881790  6354 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:34.853920  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.886509  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.887113  6482 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:34.887387  6470 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:34.888300  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.889302  6482 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:34.890213  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.891340  6482 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:34.882972  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.864033  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.885550 12411 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:34.893821  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.894804  6477 raft_consensus.cc:2396] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260812 19:23:34.895043  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 84424.9us
I20260812 19:23:34.896442  6238 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:34.896243 12411 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:34.895655  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.897426  6477 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:34.897413  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:34.896253  6417 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 2.493s (SENT)
I20260812 19:23:34.898475  6474 raft_consensus.cc:2379] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:34.906520 12404 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:34.906826 12403 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:34.907437 12131 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:34.908874 12411 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:34.911434  6354 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260812 19:23:34.907205 12404 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.907358 12403 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.921288  6359 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:34.908059  6477 raft_consensus.cc:2396] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260812 19:23:34.908116  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.906643  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.923431  6483 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:34.923367  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:34.924084  6232 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:34.912632  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:34.925398  6344 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:34.912989  6238 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:34.913513  6470 raft_consensus.cc:2396] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260812 19:23:34.927772  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:34.928638  6359 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:34.913589  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:34.915071  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:34.916090  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:34.917394  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:34.899466  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.920754  6230 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:34.920635  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:34.922338  6417 leader_election.cc:334] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 2.574s (SENT)
I20260812 19:23:34.931576  6224 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:34.932000  6241 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:34.928550  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.933377  6470 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:34.913679  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:34.934473  6228 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:34.934736  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:34.935391  6354 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:34.930730  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:34.933657  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:34.937326  6477 raft_consensus.cc:2362] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8. Re-sending same reply.
I20260812 19:23:34.938733  6417 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:34.940243  6354 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:34.942267  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.944574  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.944765  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:34.945950  6359 raft_consensus.cc:2396] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260812 19:23:34.947692  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:34.948112  6344 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:34.948555  6354 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:23:34.950003  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.951609  6482 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:34.953142  6232 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260812 19:23:34.923441 12405 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:34.954340  6224 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:34.943842  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:35.008414 12411 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:34.957649  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:35.013770  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:35.015159  6474 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:35.014765 12411 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:35.015425  7599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 440) took 2335 ms (client timeout 2493 ms). Trace:
W20260812 19:23:35.016037  7599 rpcz_store.cc:269] 0812 19:23:32.679985 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:32.680116 (+   131us) service_pool.cc:227] Handling call
0812 19:23:35.013564 (+2333448us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b5800005498. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:23:35.015357 (+  1793us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9332096}
I20260812 19:23:35.017318 12411 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:34.961082  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:34.987067 12404 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:34.986059 12403 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:35.019353  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.008s	user 0.029s	sys 0.033s
W20260812 19:23:35.019835  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.008s	user 0.029s	sys 0.034s
I20260812 19:23:34.987712 12042 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:34.968171  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 45860.6us
W20260812 19:23:35.020156  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 2.00883e+06us
I20260812 19:23:34.961529  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:35.018417 12234 raft_consensus.cc:3032] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:34.999173 12416 consensus_queue.cc:1046] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260812 19:23:34.958695 12405 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:35.002030  6241 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:35.026294  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:35.027267 12405 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:34.964896  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:34.961071  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:35.023985  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:35.031280  6481 raft_consensus.cc:2354] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:35.031554 12423 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:23:35.032112  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:35.033061  6481 raft_consensus.cc:2396] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260812 19:23:35.024995 12234 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:35.025530  6359 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:34.981825 12045 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:35.001324  6058 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 117) took 3048 ms. Trace:
I20260812 19:23:34.941661 12308 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:35.063135  6058 rpcz_store.cc:276] 0812 19:23:31.953018 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:31.953229 (+   211us) service_pool.cc:227] Handling call
0812 19:23:31.995636 (+ 42407us) spinlock_profiling.cc:243] Waited 9.72 ms on lock 0x7b5400002dd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fdaf0 00007f98f7780f2a 00007f98fd6d2d6c 00007f98fd7ccc3e 00007f98fbadefb4 00007f98fbadef42 00007f98fbadee71 00007f98fbadedec 00007f98fbade0a2 00007f98f5bae94c 00007f98f5badd86
0812 19:23:35.001251 (+3005615us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":147558,"reported_tablets":1,"spinlock_wait_cycles":22364032}
I20260812 19:23:35.027456  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:35.065017  6474 raft_consensus.cc:2379] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:35.066313  6474 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:35.028357 12289 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:34.971611 12131 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.079314 12405 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:35.028559 12355 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.862s	user 0.042s	sys 0.059s
I20260812 19:23:35.082393 12131 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:34.957371  6477 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
W20260812 19:23:35.083465  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 55098.6us
I20260812 19:23:35.029361  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:35.034382  6224 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
W20260812 19:23:35.085222  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 71917.1us
I20260812 19:23:34.980559  6230 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260812 19:23:34.967078  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:35.086302  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:35.086792  6470 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
W20260812 19:23:35.087146  6298 leader_election.cc:334] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.692s (SENT)
I20260812 19:23:35.077350 12403 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.072036 12308 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:35.082897 12355 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.916s	user 0.043s	sys 0.059s
I20260812 19:23:35.048295  6481 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:35.099653  6241 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260812 19:23:35.100322  6481 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260812 19:23:35.100690  6481 pending_rounds.cc:76] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 2
I20260812 19:23:35.100973  6481 pending_rounds.cc:97] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260812 19:23:35.101341  6481 raft_consensus.cc:2866] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:35.102938  6473 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260812 19:23:35.103031  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:35.082774 12405 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.106462  6342 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:35.049299 12234 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:34.988229 12364 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.089709  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:35.110756  6354 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:35.110817  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.111442  7607 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
W20260812 19:23:35.092108  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 62837.3us
I20260812 19:23:35.094061  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:35.067512 12417 raft_consensus.cc:3032] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:35.019052  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:35.104391  6470 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260812 19:23:35.114898  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:35.080041  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:35.105587  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:35.108783  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:35.108297  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1945) took 2547 ms. Trace:
I20260812 19:23:35.116408  6473 rpcz_store.cc:276] 0812 19:23:32.556555 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:32.615818 (+ 59263us) service_pool.cc:227] Handling call
0812 19:23:35.102399 (+2486581us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:23:35.102593 (+   194us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:35.103369 (+   776us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:35.103536 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4070144}
I20260812 19:23:35.112136  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.112419  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:35.116858  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.112802  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.118352  6416 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:35.120321  6483 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:35.121066  6482 raft_consensus.cc:2379] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:35.123140 12289 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:23:35.123383 12415 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:23:35.124912 12415 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:35.125375 12415 raft_consensus.cc:686] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:35.126962  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.127287 12405 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:35.127637  7593 raft_consensus.cc:2362] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9. Re-sending same reply.
I20260812 19:23:35.114933 12417 raft_consensus.cc:729] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:35.122529 12234 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:35.129001 12417 consensus_queue.cc:260] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.119472 12149 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260812 19:23:35.130308 12417 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:35.121996 11918 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:35.131096  6500 tablet_copy_service.cc:140] P bdfa5579d4534c618c00db6b4a841c81: Received BeginTabletCopySession request for tablet 529ed979cd2842acb5bc24debb151b93 from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:33386)
I20260812 19:23:35.119483 12364 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:35.131762  6500 tablet_copy_service.cc:161] P bdfa5579d4534c618c00db6b4a841c81: Beginning new tablet copy session on tablet 529ed979cd2842acb5bc24debb151b93 from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:33386: session id = f4ef77b3328a44e8a21dd902b370e25a-529ed979cd2842acb5bc24debb151b93
I20260812 19:23:35.131860 12355 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:35.133431 12364 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:35.133674  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:35.133991  6470 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:35.134858  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:35.113729 12358 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:35.135257  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:35.135703 12358 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:35.135946  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:35.136088 12358 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:23:35.136669  6236 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 385) took 1938 ms (client timeout 1776 ms). Trace:
I20260812 19:23:35.137157  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:35.137153  6235 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:35.131340 11918 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:23:35.137271  6236 rpcz_store.cc:269] 0812 19:23:33.198756 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:35.136461 (+1937705us) service_pool.cc:214] Skipping call since client already timed out
0812 19:23:35.136574 (+   113us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260812 19:23:35.135888  6473 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:35.127753 12131 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:35.136739  6482 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260812 19:23:35.155690  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:35.156174 12308 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:35.099066 12403 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.158116 12403 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:35.158247 12289 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.138928 11918 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.158776 12289 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:35.160718 12341 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 2.126s	user 0.012s	sys 0.020s
I20260812 19:23:35.160825 12289 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:35.141396  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.142297 12355 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:35.126245 12415 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:35.163571 12353 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 2.069s	user 0.020s	sys 0.037s
I20260812 19:23:35.164610  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:35.165930  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.167006  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:35.168143  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.153014  6232 raft_consensus.cc:1226] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:35.152931 12366 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:35.154280  6224 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:35.162324 12355 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:35.136623 12358 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:35.169987  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.170384 12355 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:35.163479  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:35.172263  7600 raft_consensus.cc:2379] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:35.172190 12402 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:35.172886 12402 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:35.152240 12102 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:35.174969 12102 raft_consensus.cc:686] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:35.175909 12102 consensus_queue.cc:237] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.176755 12406 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.177008 12213 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:35.166002  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:35.154078  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:35.179932  6347 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
W20260812 19:23:35.209954  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 44027.5us
I20260812 19:23:35.211081  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:35.212287 12366 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260812 19:23:35.184508 12351 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.090s	user 0.011s	sys 0.055s
I20260812 19:23:35.235711  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:35.216986  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:35.234338  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.235246  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.235881  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:35.226389  7607 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:35.245754  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:23:35.247924  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 129628us
I20260812 19:23:35.173895 12402 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:23:35.185400 12035 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.251045  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:35.243772 12308 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.244938 12042 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.177282 12406 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.257362 12308 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.252636  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:35.247653 12351 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.153s	user 0.013s	sys 0.055s
I20260812 19:23:35.257365 12042 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:35.252194  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:35.259042  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:35.266037  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:35.249740 12361 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:35.267282  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:35.251303 12289 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:35.257122 12436 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260812 19:23:35.234875 12431 consensus_queue.cc:1046] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260812 19:23:35.269728 12404 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:35.270629 12406 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:35.270803 12308 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:35.268872  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:35.267506 12149 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:35.332906  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:35.333582  6359 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260812 19:23:35.259097 12131 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260812 19:23:35.321251  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 75614.8us
I20260812 19:23:35.335047  6350 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:35.277319  6354 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:35.327196  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:35.328811  6342 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:35.329771  6347 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260812 19:23:35.331756 12447 consensus_queue.cc:1046] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:23:35.209152 12213 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:35.337299  6344 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:35.183342 12432 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.152s
I20260812 19:23:35.338351  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:35.279156 12404 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:35.252812 12338 consensus_queue.cc:1046] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260812 19:23:35.321116 12406 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.263128 12035 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.341712 12308 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:35.342811 12351 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:35.343132  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:35.271401 12405 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260812 19:23:35.352921 12440 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:35.271535 12045 consensus_queue.cc:1046] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260812 19:23:35.279493 12361 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:35.337981 12131 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:35.333444 12149 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:35.350539  6350 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:35.251448 12435 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260812 19:23:35.347287  6481 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:35.361521 12431 raft_consensus.cc:3032] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:35.417595 12431 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:35.413692  6353 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:35.419207  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:35.419813  6359 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:35.405905  6347 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
W20260812 19:23:35.422734  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 70343.6us
I20260812 19:23:35.424232  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:35.418519 12431 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:35.427446 12431 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:35.428602 12295 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:35.347908 12404 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:35.362936  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:35.447111  6342 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:35.437554  6359 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:23:35.393543  6354 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260812 19:23:35.398782 12405 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:35.449079 12289 raft_consensus.cc:686] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:35.449295 12405 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:35.449957 12405 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:35.450883 12457 raft_consensus.cc:3032] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:35.451417 12457 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:35.361392 12451 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:23:35.447643  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:35.452375 12457 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:35.453896 12366 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:35.454036 12457 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:35.454519  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:35.456799  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:35.353960 12351 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:35.354076 12308 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:35.464460  6347 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260812 19:23:35.363483 12149 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:35.477908  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:35.359750 12131 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:35.414858 11918 raft_consensus.cc:3032] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:35.465032  6359 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260812 19:23:35.481700  6269 debug-util.cc:398] Leaking SignalData structure 0x7b0800108cc0 after lost signal to thread 4090
W20260812 19:23:35.482841  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 148020us
I20260812 19:23:35.483027  7598 raft_consensus.cc:2396] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260812 19:23:35.459024 12303 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.626s	user 0.021s	sys 0.036s
I20260812 19:23:35.486418  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:35.463477 12366 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:35.455268 12440 raft_consensus.cc:2741] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260812 19:23:35.351341 12406 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.459738 12260 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.460229 12423 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:35.473363 12351 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:35.494733  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:35.492832  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:35.494354  6347 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:35.481937 11918 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:35.490669 12366 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:35.493875 12042 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:35.497197 12035 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:35.482062 12361 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:35.475426 12308 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:35.499506 12213 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:35.501685  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 232889us
I20260812 19:23:35.515465 12429 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:35.516105 12448 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:35.516497  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:35.517485 12450 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:35.517884 12450 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:35.518219 12450 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:35.518970  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:35.500893 12423 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:35.463737 12358 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.510578  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:35.512645  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:35.500473 11887 raft_consensus.cc:3032] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:35.490873 12451 raft_consensus.cc:686] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:35.514973 12440 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:35.515254 12338 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:23:35.532572 11918 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.534082 11918 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:35.534014 12338 consensus_queue.cc:1046] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:23:35.487453 12364 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260812 19:23:35.523056  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 2.50305e+06us
I20260812 19:23:35.523232 12415 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:23:35.537407 12415 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:23:35.539283 12035 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:35.523056  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:35.542050  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:35.542220  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:35.543820  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:35.544941  6464 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260812 19:23:35.547799  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:35.548961  6417 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:35.549630  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.550060  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:35.550613  6473 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:35.551090  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:35.551692  6238 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:35.553719  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:35.555223  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:35.555871  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:35.556581  6238 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 9: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:23:35.490167 12303 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.660s	user 0.022s	sys 0.038s
I20260812 19:23:35.520525  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:35.528235  7607 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:35.510056 12366 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:35.560235  6473 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:35.548643  6230 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:35.561498  6224 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260812 19:23:35.483462 12289 consensus_queue.cc:237] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:35.566934  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:35.516533 12448 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:35.567674  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:35.568738 12441 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260812 19:23:35.568202 12451 consensus_queue.cc:237] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:35.597019  6228 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260812 19:23:35.598137  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:35.569464  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:35.529529 12423 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:35.527129 12436 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:35.604410  6241 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:35.570979  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:35.529930 12213 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:35.576015  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:35.594484  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 45598.4us
I20260812 19:23:35.564503  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:35.601609  6347 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260812 19:23:35.531296 11887 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:35.606473  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:35.587555  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:35.607753  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:35.607867  6417 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:35.608448  6242 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:35.503618 12260 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:35.603420  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:35.564476 12440 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:23:35.560838 12415 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:35.528388 12234 consensus_queue.cc:1046] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260812 19:23:35.621618  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:35.624480  6465 raft_consensus.cc:2396] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260812 19:23:35.616308  6229 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:35.618038  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:35.620857  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:35.621197  6224 raft_consensus.cc:2379] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 11: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:35.620088  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:35.621577  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:35.621877  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:35.627041  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:35.629418  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 84820.7us
I20260812 19:23:35.629524  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:35.631578 12358 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:35.632332  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:35.633419  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.633967  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:35.631474  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:35.635047  6465 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:35.635115  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:35.634459  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.636950  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:35.635850  7591 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:35.640309  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:35.641000  6470 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:35.628580 12213 raft_consensus.cc:686] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:35.649699  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:35.603101 12436 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:35.618005 12429 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:35.607478 12448 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:35.620747 12415 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:35.659090  6179 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:35.561717 12355 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.660014  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.641002 12364 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260812 19:23:35.654402  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 96861us
I20260812 19:23:35.677811  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:35.679942  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:35.652938 12102 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:35.659471 12436 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:35.681502  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1934) took 3278 ms. Trace:
W20260812 19:23:35.695788  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 56190.5us
I20260812 19:23:35.696018  6465 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:35.697157  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:35.691547  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:35.698897  6228 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:35.700660  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:35.658951 12440 consensus_queue.cc:1046] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260812 19:23:35.662493 12274 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.675896 12358 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:35.682854 11851 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.660933 12415 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:35.761004  6465 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
W20260812 19:23:35.761581  6269 debug-util.cc:398] Leaking SignalData structure 0x7b08001db780 after lost signal to thread 6116
W20260812 19:23:35.764016  6269 debug-util.cc:398] Leaking SignalData structure 0x7b08001db240 after lost signal to thread 6138
W20260812 19:23:35.762065  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 70691.7us
W20260812 19:23:35.765336  6269 debug-util.cc:398] Leaking SignalData structure 0x7b08002675c0 after lost signal to thread 6272
I20260812 19:23:35.692348  6475 rpcz_store.cc:276] 0812 19:23:32.403424 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:32.407390 (+  3966us) service_pool.cc:227] Handling call
0812 19:23:32.407826 (+   436us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:32.408090 (+   264us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:23:32.564559 (+156469us) log.cc:842] Serialized 14 byte log entry
0812 19:23:32.640183 (+ 75624us) log.cc:842] Serialized 14 byte log entry
0812 19:23:34.788946 (+2148763us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b180033e8c0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f47d34ca 00007f98fdea8f99 00007f98fc61f088 00007f98fc6166b1 00007f98fc616657 00007f98fc70a978 00007f98fc70a627 00007f98fc71eb2c 00007f98fc71ead8
0812 19:23:35.528655 (+739709us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b180033e8c0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f4859155 00007f98f77703d0 00007f98f7782576 00007f98f77930d7 00007f98f7793058
0812 19:23:35.681146 (+152491us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:35.681204 (+    58us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:35.681253 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:35.681329 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:35.681449 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":40838,"prepare.queue_time_us":192751,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":100,"raft.queue_time_us":96259,"raft.run_cpu_time_us":42228,"raft.run_wall_time_us":2105502,"spinlock_wait_cycles":62459520,"thread_start_us":378846,"threads_started":3,"wal-append.queue_time_us":182822,"wal-append.run_cpu_time_us":7804,"wal-append.run_wall_time_us":1160894}
I20260812 19:23:35.766964  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:35.767383  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.767699  6475 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:35.772296 12462 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.772575 12440 raft_consensus.cc:3032] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:35.773100 12440 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:35.772810 12213 consensus_queue.cc:237] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.775616  6475 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260812 19:23:35.773983 12440 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:35.792065 12440 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:35.792269  6475 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:35.793879  6475 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260812 19:23:35.794188  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.795058 12309 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:35.795440  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:35.796113 12460 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:35.796619 12460 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:35.796656  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:35.797184 12460 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:35.745812 12406 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:35.753978 12393 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:35.800123  6241 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 5. Current term is 6. Ops: []
W20260812 19:23:35.803936  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 103313us
I20260812 19:23:35.809223  6241 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
W20260812 19:23:35.763186 12434 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
W20260812 19:23:35.855930  6297 connection.cc:232] RPC call timeout handler was delayed by -1.7681371869985014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260812 19:23:35.856014  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:23:35.854525  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 48828us
I20260812 19:23:35.821650  6475 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260812 19:23:35.690737 12429 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:35.702401 12234 consensus_queue.cc:1046] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.100s
I20260812 19:23:35.855141  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.852599  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:35.860601  6473 raft_consensus.cc:2396] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260812 19:23:35.864657  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:35.867430  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:35.868825 12468 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260812 19:23:35.863215  7599 raft_consensus.cc:2362] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9. Re-sending same reply.
I20260812 19:23:35.777115 12435 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:35.873118  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:35.874625  6228 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:35.821575  6359 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
W20260812 19:23:35.876896  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 269078us
W20260812 19:23:35.856607  6297 connection.cc:232] RPC call timeout handler was delayed by -1.7636371869593859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260812 19:23:35.661981 11887 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.755551 12358 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:23:35.884615  6297 connection.cc:232] RPC call timeout handler was delayed by -1.7267371870111674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260812 19:23:35.884708  6417 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:35.821313 12393 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:35.897887 12358 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:23:35.871125 12470 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260812 19:23:35.897529  6297 connection.cc:232] RPC call timeout handler was delayed by -1.6133371868636459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260812 19:23:35.907639  6297 connection.cc:232] RPC call timeout handler was delayed by -1.4999371869489551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
I20260812 19:23:35.757300 12274 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:35.908511  6297 connection.cc:232] RPC call timeout handler was delayed by -1.4783371870871633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
I20260812 19:23:35.860080 12035 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.691771 12457 consensus_queue.cc:1046] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.168s
I20260812 19:23:35.872901 12406 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:35.911984  6297 connection.cc:232] RPC call timeout handler was delayed by -1.424337187083438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
I20260812 19:23:35.802181 11851 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.885691 12435 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:23:35.926436  6297 connection.cc:232] RPC call timeout handler was delayed by -1.4189371869433671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
I20260812 19:23:35.745309 12475 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.226s
I20260812 19:23:35.879243 12343 consensus_queue.cc:1046] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260812 19:23:35.888314 12338 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260812 19:23:35.772946 12462 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:35.975605 11851 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:35.928900  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 232287us
I20260812 19:23:35.948370 12493 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260812 19:23:35.915200 11918 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:23:35.923604 12035 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.983546  6347 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:35.984582 12338 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:23:35.968139 12234 raft_consensus.cc:3032] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:35.950902  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:35.985176 12462 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:35.908641 12102 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.948765 12260 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:35.985651 12234 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:23:35.986876  6297 connection.cc:232] RPC call timeout handler was delayed by -1.39463718701154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
I20260812 19:23:35.950292 12361 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
W20260812 19:23:35.987426  6297 connection.cc:232] RPC call timeout handler was delayed by -1.3811371868941933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260812 19:23:35.987946  6297 connection.cc:232] RPC call timeout handler was delayed by -1.3514371870551258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
I20260812 19:23:35.988075 12361 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:23:35.985144 12035 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:35.988409  6297 connection.cc:232] RPC call timeout handler was delayed by -1.3127371869049966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
I20260812 19:23:35.987586 12234 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:35.988794 12361 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:35.989328 12361 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:35.930510 12406 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:35.990270 12361 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:35.990896 12102 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:35.991778 12361 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:35.913537 12393 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.986124 12435 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:35.952215 12448 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:35.988905  6297 connection.cc:232] RPC call timeout handler was delayed by -1.2803371869958937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
W20260812 19:23:36.022469  6297 connection.cc:232] RPC call timeout handler was delayed by -1.2587371869012713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260812 19:23:36.022997  6297 connection.cc:232] RPC call timeout handler was delayed by -1.2488371869549155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
W20260812 19:23:36.023346  6297 connection.cc:232] RPC call timeout handler was delayed by -1.1363371869083494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2277s for a response
W20260812 19:23:35.994930  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 44146.4us
I20260812 19:23:35.983549  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:36.028644  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:36.031522  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 48061.3us
W20260812 19:23:36.023680  6297 connection.cc:232] RPC call timeout handler was delayed by -1.067037187051028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23540000000000003s for a response
I20260812 19:23:36.035264  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:36.036589  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:36.038077  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:36.000813  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:36.041008  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:36.046295  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:36.001358 12479 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.996794 12481 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:23:36.030313 12355 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:36.036640 12364 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:36.043668 12462 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:36.042763 12035 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:36.043475 12234 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:36.042976 11851 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:36.043076 12213 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:36.080519  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:36.027493 12452 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.224s
W20260812 19:23:36.118155 12466 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
W20260812 19:23:36.118906 12492 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.248s	user 0.000s	sys 0.002s
W20260812 19:23:36.091001 12405 consensus_meta.cc:287] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.640s	user 0.008s	sys 0.005s
I20260812 19:23:36.093854 12213 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.085086 12462 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:36.089113 12035 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:36.179428 12462 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:36.179545 12035 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:36.179057 12405 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.180637 12213 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:36.182331 12405 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:36.127642 12509 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260812 19:23:36.183027  6482 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 9: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:36.088896 12482 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260812 19:23:36.090023 12366 consensus_meta.cc:287] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.007s
I20260812 19:23:36.183969 12366 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.186091 12366 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:36.186578  6232 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 8. Current term is 9. Ops: []
W20260812 19:23:36.178964  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 143603us
I20260812 19:23:36.116817 12485 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.169s
I20260812 19:23:36.118834 12446 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:36.136499 12510 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:36.188551 12510 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:23:36.188920  6470 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.001s	sys 0.005s
W20260812 19:23:36.189352  6470 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.001s	sys 0.005s
I20260812 19:23:36.189668 12462 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.189517 12510 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.141692  7597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 481) took 4192 ms. Trace:
W20260812 19:23:36.142843 12404 consensus_meta.cc:287] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.679s	user 0.005s	sys 0.007s
W20260812 19:23:36.142868 12423 consensus_meta.cc:287] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260812 19:23:36.191733 12462 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:36.190955  7597 rpcz_store.cc:276] 0812 19:23:31.948870 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:31.965322 (+ 16452us) service_pool.cc:227] Handling call
0812 19:23:31.967831 (+  2509us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:32.339652 (+371821us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:36.141360 (+3801708us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b5400229cd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:36.141591 (+   231us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":852742912}
W20260812 19:23:36.146839 12503 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260812 19:23:36.192085 12423 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.194466 12423 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:36.091450 12355 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260812 19:23:36.082249 12490 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:36.145565  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1676) took 1308 ms. Trace:
I20260812 19:23:36.195783  6483 rpcz_store.cc:276] 0812 19:23:34.837147 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:35.034192 (+197045us) service_pool.cc:227] Handling call
0812 19:23:36.145359 (+1111167us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b5400271854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:36.145492 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9499520}
W20260812 19:23:36.150885  6269 debug-util.cc:398] Leaking SignalData structure 0x7b08001c1140 after lost signal to thread 6399
W20260812 19:23:36.198176  6269 debug-util.cc:398] Leaking SignalData structure 0x7b0800255700 after lost signal to thread 6400
W20260812 19:23:36.149966 12149 consensus_meta.cc:287] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.001s
I20260812 19:23:36.087975 12493 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election won for term 10
W20260812 19:23:36.151629 12431 consensus_meta.cc:287] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.000s
W20260812 19:23:36.152097 12494 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260812 19:23:36.152985 12308 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.002s
I20260812 19:23:36.086262 12102 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:36.159070  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 78961us
I20260812 19:23:36.207828  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:36.091177 12364 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:36.209898  7600 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260812 19:23:36.210404  7600 pending_rounds.cc:76] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Aborting all ops after (but not including) 7
I20260812 19:23:36.210768  7600 pending_rounds.cc:97] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260812 19:23:36.211056  7600 raft_consensus.cc:2866] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:36.014904 12393 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.093303 11851 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:36.191956 12404 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.088615 12477 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
I20260812 19:23:36.195344 12490 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:36.119488 12489 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:36.150583 12435 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:36.137163 12450 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.000s
W20260812 19:23:36.162839 12451 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.001s	sys 0.003s
I20260812 19:23:36.214546  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:36.052282 12479 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.238826 11851 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:36.239549 12479 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:36.225109 12490 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:36.243423 12343 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260812 19:23:36.214721 12486 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
I20260812 19:23:36.230355 12444 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260812 19:23:36.233026 12460 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.204319 12149 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.255308  6481 raft_consensus.cc:2354] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8.
I20260812 19:23:36.255303  7598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 468) took 1159 ms. Trace:
I20260812 19:23:36.256264 12149 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:36.219156 12213 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260812 19:23:36.256793  7606 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260812 19:23:36.257187  7606 pending_rounds.cc:76] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: Aborting all ops after (but not including) 6
I20260812 19:23:36.257416  7606 pending_rounds.cc:97] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260812 19:23:36.257645  7606 raft_consensus.cc:2866] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:36.216481 12448 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:36.235838 12364 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:36.261745 12351 consensus_meta.cc:287] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.752s	user 0.009s	sys 0.001s
I20260812 19:23:36.264838  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:36.203722 12325 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 3.124s	user 0.027s	sys 0.002s
I20260812 19:23:36.244618 12393 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:36.244908 12415 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.245527  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:36.246933 12451 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.001s	sys 0.004s
I20260812 19:23:36.216756 12446 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:23:36.210125 12308 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.248497 12406 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:36.248777 12398 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 2.216s	user 0.004s	sys 0.019s
I20260812 19:23:36.214027 12274 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:36.270179 12325 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 3.191s	user 0.027s	sys 0.002s
I20260812 19:23:36.250560 11887 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:36.277313  6464 raft_consensus.cc:1226] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260812 19:23:36.214319 12423 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260812 19:23:36.251302 12450 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.235100 12477 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:36.236522 12404 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:36.263252  6269 debug-util.cc:398] Leaking SignalData structure 0x7b0800315a80 after lost signal to thread 6521
W20260812 19:23:36.295387  6269 debug-util.cc:398] Leaking SignalData structure 0x7b080030be20 after lost signal to thread 6522
I20260812 19:23:36.295130 12477 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:36.296772  6269 debug-util.cc:398] Leaking SignalData structure 0x7b080038da20 after lost signal to thread 7647
I20260812 19:23:36.228962  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:36.255949  7598 rpcz_store.cc:276] 0812 19:23:35.095501 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:35.095664 (+   163us) service_pool.cc:227] Handling call
0812 19:23:36.255052 (+1159388us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54002e68d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:36.255238 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":836601600}
W20260812 19:23:36.297482  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 68605.8us
I20260812 19:23:36.266846  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:36.243620  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:36.298739 12213 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election won for term 10
W20260812 19:23:36.298918  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55369.2us
I20260812 19:23:36.299269 12213 raft_consensus.cc:686] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:36.299309 12303 raft_consensus.cc:3032] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:36.299926 12303 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:36.300251 12213 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.300941 12303 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.302843 12343 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:36.303943  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:36.304699  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:36.305074  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:36.305255  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:36.306730 12484 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:36.270556  6230 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:36.313418  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:36.313716 12484 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:23:36.269670  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 236023us
W20260812 19:23:36.250461 12131 consensus_meta.cc:287] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.769s	user 0.000s	sys 0.012s
I20260812 19:23:36.246773 12435 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:36.314769 12484 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.314997 12131 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.315994  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:36.209599 12493 raft_consensus.cc:686] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:36.316212 12404 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260812 19:23:36.318445 12493 consensus_queue.cc:237] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.319195 12404 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:36.302460 12303 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:36.317189  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:36.323009 12514 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:36.323740  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:36.335784  6228 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:36.281514 12450 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:36.282372 12393 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:36.288292 12308 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:36.289131 12400 consensus_queue.cc:1046] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260812 19:23:36.297922 12477 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:36.304735  6347 raft_consensus.cc:2354] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:36.310135  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:36.313810  6353 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260812 19:23:36.314127  6345 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:36.317178 12131 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:36.323767  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:36.256068 12460 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:36.325343 12366 raft_consensus.cc:3032] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:36.325587 12415 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:36.330506  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:36.330600  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:36.268363  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 385085us
I20260812 19:23:36.332418  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 1968) took 1243 ms. Trace:
I20260812 19:23:36.410229  6235 rpcz_store.cc:276] 0812 19:23:35.089086 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:35.098592 (+  9506us) service_pool.cc:227] Handling call
0812 19:23:36.332227 (+1233635us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b540027c4d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:36.332354 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":49139456}
I20260812 19:23:36.306770  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:36.280993 12035 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.371181  6230 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:36.411770  6344 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:36.384685 12393 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:36.379985  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:36.263813 12351 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.396802  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:36.415696  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:36.415874  6236 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:23:36.397718  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:36.316334 12484 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:36.222929 12436 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.416867  6228 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:36.407434  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:36.409811  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 99791.8us
I20260812 19:23:36.374691  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:36.423533  6241 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:36.424269  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:36.377049  6242 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260812 19:23:36.409732  6359 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:36.409222  6238 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:36.309019 12358 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.419872  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:36.427404  6230 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:36.404538  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:36.428154  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:36.429353  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:36.408306 12295 consensus_meta.cc:287] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.979s	user 0.003s	sys 0.010s
I20260812 19:23:36.430171  6344 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:36.434953  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:36.431993  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:36.433719  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:36.435807  6238 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:36.406967 12366 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:36.438203  6178 leader_election.cc:398] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:36.438335  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:36.438719  6178 leader_election.cc:401] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260812 19:23:36.427284  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:36.439638  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:36.437197  7603 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:36.443001  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:36.443694  6236 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:36.444698  6242 raft_consensus.cc:2396] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260812 19:23:36.444855  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:36.458746  6342 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260812 19:23:36.459842  6298 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:36.421510 12361 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:36.418870 12406 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:36.465831  6347 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:23:36.467846  6481 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260812 19:23:36.469700  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:36.470325  6481 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:36.472908  6298 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:36.476238  6238 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:36.476393  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:36.442756 12411 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:36.478972  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:36.479785  6470 raft_consensus.cc:2354] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:36.479789  6298 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:36.484257  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:36.482244  6344 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:36.488094  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:36.492456  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:36.503294  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:36.488773 12411 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.474493 12393 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.482301 12440 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:36.513758 12458 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:36.419962 12446 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260812 19:23:36.517045  6481 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:36.517336  6474 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:36.482028 12308 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:36.442793 12415 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:36.484973  6235 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:36.521757  6342 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:36.462167 12477 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:36.522679 12035 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:36.455892 12417 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
W20260812 19:23:36.522727  7603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 439) took 3843 ms (client timeout 1948 ms). Trace:
W20260812 19:23:36.564980  7603 rpcz_store.cc:269] 0812 19:23:32.679612 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:32.679756 (+   144us) service_pool.cc:227] Handling call
0812 19:23:33.031406 (+351650us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b5800005498. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:23:36.522489 (+3491083us) spinlock_profiling.cc:243] Waited 3.27 s on lock 0x7b5400670554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:36.522616 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7538697344}
I20260812 19:23:36.524341  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:36.443261 12460 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:36.526867  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:36.524609 12444 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:23:36.529142  6238 raft_consensus.cc:2354] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7.
I20260812 19:23:36.531157  6230 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:36.538048  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:36.539357  6482 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260812 19:23:36.477260 12406 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:36.542255  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:36.544792  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:36.538177  6178 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:36.485544 12274 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 19:23:36.538956 12366 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.543071 12355 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:36.551851  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:36.586553  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:36.587339  6464 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:36.439422 12325 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260812 19:23:36.551458 12351 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:36.559217 12446 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:36.592084  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:36.560602 12454 raft_consensus.cc:3032] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:36.543676 12440 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:36.563242  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:36.446714 12462 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.093s
I20260812 19:23:36.611095  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:36.569603  6475 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:36.612038  6342 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
W20260812 19:23:36.613837 12531 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260812 19:23:36.528734  6470 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:23:36.615751 12534 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260812 19:23:36.617060 12404 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:36.568610 12477 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.617623 12404 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.619668  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:36.620036 12477 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:36.575906 12464 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:36.621769  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1678) took 1281 ms. Trace:
I20260812 19:23:36.622265  6481 raft_consensus.cc:1226] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:36.622197  6354 rpcz_store.cc:276] 0812 19:23:35.340354 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:35.342166 (+  1812us) service_pool.cc:227] Handling call
0812 19:23:35.342507 (+   341us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:35.448179 (+105672us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:36.621548 (+1173369us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b5400180954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:36.621708 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":115827072}
I20260812 19:23:36.624629 11851 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:36.579895 12460 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:36.581789  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:36.585598  6236 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:36.590312  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:36.659385 12464 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:23:36.564869 12393 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:36.661131  6464 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:36.489908 12400 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260812 19:23:36.594771  6482 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:36.597118  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:23:36.598057  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60027.8us
W20260812 19:23:36.599049  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 119260us
I20260812 19:23:36.602581  6345 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:36.665395  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:36.607161  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:36.625414  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:36.667292  7603 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:36.626052  6483 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:36.576261  6238 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:36.621769  6349 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260812 19:23:36.668368  6344 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:36.586565 12406 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:36.669554  6349 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260812 19:23:36.583312  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 45733.3us
I20260812 19:23:36.586618 12355 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:36.670684 12400 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:36.671197 12355 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:36.591902 12131 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:36.673117 12131 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:36.673611 12131 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:36.669632  6344 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260812 19:23:36.676028 12364 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:36.676646 12361 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:23:36.664676  7553 leader_election.cc:398] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7.
I20260812 19:23:36.665464  6298 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:36.679740  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:36.680972  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:36.682085  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:36.617544  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:36.671247 12400 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:36.684104  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:36.679692  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:36.685510  6482 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 19:23:36.689477  6470 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
W20260812 19:23:36.656067  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 217793us
I20260812 19:23:36.691370  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:36.595752 12450 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:36.693883  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:36.694197  6298 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:36.565297 12415 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.598349 12454 raft_consensus.cc:729] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:36.594205 12446 raft_consensus.cc:686] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:36.564357 12308 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.699775  6236 raft_consensus.cc:3032] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:36.655758 12366 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:36.707664  6465 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260812 19:23:36.704593  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:36.628057 12351 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:36.626983 12440 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:36.705354  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:36.706571  6342 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:36.710502  6236 raft_consensus.cc:729] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:36.695559  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:36.711118  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:36.712527  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:36.699537 12400 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:36.717839  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:36.717932  7603 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 4. Current term is 5. Ops: []
I20260812 19:23:36.699404 12481 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:36.693768 12035 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:36.551891 12458 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.700558 12436 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:36.699271 12477 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:36.720790  6178 leader_election.cc:398] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8.
I20260812 19:23:36.703150 12045 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:36.678423 12361 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260812 19:23:36.722023  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:36.715422  6236 consensus_queue.cc:260] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.706241 12429 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:36.756824  6178 leader_election.cc:398] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:36.704124 12444 raft_consensus.cc:2741] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260812 19:23:36.755312  6236 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:36.688994 12464 consensus_queue.cc:1046] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260812 19:23:36.709090 12274 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:36.633858 12451 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260812 19:23:36.715097 12351 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:36.785928  6344 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 5. Current term is 6. Ops: []
I20260812 19:23:36.786329  6475 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
W20260812 19:23:36.784906  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 67182.2us
I20260812 19:23:36.711720 12525 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:36.717705 12489 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:36.720485 12481 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:36.754922  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:36.709322 12149 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260812 19:23:36.704352 12213 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260812 19:23:36.761071 12553 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:36.804025  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:36.832010  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:36.878501  7600 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:36.760944 12518 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:36.707479 12450 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.765478 12436 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:36.757130 12045 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:36.705685 12042 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260812 19:23:36.843631  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:36.719832 12403 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:36.718133 12251 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260812 19:23:36.852267  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 63875.9us
I20260812 19:23:36.753638 12358 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:36.915294 12358 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:36.756307 12477 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:36.724037 12490 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:36.800071 12274 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:36.835369 12351 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:36.832944 12325 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:36.789700 12487 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:36.803601 12404 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:36.877944  6345 raft_consensus.cc:2396] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260812 19:23:36.786356 12364 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260812 19:23:36.833205 12525 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:23:36.868247 12535 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260812 19:23:36.853220 12481 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:23:36.897828  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 54311.1us
I20260812 19:23:36.981035  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:36.879184 12435 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election won for term 10
W20260812 19:23:36.887018 12303 consensus_meta.cc:287] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.002s
W20260812 19:23:36.864979  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 110209us
I20260812 19:23:36.883244 12518 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:36.892637 12045 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:36.923090  7600 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:36.918329 12489 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:36.920581 12403 raft_consensus.cc:686] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:36.950098 12458 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:36.917375 12506 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.178s
I20260812 19:23:36.976338  6359 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:36.997337  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:36.922721 12477 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:36.799921 12454 consensus_queue.cc:260] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.955188 12274 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:23:36.970276 12562 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260812 19:23:36.986004  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:36.985363 12460 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:36.990821 12325 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:36.993768  6179 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:36.897081 12436 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.995937  6353 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:36.869181 12446 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:36.967360 12487 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:36.999419  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:37.001355  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 279383us
I20260812 19:23:36.999840  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:37.000978  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 94387us
I20260812 19:23:37.126796  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:37.124907  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.129088  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.131845  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:37.002686  6470 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:23:37.133249  6464 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:37.133258  6470 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:37.005105  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:36.980983 12525 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:36.989873  6345 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260812 19:23:36.989997  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:36.993413 12518 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:37.012564  6235 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:23:36.997313 12308 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:36.997252 12415 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:37.056650 12490 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:37.047613 12325 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.124550 12416 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:37.012341 12522 consensus_queue.cc:1046] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260812 19:23:37.067325 12403 consensus_queue.cc:237] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:37.074839 12578 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260812 19:23:37.007998 12566 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:37.063516  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:37.071408 12436 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:36.991881 12423 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260812 19:23:37.135133 12487 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:37.113809 12491 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.910s	user 0.001s	sys 0.002s
I20260812 19:23:37.011330 12489 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:23:37.114943 12260 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260812 19:23:37.115875 12359 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:37.001166 12354 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:37.116871 12447 raft_consensus.cc:3032] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:23:37.006217 12435 raft_consensus.cc:686] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:37.120383  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:37.120841 12450 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:37.123104 12475 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:37.122629 12274 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:37.124840  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 103154us
I20260812 19:23:37.142530  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:37.142620  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:37.129689  6354 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:37.144618  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:37.149835  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:37.151477  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:37.114068 12440 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.150923 12574 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:37.167160  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:37.208297 12574 raft_consensus.cc:686] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:37.209138  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:37.169687  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:37.048484 12560 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260812 19:23:37.202211 12475 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.194140 12359 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.188409 12260 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:35.851162  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:37.176373 12566 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:37.171954  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:37.226051  6054 catalog_manager.cc:5495] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 6 to 7, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 7 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:37.228192  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:37.187302  6473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1952) took 1620 ms (client timeout 2012 ms). Trace:
I20260812 19:23:37.185082  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:37.229158  6473 rpcz_store.cc:269] 0812 19:23:35.566461 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:35.566558 (+    97us) service_pool.cc:227] Handling call
0812 19:23:37.187043 (+1620485us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b540003c5d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:37.187227 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":652863744}
I20260812 19:23:37.158828 12444 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260812 19:23:37.199554  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:37.176633 12522 consensus_queue.cc:1225] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Peer bdfa5579d4534c618c00db6b4a841c81 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260812 19:23:37.203540  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:37.218367  6060 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 238) took 5417 ms. Trace:
I20260812 19:23:37.233901  6475 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:37.209527 12574 consensus_queue.cc:237] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.236373  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:37.236649 12506 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:37.237250  6230 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:37.237246 12506 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:37.239573 12506 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:37.239806 12247 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:23:37.238391  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:37.242182  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:37.203702  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:37.204603  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:37.190677 12447 raft_consensus.cc:729] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:23:37.190034 12514 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.863s	user 0.017s	sys 0.000s
I20260812 19:23:37.207152 12490 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:37.210610  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:37.262490 12502 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.175s	user 0.006s	sys 0.004s
I20260812 19:23:37.263212  6236 raft_consensus.cc:2379] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 7: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:37.227905  6054 catalog_manager.cc:5495] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:37.265688  6054 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 9 to 10, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 10 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:23:37.203991  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 54286.6us
I20260812 19:23:37.267527  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:37.268018  6224 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260812 19:23:37.268718  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:37.250622  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:37.269908  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:37.212137  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 432) took 1653 ms. Trace:
I20260812 19:23:37.268589  6054 catalog_manager.cc:5495] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:37.243832  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:37.270864  6477 rpcz_store.cc:276] 0812 19:23:35.558279 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:35.560260 (+  1981us) service_pool.cc:227] Handling call
0812 19:23:35.560578 (+   318us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:35.661445 (+100867us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:35.661484 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:35.686546 (+ 25062us) log.cc:842] Serialized 26 byte log entry
0812 19:23:35.912944 (+226398us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:35.913008 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:35.913129 (+   121us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:37.112677 (+1199548us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:37.211731 (+ 99054us) raft_consensus.cc:1671] finished
0812 19:23:37.211763 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:37.212034 (+   271us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":237642,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":500,"spinlock_wait_cycles":12846848,"thread_start_us":254401,"threads_started":2,"wal-append.queue_time_us":356714}
I20260812 19:23:37.188472  6342 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260812 19:23:37.243602  6242 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:37.248903  7606 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260812 19:23:37.249686  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:37.234400  6060 rpcz_store.cc:276] 0812 19:23:31.800653 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:31.801029 (+   376us) service_pool.cc:227] Handling call
0812 19:23:37.218285 (+5417256us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:33.276119 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:33.276905 (+   786us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:33.276951 (+    46us) write_op.cc:435] Acquired schema lock
0812 19:23:33.276976 (+    25us) tablet.cc:660] Decoding operations
0812 19:23:33.277868 (+   892us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:33.277971 (+   103us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:33.278010 (+    39us) tablet.cc:683] Acquiring locks for 5 operations
0812 19:23:33.278751 (+   741us) tablet.cc:699] Row locks acquired
0812 19:23:33.278779 (+    28us) write_op.cc:260] PREPARE: finished
0812 19:23:33.278967 (+   188us) write_op.cc:270] Start()
0812 19:23:33.279109 (+   142us) write_op.cc:276] Timestamp: P: 1786562613278902 usec, L: 0
0812 19:23:33.279152 (+    43us) op_driver.cc:331] REPLICATION: starting
0812 19:23:33.279952 (+   800us) log.cc:842] Serialized 2059 byte log entry
0812 19:23:33.445044 (+165092us) op_driver.cc:444] REPLICATION: finished
0812 19:23:33.938403 (+493359us) write_op.cc:301] APPLY: starting
0812 19:23:33.939827 (+  1424us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:33.951809 (+ 11982us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:33.967839 (+ 16030us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:34.051610 (+ 83771us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:34.060074 (+  8464us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0812 19:23:34.060146 (+    72us) write_op.cc:312] APPLY: finished
0812 19:23:34.060421 (+   275us) log.cc:842] Serialized 47 byte log entry
0812 19:23:34.061256 (+   835us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:34.061392 (+   136us) write_op.cc:454] Released schema lock
0812 19:23:34.061439 (+    47us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:34.064690 (+  3251us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:34.065013 (+   323us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1101220,"reported_tablets":21,"spinlock_wait_cycles":17408,"child_traces":[["op",{"apply.queue_time_us":471876,"apply.run_cpu_time_us":4319,"apply.run_wall_time_us":136830,"num_ops":5,"prepare.queue_time_us":88496,"prepare.run_cpu_time_us":9979,"prepare.run_wall_time_us":71339,"raft.queue_time_us":72651,"raft.run_cpu_time_us":7369,"raft.run_wall_time_us":28674,"replication_time_us":165727,"thread_start_us":208958,"threads_started":4,"wal-append.queue_time_us":85425,"wal-append.run_cpu_time_us":27749,"wal-append.run_wall_time_us":1701410}]]}
I20260812 19:23:37.240345 12247 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:37.251816  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:37.276579  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:37.252512  6349 raft_consensus.cc:2379] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:37.172950 12355 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:37.219269 12260 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:37.255271 12303 consensus_queue.cc:1046] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:23:37.255715  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:37.294617  7603 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:37.255793 12295 consensus_queue.cc:1046] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:23:37.215294 12489 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.256934 12482 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:37.221632 12131 consensus_meta.cc:287] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.003s
I20260812 19:23:37.212981 12440 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:37.216209  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1945) took 1612 ms. Trace:
I20260812 19:23:37.339221  6232 rpcz_store.cc:276] 0812 19:23:35.603782 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:35.603885 (+   103us) service_pool.cc:227] Handling call
0812 19:23:35.636982 (+ 33097us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:36.187050 (+550068us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:37.215984 (+1028934us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54000f50d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:37.216141 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1263549312}
I20260812 19:23:37.273792  6464 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 5.
I20260812 19:23:37.277081  6054 catalog_manager.cc:5495] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:37.279241  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:37.284638  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:37.243398  6475 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
W20260812 19:23:37.342491  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 57926.9us
I20260812 19:23:37.343218  6475 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260812 19:23:37.344794  6475 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260812 19:23:37.217726 12475 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:37.247509 12359 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:37.338824 12131 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:37.299599  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 49087.3us
I20260812 19:23:37.264868 12510 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:37.250044 12450 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:23:37.300923  6417 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:37.266263 12514 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260812 19:23:37.292249 12366 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.568s	user 0.014s	sys 0.000s
I20260812 19:23:37.286818 12213 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:37.232779 12436 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260812 19:23:37.336510  6236 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:23:37.337563 12338 raft_consensus.cc:3032] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:37.210321 12400 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.288473 12444 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260812 19:23:37.303284 12406 consensus_meta.cc:287] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.007s
I20260812 19:23:37.288657 12462 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:37.350901  6464 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260812 19:23:37.354817  6481 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:37.354843  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:37.252214 12431 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260812 19:23:37.343640  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:37.265194 12479 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260812 19:23:37.294837 12416 raft_consensus.cc:686] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:37.332571 12415 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:37.366467  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 65655.4us
I20260812 19:23:37.369385  6475 raft_consensus.cc:1226] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260812 19:23:37.193069 12354 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.358048 12482 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:37.354455 12042 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260812 19:23:37.446911  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 92175.3us
I20260812 19:23:37.447745 12149 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:23:37.448925 12585 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:37.449611 12440 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:37.417256 12487 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.387053 12475 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:37.412045 12506 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:37.452011 12591 log.cc:924] Time spent T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260812 19:23:37.449612  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:37.458568  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 115007us
I20260812 19:23:37.469123  6242 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260812 19:23:37.372807 12295 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:37.457083 12551 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.865s	user 0.003s	sys 0.000s
I20260812 19:23:37.402207 12131 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:37.480808 12417 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:37.367053 12582 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:37.478578 12351 consensus_meta.cc:287] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.004s
I20260812 19:23:37.468152 12444 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:37.430824 12338 raft_consensus.cc:729] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:37.436803 12260 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:37.489257 11851 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:37.372898 12448 consensus_queue.cc:1046] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260812 19:23:37.334918 12435 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:37.463068 12460 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:37.501782  6232 raft_consensus.cc:1261] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260812 19:23:37.541903  6232 pending_rounds.cc:76] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 3
I20260812 19:23:37.541671  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:37.542268  6232 pending_rounds.cc:97] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260812 19:23:37.542603  6232 raft_consensus.cc:2866] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:37.489997 12042 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:37.494515 12514 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:37.459937 12406 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.386888 12247 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:37.489935 12415 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.525602  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1978) took 1139 ms. Trace:
I20260812 19:23:37.551016  6241 rpcz_store.cc:276] 0812 19:23:36.385781 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:36.456956 (+ 71175us) service_pool.cc:227] Handling call
0812 19:23:36.457223 (+   267us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:36.484771 (+ 27548us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:36.484809 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:36.485244 (+   435us) log.cc:842] Serialized 26 byte log entry
0812 19:23:36.591284 (+106040us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:36.591337 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:36.591426 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:37.455435 (+864009us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:37.525158 (+ 69723us) raft_consensus.cc:1671] finished
0812 19:23:37.525179 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:37.525537 (+   358us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":80501,"raft.queue_time_us":31245,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":141,"spinlock_wait_cycles":15334784,"thread_start_us":105703,"threads_started":1,"wal-append.queue_time_us":106028}
I20260812 19:23:37.553670  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:37.526881 12260 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:37.512557 12446 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260812 19:23:37.508559 12553 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260812 19:23:37.521739 12444 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:37.522620 12351 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:37.565868 12444 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:37.528744 12411 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:37.512847 12295 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:37.503222 12475 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:37.539700  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:37.543578  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:23:37.519973 12045 consensus_meta.cc:287] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.005s
I20260812 19:23:37.524080 12416 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:37.514253 12274 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:37.540154 12477 consensus_meta.cc:287] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.520s	user 0.016s	sys 0.001s
I20260812 19:23:37.507272 12431 consensus_queue.cc:1046] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260812 19:23:37.548096 12042 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:37.541739 12131 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260812 19:23:37.538691 11851 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:37.558876 12247 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:37.559597 12260 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.560214 12400 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:37.574477 12475 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:37.562986 12446 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:37.543365 12355 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:37.556376 12514 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.516238 12417 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.568240  6238 raft_consensus.cc:1226] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:37.505177 12440 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.610977  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:37.571892  6241 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
W20260812 19:23:37.579294  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 98567.2us
I20260812 19:23:37.363786 12566 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.613425 12355 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:37.615861 12406 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:37.622591 12600 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
I20260812 19:23:37.583415  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:23:37.585089  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 45515.5us
I20260812 19:23:37.581126 12477 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:37.587147 12481 consensus_meta.cc:287] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.593s	user 0.001s	sys 0.014s
I20260812 19:23:37.537271 12582 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.579308 12045 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.513301 12585 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
W20260812 19:23:37.563488 12587 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260812 19:23:37.597570 12358 consensus_queue.cc:1046] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.008s
I20260812 19:23:37.578433 12458 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:37.578590 12213 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:37.584604 12460 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:37.609270  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1702) took 1135 ms. Trace:
I20260812 19:23:37.653215  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:23:37.602058 12563 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.985s	user 0.010s	sys 0.000s
I20260812 19:23:37.660317 12592 raft_consensus.cc:3032] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:37.661147 12592 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:37.626681  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.627471  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:37.628543  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:37.613992 12355 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.630681  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:37.610934 12581 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:37.631830 12343 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:37.632097 12400 consensus_queue.cc:1046] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:37.632774  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:37.605873 12351 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:37.673385  6464 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:37.635490 12417 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:37.633968 12589 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.187s	user 0.001s	sys 0.001s
I20260812 19:23:37.589404 12506 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:37.642009 12582 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:37.642405 12440 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:37.644484  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1952) took 1264 ms. Trace:
I20260812 19:23:37.695735  6359 rpcz_store.cc:276] 0812 19:23:36.380045 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:36.431501 (+ 51456us) service_pool.cc:227] Handling call
0812 19:23:36.431848 (+   347us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:37.002487 (+570639us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:37.644183 (+641696us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54002d05d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:37.644412 (+   229us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1251470720}
I20260812 19:23:37.697108  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:37.698398  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.637049  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:37.585060 12274 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260812 19:23:37.726814 12581 raft_consensus.cc:686] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:37.653892  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1947) took 1279 ms. Trace:
I20260812 19:23:37.654219  7603 raft_consensus.cc:2379] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:37.653345  6465 rpcz_store.cc:276] 0812 19:23:36.473726 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:36.524248 (+ 50522us) service_pool.cc:227] Handling call
0812 19:23:36.524545 (+   297us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:36.711115 (+186570us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:37.609074 (+897959us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54004448d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:37.609215 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":420253056}
I20260812 19:23:37.727566  6347 rpcz_store.cc:276] 0812 19:23:36.374727 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:36.404311 (+ 29584us) service_pool.cc:227] Handling call
0812 19:23:37.653705 (+1249394us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b540003fcd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:37.653830 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":85098880}
I20260812 19:23:37.659567  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.728617  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:37.664959  6470 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 11: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:37.663019  6342 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 5.
I20260812 19:23:37.668875  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:37.730916  6352 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:37.669392  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:37.633474 12595 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260812 19:23:37.675805  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:37.677639  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 168199us
I20260812 19:23:37.685043 12482 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:37.646787 12481 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.672345 12487 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:37.688370  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 398) took 1202 ms. Trace:
I20260812 19:23:37.645090 12477 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:37.686446 12295 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:37.676470 12358 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:37.691838 12260 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:37.759629  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 123902us
I20260812 19:23:37.678826 12514 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:37.724071  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.761015  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:37.761436  6353 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:37.659281 12458 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:37.731881  6464 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:37.728801  6345 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:23:37.735841  6465 raft_consensus.cc:1226] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260812 19:23:37.737023  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.697679 12354 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:37.685704  7600 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:37.738389  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:37.740887  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.743393  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:37.742985  6228 rpcz_store.cc:276] 0812 19:23:36.486214 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:36.578781 (+ 92567us) service_pool.cc:227] Handling call
0812 19:23:36.579165 (+   384us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:36.579399 (+   234us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:36.579428 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:36.579927 (+   499us) log.cc:842] Serialized 26 byte log entry
0812 19:23:36.589878 (+  9951us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:36.589918 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:36.589991 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:37.566878 (+976887us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:37.662205 (+ 95327us) raft_consensus.cc:1671] finished
0812 19:23:37.662240 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:37.688276 (+ 26036us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":35997440,"thread_start_us":9557,"threads_started":1,"wal-append.queue_time_us":9981}
I20260812 19:23:37.742637 12585 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:37.738230 12213 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.759675 12358 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:37.777384  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:37.762615  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:37.749796 12602 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.124s	user 0.001s	sys 0.001s
I20260812 19:23:37.764503 12514 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260812 19:23:37.730476 12525 consensus_meta.cc:287] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.563s	user 0.004s	sys 0.013s
I20260812 19:23:37.780226  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.780534  6475 raft_consensus.cc:1226] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:37.785142  6477 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:37.738773 12045 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:37.785748  6228 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 5. Current term is 7. Ops: []
W20260812 19:23:37.786401  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 48107.2us
I20260812 19:23:37.764005 12458 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:37.789000  6350 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
W20260812 19:23:37.780107 12518 consensus_meta.cc:287] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.007s
I20260812 19:23:37.799404  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.800256  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.800859  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.803840  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:37.813755  6350 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:37.778010 12358 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.784837 12295 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:37.823251 12251 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:37.796139 12525 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.824494  6350 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:23:37.828426  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.839071  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.839205  6345 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:37.839413  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:37.834969  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:37.785017 12585 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:37.825730  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:37.844839  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 67597.3us
I20260812 19:23:37.845297  6228 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:37.783531 12415 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:37.803583 12406 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:37.836560  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:37.852985  6242 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:37.853022  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:37.842350  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.840240  6353 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 12: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:23:37.855666  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 115648us
I20260812 19:23:37.824021 12045 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:37.843976  6352 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:23:37.791222 12402 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:37.785306 12514 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:37.825114  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:37.857213  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:37.823626 12131 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:37.832791 12457 raft_consensus.cc:3032] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:37.848409  7593 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260812 19:23:37.866537  6350 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260812 19:23:37.869307  6228 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:23:37.809754  7600 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:37.880277 12343 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:37.825116 12411 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:37.898427 12411 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:37.894448 12403 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:37.899886 12481 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:37.885392  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:37.840812 12295 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:37.804297 12489 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.054s
I20260812 19:23:37.831501 12251 raft_consensus.cc:686] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:23:37.851826 12490 consensus_meta.cc:287] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.004s
I20260812 19:23:37.897172 12423 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:37.889065  6354 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: []
W20260812 19:23:37.890455  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 65217.9us
I20260812 19:23:37.823729 12458 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:37.734702 12592 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.889066 12514 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:37.826344 12518 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.905110  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:37.764523 12581 consensus_queue.cc:237] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.890475 12457 raft_consensus.cc:729] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:37.911144  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:37.914412  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:37.890699 12247 consensus_queue.cc:1046] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260812 19:23:37.904542 12355 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:37.907218 12295 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:37.910336 12435 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:37.889856 12045 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.956250 12435 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:37.956732 12435 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:37.907657  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:37.894618 12131 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.949146  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:37.949972  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:37.951761 12597 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.269s	user 0.002s	sys 0.000s
I20260812 19:23:37.898989 12343 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:37.937989 12423 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:37.955457 12611 consensus_queue.cc:1046] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260812 19:23:37.923079 12490 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260812 19:23:37.963587  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55990.3us
I20260812 19:23:37.962807  6228 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:37.960449 12403 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:37.999573  6354 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260812 19:23:37.979200  6235 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260812 19:23:37.902310 12417 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
W20260812 19:23:37.970424  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 59318.1us
I20260812 19:23:38.028575  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:37.963675 12487 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:37.936043 12458 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:37.982957 12416 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:37.980741 12525 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:37.978133 12482 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:38.041275  6242 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:38.056238  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:38.075623  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:38.076722  6228 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:23:38.086826  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 189774us
I20260812 19:23:38.075587  6242 raft_consensus.cc:2396] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260812 19:23:38.035360 12416 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:38.067932 12355 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:37.978353 12251 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:38.000577 11851 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:38.104537 12481 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:38.083647 12042 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:38.146298  6353 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:38.117841 12416 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:23:38.229549  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 279605us
I20260812 19:23:38.231873  6228 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:23:38.233174  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:38.234398  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:38.235286  6242 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:38.236374  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:38.140312 12644 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260812 19:23:38.240216 12540 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.453s	user 0.004s	sys 0.013s
I20260812 19:23:38.240602 12644 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:23:38.241317 12631 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260812 19:23:38.243896 12131 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:38.244041 12518 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:38.246683 12423 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:38.247241  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 144000us
I20260812 19:23:38.241210 12644 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:23:38.249765  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 248928us
I20260812 19:23:38.228946  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1976) took 1069 ms. Trace:
I20260812 19:23:38.251416  6470 rpcz_store.cc:276] 0812 19:23:37.159434 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.243587 (+ 84153us) service_pool.cc:227] Handling call
0812 19:23:38.228680 (+985093us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54003a9154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:38.228876 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":898438912}
I20260812 19:23:38.253656  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:38.255887  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:38.199649 12444 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.006s
I20260812 19:23:38.257280  6228 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:38.258066  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:38.265830  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:38.187523 12618 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:38.270844  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:38.145601 11851 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:38.167748 12045 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:38.283881 12628 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.297s	user 0.005s	sys 0.002s
I20260812 19:23:38.246264 12514 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:38.312644  6354 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:38.142366 12355 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:38.288259 12131 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:38.334348  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1977) took 1952 ms. Trace:
I20260812 19:23:38.257390 12446 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:38.312269  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:38.293241 12415 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:38.213141 12481 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:38.342727  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:38.262180 12487 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260812 19:23:38.331238 12045 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:38.344712  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1963) took 1100 ms. Trace:
I20260812 19:23:38.354809  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:38.351403  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1962) took 1159 ms. Trace:
I20260812 19:23:38.311450 12458 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:38.345645  6229 rpcz_store.cc:276] 0812 19:23:36.381620 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:36.381778 (+   158us) service_pool.cc:227] Handling call
0812 19:23:36.382238 (+   460us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:36.382691 (+   453us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:36.382733 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:36.383308 (+   575us) log.cc:842] Serialized 26 byte log entry
0812 19:23:36.490453 (+107145us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:36.490505 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:36.490595 (+    90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:38.238897 (+1748302us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:38.316658 (+ 77761us) raft_consensus.cc:1671] finished
0812 19:23:38.316685 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:38.334250 (+ 17565us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20664,"raft.queue_time_us":1914,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":17118,"spinlock_wait_cycles":9354752,"thread_start_us":88542,"threads_started":1,"wal-append.queue_time_us":304620}
I20260812 19:23:38.371622  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:38.372507  6228 rpcz_store.cc:276] 0812 19:23:37.244732 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:38.269392 (+1024660us) service_pool.cc:227] Handling call
0812 19:23:38.271488 (+  2096us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:38.343594 (+ 72106us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:38.343739 (+   145us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:38.344394 (+   655us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:38.344448 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:38.344525 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:38.344647 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:38.350673  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 96762.8us
I20260812 19:23:38.398406  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 408) took 1145 ms. Trace:
I20260812 19:23:38.398962  6229 rpcz_store.cc:276] 0812 19:23:37.252609 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:38.397363 (+1144754us) service_pool.cc:227] Handling call
0812 19:23:38.397761 (+   398us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:38.397998 (+   237us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:38.398034 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:38.398087 (+    53us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:38.398130 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:38.398195 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:38.398335 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:38.395921  7598 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:23:38.375617 12645 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:38.271198 12444 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:38.405332  6179 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:38.372733  6232 rpcz_store.cc:276] 0812 19:23:37.191833 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.646063 (+454230us) service_pool.cc:227] Handling call
0812 19:23:37.687726 (+ 41663us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:37.692492 (+  4766us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:37.692539 (+    47us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:37.694175 (+  1636us) log.cc:842] Serialized 52 byte log entry
0812 19:23:37.900439 (+206264us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:37.900483 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:37.900555 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:38.351113 (+450558us) raft_consensus.cc:1671] finished
0812 19:23:38.351136 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:38.351340 (+   204us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4241,"raft.queue_time_us":13553,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":10635,"thread_start_us":166755,"threads_started":1,"wal-append.queue_time_us":235794}
I20260812 19:23:38.358389 12525 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:23:38.352224 12415 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:38.409327  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:38.360345 12518 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:38.362643 12131 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:38.348330 11851 consensus_queue.cc:1046] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260812 19:23:38.394906  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:38.378448 12417 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:38.407621 12645 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:38.465829  6229 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260812 19:23:38.471114  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1964) took 1181 ms. Trace:
I20260812 19:23:38.411208 12045 raft_consensus.cc:686] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:23:38.444936 12506 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.017s	sys 0.042s
I20260812 19:23:38.471935  6229 rpcz_store.cc:276] 0812 19:23:37.289919 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:38.400108 (+1110189us) service_pool.cc:227] Handling call
0812 19:23:38.465511 (+ 65403us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:38.470746 (+  5235us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:38.471040 (+   294us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:38.414951 12423 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:38.359305 12325 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260812 19:23:38.359114 12446 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:38.449334 12415 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:38.411996 12458 consensus_queue.cc:1046] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
W20260812 19:23:38.470644 12619 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.226s	user 0.002s	sys 0.000s
I20260812 19:23:38.463330 12518 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:38.475148 12417 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:38.501991  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 244027us
W20260812 19:23:38.478227 12506 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.017s	sys 0.043s
I20260812 19:23:38.505270  6470 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260812 19:23:38.497020 12660 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260812 19:23:38.477041 12645 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:38.506161 12045 consensus_queue.cc:237] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:38.297746 12618 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:38.516781  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:38.507284 12642 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260812 19:23:38.512250  6473 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 8. Current term is 9. Ops: [5.4-8.5]
W20260812 19:23:38.497393 12626 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.235s	user 0.002s	sys 0.005s
I20260812 19:23:38.516188  6465 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260812 19:23:38.492398 12481 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:38.497021 12621 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.315s	user 0.002s	sys 0.005s
I20260812 19:23:38.628424  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:38.626824  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1961) took 1440 ms. Trace:
I20260812 19:23:38.560896  6228 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
W20260812 19:23:38.606870 12658 log.cc:924] Time spent T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.125s	user 0.000s	sys 0.002s
W20260812 19:23:38.640410 12661 log.cc:924] Time spent T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260812 19:23:38.643970 12402 consensus_meta.cc:287] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.755s	user 0.005s	sys 0.013s
W20260812 19:23:38.598752 12475 consensus_meta.cc:287] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.989s	user 0.016s	sys 0.000s
I20260812 19:23:38.642951  6241 rpcz_store.cc:276] 0812 19:23:37.185974 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.631687 (+445713us) service_pool.cc:227] Handling call
0812 19:23:37.636382 (+  4695us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:37.735855 (+ 99473us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:23:37.735889 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:37.736325 (+   436us) log.cc:842] Serialized 26 byte log entry
0812 19:23:37.950503 (+214178us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:37.950736 (+   233us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:38.626231 (+675495us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x7b54002f9754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:38.626309 (+    78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:38.626380 (+    71us) raft_consensus.cc:1671] finished
0812 19:23:38.626400 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:38.626740 (+   340us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5783,"raft.queue_time_us":20081,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":122,"spinlock_wait_cycles":141982464,"thread_start_us":213642,"threads_started":1,"wal-append.queue_time_us":534525}
I20260812 19:23:38.646401 12475 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:38.595894 12514 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:38.648000 12514 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:38.642997  6465 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:38.649720 12484 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:38.643004 12416 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:38.652954 12484 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:23:38.648967  6241 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260812 19:23:38.654772  6241 pending_rounds.cc:76] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 6
I20260812 19:23:38.617255 12657 raft_consensus.cc:3032] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:38.655268  6241 pending_rounds.cc:97] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260812 19:23:38.655576 12657 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:38.655874  6241 raft_consensus.cc:2866] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:23:38.525038  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 182363us
I20260812 19:23:38.505028 12403 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:38.675130  6359 raft_consensus.cc:3032] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:38.675251 12416 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:38.675796  6359 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:38.676424 12416 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:38.676658  6359 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:38.677289 12416 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:38.678602 12462 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:38.679656 12462 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:38.680539 12618 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:38.616353 12637 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260812 19:23:38.497608 12042 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:38.648944 12514 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:38.587106 12581 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:38.624755 12446 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:38.706904  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 352176us
I20260812 19:23:38.638577 12677 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:38.680491 12416 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:38.595105 12444 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:38.734962  6474 raft_consensus.cc:2379] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:38.703706  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1966) took 1572 ms. Trace:
I20260812 19:23:38.736864  6465 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:38.588769 12487 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:38.690511 12403 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:38.556870 12131 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:39.000054  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.002s	sys 0.009s
I20260812 19:23:38.842866  7603 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:38.929379  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:38.879735  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1978) took 1082 ms. Trace:
I20260812 19:23:38.861238  6354 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260812 19:23:39.000682  6228 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260812 19:23:38.828891  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:38.810525  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1957) took 1646 ms. Trace:
I20260812 19:23:38.819155  6232 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260812 19:23:38.974817  6347 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.000s	sys 0.041s
W20260812 19:23:39.032919  6347 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.003s	sys 0.043s
I20260812 19:23:38.878327  7600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60760 (request call id 498) took 1337 ms. Trace:
W20260812 19:23:39.027655  6175 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.004s	sys 0.006s
I20260812 19:23:38.974390  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 407) took 1760 ms. Trace:
I20260812 19:23:38.886366  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 469) took 2199 ms. Trace:
I20260812 19:23:38.730692 12042 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:23:38.831651 12435 consensus_meta.cc:287] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.874s	user 0.017s	sys 0.000s
I20260812 19:23:38.951967  7591 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260812 19:23:39.031818  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:38.967260 12644 consensus_meta.cc:287] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.674s	user 0.007s	sys 0.010s
I20260812 19:23:38.816072  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1971) took 1683 ms. Trace:
I20260812 19:23:39.058269  6344 rpcz_store.cc:276] 0812 19:23:36.686891 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:36.699131 (+ 12240us) service_pool.cc:227] Handling call
0812 19:23:36.699402 (+   271us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:36.842758 (+143356us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:38.886035 (+2043277us) spinlock_profiling.cc:243] Waited 67.4 ms on lock 0x7b5400407ed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:38.886278 (+   243us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":155087744}
I20260812 19:23:38.941098  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:23:39.050618  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 188012us
I20260812 19:23:39.033928  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1981) took 1235 ms. Trace:
I20260812 19:23:38.828653  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:39.063911  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.005s	sys 0.011s
I20260812 19:23:38.892668  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1952) took 1760 ms. Trace:
I20260812 19:23:38.738176 12581 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:39.078086  6347 rpcz_store.cc:276] 0812 19:23:37.798310 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.854553 (+ 56243us) service_pool.cc:227] Handling call
0812 19:23:37.855002 (+   449us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:38.294272 (+439270us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:38.294310 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:38.309596 (+ 15286us) log.cc:842] Serialized 26 byte log entry
0812 19:23:39.033566 (+723970us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:39.033611 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:39.033690 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:39.033738 (+    48us) raft_consensus.cc:1671] finished
0812 19:23:39.033750 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:39.033877 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":47965,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":3218,"thread_start_us":1118727,"threads_started":2,"wal-append.queue_time_us":630567}
I20260812 19:23:39.030359  6350 rpcz_store.cc:276] 0812 19:23:37.797506 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.849981 (+ 52475us) service_pool.cc:227] Handling call
0812 19:23:37.866311 (+ 16330us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:37.895454 (+ 29143us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:38.879549 (+984095us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5400061650. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:38.879678 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":36785920}
I20260812 19:23:38.813237  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 402) took 2125 ms. Trace:
I20260812 19:23:39.004747 12683 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:38.823086 12417 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:38.931397 12423 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:38.943181 12582 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:38.800432 12251 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:39.026714 12403 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:39.013798  6482 rpcz_store.cc:276] 0812 19:23:37.130947 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.131095 (+   148us) service_pool.cc:227] Handling call
0812 19:23:37.131420 (+   325us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:37.224009 (+ 92589us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:37.224053 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:37.242617 (+ 18564us) log.cc:842] Serialized 26 byte log entry
0812 19:23:37.508598 (+265981us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:37.508636 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:38.683316 (+1174680us) spinlock_profiling.cc:243] Waited 92.1 ms on lock 0x7b54002d2654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:38.683380 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:38.683442 (+    62us) raft_consensus.cc:1671] finished
0812 19:23:38.683461 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:38.703593 (+ 20132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":25800,"raft.queue_time_us":10060,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":17440,"spinlock_wait_cycles":211722624,"thread_start_us":243680,"threads_started":1,"wal-append.queue_time_us":318338}
I20260812 19:23:39.152640  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:38.933976 12484 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:39.034590  6175 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.005s	sys 0.007s
I20260812 19:23:39.146680  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:39.154990  6465 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:39.057287  6354 pending_rounds.cc:76] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 3
I20260812 19:23:39.155678  6354 pending_rounds.cc:97] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260812 19:23:39.155985  6354 raft_consensus.cc:2866] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:39.008020 12481 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:38.872190 12351 raft_consensus.cc:3032] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:38.875231  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1700) took 2405 ms. Trace:
I20260812 19:23:39.077080  6477 rpcz_store.cc:276] 0812 19:23:37.132592 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.272601 (+140009us) service_pool.cc:227] Handling call
0812 19:23:37.276284 (+  3683us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:37.795038 (+518754us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:38.815794 (+1020756us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54002143d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:38.815990 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1166881664}
W20260812 19:23:39.036873  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 107643us
I20260812 19:23:39.078338  6230 rpcz_store.cc:276] 0812 19:23:37.132060 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.237982 (+105922us) service_pool.cc:227] Handling call
0812 19:23:38.892448 (+1654466us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b540027c9d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:38.892604 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1631653120}
I20260812 19:23:39.165380  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:39.165659  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:39.162744  6483 rpcz_store.cc:276] 0812 19:23:36.469651 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:36.471394 (+  1743us) service_pool.cc:227] Handling call
0812 19:23:36.516496 (+ 45102us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:36.668171 (+151675us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:38.874937 (+2206766us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400272754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:38.875146 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":251093888}
I20260812 19:23:39.167038  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:39.167824  6228 raft_consensus.cc:2379] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:39.168533  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:39.057037  6242 rpcz_store.cc:276] 0812 19:23:37.213614 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:38.259364 (+1045750us) service_pool.cc:227] Handling call
0812 19:23:38.259836 (+   472us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:38.260097 (+   261us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:38.260124 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:38.272362 (+ 12238us) log.cc:842] Serialized 26 byte log entry
0812 19:23:38.530305 (+257943us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:23:38.530356 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:38.530453 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:38.974113 (+443660us) raft_consensus.cc:1671] finished
0812 19:23:38.974138 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:38.974320 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":192889,"threads_started":1,"wal-append.queue_time_us":610436}
I20260812 19:23:39.171617  6347 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:39.171777  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:39.031682  6235 rpcz_store.cc:276] 0812 19:23:37.163914 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.293303 (+129389us) service_pool.cc:227] Handling call
0812 19:23:37.335817 (+ 42514us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:38.000114 (+664297us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:38.810172 (+810058us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b5400163ad4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:38.810444 (+   272us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1476139264}
W20260812 19:23:39.078320  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 822486us
I20260812 19:23:39.085852  6238 rpcz_store.cc:276] 0812 19:23:36.687753 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:36.688034 (+   281us) service_pool.cc:227] Handling call
0812 19:23:36.688425 (+   391us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:37.613025 (+924600us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:38.812941 (+1199916us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54002fab54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:38.813161 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2022874496}
I20260812 19:23:39.173041  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:39.173265  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:39.173867  6238 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:39.174767  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:39.175402  6238 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:39.176398  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:39.089561 12581 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:39.010325 12415 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:39.170336 12045 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:39.210786 12045 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:39.178591 12481 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:39.214306 12423 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:39.069181 12435 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:38.953545 12338 consensus_queue.cc:260] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:38.832486 12657 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:38.885700 12355 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:39.033732  7600 rpcz_store.cc:276] 0812 19:23:37.540559 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.540739 (+   180us) service_pool.cc:227] Handling call
0812 19:23:38.878125 (+1337386us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54004d12d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:38.878257 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":329428864}
I20260812 19:23:38.843997 12514 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:38.840428 12462 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:38.844732  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:39.033241 12448 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:38.835973 12475 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:39.135298  6473 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260812 19:23:38.940074  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:39.033607 12035 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:23:39.081357  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 140320us
I20260812 19:23:39.062980 12679 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260812 19:23:38.853152 12295 consensus_meta.cc:287] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.872s	user 0.006s	sys 0.010s
I20260812 19:23:39.179342  6230 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260812 19:23:39.133733 12416 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
I20260812 19:23:39.180586  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:38.968163 12645 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:39.173625  6242 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:39.032562 12446 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:39.067569 12042 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:38.831342 12677 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:39.030215 12487 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:39.081969 12644 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:41.673722 12514 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:41.673863 12448 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:41.675911 12514 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:39.170157 12417 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:41.678678 12417 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:39.160362 12582 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:39.215911 12481 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:41.681545 12481 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:39.160036 12251 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:39.448354 12692 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260812 19:23:41.948408 12042 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:41.949630 12251 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:39.170578 12351 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:41.951175 12455 consensus_queue.cc:1046] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:23:41.951866 12415 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:39.144361 12683 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:41.759133 12417 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:41.960289 12351 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:41.362020 12045 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:39.545327 12436 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:41.980123 12436 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:41.981942 12035 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:41.952653 12528 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:41.983861 12528 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:41.985662 12035 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:39.287324 12676 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:41.972985 12514 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:41.682380 12481 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:39.920608 12693 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.000s	sys 0.009s
W20260812 19:23:39.296281 12691 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.163s	user 0.001s	sys 0.001s
I20260812 19:23:41.961547 12451 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:39.703565 12402 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:39.178824 12611 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:41.986526 12528 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:40.952313  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 1.76665e+06us
W20260812 19:23:41.990932 12581 consensus_meta.cc:287] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 2.414s	user 0.009s	sys 0.004s
I20260812 19:23:42.079244 12295 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:39.219372 12671 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:42.009593 12446 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.146152 12677 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:42.147820 12446 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:42.147497 12402 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:39.139964 12678 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:39.187762 12484 consensus_queue.cc:1046] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 2.965s
I20260812 19:23:42.013394 12582 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:42.213058 12683 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:42.156586 12657 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:42.240724 12644 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:42.241967 12644 consensus_queue.cc:1046] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:23:42.242332  7606 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260812 19:23:42.245564 12435 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:42.246495 12435 raft_consensus.cc:3032] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:42.211966 12451 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:42.246948 12435 raft_consensus.cc:729] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:42.249521 12451 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:42.154213 12484 raft_consensus.cc:3032] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Stepping down as leader of term 10
W20260812 19:23:42.105472 12693 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.704s	user 0.000s	sys 0.013s
I20260812 19:23:42.252975  7594 raft_consensus.cc:2379] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:42.214165 12671 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:42.258174 12484 raft_consensus.cc:729] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:42.150468 12402 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:42.156663 12131 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.029s	sys 0.051s
I20260812 19:23:42.214711 12436 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:42.214720 12403 consensus_meta.cc:287] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 3.028s	user 0.004s	sys 0.011s
I20260812 19:23:42.213060 12481 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:42.212194 12645 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:42.156724 12679 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:42.271615 12679 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:42.214075 12487 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:42.276089 12435 consensus_queue.cc:260] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:42.256388 12671 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:42.270242 12295 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:42.280236  6349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1714) took 5520 ms (client timeout 2411 ms). Trace:
W20260812 19:23:42.280819  6349 rpcz_store.cc:269] 0812 19:23:36.759626 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:36.789635 (+ 30009us) service_pool.cc:227] Handling call
0812 19:23:42.279532 (+5489897us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54001b8854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:42.279889 (+   357us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":848491392}
W20260812 19:23:42.266534 12131 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.029s	sys 0.061s
I20260812 19:23:42.211838 12581 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:42.156508 12676 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.287624 12484 consensus_queue.cc:260] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:42.292865 12581 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:42.292845 12484 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:42.296335  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 1997) took 5295 ms. Trace:
I20260812 19:23:42.298808  6236 rpcz_store.cc:276] 0812 19:23:37.000768 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.263874 (+263106us) service_pool.cc:227] Handling call
0812 19:23:37.264297 (+   423us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:37.444601 (+180304us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:42.295615 (+4851014us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b540027d8d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:42.296012 (+   397us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":165416192}
I20260812 19:23:42.214564 12611 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.314429 12450 raft_consensus.cc:3032] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:42.314990 12450 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:42.315565 12611 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:42.321887 12676 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:42.322624 12460 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 4.526s	user 0.009s	sys 0.027s
I20260812 19:23:42.287022 12403 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.316880 12679 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:42.324668  7598 raft_consensus.cc:2379] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:42.325181 12403 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:42.323171 12460 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 4.540s	user 0.009s	sys 0.027s
W20260812 19:23:42.328886  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 172760us
I20260812 19:23:42.331485 12450 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.342546 12450 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:42.343222  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2020) took 3171 ms. Trace:
I20260812 19:23:42.327065 12679 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:42.351775  6236 rpcz_store.cc:276] 0812 19:23:39.171465 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:42.334761 (+3163296us) service_pool.cc:227] Handling call
0812 19:23:42.342416 (+  7655us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:42.342835 (+   419us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:42.342862 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:42.342922 (+    60us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:42.342957 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:42.343015 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:42.343143 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:42.348158  7553 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.633s (SENT) [suppressed 63 similar messages]
I20260812 19:23:42.349983  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1980) took 3841 ms. Trace:
I20260812 19:23:42.353796  6470 rpcz_store.cc:276] 0812 19:23:38.508791 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:38.508950 (+   159us) service_pool.cc:227] Handling call
0812 19:23:38.509389 (+   439us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:38.509804 (+   415us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:38.509834 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:42.278043 (+3768209us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b2c000cda88. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:23:42.286288 (+  8245us) log.cc:842] Serialized 26 byte log entry
0812 19:23:42.328996 (+ 42708us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:42.337174 (+  8178us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:42.340361 (+  3187us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:42.349275 (+  8914us) raft_consensus.cc:1671] finished
0812 19:23:42.349297 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:42.349705 (+   408us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":127666,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"spinlock_wait_cycles":19025664,"thread_start_us":38694,"threads_started":1,"wal-append.queue_time_us":42721}
W20260812 19:23:42.358454  6470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1713) took 3609 ms (client timeout 2972 ms). Trace:
W20260812 19:23:42.359135  6470 rpcz_store.cc:269] 0812 19:23:38.749126 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:42.358063 (+3608937us) service_pool.cc:214] Skipping call since client already timed out
0812 19:23:42.358252 (+   189us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:23:42.360862  6470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1717) took 3553 ms (client timeout 3115 ms). Trace:
W20260812 19:23:42.370844  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 3.276s	user 0.036s	sys 0.059s
W20260812 19:23:42.371621  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.290s	user 0.036s	sys 0.062s
I20260812 19:23:42.372918 12325 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:42.373907 12325 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.383747 12509 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:42.384728 12509 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:42.387284 12509 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:42.388238 12509 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:42.389055 12509 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:42.391489 12509 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:42.392717  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:42.393904 12509 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:42.394976 12509 raft_consensus.cc:686] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:42.396603 12509 consensus_queue.cc:237] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:42.404364 12102 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:42.406312 12581 raft_consensus.cc:3032] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:42.410778  6349 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260812 19:23:42.415647 12581 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:42.417073 12325 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:42.417457  6044 maintenance_manager.cc:419] P 4483e3a69e644cbea699c6f7c9c1da9e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.034234
I20260812 19:23:42.418203 12581 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.419428 12684 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:42.419692 12581 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:42.420466 12684 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:42.422911 12657 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:42.423193 12042 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:42.423723 12657 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.424206 12042 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.426481 12657 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:42.427096 12657 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:42.427765 12213 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:42.427964  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:42.428501 12213 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:42.429970  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:42.430986 12213 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:42.361564  6470 rpcz_store.cc:269] 0812 19:23:38.806990 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:42.360606 (+3553616us) service_pool.cc:214] Skipping call since client already timed out
0812 19:23:42.360767 (+   161us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260812 19:23:42.436787 12645 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:42.443903 12042 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:42.427814 12657 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.438325  6349 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260812 19:23:42.455577  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2017) took 3285 ms. Trace:
I20260812 19:23:42.436205 12554 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:23:42.464746  6470 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260812 19:23:42.464962 12657 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:42.465837  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1985) took 3908 ms. Trace:
I20260812 19:23:42.467267 12684 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:42.469444  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:42.470400  6349 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:42.466336  6470 rpcz_store.cc:276] 0812 19:23:38.557184 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:42.461609 (+3904425us) service_pool.cc:227] Handling call
0812 19:23:42.464270 (+  2661us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:42.465452 (+  1182us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:42.465740 (+   288us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:42.473701  6470 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260812 19:23:42.474001  6470 pending_rounds.cc:76] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 3
I20260812 19:23:42.474242  6470 pending_rounds.cc:97] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260812 19:23:42.477326 12657 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:42.478197 12657 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:42.480242 12509 consensus_queue.cc:1046] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:23:42.474561  6470 raft_consensus.cc:2866] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:42.482226 12683 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:42.484557  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 445) took 4856 ms. Trace:
I20260812 19:23:42.485149  6475 rpcz_store.cc:276] 0812 19:23:37.627785 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.627947 (+   162us) service_pool.cc:227] Handling call
0812 19:23:37.628307 (+   360us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:37.794653 (+166346us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:42.483745 (+4689092us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54004461d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:42.484210 (+   465us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":349525248}
W20260812 19:23:42.478399  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 48577.5us
I20260812 19:23:42.486994 12683 consensus_queue.cc:1046] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:42.456197  6241 rpcz_store.cc:276] 0812 19:23:39.170284 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:39.224369 (+ 54085us) service_pool.cc:227] Handling call
0812 19:23:42.413882 (+3189513us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:42.414202 (+   320us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:23:42.414610 (+   408us) log.cc:842] Serialized 14 byte log entry
0812 19:23:42.455031 (+ 40421us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:42.455083 (+    52us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:42.455128 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:42.455198 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:42.455370 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":167,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":168,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"spinlock_wait_cycles":59392,"thread_start_us":23518,"threads_started":1,"wal-append.queue_time_us":23965}
I20260812 19:23:42.490265  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1986) took 3931 ms. Trace:
I20260812 19:23:42.492915  6470 rpcz_store.cc:276] 0812 19:23:38.559050 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:42.472922 (+3913872us) service_pool.cc:227] Handling call
0812 19:23:42.473279 (+   357us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:42.489459 (+ 16180us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:42.490166 (+   707us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:42.491633  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:42.511490  6352 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:42.511924  6470 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:42.512277  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:42.512734  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:42.513478  6352 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:42.514547  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:42.487561  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:42.499576  6475 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260812 19:23:42.482571 12657 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:42.500394  6178 connection.cc:232] RPC call timeout handler was delayed by -3.2860394932795316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
I20260812 19:23:42.507323  6349 raft_consensus.cc:2396] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260812 19:23:42.972419  6178 connection.cc:232] RPC call timeout handler was delayed by -3.2428394930902869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260812 19:23:42.973098  6178 connection.cc:232] RPC call timeout handler was delayed by -3.0709394931327552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
I20260812 19:23:42.973340  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:42.974059  6349 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:42.975244 12359 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:42.975891 12359 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.978094 12359 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:42.508914 12274 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:42.978904 12274 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:42.980002 12440 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:42.980602 12440 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.981231 12274 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:42.517797  6347 raft_consensus.cc:2396] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260812 19:23:42.503448 12684 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.056442  7593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 492) took 4347 ms. Trace:
I20260812 19:23:43.056531 12684 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.518723  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1987) took 3952 ms. Trace:
I20260812 19:23:43.060156 12684 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.060516  6475 rpcz_store.cc:276] 0812 19:23:38.567480 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:42.486458 (+3918978us) service_pool.cc:227] Handling call
0812 19:23:42.499177 (+ 12719us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:42.518333 (+ 19156us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:42.518641 (+   308us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:43.057011  7593 rpcz_store.cc:276] 0812 19:23:38.708783 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:38.734761 (+ 25978us) service_pool.cc:227] Handling call
0812 19:23:38.840843 (+106082us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:41.958686 (+3117843us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:41.958793 (+   107us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:41.959871 (+  1078us) log.cc:842] Serialized 26 byte log entry
0812 19:23:42.005532 (+ 45661us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:42.008832 (+  3300us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.042121 (+1033289us) spinlock_profiling.cc:243] Waited 3.11 s on lock 0x7b54005ae6d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:43.042188 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:43.042258 (+    70us) raft_consensus.cc:1671] finished
0812 19:23:43.042284 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:43.056203 (+ 13919us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3905,"raft.queue_time_us":51206,"raft.run_cpu_time_us":697,"raft.run_wall_time_us":259145,"spinlock_wait_cycles":7149202816,"thread_start_us":34422,"threads_started":1,"wal-append.queue_time_us":279609}
I20260812 19:23:42.512673  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1716) took 3706 ms. Trace:
I20260812 19:23:43.065260  6470 rpcz_store.cc:276] 0812 19:23:38.806671 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:42.511142 (+3704471us) service_pool.cc:227] Handling call
0812 19:23:42.511594 (+   452us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:42.512390 (+   796us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:42.512584 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:42.527052  6352 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:43.067938  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:43.068563  6352 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:23:42.603708  6413 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 3.057s	user 0.012s	sys 0.018s
W20260812 19:23:43.075645  6413 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.529s	user 0.013s	sys 0.018s
I20260812 19:23:43.084818 12448 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:42.642917  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:42.643379  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:42.700941  6298 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 3.363s	user 0.011s	sys 0.028s
W20260812 19:23:42.701349  6238 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 3.480s	user 0.023s	sys 0.027s
W20260812 19:23:43.088907  6238 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 3.868s	user 0.024s	sys 0.027s
W20260812 19:23:43.088980  6298 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.763s	user 0.012s	sys 0.028s
I20260812 19:23:43.090379  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2012) took 3924 ms. Trace:
I20260812 19:23:43.090895  6238 rpcz_store.cc:276] 0812 19:23:39.165808 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:39.177178 (+ 11370us) service_pool.cc:227] Handling call
0812 19:23:39.177478 (+   300us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:39.177693 (+   215us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:23:39.221108 (+ 43415us) log.cc:842] Serialized 14 byte log entry
0812 19:23:43.089662 (+3868554us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:43.089789 (+   127us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:43.089914 (+   125us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.090056 (+   142us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:43.090300 (+   244us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":46515,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":9093,"thread_start_us":3868108,"threads_started":1,"wal-append.queue_time_us":2929712}
I20260812 19:23:42.708173  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:43.093945  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:42.709535 12355 raft_consensus.cc:3032] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:42.715346 12447 consensus_queue.cc:260] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:42.715941  6477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1711) took 3976 ms (client timeout 2270 ms). Trace:
W20260812 19:23:42.720026  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 371890us
I20260812 19:23:42.722754 12454 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:39.219143  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.062203  6475 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:23:42.745688 12446 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:42.746304 12457 consensus_queue.cc:260] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:42.521207  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:42.769539 12411 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:43.094568  6179 connection.cc:232] RPC call timeout handler was delayed by -2.9270956220570952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2918s for a response
W20260812 19:23:43.111505  6179 connection.cc:232] RPC call timeout handler was delayed by -1.9986954631749541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24070000000000003s for a response
W20260812 19:23:43.111560  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 590535us
I20260812 19:23:43.112645  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:43.113909 12618 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.114557 12618 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.095508  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:43.116202 12446 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:43.117017 12618 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:42.775871  6242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2013) took 3609 ms (client timeout 1996 ms). Trace:
W20260812 19:23:43.117657  6242 rpcz_store.cc:269] 0812 19:23:39.166056 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:39.172691 (+  6635us) service_pool.cc:227] Handling call
0812 19:23:42.775602 (+3602911us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:43.118265  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:43.095844 12667 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.119154  7600 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:43.119390 12667 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.802735  6228 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260812 19:23:39.299782  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1965) took 1961 ms. Trace:
I20260812 19:23:42.849552 12351 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:39.477824  6465 raft_consensus.cc:2396] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260812 19:23:42.859297  6482 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:42.863003  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1985) took 5063 ms. Trace:
I20260812 19:23:42.867688 12482 raft_consensus.cc:3032] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:42.869048  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2014) took 3702 ms. Trace:
I20260812 19:23:42.869756 12303 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:42.871361 12566 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:43.103658  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 449) took 4072 ms. Trace:
W20260812 19:23:43.096714  6477 rpcz_store.cc:269] 0812 19:23:38.739895 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:39.164024 (+424129us) service_pool.cc:227] Handling call
0812 19:23:42.715771 (+3551747us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:42.879302  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:39.304728  6500 tablet_copy_source_session.cc:205] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Tablet Copy: opened 0 blocks and 1 log segments
W20260812 19:23:42.916827 12525 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 4.437s	user 0.003s	sys 0.042s
W20260812 19:23:43.131157 12525 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 4.658s	user 0.003s	sys 0.043s
I20260812 19:23:43.131536 12525 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:43.132774  6500 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:33386 (request call id 426) took 8020 ms. Trace:
I20260812 19:23:43.132966 12525 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.928691 12592 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:43.096529 12447 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:23:42.925725 12607 raft_consensus.cc:3032] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
W20260812 19:23:42.944917  6417 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 3.379s	user 0.015s	sys 0.046s
I20260812 19:23:43.138223 12607 raft_consensus.cc:729] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:42.947978 12616 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.106304 12689 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.139129 12616 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.139314 12689 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.139533 12607 consensus_queue.cc:260] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.140789 12607 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:42.948539 12509 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:42.949515 12354 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:42.965198  7606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 466) took 4123 ms. Trace:
I20260812 19:23:42.969254 12338 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:43.145366 12446 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:42.983610  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.147051  6347 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
W20260812 19:23:42.984532  7594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 467) took 4142 ms (client timeout 3241 ms). Trace:
W20260812 19:23:42.974398  6178 connection.cc:232] RPC call timeout handler was delayed by -2.8288394932169467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260812 19:23:42.989812  6350 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260812 19:23:42.990239  6359 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:43.148864 12354 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:42.991714 12440 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:42.997228  6349 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:43.100158 12507 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:43.007650  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.116938  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:39.298918  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1968) took 2167 ms. Trace:
I20260812 19:23:43.095335 12684 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:43.141726 12616 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.099485  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:43.122504  6230 rpcz_store.cc:276] 0812 19:23:39.166288 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:39.178465 (+ 12177us) service_pool.cc:227] Handling call
0812 19:23:39.178880 (+   415us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:42.868450 (+3689570us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:42.868851 (+   401us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:43.141753 12689 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:43.121263  6352 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:23:42.877040  6354 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 6. Ops: [4.6-4.6]
W20260812 19:23:43.106899  7598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60760 (request call id 501) took 4178 ms (client timeout 2407 ms). Trace:
I20260812 19:23:43.100847  6483 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:43.105455 12685 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:43.171626  7598 rpcz_store.cc:269] 0812 19:23:38.928753 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:38.928922 (+   169us) service_pool.cc:227] Handling call
0812 19:23:43.106597 (+4177675us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b54002e95d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:43.106809 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":794284416}
I20260812 19:23:43.103587 12510 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260812 19:23:43.128901  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2015) took 3962 ms. Trace:
I20260812 19:23:43.129192  6232 rpcz_store.cc:276] 0812 19:23:37.338879 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:38.415516 (+1076637us) service_pool.cc:227] Handling call
0812 19:23:38.818786 (+403270us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:39.057598 (+238812us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:39.299509 (+241911us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b540035f550. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:39.299701 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":811899648}
I20260812 19:23:43.103025  6470 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260812 19:23:43.133251  6500 rpcz_store.cc:276] 0812 19:23:35.128833 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:35.130785 (+  1952us) service_pool.cc:227] Handling call
0812 19:23:39.303909 (+4173124us) spinlock_profiling.cc:243] Waited 3.22 s on lock 0x7b5400022e54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7782257 00007f98fc6955e6 00007f98fc69ee5e 00007f98f41855db 00007f98fc69edda 00007f98fc699eec 00007f98fc69524b 00007f98fc689e45 00007f98fb792a54 00007f98fb7929e2
0812 19:23:43.132487 (+3828578us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7407816960}
I20260812 19:23:42.932701  6224 raft_consensus.cc:1226] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:43.179250 12667 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.179739  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.179862 12684 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.181615  7591 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
I20260812 19:23:43.182060 12684 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.174263 12507 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.183382  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 450) took 4124 ms. Trace:
I20260812 19:23:43.183491 12489 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.184551  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.127102  6475 rpcz_store.cc:276] 0812 19:23:39.031081 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:43.061411 (+4030330us) service_pool.cc:227] Handling call
0812 19:23:43.061835 (+   424us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:43.103314 (+ 41479us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.103578 (+   264us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:43.184923 12507 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:42.945389 12666 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:43.174541  6228 rpcz_store.cc:276] 0812 19:23:39.166545 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:39.186648 (+ 20103us) service_pool.cc:227] Handling call
0812 19:23:42.801885 (+3615237us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:43.120701 (+318816us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.128829 (+  8128us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:43.185401 12685 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:43.127019 12566 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:43.124775 12303 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:43.106549 12102 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.153184  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.000306  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:43.154400  6178 connection.cc:232] RPC call timeout handler was delayed by -2.7739394931122661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.227s for a response
I20260812 19:23:43.095695 12355 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:43.161809  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:43.149664  7594 rpcz_store.cc:269] 0812 19:23:38.841940 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:38.844265 (+  2325us) service_pool.cc:227] Handling call
0812 19:23:42.984241 (+4139976us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400670554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:42.984426 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":691150592}
I20260812 19:23:43.163246 12354 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.164000  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.165362  6481 rpcz_store.cc:276] 0812 19:23:37.131671 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.133564 (+  1893us) service_pool.cc:227] Handling call
0812 19:23:37.133849 (+   285us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:37.446257 (+312408us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:39.298606 (+1852349us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b5400271854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:39.298844 (+   238us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":507722624}
W20260812 19:23:43.193593  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 81103.4us
I20260812 19:23:43.166096 12618 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:43.196602 12355 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.197793 12355 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:43.197487 12618 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.166630  6345 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:42.781018 12614 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:43.159158  6465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1714) took 4360 ms (client timeout 1749 ms). Trace:
I20260812 19:23:43.192193  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.193490  6242 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:43.122351  6353 rpcz_store.cc:276] 0812 19:23:37.799459 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.864576 (+ 65117us) service_pool.cc:227] Handling call
0812 19:23:37.864944 (+   368us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:38.199080 (+334136us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:42.862460 (+4663380us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400350554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:42.862824 (+   364us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":646284672}
I20260812 19:23:43.103461 12518 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.175899  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:43.178406  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 302619us
I20260812 19:23:43.161870 12493 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:23:43.184119 12489 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:43.138374  6417 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.572s	user 0.015s	sys 0.047s
I20260812 19:23:43.185698  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:43.185925  6474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33386 (request call id 444) took 5558 ms (client timeout 1633 ms). Trace:
I20260812 19:23:43.167951  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:43.106418 12429 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.124147 12482 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:43.143461  7606 rpcz_store.cc:276] 0812 19:23:38.841601 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:38.843081 (+  1480us) service_pool.cc:227] Handling call
0812 19:23:38.843472 (+   391us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:42.245018 (+3401546us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:42.964672 (+719654us) spinlock_profiling.cc:243] Waited 3.4 s on lock 0x7b540058e154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:42.965060 (+   388us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7814727040}
W20260812 19:23:43.186973  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 87600.7us
I20260812 19:23:43.183763  6470 rpcz_store.cc:276] 0812 19:23:39.058745 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:43.066112 (+4007367us) service_pool.cc:227] Handling call
0812 19:23:43.066575 (+   463us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:43.183097 (+116522us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.183310 (+   213us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:43.174283  6483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1718) took 4367 ms (client timeout 2209 ms). Trace:
I20260812 19:23:43.182411  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:43.236413  6474 rpcz_store.cc:269] 0812 19:23:37.627108 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.627248 (+   140us) service_pool.cc:227] Handling call
0812 19:23:43.185499 (+5558251us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400103bd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:43.185721 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2404648704}
I20260812 19:23:43.195322  6349 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:43.244387  6347 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:43.168351 12509 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.196030 12566 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:43.226689  6178 connection.cc:232] RPC call timeout handler was delayed by -2.1421394932549447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2972s for a response
I20260812 19:23:43.167591  6344 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
W20260812 19:23:43.250830  6178 connection.cc:232] RPC call timeout handler was delayed by -2.0134394932538271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31150000000000005s for a response
W20260812 19:23:43.251276  6178 connection.cc:232] RPC call timeout handler was delayed by -1.7785231631714851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
I20260812 19:23:43.227135  6350 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:23:43.228529 12616 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:23:43.251575  6178 connection.cc:232] RPC call timeout handler was delayed by -1.7785231631714851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
I20260812 19:23:43.197839 12685 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:43.251922  6178 connection.cc:232] RPC call timeout handler was delayed by -1.769523163093254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260812 19:23:43.252238  6178 connection.cc:232] RPC call timeout handler was delayed by -1.769523163093254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260812 19:23:43.252400  6178 connection.cc:232] RPC call timeout handler was delayed by -1.7056231631431729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260812 19:23:43.252537  6178 connection.cc:232] RPC call timeout handler was delayed by -1.7056231631431729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260812 19:23:43.252774  6178 connection.cc:232] RPC call timeout handler was delayed by -1.6426231630612165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260812 19:23:43.252929  6178 connection.cc:232] RPC call timeout handler was delayed by -1.6426231630612165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260812 19:23:43.253064  6178 connection.cc:232] RPC call timeout handler was delayed by -1.6174231632612646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260812 19:23:43.253269  6178 connection.cc:232] RPC call timeout handler was delayed by -1.6174231632612646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260812 19:23:43.253430  6178 connection.cc:232] RPC call timeout handler was delayed by -1.4968231632374227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260812 19:23:43.253566  6178 connection.cc:232] RPC call timeout handler was delayed by -1.3726231632754207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
W20260812 19:23:43.253701  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1386231631040573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24060000000000004s for a response
W20260812 19:23:43.253931  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1386231631040573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24060000000000004s for a response
W20260812 19:23:43.254078  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1377231632359326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24070000000000003s for a response
I20260812 19:23:43.190616 12411 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:43.235402  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:43.226778  6465 rpcz_store.cc:269] 0812 19:23:38.798861 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:39.146065 (+347204us) service_pool.cc:227] Handling call
0812 19:23:43.158933 (+4012868us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:43.246865  6475 raft_consensus.cc:2379] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:43.247047  6342 raft_consensus.cc:2396] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260812 19:23:43.243620  6483 rpcz_store.cc:269] 0812 19:23:38.807326 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:39.167260 (+359934us) service_pool.cc:227] Handling call
0812 19:23:43.171827 (+4004567us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:43.248649 12482 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.243981  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.198675  6055 catalog_manager.cc:5495] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260812 19:23:43.197793  6482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1712) took 4457 ms (client timeout 1940 ms). Trace:
I20260812 19:23:43.256117  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.256711  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.257668  6359 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260812 19:23:43.256806  6352 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:23:43.258666  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:43.255391  6482 rpcz_store.cc:269] 0812 19:23:38.740240 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:39.165416 (+425176us) service_pool.cc:227] Handling call
0812 19:23:43.197543 (+4032127us) spinlock_profiling.cc:243] Waited 3.69 s on lock 0x7b54000749d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:43.197722 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8492230400}
I20260812 19:23:43.258965  6481 raft_consensus.cc:1226] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260812 19:23:43.258684  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.185729 12666 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.257164  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.259871  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 451) took 4176 ms. Trace:
I20260812 19:23:43.264580  6481 rpcz_store.cc:276] 0812 19:23:39.083313 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:43.194045 (+4110732us) service_pool.cc:227] Handling call
0812 19:23:43.256528 (+ 62483us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:43.259581 (+  3053us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.259826 (+   245us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:43.260833 12566 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:43.273929 12411 raft_consensus.cc:686] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:43.275257 12411 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.260882  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.276628 12493 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.277109  6344 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:23:43.277540  7597 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:23:43.277190 12493 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.278368  6344 raft_consensus.cc:3032] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:43.278313  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:43.278841  6344 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:43.279175  6238 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:43.279235  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 405) took 6257 ms. Trace:
I20260812 19:23:43.279721  6344 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.280169  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.280814  6344 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:43.280972  6474 raft_consensus.cc:2379] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:43.281914  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 1967) took 5820 ms. Trace:
I20260812 19:23:43.282874 12655 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.283601  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 483) took 4116 ms. Trace:
I20260812 19:23:43.283484 12655 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.284029  6354 rpcz_store.cc:276] 0812 19:23:39.167604 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:39.168410 (+   806us) service_pool.cc:227] Handling call
0812 19:23:39.168813 (+   403us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:43.178986 (+4010173us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.283288 (+104302us) spinlock_profiling.cc:243] Waited 3.71 s on lock 0x7b54004119d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:43.283523 (+   235us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8527070464}
I20260812 19:23:43.261754  6232 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:23:43.286832 12493 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:43.287274 12303 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.287986 12493 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.261951  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:43.282325  6229 rpcz_store.cc:276] 0812 19:23:37.462202 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:38.479155 (+1016953us) service_pool.cc:227] Handling call
0812 19:23:38.503862 (+ 24707us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:38.556939 (+ 53077us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:38.556980 (+    41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:38.557023 (+    43us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:23:38.557076 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.281506 (+4724430us) spinlock_profiling.cc:243] Waited 52.8 ms on lock 0x7b54002fd854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:43.281572 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:43.281751 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":121415936}
I20260812 19:23:43.261036  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.258500 12429 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.279723  6224 rpcz_store.cc:276] 0812 19:23:37.022363 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.269016 (+246653us) service_pool.cc:227] Handling call
0812 19:23:42.932204 (+5663188us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:43.179116 (+246912us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.279019 (+ 99903us) spinlock_profiling.cc:243] Waited 5.66 s on lock 0x7b540027d8d0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:43.279173 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13023226240}
I20260812 19:23:43.289184 12493 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.266319 12435 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:43.289214 12303 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:43.293030  6483 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260812 19:23:43.293733  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 453) took 4135 ms. Trace:
I20260812 19:23:43.294070  6483 rpcz_store.cc:276] 0812 19:23:39.158160 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:43.292368 (+4134208us) service_pool.cc:227] Handling call
0812 19:23:43.292800 (+   432us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:43.293461 (+   661us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.293679 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:43.267418 12509 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.263518  6345 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260812 19:23:43.296594  6345 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:43.263677  6349 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:43.256677 12618 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:43.245715 12614 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:43.303836  6464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 1983) took 4789 ms (client timeout 1718 ms). Trace:
W20260812 19:23:43.304287  6464 rpcz_store.cc:269] 0812 19:23:38.514548 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:38.516522 (+  1974us) service_pool.cc:227] Handling call
0812 19:23:43.303477 (+4786955us) spinlock_profiling.cc:243] Waited 4.74 s on lock 0x7b540003c0d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:43.303656 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10893736192}
I20260812 19:23:43.305652 12614 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:43.265971  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 1984) took 4724 ms. Trace:
I20260812 19:23:43.268447  6352 raft_consensus.cc:3032] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:43.272668  6235 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:43.273360 12581 raft_consensus.cc:3032] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:43.283814 12689 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.290104  6342 raft_consensus.cc:595] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:43.281044  6475 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260812 19:23:43.262859  6417 connection.cc:232] RPC call timeout handler was delayed by -1.5018013687804341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32410000000000005s for a response
I20260812 19:23:43.292517 12429 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.312963  6352 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:43.269778  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:43.309067  6473 rpcz_store.cc:276] 0812 19:23:38.522061 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:38.522903 (+   842us) service_pool.cc:227] Handling call
0812 19:23:38.568035 (+ 45132us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:42.304238 (+3736203us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.195535 (+891297us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b5400450954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:43.245995 (+ 50460us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1303863040}
I20260812 19:23:43.259675  6359 pending_rounds.cc:76] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 8
I20260812 19:23:43.318992  7600 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:23:43.319473  6342 raft_consensus.cc:603] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:43.321197  6359 pending_rounds.cc:97] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260812 19:23:43.321136  6350 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:43.322160  6359 raft_consensus.cc:2866] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:43.192812 12102 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.305701  6055 catalog_manager.cc:5495] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 5 to 6, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 6 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:43.328030  7597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 460) took 6333 ms. Trace:
I20260812 19:23:43.328644  7597 rpcz_store.cc:276] 0812 19:23:36.994768 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:37.007480 (+ 12712us) service_pool.cc:227] Handling call
0812 19:23:37.059579 (+ 52099us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:43.277922 (+6218343us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.327631 (+ 49709us) spinlock_profiling.cc:243] Waited 6.14 s on lock 0x7b54000929d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:43.327948 (+   317us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":14111556864}
I20260812 19:23:43.330773  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 455) took 4161 ms. Trace:
I20260812 19:23:43.331244  6475 rpcz_store.cc:276] 0812 19:23:39.169100 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:43.280375 (+4111275us) service_pool.cc:227] Handling call
0812 19:23:43.280725 (+   350us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:43.319517 (+ 38792us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.330701 (+ 11184us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:43.334028 12648 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.334580 12648 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.311021 12616 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.335393  6353 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:43.336906 12616 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:43.338129  6353 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260812 19:23:43.329449  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:43.341774  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:43.345239  6238 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:23:43.348268  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.352638  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.351344  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 481) took 4677 ms. Trace:
I20260812 19:23:43.353964  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.354976  6345 raft_consensus.cc:2396] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260812 19:23:43.355837  6347 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:43.356163  6238 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 12: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:43.353654  6359 rpcz_store.cc:276] 0812 19:23:38.674378 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:38.674583 (+   205us) service_pool.cc:227] Handling call
0812 19:23:38.674945 (+   362us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:42.951557 (+4276612us) spinlock_profiling.cc:243] Waited 4.27 s on lock 0x7b1800241320. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f77b3856 00007f98f7705f7e 00007f98f776f367 00007f98f7770b4e 00007f98f777ac89 00007f98f777b556 00007f98f7777edf 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684
0812 19:23:42.989729 (+ 38172us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b58008ddab0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f76f3f63 00007f98f7757aba 00007f98f776f3af 00007f98f7770b4e 00007f98f777ac89 00007f98f777b556 00007f98f7777edf 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684
0812 19:23:43.341310 (+351581us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.351264 (+  9954us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9911072768}
I20260812 19:23:43.307353 12655 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.362262  6344 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260812 19:23:43.318791 12581 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:23:43.356315  6235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 1969) took 4184 ms (client timeout 1718 ms). Trace:
I20260812 19:23:43.361068  6055 catalog_manager.cc:5495] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 4 to 5, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 5 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:43.371107 12685 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:43.371309 12457 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:43.372071  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.373623 12431 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.374330 12431 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.348930 12667 raft_consensus.cc:2741] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260812 19:23:43.374902  6352 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:43.376040  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 132831us
I20260812 19:23:43.376135  6352 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:43.366050 12482 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:43.376897  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:43.378064 12581 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.379202 12581 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:43.357517 12689 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.372249 12493 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:43.385046 12689 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:43.385221 12748 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.058s	user 0.000s	sys 0.002s
I20260812 19:23:43.386278  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:43.394008 12664 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.394608 12664 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.395048 12667 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:43.394891 12446 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:43.397606 12664 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.397409 12446 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:23:43.399484 12648 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:43.400240  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 70885.7us
I20260812 19:23:43.401582 12667 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:43.402834 12489 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:43.403929  7606 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:43.404664  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.405520  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.394856  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.406976 12574 consensus_queue.cc:1046] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260812 19:23:43.369056  6235 rpcz_store.cc:269] 0812 19:23:39.172040 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:39.172626 (+   586us) service_pool.cc:227] Handling call
0812 19:23:43.338892 (+4166266us) spinlock_profiling.cc:243] Waited 81.7 ms on lock 0x7b540027ced4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:43.356235 (+ 17343us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":187852288}
I20260812 19:23:43.408039  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:43.373550  6179 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:43.409886  6055 catalog_manager.cc:5495] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:23:43.420989  6350 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:23:43.437340  7600 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:43.442201  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:43.442919  6347 raft_consensus.cc:595] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:43.443327  6347 raft_consensus.cc:603] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:43.442456  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.450529  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.454810  7603 raft_consensus.cc:2379] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:43.452016  6475 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:23:43.458810  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.474078  6349 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260812 19:23:43.481014  6481 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
W20260812 19:23:43.482184  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 108782us
I20260812 19:23:43.484443 12102 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.485761  7591 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:43.488188  6352 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260812 19:23:43.488824  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1746) took 1018 ms. Trace:
I20260812 19:23:43.491950  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.489097  6352 rpcz_store.cc:276] 0812 19:23:42.470000 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:43.268041 (+798041us) service_pool.cc:227] Handling call
0812 19:23:43.268295 (+   254us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:43.488547 (+220252us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.488757 (+   210us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:43.476382  7594 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 12: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:43.461737 12664 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:23:43.477996  7597 raft_consensus.cc:2379] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 7: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:43.500370  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.508926  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.512415 12102 consensus_queue.cc:1046] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:23:43.513748 12102 raft_consensus.cc:3032] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:23:43.514160 12102 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:43.516601  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:43.518410  6347 raft_consensus.cc:2396] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260812 19:23:43.519873  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.520861  6342 raft_consensus.cc:2396] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260812 19:23:43.523379  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.526470  7600 raft_consensus.cc:2396] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260812 19:23:43.527526  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 102575us
I20260812 19:23:43.528429  6350 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:43.528347  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.517244  6352 raft_consensus.cc:595] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:43.521375  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.534574  6179 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:23:43.537010  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 187015us
I20260812 19:23:43.487041 12489 consensus_queue.cc:1046] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260812 19:23:43.565639  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 120090us
I20260812 19:23:43.533281 12664 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:43.572438  7591 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
W20260812 19:23:43.573774  6514 debug-util.cc:398] Leaking SignalData structure 0x7b0800374a00 after lost signal to thread 4090
W20260812 19:23:43.574954  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd9c0 after lost signal to thread 6116
W20260812 19:23:43.575281  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08003de380 after lost signal to thread 6138
I20260812 19:23:43.573930  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260812 19:23:43.580998 12620 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:23:43.581660 12620 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:43.582808 12575 consensus_queue.cc:1046] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260812 19:23:43.583070  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.571970  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.584457  7597 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
W20260812 19:23:43.584811 12750 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260812 19:23:43.585377  7599 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:43.586064 12458 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.583860  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.587013  7591 raft_consensus.cc:2379] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:43.586632 12458 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.576953  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:43.583828 12575 raft_consensus.cc:3032] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:43.582643 12620 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.591143  6179 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:23:43.591815  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4e60 after lost signal to thread 6272
I20260812 19:23:43.573951  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:43.593219  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4e80 after lost signal to thread 6273
I20260812 19:23:43.593549  6230 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:43.573040 12666 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.594514 12355 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:43.595032 12355 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:43.595189 12667 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:23:43.595494 12355 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:43.595458  6514 debug-util.cc:398] Leaking SignalData structure 0x7b080033cae0 after lost signal to thread 6399
W20260812 19:23:43.598807  6514 debug-util.cc:398] Leaking SignalData structure 0x7b080011b320 after lost signal to thread 6400
W20260812 19:23:43.607695  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08003993c0 after lost signal to thread 6521
W20260812 19:23:43.608754  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08003f5160 after lost signal to thread 7647
W20260812 19:23:43.611164  6514 debug-util.cc:398] Leaking SignalData structure 0x7b080026d580 after lost signal to thread 7649
I20260812 19:23:43.614993  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:23:43.616305  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 49493us
I20260812 19:23:43.617235  7600 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260812 19:23:43.617576  7600 pending_rounds.cc:76] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Aborting all ops after (but not including) 6
I20260812 19:23:43.620434  7600 pending_rounds.cc:97] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260812 19:23:43.592780 12575 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:43.561383 12102 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.620939  7600 raft_consensus.cc:2866] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:43.626781  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:43.624095 12457 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260812 19:23:43.631278 12747 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.258s	user 0.004s	sys 0.000s
I20260812 19:23:43.632176 12458 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.630031  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:43.625866 12411 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260812 19:23:43.629446 12303 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:43.629179 12102 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:43.633167 12338 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:43.642684  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:43.645602  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:43.650985  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:43.652241  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 452) took 4529 ms. Trace:
I20260812 19:23:43.642304 12303 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:43.652711  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 454) took 4479 ms. Trace:
I20260812 19:23:43.653469  6470 rpcz_store.cc:276] 0812 19:23:39.116714 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:43.243462 (+4126748us) service_pool.cc:227] Handling call
0812 19:23:43.288511 (+ 45049us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:43.288829 (+   318us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:23:43.453004 (+164175us) log.cc:842] Serialized 14 byte log entry
0812 19:23:43.645062 (+192058us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:43.645136 (+    74us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:43.645197 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.645391 (+   194us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:43.645598 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5147,"prepare.queue_time_us":192431,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":12214,"thread_start_us":321527,"threads_started":2}
I20260812 19:23:43.644996 12435 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:43.644867 12338 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:43.654488  6477 rpcz_store.cc:276] 0812 19:23:39.167786 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:43.291071 (+4123285us) service_pool.cc:227] Handling call
0812 19:23:43.291445 (+   374us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:43.291714 (+   269us) raft_consensus.cc:1520] Early marking committed up to index 7
0812 19:23:43.413506 (+121792us) log.cc:842] Serialized 14 byte log entry
0812 19:23:43.642616 (+229110us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:43.642716 (+   100us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:43.646636 (+  3920us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:43.646974 (+   338us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:43.647122 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2373,"prepare.queue_time_us":189867,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":9377,"thread_start_us":302906,"threads_started":2}
I20260812 19:23:43.649778 12458 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:43.653842 12457 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:43.661336 12648 raft_consensus.cc:2741] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260812 19:23:43.663161 12457 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:43.659353  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:23:43.655589 12303 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:43.642572 12429 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260812 19:23:43.637694 12664 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.661761 12338 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:43.669966 12435 raft_consensus.cc:686] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:43.663911 12644 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.662295 12458 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:23:43.679338  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 49259.6us
I20260812 19:23:43.663753 12457 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:43.663883 12446 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260812 19:23:43.683416 12458 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:43.691787 12435 consensus_queue.cc:237] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.691838 12431 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.695763 12274 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Stepping down as leader of term 9
W20260812 19:23:43.697084  6054 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38512 (request call id 231) took 11358 ms (client timeout 15000 ms). Trace:
I20260812 19:23:43.655576 12575 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.680647  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:43.712209 12274 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:43.683646 12644 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.723702 12431 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260812 19:23:43.740067 12335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 529ed979cd2842acb5bc24debb151b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:23:43.741225 12274 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.742458 12274 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:43.746862 12657 raft_consensus.cc:3032] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:43.747308 12657 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:43.748196 12657 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.749246 12657 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:43.716738 12507 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260812 19:23:43.752755 12482 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:43.754351  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:43.755394  6230 raft_consensus.cc:2396] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260812 19:23:43.755285  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:43.756001  6477 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:43.757951  6179 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:43.758106 12644 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.759024 12429 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:43.759430 12429 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:43.759799 12429 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:43.767902 12575 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:43.768317  6477 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:43.772647  6470 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:43.772691  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.773495  6481 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:43.777454  6475 raft_consensus.cc:1261] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260812 19:23:43.796553 12489 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:23:43.783087  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.797659  6482 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:43.783913  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.798645  6483 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:43.784986  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.799222 12620 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:43.799860  6481 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 9: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:43.799760 12620 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.787004 12482 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 19:23:43.809258  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:43.809615  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.809880  6473 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:43.810248  6228 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:43.811082  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.811797  6482 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:23:43.812841  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.808919  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.788322  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:43.711227  6054 rpcz_store.cc:269] 0812 19:23:32.338116 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:34.835157 (+2497041us) service_pool.cc:227] Handling call
0812 19:23:43.696816 (+8861659us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:37.398500 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:37.399053 (+   553us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:37.399081 (+    28us) write_op.cc:435] Acquired schema lock
0812 19:23:37.399092 (+    11us) tablet.cc:660] Decoding operations
0812 19:23:37.399666 (+   574us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:37.399732 (+    66us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:37.399749 (+    17us) tablet.cc:683] Acquiring locks for 5 operations
0812 19:23:37.400284 (+   535us) tablet.cc:699] Row locks acquired
0812 19:23:37.400299 (+    15us) write_op.cc:260] PREPARE: finished
0812 19:23:37.400421 (+   122us) write_op.cc:270] Start()
0812 19:23:37.400508 (+    87us) write_op.cc:276] Timestamp: P: 1786562617400380 usec, L: 0
0812 19:23:37.400521 (+    13us) op_driver.cc:331] REPLICATION: starting
0812 19:23:37.401163 (+   642us) log.cc:842] Serialized 2064 byte log entry
0812 19:23:38.651727 (+1250564us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b18002b09c0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:23:38.698586 (+ 46859us) op_driver.cc:444] REPLICATION: finished
0812 19:23:39.140000 (+441414us) write_op.cc:301] APPLY: starting
0812 19:23:39.159520 (+ 19520us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:39.302838 (+143318us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:39.302875 (+    37us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:39.303951 (+  1076us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:39.304432 (+   481us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0812 19:23:39.304555 (+   123us) write_op.cc:312] APPLY: finished
0812 19:23:39.304989 (+   434us) log.cc:842] Serialized 47 byte log entry
0812 19:23:42.307279 (+3002290us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:42.316499 (+  9220us) write_op.cc:454] Released schema lock
0812 19:23:42.316642 (+   143us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:42.317653 (+  1011us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:42.317705 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":243422,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":360919,"apply.run_cpu_time_us":25711,"apply.run_wall_time_us":3223510,"num_ops":5,"prepare.queue_time_us":45990,"prepare.run_cpu_time_us":16178,"prepare.run_wall_time_us":82604,"raft.queue_time_us":102998,"raft.run_cpu_time_us":9613,"raft.run_wall_time_us":340157,"replication_time_us":1282760,"spinlock_wait_cycles":8427264,"thread_start_us":3406801,"threads_started":5,"wal-append.queue_time_us":3065993,"wal-append.run_cpu_time_us":43410,"wal-append.run_wall_time_us":2246005}]]}
I20260812 19:23:43.777751  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:43.791852  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:43.792816 12446 consensus_queue.cc:1046] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:23:43.795048  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.795459  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.795702 12355 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.759053 12566 raft_consensus.cc:3032] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:43.846120  6230 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:43.796574  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.800730  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.801288  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.848491  6235 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 8: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:43.842500  6477 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:43.801467  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.803543  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:43.808883  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:43.850252  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46798.4us
I20260812 19:23:43.809051  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.819976  6473 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:23:43.847743  6224 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:43.852916  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.835161  6470 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
W20260812 19:23:43.836163  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 58549.2us
I20260812 19:23:43.837273  6354 raft_consensus.cc:2379] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 6: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:43.855269  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.849340  6242 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:43.857044  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.858903  6475 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:43.860275  6473 raft_consensus.cc:2379] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:43.855984  6236 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:43.860997  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.861858  6481 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:43.862046  6228 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260812 19:23:43.869376  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.869387  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.870121  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.872095  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.845819 12566 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:43.872128  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.873915  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.875196  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.865017 12489 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:43.892867  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.895395  6228 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:43.897388  6475 raft_consensus.cc:2396] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260812 19:23:43.860844 12644 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:43.900130  6241 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:43.837596 12303 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.905081  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.907884  6224 raft_consensus.cc:2379] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 10: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:43.909211  6464 raft_consensus.cc:2396] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260812 19:23:43.845942 12338 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:43.909505  6297 connection.cc:232] RPC call timeout handler was delayed by -3.6671389010734856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
I20260812 19:23:43.912709  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:43.912911  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 44828.1us
W20260812 19:23:43.913086  6297 connection.cc:232] RPC call timeout handler was delayed by -3.5852389009669423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
I20260812 19:23:43.913983  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:43.916934  6297 connection.cc:232] RPC call timeout handler was delayed by -3.3953389010857791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
I20260812 19:23:43.917416  6475 raft_consensus.cc:2379] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:43.914826  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:43.897796 12489 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:43.922585  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:43.923269  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:43.902637 12644 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:43.893957 12482 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.021s
I20260812 19:23:43.919018 12489 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:43.926528  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.929688  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:43.919066 12446 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:43.932232  6475 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260812 19:23:43.924526 12507 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:43.924754 12644 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:43.936255  6224 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:43.938179  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.939344  7603 raft_consensus.cc:2396] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260812 19:23:43.939834  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:43.940485  6241 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:43.940639  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.908429 12457 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.930505 12648 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:23:43.930459 12685 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:43.947440  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.947121  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.908470 12458 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.946998  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.950693  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.925400 12566 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.957626  7600 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:43.952946 12685 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:43.959683  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.930337 12574 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260812 19:23:43.960258  6475 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:43.942637 12435 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260812 19:23:43.965905 12773 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260812 19:23:43.966125  6224 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260812 19:23:43.967284 12338 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.968346  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:43.969692  7594 raft_consensus.cc:2396] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260812 19:23:43.967303 12303 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.974974  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.976264  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:43.977048  6475 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 9: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:43.963378  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:43.961074 12685 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:43.953122 12507 raft_consensus.cc:686] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 11 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:43.995460 12620 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:43.995078 12507 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:43.996409 12554 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:43.996937 12554 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:43.997843 12554 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.999280  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:44.000274 12493 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:23:44.004160 12457 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:43.979068 12482 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.026s
I20260812 19:23:44.008944 12689 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Stepping down as leader of term 8
W20260812 19:23:44.009436 12777 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260812 19:23:44.009543 12689 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:44.011071 12689 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:43.993237  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:43.936884 12446 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.034260 12355 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:44.035897 12457 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:44.036641 12581 consensus_queue.cc:1046] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260812 19:23:44.058215 12783 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.108s	user 0.004s	sys 0.000s
W20260812 19:23:44.078611  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 119636us
W20260812 19:23:44.078428  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 79229.5us
I20260812 19:23:44.078536  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:44.080977  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 87881us
I20260812 19:23:44.083930  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:44.086037 12620 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:23:44.086282  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:44.044770 12457 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:44.082768 12689 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:44.104343  6344 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260812 19:23:44.105583  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:44.105867  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:44.106504  6482 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:44.108157  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:44.088300 12566 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:44.109833  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:44.110499  6481 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:44.111442  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:44.112059  6359 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:44.113399  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:44.114831  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:44.115442  7600 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:44.115685  6230 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:44.116874  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:44.117508  6235 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 12
I20260812 19:23:44.119577  6236 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260812 19:23:44.100519 12772 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260812 19:23:44.137259  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:44.094357 12581 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:44.123546  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:44.138208  6465 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:44.090036 12431 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:44.167323 12458 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:44.167670 12431 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:44.168126 12431 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:44.092391 12457 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:44.138746  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:44.140237 12406 raft_consensus.cc:3032] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:44.140851 12338 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 19:23:44.140997 12774 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260812 19:23:44.103832 12435 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:44.144970 12429 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.147148 12574 consensus_queue.cc:1046] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260812 19:23:44.149236 12783 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260812 19:23:44.150393 12355 raft_consensus.cc:3032] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:44.154963 12664 consensus_queue.cc:1046] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:44.158600 12666 consensus_queue.cc:1046] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:44.160609  7593 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:44.160718  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:44.179629 12446 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:44.180084 12493 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260812 19:23:44.212921  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 52323.3us
W20260812 19:23:44.180341  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 83624.8us
W20260812 19:23:44.185719  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 47116.9us
I20260812 19:23:44.209443  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:44.224151  6232 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:44.200273 12458 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:44.226272  6179 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:44.186892 12406 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:44.204924 12435 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:44.205001 12355 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:44.246739  6359 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:44.262845  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:44.258956  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:44.259017  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 55782.2us
I20260812 19:23:44.235096  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:44.265618  6344 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 8
I20260812 19:23:44.219792 12620 raft_consensus.cc:3032] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:44.258790 12664 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election won for term 8
W20260812 19:23:44.265235 12774 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260812 19:23:44.234694 12633 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:44.233011 12458 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:44.222252 12102 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:44.264086 12440 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:44.289572  6344 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:44.293473 12406 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.229518 12648 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260812 19:23:44.297700  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 70109us
I20260812 19:23:44.286599 12303 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:44.280331 12620 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:44.290735  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:44.311987  6235 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:23:44.296903 12458 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:44.291682 12664 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:44.352723  6477 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260812 19:23:44.356377  6477 pending_rounds.cc:76] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 7
I20260812 19:23:44.356669  6477 pending_rounds.cc:97] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260812 19:23:44.297212 12102 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:44.356962  6477 raft_consensus.cc:2866] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:44.360338  6465 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:44.335461 12667 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:44.344450 12406 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:44.324473 12446 raft_consensus.cc:3032] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:44.356714 12685 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:44.372272 12786 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260812 19:23:44.373713 12685 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:44.366247 12102 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:44.374415 12667 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.367089  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:44.380291  6481 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:23:44.379302  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:44.306905 12440 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:44.326789 12574 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260812 19:23:44.379115  7594 raft_consensus.cc:2379] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 12: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:44.384739  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:44.370541 12446 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:44.394623 12685 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:44.361145 12633 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260812 19:23:44.397800 12644 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.335525 12493 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260812 19:23:44.365772 12274 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260812 19:23:44.307075 12355 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.387720 12429 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:44.494948  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 232209us
W20260812 19:23:44.496061  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 145527us
I20260812 19:23:44.505602  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:44.509297  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:44.512593  6481 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 19:23:44.487751 12554 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:23:44.494721 12685 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:44.516986 12685 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:44.518036 12440 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:44.519212 12685 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:44.520782 12667 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:44.501436 12664 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:44.524830 12797 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260812 19:23:44.514055 12411 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election won for term 10
W20260812 19:23:44.525830 12793 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260812 19:23:44.526252 12411 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:44.527169 12411 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.502915 12446 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.513538  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:44.511942 12575 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:44.530155 12575 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:44.531675 12644 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:44.529390 12446 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:44.536247 12338 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:23:44.536815 12338 raft_consensus.cc:686] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:44.537817 12338 consensus_queue.cc:237] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.499220 12620 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:44.539741 12620 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:23:44.539942 12489 consensus_meta.cc:287] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.597s	user 0.020s	sys 0.000s
I20260812 19:23:44.540405 12457 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.571493  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:44.531994 12575 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:44.570768  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 68224.4us
I20260812 19:23:44.588538  7600 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:44.540401 12489 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:44.532075 12431 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.598969  7599 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:44.599632  6464 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:44.603163  7603 raft_consensus.cc:2354] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:44.589888 12482 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:44.586580 12303 raft_consensus.cc:686] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:44.603492 12575 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:44.612891 12457 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:44.613143 12489 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:44.613231  7593 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:44.602768  7594 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 11 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260812 19:23:44.611616 12411 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:44.625650 12335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60772 (request call id 445) took 11936 ms. Trace:
I20260812 19:23:44.626109 12335 rpcz_store.cc:276] 0812 19:23:32.688966 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:32.841315 (+152349us) service_pool.cc:227] Handling call
0812 19:23:33.037840 (+196525us) ts_tablet_manager.cc:928] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
0812 19:23:33.405443 (+367603us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f483e5fe 00007f98fd669a39 00007f98f485b8bb 00007f98f485862a 00007f98f4858552 00007f98fc669691
0812 19:23:43.705283 (+10299840us) tablet_copy_client.cc:361] Tablet copy session begun
0812 19:23:44.079436 (+374153us) tablet_metadata.cc:641] Metadata flushed
0812 19:23:44.153649 (+ 74213us) tablet_copy_client.cc:490] Wrote new tablet metadata
0812 19:23:44.581168 (+427519us) tablet_copy_client.cc:411] Wrote new consensus metadata
0812 19:23:44.613934 (+ 32766us) tablet_replica.cc:205] Creating consensus instance
0812 19:23:44.625353 (+ 11419us) ts_tablet_manager.cc:983] Replica registered.
0812 19:23:44.625528 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":16853,"spinlock_wait_cycles":317527808,"tablet-copy.queue_time_us":168994,"thread_start_us":535976,"threads_started":2}
W20260812 19:23:44.627785  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 402234us
I20260812 19:23:44.631055  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:44.632447  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:44.633339 12489 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:44.633780 12489 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:44.634151 12489 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:44.635066 12431 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:44.633798  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:44.638031 12411 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:44.646890 12482 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:23:44.650759 12689 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:23:44.651588 12102 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:44.653812 12102 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:44.654907 12493 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:23:44.657039 12493 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:44.663555 12411 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:44.667173  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 86833.3us
I20260812 19:23:44.627818 12335 tablet_copy_client.cc:791] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:23:44.687278  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:44.688051  6483 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:44.696035  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:44.697278  6475 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:44.666640 12493 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260812 19:23:44.682160 12804 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260812 19:23:44.698774 12804 consensus_queue.cc:1225] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer 54f83319db6b49929cc8f18a66a66975 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:23:44.678633 12102 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260812 19:23:44.671293 12489 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:44.704171 12489 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:44.668089 12458 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.705951 12355 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:44.707017 12335 tablet_copy_client.cc:655] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:23:44.708309 12435 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.709493  7594 raft_consensus.cc:1226] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:44.706427 12458 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:44.716990  6483 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:44.727778 12102 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:44.728369 12102 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:44.730490 12102 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:44.683101 12303 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.732079 12804 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:44.733477 12804 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 19:23:44.744532  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:44.749478 12815 consensus_queue.cc:1046] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260812 19:23:44.750535 12815 raft_consensus.cc:3032] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:44.750991 12815 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:44.754825  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:44.755576  7603 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:44.756664  6224 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260812 19:23:44.757236  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:44.760174 12411 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:44.761022  6298 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:44.764882 12406 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:44.765276 12406 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:44.765618 12406 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:44.739203 12446 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:44.767426 12446 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:44.770079 12446 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:44.763464  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:44.771404  6228 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:44.775478  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:44.776356  6483 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:44.752085 12815 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.783686  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:44.784754 12335 tablet_copy_client.cc:531] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:23:44.784942  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:44.786091  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:44.786723 12575 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:44.787508  6238 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:44.787292 12575 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:44.788341  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:44.789114  6229 raft_consensus.cc:2396] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260812 19:23:44.795219  6224 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260812 19:23:44.796075  6228 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:23:44.742988 12507 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260812 19:23:44.805904  6483 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:44.806545  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:44.793103 12411 raft_consensus.cc:686] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:44.808205  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:44.809422  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:44.811285  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:44.811959  6224 raft_consensus.cc:2396] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260812 19:23:44.799129 12815 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:44.812992  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:44.813786  6229 raft_consensus.cc:2396] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260812 19:23:44.815480  6238 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:23:44.817132  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:44.814903 12411 consensus_queue.cc:237] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.819185  6228 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:44.824842 12335 tablet_bootstrap.cc:492] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:23:44.818169 12406 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.835332 12435 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:44.835497  6475 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:44.835793 12406 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:44.826511  6228 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:44.829300 12592 raft_consensus.cc:3032] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:44.838945  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:44.839047  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:44.844759  7603 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:44.845647  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:44.813167 12303 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:44.846273  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:44.839902 12592 raft_consensus.cc:729] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:44.847157 12303 raft_consensus.cc:686] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:44.847553 12592 consensus_queue.cc:260] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:44.848071 12303 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.843607 12575 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:44.849716 12685 consensus_queue.cc:1046] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:23:44.848588 12592 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:44.849647 12435 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:44.852957 12489 raft_consensus.cc:3032] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:44.860464 12489 raft_consensus.cc:729] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:44.861479 12489 consensus_queue.cc:260] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.862821 12489 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:44.867650  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:44.868312  6238 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:44.868880  7603 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:44.870092  6298 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:23:44.883443  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 54035.5us
I20260812 19:23:44.872846 12815 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:44.885216 12815 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:44.874948 12435 raft_consensus.cc:686] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:44.895895  6238 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:44.903281  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:44.904114  6483 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:44.912168  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:44.886174 12815 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.926002 12435 consensus_queue.cc:237] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.937403  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:44.938390  6470 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:44.939078  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:44.939868  6482 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:44.940793  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:44.941061  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.004s	sys 0.012s
W20260812 19:23:44.941378  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.004s	sys 0.012s
W20260812 19:23:44.942011  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 573751us
I20260812 19:23:44.943270  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:44.944096  6465 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:44.944921  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:44.927557  6481 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260812 19:23:45.289471  6481 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260812 19:23:44.927410  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:44.955132 12813 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:45.291335  6236 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:45.291455 12813 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:44.959235  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:45.293078  6354 raft_consensus.cc:2379] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 6: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:45.293869 12813 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:45.294091  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:45.294775  6354 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 9
I20260812 19:23:44.952634 12575 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:44.895183 12685 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:45.301172 12575 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:45.301760 12685 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:45.303781 12685 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:45.304307 12685 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:45.304749 12685 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:44.959278  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:45.305799  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 346629us
I20260812 19:23:45.306450  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.306764  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:45.308017  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:45.308176  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:44.954571 12446 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:45.398511 12446 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:45.400615 12446 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:45.401113 12446 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:45.401492 12446 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:45.401844 12446 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:44.964159  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.403563  6347 raft_consensus.cc:2396] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260812 19:23:45.404551  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.405205  6347 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:45.406073  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.407155  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:44.978610  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.408643  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:45.192451  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 468) took 1100 ms. Trace:
I20260812 19:23:45.413512  6477 rpcz_store.cc:276] 0812 19:23:44.091214 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:44.091339 (+   125us) service_pool.cc:227] Handling call
0812 19:23:44.108029 (+ 16690us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:44.362032 (+254003us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:45.191547 (+829515us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b540003cad4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:45.191780 (+   233us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":561900416}
I20260812 19:23:45.415237  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.416157  6477 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:45.417049  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.417958  6477 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:45.195672  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.419834  6342 raft_consensus.cc:2396] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260812 19:23:45.196708  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:45.200690 12815 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:45.214622  6296 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35822 dropped due to backpressure. The service queue is full; it has 50 items.
I20260812 19:23:45.424266  6241 raft_consensus.cc:2396] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260812 19:23:45.424115 12815 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:45.231439  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:45.425647 12457 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:45.426105  6235 raft_consensus.cc:2379] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:23:45.234829 12803 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.005s	sys 0.009s
W20260812 19:23:45.237007 12796 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.925s	user 0.007s	sys 0.013s
I20260812 19:23:45.426790  7599 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:45.424475  6296 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35822 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2008)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2010)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1775)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2025)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2016)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1779)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1780)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2006)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2007)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2013)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2017)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1781)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1769)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2011)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2012)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2018)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2019)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2020)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2021)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2022)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1768)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1782)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1784)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1785)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1788)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1789)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1790)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1792)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1793)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 505)
I20260812 19:23:45.253043 12274 raft_consensus.cc:3032] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:45.428254 12274 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:45.429167 12274 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:44.941437  6482 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:45.431519  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.432133  6482 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:45.432883  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.433383  6482 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:45.434139  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:45.270038  6470 raft_consensus.cc:2396] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260812 19:23:45.435340  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.436345  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:45.437101  6470 raft_consensus.cc:2396] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260812 19:23:45.437872  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.270692  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.441108  6344 raft_consensus.cc:2379] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:45.441975  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.442054  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.442606  6477 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:45.272274  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.443675  6349 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:45.277472  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:44.958338 12406 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:45.447870 12406 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:45.442541  6344 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:45.306927 12813 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:45.449996  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.450152 12813 raft_consensus.cc:686] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:45.451138 12813 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:44.919031  6475 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:45.309316 12685 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:45.306725 12575 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:45.309955  6481 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260812 19:23:45.317947  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:45.319947 12848 consensus_queue.cc:1046] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:45.321861  6354 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:45.702941  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.704067  6354 raft_consensus.cc:2396] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260812 19:23:45.323269  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:45.335515 12790 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.945s	user 0.005s	sys 0.001s
I20260812 19:23:45.357581 12574 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:45.706526 12848 raft_consensus.cc:3032] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:45.707073 12848 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:45.370132  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:45.386173 12482 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:45.387305  6179 leader_election.cc:398] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:45.388156  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.708465  6179 leader_election.cc:401] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260812 19:23:45.388769 12620 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:45.709785 12620 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:45.394960  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.396435  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.446445  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.711318  6473 raft_consensus.cc:2354] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
W20260812 19:23:45.426803 12803 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.006s	sys 0.009s
I20260812 19:23:45.444779  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.420861  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.716888  6342 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:23:45.456058  6344 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:45.456195  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:45.447897  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.443482  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:45.718068  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 261971us
I20260812 19:23:45.718428  6477 raft_consensus.cc:2396] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260812 19:23:45.456399  6482 raft_consensus.cc:2354] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:45.457963 12274 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:45.466833 12815 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:45.456746 12457 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:45.705612 12554 raft_consensus.cc:2741] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260812 19:23:45.722589 12804 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:23:45.723377  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.723973  6482 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:45.469430 12406 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:45.724256 12458 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:45.559046  6043 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.347s	user 0.000s	sys 0.000s
I20260812 19:23:45.724802  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.725184  7603 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260812 19:23:45.715847 12620 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:45.580765 12856 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:45.596730 12851 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:23:45.598080  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:45.598269  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:45.727706  6241 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:45.608363 12852 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:45.613306  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.614975  6352 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260812 19:23:45.617347  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:45.618832 12446 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:45.619639  6465 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:45.642472  7594 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260812 19:23:45.715901 12575 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:23:45.644212 12808 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:45.720937 12803 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:45.737447 12446 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:45.737538 12803 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:45.738099 12803 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:45.735164 12808 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:45.739461 12808 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:45.740188  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:45.740578 12808 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:45.672356  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:45.741348  6242 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:45.698391  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:45.701658  6230 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:45.706301  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.743744  6475 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:45.741348  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.724275 12457 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:45.706382  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:45.710322  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 323196us
W20260812 19:23:45.712743  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 389510us
I20260812 19:23:45.745132  6481 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:45.708837  6359 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:45.713649  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.710456 12355 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:45.710192 12482 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:45.715284  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.746589  6350 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:45.715197  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:45.746448  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:45.716401 12848 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:45.457932  6347 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:23:45.747170  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 48905.6us
I20260812 19:23:45.721714  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:45.747654  6359 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:45.748839  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:45.744616  6345 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
I20260812 19:23:45.722271  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:45.722368  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:45.578917  6353 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:45.581249 12849 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:45.726903  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.755924  6483 raft_consensus.cc:2396] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260812 19:23:45.607451  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:45.756219  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:45.756533  6232 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:45.729532  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.730502  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.733043  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.757507  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:45.757802  6464 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:45.757930  6352 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:45.732097  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.654735  6296 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35822 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2010)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1775)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2025)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2016)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2028)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1779)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1780)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2006)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2026)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2007)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2013)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2017)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1781)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2027)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1769)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2011)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2012)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2018)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2019)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2020)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2021)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2022)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1768)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1782)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1784)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1785)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1788)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1789)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1790)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1792)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1793)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 505)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 509)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 510)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 512)
I20260812 19:23:45.736349  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.736905 12575 raft_consensus.cc:686] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:45.761740  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.762020  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.671339  7600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 515) took 1508 ms. Trace:
I20260812 19:23:45.747555  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:45.755151  6344 raft_consensus.cc:2362] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10. Re-sending same reply.
I20260812 19:23:45.762916  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.755681  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.763820  6354 raft_consensus.cc:2362] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12. Re-sending same reply.
I20260812 19:23:45.763990  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.756456  6474 raft_consensus.cc:2354] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:45.731287  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.758967  6235 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260812 19:23:45.765152  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.765755  6481 raft_consensus.cc:2354] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12.
I20260812 19:23:45.759133  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:45.759407  6465 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:45.747658 12446 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260812 19:23:45.766394  6230 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:45.761075  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:45.766928  6347 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:45.724778 12458 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:45.768630  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.762750  7600 rpcz_store.cc:276] 0812 19:23:44.163056 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:44.163185 (+   129us) service_pool.cc:227] Handling call
0812 19:23:44.163537 (+   352us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:44.589029 (+425492us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:45.671008 (+1081979us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b540048b554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:45.671235 (+   227us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":976964992}
I20260812 19:23:45.769757  6477 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:45.764595  6345 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:45.771299  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.775236  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.767922 12849 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:45.776345  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.777405  6352 raft_consensus.cc:2396] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260812 19:23:45.776403  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.769289  6475 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:45.778481  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.778868  6359 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:45.779776  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.780443  6344 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:45.780552  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.780643 12482 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:45.781263 12482 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:45.781308  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.781601  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.782024  6344 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:23:45.782147  6464 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:45.782902  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:45.782970  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.783838  6464 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:45.784598  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.785334  6464 raft_consensus.cc:2396] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260812 19:23:45.785220  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:45.785982  6473 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:45.786127  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.761579 12685 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:45.787214 12685 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:45.787276  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.787629 12685 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:45.788164  6477 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:45.789249  6477 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260812 19:23:45.789642  6238 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260812 19:23:45.790367  6477 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:45.761754 12489 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:45.779922 12458 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:45.729511 12856 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:45.804301 12856 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:45.804694 12666 consensus_queue.cc:1046] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 19:23:45.731997 12852 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:45.790608  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:45.782920  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:45.790916  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:45.791123 12575 consensus_queue.cc:237] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:45.821059  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:45.822284  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.791443  6229 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:45.817180 12406 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:45.783839  6465 raft_consensus.cc:2396] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260812 19:23:45.823693  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:45.823534 12406 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:45.824621  6465 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260812 19:23:45.825011  6465 pending_rounds.cc:76] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 4
I20260812 19:23:45.825224  6465 pending_rounds.cc:97] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260812 19:23:45.825455  6465 raft_consensus.cc:2866] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:45.825743 12406 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:45.791914  6224 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260812 19:23:45.827704  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:45.828576  6224 raft_consensus.cc:2396] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260812 19:23:45.795648 12804 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 19:23:45.829384  6483 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:45.796764  6464 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260812 19:23:45.831137  6482 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:45.832261 12852 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:45.832584  6482 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:23:45.833271  6464 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260812 19:23:45.787328  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:45.834924 12849 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:45.792580  6058 catalog_manager.cc:5495] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 7 to 9, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 9 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:45.822949  6229 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:45.837725  6465 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260812 19:23:45.798508  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:45.840420  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:45.841481 12852 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:45.841858  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:45.842069 12852 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:45.843015 12849 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:45.792611  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.792030  6475 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:45.819105 12620 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:45.843925 12620 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:45.843050 12852 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260812 19:23:45.844533 12620 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:45.844779  6474 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:45.846426  6464 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260812 19:23:45.801986  6241 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:45.818337  6235 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:45.837153  6058 catalog_manager.cc:5495] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 8 to 9, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 9 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:45.847560  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:45.792611  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.848501  6058 catalog_manager.cc:5495] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 5 to 6, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 6 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:45.849977 12406 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:45.850127  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.850416 12406 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:45.850903 12406 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:45.792773 12592 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260812 19:23:45.827651 12808 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:45.819692  6347 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:45.851490 12592 consensus_queue.cc:1225] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Peer f4ef77b3328a44e8a21dd902b370e25a log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260812 19:23:45.854781  6238 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260812 19:23:45.854954  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:45.856047  6347 raft_consensus.cc:2396] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260812 19:23:45.852169 12808 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:45.857189  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.851125  6352 raft_consensus.cc:2396] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260812 19:23:45.857977 12808 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:45.858215  6347 raft_consensus.cc:2396] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260812 19:23:45.857196  6229 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:45.859148  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.859659  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:45.860128  6347 raft_consensus.cc:2396] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260812 19:23:45.860970  6229 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:45.854131  6477 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260812 19:23:45.777541  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:45.781352  6470 raft_consensus.cc:2396] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260812 19:23:45.823161  6345 raft_consensus.cc:2396] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260812 19:23:45.836867  6483 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:23:45.842723 12554 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260812 19:23:45.843362  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.783869  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:45.852916  6241 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260812 19:23:45.818320  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.864986  6344 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:45.809943  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.853507  6482 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260812 19:23:45.865183  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 81393.1us
I20260812 19:23:45.808422  6242 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:45.872908  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2032) took 1098 ms. Trace:
I20260812 19:23:45.873965  6345 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260812 19:23:45.874105  6236 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260812 19:23:45.874346  6345 pending_rounds.cc:76] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 4
I20260812 19:23:45.874576  6345 pending_rounds.cc:97] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260812 19:23:45.874478  6242 rpcz_store.cc:276] 0812 19:23:44.774280 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:45.672046 (+897766us) service_pool.cc:227] Handling call
0812 19:23:45.872852 (+200806us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:45.819144  6055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 118) took 9426 ms. Trace:
I20260812 19:23:45.865240  6350 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:45.866817  6354 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:45.875025  6345 raft_consensus.cc:2866] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:45.864579  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.798925  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:45.879554  6235 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:45.746810 12869 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260812 19:23:45.881373  6232 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:23:45.797935 12848 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:45.883076  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.885568  6477 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260812 19:23:45.886915  6344 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260812 19:23:45.887902  6359 raft_consensus.cc:2396] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260812 19:23:45.888018  6352 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:45.891045  6238 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260812 19:23:45.911831  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 154375us
I20260812 19:23:45.884305  6058 catalog_manager.cc:5495] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 6 to 7, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 7 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:45.890254  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:45.922770  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:45.923054  6242 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:45.919004  6470 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:45.883301  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:45.871858 12355 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:45.892491  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.923448  6236 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:23:45.931879  6359 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260812 19:23:45.935268  6482 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260812 19:23:45.936435  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.937944  6470 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:45.929486  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.950529  6228 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:23:45.890180 12457 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.120s
I20260812 19:23:45.950894  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.960175  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:45.948679  6474 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
W20260812 19:23:45.961186  6396 debug-util.cc:398] Leaking SignalData structure 0x7b080017c040 after lost signal to thread 4090
I20260812 19:23:46.178345  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:46.178689  6396 debug-util.cc:398] Leaking SignalData structure 0x7b0800165f00 after lost signal to thread 6116
W20260812 19:23:46.179208  6396 debug-util.cc:398] Leaking SignalData structure 0x7b080016ae40 after lost signal to thread 6138
I20260812 19:23:46.019158  6230 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:46.003902  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:46.061878  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 284380us
W20260812 19:23:46.181674  6396 debug-util.cc:398] Leaking SignalData structure 0x7b08002e28c0 after lost signal to thread 6272
I20260812 19:23:46.181913  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:46.182039  6396 debug-util.cc:398] Leaking SignalData structure 0x7b08001397e0 after lost signal to thread 6273
I20260812 19:23:45.993019  6349 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260812 19:23:46.183662  6396 debug-util.cc:398] Leaking SignalData structure 0x7b080036e940 after lost signal to thread 6399
W20260812 19:23:46.089278  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 165976us
I20260812 19:23:46.185333  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:46.067000  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:46.186677  6482 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:46.187186  6344 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260812 19:23:46.060492  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:45.881724 12458 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election won for term 10
W20260812 19:23:46.185712  6396 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1060 after lost signal to thread 6521
W20260812 19:23:46.200477  6396 debug-util.cc:398] Leaking SignalData structure 0x7b08001ffd40 after lost signal to thread 6522
W20260812 19:23:46.202318  6396 debug-util.cc:398] Leaking SignalData structure 0x7b0800033940 after lost signal to thread 7647
I20260812 19:23:46.179122  6465 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:46.176537  6470 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:46.207458  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:46.214040  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:45.926939 12804 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:23:46.218384  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:46.219152  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:46.219511  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:46.132119 12873 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
W20260812 19:23:46.202952  6396 debug-util.cc:398] Leaking SignalData structure 0x7b08001b4080 after lost signal to thread 7649
I20260812 19:23:46.213418  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:46.217993 12575 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:46.218636 12458 raft_consensus.cc:686] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:46.230540  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:46.234524  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:46.141637 12808 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:46.021399 12818 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.239s
I20260812 19:23:46.235931  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:46.284775  6236 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:46.232041  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:46.237190  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:45.924538 12435 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.296s
I20260812 19:23:46.210386 12554 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:46.228480 12274 consensus_meta.cc:287] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260812 19:23:46.218051 12592 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:46.218102 12489 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:46.248351  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:46.231276  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1785) took 1022 ms. Trace:
W20260812 19:23:46.009238 12335 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260812 19:23:45.960783 12303 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.277s
I20260812 19:23:46.220729 12883 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:46.278909  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2022) took 1281 ms. Trace:
I20260812 19:23:46.332765  6352 rpcz_store.cc:276] 0812 19:23:44.997385 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:45.931117 (+933732us) service_pool.cc:227] Handling call
0812 19:23:46.278059 (+346942us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b5800004598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:23:46.278290 (+   231us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:46.278489 (+   199us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:46.278514 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:46.278562 (+    48us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:46.278618 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.278699 (+    81us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:46.278845 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5309696}
I20260812 19:23:46.213858 12338 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260812 19:23:45.877139  6055 rpcz_store.cc:276] 0812 19:23:36.392298 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:36.392478 (+   180us) service_pool.cc:227] Handling call
0812 19:23:45.819076 (+9426598us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:43.943613 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:44.015234 (+ 71621us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:44.015297 (+    63us) write_op.cc:435] Acquired schema lock
0812 19:23:44.015325 (+    28us) tablet.cc:660] Decoding operations
0812 19:23:44.097145 (+ 81820us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:44.120807 (+ 23662us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:44.120860 (+    53us) tablet.cc:683] Acquiring locks for 4 operations
0812 19:23:44.121360 (+   500us) tablet.cc:699] Row locks acquired
0812 19:23:44.121393 (+    33us) write_op.cc:260] PREPARE: finished
0812 19:23:44.121575 (+   182us) write_op.cc:270] Start()
0812 19:23:44.121724 (+   149us) write_op.cc:276] Timestamp: P: 1786562624121511 usec, L: 0
0812 19:23:44.121773 (+    49us) op_driver.cc:331] REPLICATION: starting
0812 19:23:44.122501 (+   728us) log.cc:842] Serialized 1662 byte log entry
0812 19:23:44.862717 (+740216us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:45.236674 (+373957us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b24002b1198. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f46b4cf4 00007f98f46b2dfb 00007f98f4741559 00007f98f47411e5 00007f98f474082d 00007f98f73e346e 00007f98f73fac0c 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551
0812 19:23:45.552421 (+315747us) op_driver.cc:444] REPLICATION: finished
0812 19:23:45.610964 (+ 58543us) write_op.cc:301] APPLY: starting
0812 19:23:45.611046 (+    82us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:45.612074 (+  1028us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:45.614642 (+  2568us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:45.679801 (+ 65159us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:45.680048 (+   247us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=8
0812 19:23:45.680093 (+    45us) write_op.cc:312] APPLY: finished
0812 19:23:45.680444 (+   351us) log.cc:842] Serialized 65 byte log entry
0812 19:23:45.681259 (+   815us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:45.681371 (+   112us) write_op.cc:454] Released schema lock
0812 19:23:45.681413 (+    42us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:45.681681 (+   268us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:45.681709 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1277231,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":58216,"apply.run_cpu_time_us":12094,"apply.run_wall_time_us":71054,"cfile_cache_hit":6,"cfile_cache_hit_bytes":6279,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":1,"lbm_read_time_us":10767,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":6,"num_ops":4,"prepare.queue_time_us":225070,"prepare.run_cpu_time_us":22391,"prepare.run_wall_time_us":331446,"raft.queue_time_us":124310,"raft.run_cpu_time_us":25832,"raft.run_wall_time_us":29940,"replication_time_us":1430546,"spinlock_wait_cycles":175346432,"thread_start_us":407649,"threads_started":4,"wal-append.queue_time_us":159891}]]}
I20260812 19:23:46.281852  6349 raft_consensus.cc:595] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:46.337781  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:46.238909 12355 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:46.295331  6353 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:46.278509 12849 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:46.298856  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 74391us
I20260812 19:23:46.341607  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:46.298444 12489 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:46.283762 12482 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260812 19:23:46.323051  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 93315.6us
I20260812 19:23:46.334319 12274 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:46.354612  6349 pending_rounds.cc:76] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 4
I20260812 19:23:46.361411  6349 pending_rounds.cc:97] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260812 19:23:46.291430 12808 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:46.335011  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 121664us
I20260812 19:23:46.296586 12592 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:46.298632  6344 rpcz_store.cc:276] 0812 19:23:45.208839 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:46.189585 (+980746us) service_pool.cc:227] Handling call
0812 19:23:46.230772 (+ 41187us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:46.230945 (+   173us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:46.230975 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:46.231025 (+    50us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:46.231057 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.231110 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:46.231220 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:46.344381  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:46.367530  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:46.368088  6236 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:46.369333  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:46.370118  6236 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:46.344550  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:46.347430  6232 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:46.346550  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:46.345036  6352 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:46.350203  6224 raft_consensus.cc:3032] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:46.338435  6242 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:46.353615  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:46.282974 12575 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:46.323448  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 75221.8us
I20260812 19:23:46.360298  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:46.361737  6349 raft_consensus.cc:2866] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:46.359880 12482 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:46.372025  6232 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:46.382256  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:46.373987  6224 raft_consensus.cc:729] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:46.295246 12554 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:46.355266 12489 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:46.387099  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:46.371475 12592 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:46.348709 12883 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:46.377503  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:46.237323 12851 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260812 19:23:46.379211  6230 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:46.384817  6352 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:46.373214 12435 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:46.377470 12869 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:46.387957  6241 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:46.361379 12274 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:46.383502  6224 consensus_queue.cc:260] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:46.397600  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:46.398061  6224 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:46.398577  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:46.369006  6416 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:46.384733  6232 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:46.399854  6232 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:46.393469  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1790) took 1181 ms. Trace:
I20260812 19:23:46.400424  6352 rpcz_store.cc:276] 0812 19:23:45.212135 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:46.373837 (+1161702us) service_pool.cc:227] Handling call
0812 19:23:46.384625 (+ 10788us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:46.393214 (+  8589us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.393414 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:46.386022  6238 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:23:46.348510 12849 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:46.405164 12849 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:46.348444 12355 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:46.413656  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 44732.7us
I20260812 19:23:46.414047  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:46.385649 12482 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:46.399760  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:46.363106 12457 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260812 19:23:46.376511 12894 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:46.414567  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:46.416503  6229 consensus_meta.cc:287] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.004s
I20260812 19:23:46.394676 12303 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260812 19:23:46.419867 12891 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260812 19:23:46.395824 12869 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:46.420743 12869 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:46.401703 12435 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:46.418072 12852 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:46.423102 12852 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:46.423882 12435 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:46.424084 12852 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:46.425349 12852 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:46.425621 12554 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:46.417097  6352 raft_consensus.cc:595] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:46.426633  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1734) took 1031 ms. Trace:
I20260812 19:23:46.426725  6352 raft_consensus.cc:603] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:46.428759  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2019) took 1432 ms. Trace:
I20260812 19:23:46.429212  6352 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:46.430109  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1792) took 1217 ms. Trace:
I20260812 19:23:46.429105  6350 rpcz_store.cc:276] 0812 19:23:44.996443 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:45.877470 (+881027us) service_pool.cc:227] Handling call
0812 19:23:45.917205 (+ 39735us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:45.930109 (+ 12904us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:45.930153 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:45.930612 (+   459us) log.cc:842] Serialized 26 byte log entry
0812 19:23:46.250431 (+319819us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:46.250468 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.250539 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:46.428529 (+177990us) raft_consensus.cc:1671] finished
0812 19:23:46.428546 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:46.428703 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12499,"raft.queue_time_us":29545,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":98855,"thread_start_us":117403,"threads_started":1,"wal-append.queue_time_us":465241}
I20260812 19:23:46.430483  6352 rpcz_store.cc:276] 0812 19:23:45.212728 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:46.428631 (+1215903us) service_pool.cc:227] Handling call
0812 19:23:46.428994 (+   363us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:46.429859 (+   865us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.430054 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:46.419335  6229 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260812 19:23:46.431764  6350 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:46.431954  6229 pending_rounds.cc:76] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 6
I20260812 19:23:46.432307  6229 pending_rounds.cc:97] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260812 19:23:46.432585  6229 raft_consensus.cc:2866] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:46.370520 12458 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:46.434594  6352 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 19:23:46.435214  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 504) took 1221 ms. Trace:
I20260812 19:23:46.406394 12849 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:46.427083  6473 rpcz_store.cc:276] 0812 19:23:45.394931 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:45.786491 (+391560us) service_pool.cc:227] Handling call
0812 19:23:45.786832 (+   341us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:45.790917 (+  4085us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:23:45.923526 (+132609us) log.cc:842] Serialized 14 byte log entry
0812 19:23:46.222032 (+298506us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:46.223178 (+  1146us) log.cc:842] Serialized 26 byte log entry
0812 19:23:46.223337 (+   159us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:23:46.223568 (+   231us) log.cc:842] Serialized 14 byte log entry
0812 19:23:46.361579 (+138011us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.361661 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:46.426394 (+ 64733us) raft_consensus.cc:1671] finished
0812 19:23:46.426418 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:46.426549 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":25483,"prepare.queue_time_us":586111,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":6152,"raft.queue_time_us":31610,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":40081,"thread_start_us":407201,"threads_started":3,"wal-append.queue_time_us":332941}
I20260812 19:23:46.432412  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1793) took 1219 ms. Trace:
I20260812 19:23:46.442615  6350 rpcz_store.cc:276] 0812 19:23:45.213037 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:46.431154 (+1218117us) service_pool.cc:227] Handling call
0812 19:23:46.431544 (+   390us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:46.432194 (+   650us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.432363 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:46.442881  6352 rpcz_store.cc:276] 0812 19:23:45.213360 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:46.433891 (+1220531us) service_pool.cc:227] Handling call
0812 19:23:46.434235 (+   344us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:46.434991 (+   756us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.435164 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:46.444235 12848 consensus_meta.cc:287] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
W20260812 19:23:46.439565 12803 consensus_meta.cc:287] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.000s
W20260812 19:23:46.440852 12406 consensus_meta.cc:287] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.000s
I20260812 19:23:46.442157 12849 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:23:46.447729 12881 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260812 19:23:46.446957 12406 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:46.454732  6342 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:46.455844  6352 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260812 19:23:46.456436  6352 pending_rounds.cc:76] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 8
I20260812 19:23:46.456807  6352 pending_rounds.cc:97] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260812 19:23:46.457638  6352 raft_consensus.cc:2866] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:46.446666 12803 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:46.472837  6359 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260812 19:23:46.393886 12880 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:23:46.407290 12274 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:46.407292 12804 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260812 19:23:46.483706  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 121555us
W20260812 19:23:46.442963 12685 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.655s	user 0.008s	sys 0.003s
I20260812 19:23:46.412448 12666 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:46.450084 12406 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:46.447139 12849 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:46.532270  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2018) took 1536 ms. Trace:
I20260812 19:23:46.459919  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 508) took 1032 ms. Trace:
W20260812 19:23:46.521907  6345 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.005s	sys 0.007s
W20260812 19:23:46.536049  6345 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.005s	sys 0.007s
I20260812 19:23:46.472697 12894 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election won for term 10
W20260812 19:23:46.528999  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 114514us
I20260812 19:23:46.485976  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:46.532317  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 132623us
I20260812 19:23:46.537905  6352 rpcz_store.cc:276] 0812 19:23:45.427789 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:46.444174 (+1016385us) service_pool.cc:227] Handling call
0812 19:23:46.444509 (+   335us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:46.459575 (+ 15066us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.459846 (+   271us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:46.541716  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 55835.4us
I20260812 19:23:46.534919  6347 rpcz_store.cc:276] 0812 19:23:44.996114 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:45.876249 (+880135us) service_pool.cc:227] Handling call
0812 19:23:45.916821 (+ 40572us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:45.917046 (+   225us) raft_consensus.cc:1520] Early marking committed up to index 7
0812 19:23:46.244943 (+327897us) log.cc:842] Serialized 14 byte log entry
0812 19:23:46.529233 (+284290us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:46.529521 (+   288us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:46.529717 (+   196us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.532027 (+  2310us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:46.532202 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":465440,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":2162,"raft.queue_time_us":309,"thread_start_us":532420,"threads_started":2}
I20260812 19:23:46.482474 12804 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:46.547931  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:46.546144 12338 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:23:46.549674  6347 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260812 19:23:46.549944  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:46.526396 12666 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:46.523200 12554 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:46.535064 12909 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:46.523953 12908 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:46.557713  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:46.585011  6347 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260812 19:23:46.555028 12804 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:46.531761 12685 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:46.488694  6043 maintenance_manager.cc:643] P 4483e3a69e644cbea699c6f7c9c1da9e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 3.676s	user 0.178s	sys 0.052s Metrics: {"bytes_written":28948,"cfile_init":1,"dirs.queue_time_us":184396,"dirs.run_cpu_time_us":697,"dirs.run_wall_time_us":38014,"drs_written":1,"lbm_read_time_us":361,"lbm_reads_lt_1ms":4,"lbm_write_time_us":186886,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":7,"lbm_writes_lt_1ms":20,"peak_mem_usage":0,"rows_written":63,"thread_start_us":104654,"threads_started":1}
I20260812 19:23:46.534765 12489 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:46.543530 12911 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:46.579121 12338 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260812 19:23:46.598366  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 56815.3us
W20260812 19:23:46.599020  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 216850us
I20260812 19:23:46.599280 12808 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:46.561728 12666 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:46.600097  6347 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:23:46.553436 12435 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260812 19:23:46.607242  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:46.607242  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:46.608367  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 509) took 1021 ms. Trace:
I20260812 19:23:46.611505  6044 maintenance_manager.cc:419] P 4483e3a69e644cbea699c6f7c9c1da9e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9652 bytes on disk
I20260812 19:23:46.615731  6481 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:23:46.599934 12910 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260812 19:23:46.554641 12457 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260812 19:23:46.618307  6347 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:46.447115 12883 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:46.619506  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1779) took 1412 ms. Trace:
I20260812 19:23:46.622090  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:46.623478  6352 rpcz_store.cc:276] 0812 19:23:45.587401 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:46.543178 (+955777us) service_pool.cc:227] Handling call
0812 19:23:46.543784 (+   606us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:46.544018 (+   234us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:23:46.564613 (+ 20595us) log.cc:842] Serialized 14 byte log entry
0812 19:23:46.605883 (+ 41270us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:46.605944 (+    61us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:23:46.606006 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.608165 (+  2159us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:46.608291 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":16792,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":92,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":8695,"thread_start_us":40536,"threads_started":1}
I20260812 19:23:46.626212  6353 rpcz_store.cc:276] 0812 19:23:45.206863 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:45.755407 (+548544us) service_pool.cc:227] Handling call
0812 19:23:46.619350 (+863943us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54001ce3d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:46.619453 (+   103us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1221836032}
I20260812 19:23:46.579857 12554 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:46.609943 12338 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:46.642939 12338 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:46.609902 12575 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:46.646360  6043 maintenance_manager.cc:643] P 4483e3a69e644cbea699c6f7c9c1da9e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.022s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":418,"lbm_reads_lt_1ms":4}
I20260812 19:23:46.644645  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:46.663717  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 56539.5us
I20260812 19:23:46.664026  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:46.664776  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:46.665711  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:46.640720 12903 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260812 19:23:46.579596 12906 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260812 19:23:46.640992 12808 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:46.669133  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:46.625070 12918 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:46.644171 12852 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:46.671845  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:46.672806  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 115202us
I20260812 19:23:46.641222 12803 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:46.636276 12908 raft_consensus.cc:686] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:46.660584 12355 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:46.681999  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:46.681367  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:46.659935 12818 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:23:46.680718  6232 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260812 19:23:46.677565  7593 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:46.672988 12575 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:46.670929 12446 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:46.690846  6232 pending_rounds.cc:76] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 8
I20260812 19:23:46.698882 12919 raft_consensus.cc:2741] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260812 19:23:46.698776 12908 consensus_queue.cc:237] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:46.674239 12848 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:23:46.670449 12406 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:23:46.675372 12880 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:46.720027 12880 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:23:46.720626 12877 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.831s	user 0.010s	sys 0.010s
I20260812 19:23:46.721148 12880 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:46.703676  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1789) took 1491 ms. Trace:
I20260812 19:23:46.702966  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2020) took 1706 ms. Trace:
I20260812 19:23:46.710865  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:46.675271 12918 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:46.712651  6232 pending_rounds.cc:97] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260812 19:23:46.685093 12852 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:46.612986 12911 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:46.719008 12945 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:46.725313  6344 rpcz_store.cc:276] 0812 19:23:45.211840 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:46.366778 (+1154938us) service_pool.cc:227] Handling call
0812 19:23:46.367241 (+   463us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:46.587946 (+220705us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:46.587992 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:46.594176 (+  6184us) log.cc:842] Serialized 26 byte log entry
0812 19:23:46.674028 (+ 79852us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:46.674112 (+    84us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.674263 (+   151us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:46.703385 (+ 29122us) raft_consensus.cc:1671] finished
0812 19:23:46.703417 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:46.703601 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5616,"raft.queue_time_us":38201,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"thread_start_us":262164,"threads_started":2,"wal-append.queue_time_us":87661}
I20260812 19:23:46.668179 12869 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:46.709424 12803 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:46.725396  6354 rpcz_store.cc:276] 0812 19:23:44.996755 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:45.877654 (+880899us) service_pool.cc:227] Handling call
0812 19:23:45.917782 (+ 40128us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:45.992585 (+ 74803us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:45.992630 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:46.228873 (+236243us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b18004154e0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a
0812 19:23:46.296670 (+ 67797us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b2c00012928. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:23:46.301637 (+  4967us) log.cc:842] Serialized 26 byte log entry
0812 19:23:46.483364 (+181727us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:46.483413 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.483502 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:46.702739 (+219237us) raft_consensus.cc:1671] finished
0812 19:23:46.702759 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:46.702903 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20113,"raft.queue_time_us":65741,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":50422,"spinlock_wait_cycles":38415488,"thread_start_us":129785,"threads_started":1,"wal-append.queue_time_us":313229}
I20260812 19:23:46.730829  6232 raft_consensus.cc:2866] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:46.732304  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1773) took 1148 ms. Trace:
I20260812 19:23:46.741590  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 505) took 1528 ms. Trace:
I20260812 19:23:46.744634  6481 rpcz_store.cc:276] 0812 19:23:45.583809 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:45.777038 (+193229us) service_pool.cc:227] Handling call
0812 19:23:46.732085 (+955047us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b5400213754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:46.732240 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1819439360}
I20260812 19:23:46.731002 12918 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:46.742205 12945 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:46.709234 12575 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:46.744760  6350 rpcz_store.cc:276] 0812 19:23:45.213625 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:46.443882 (+1230257us) service_pool.cc:227] Handling call
0812 19:23:46.444288 (+   406us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:46.444651 (+   363us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:46.444680 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:46.445141 (+   461us) log.cc:842] Serialized 26 byte log entry
0812 19:23:46.562730 (+117589us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:46.563215 (+   485us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.563526 (+   311us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:46.741348 (+177822us) raft_consensus.cc:1671] finished
0812 19:23:46.741373 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:46.741526 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":206,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":116057,"threads_started":1,"wal-append.queue_time_us":232737}
W20260812 19:23:46.785746  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 104448us
I20260812 19:23:46.788172  6224 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260812 19:23:46.733402 12904 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260812 19:23:46.793215  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 440) took 1004 ms. Trace:
I20260812 19:23:46.795135  6224 rpcz_store.cc:276] 0812 19:23:45.788910 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:45.829074 (+ 40164us) service_pool.cc:227] Handling call
0812 19:23:45.829349 (+   275us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:46.350102 (+520753us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54001584a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7708730 00007f98f777a300 00007f98f777b371 00007f98f7777edf 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc
0812 19:23:46.793000 (+442898us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.793169 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1040484608}
I20260812 19:23:46.793680  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:46.711835 12808 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260812 19:23:46.715384 12435 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260812 19:23:46.743897 12803 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:46.797693 12923 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:46.823720 12923 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:46.824071 12923 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:46.828632 12808 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:46.829077 12808 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:46.829430 12808 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:46.717087 12818 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
W20260812 19:23:46.831473 12915 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260812 19:23:46.834868 12952 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:46.835614 12952 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:46.841580 12685 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:46.795652 12575 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:46.801748 12852 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:46.846469 12852 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:46.847009 12852 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:46.822953 12803 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:46.802284 12856 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260812 19:23:46.870630  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 322839us
I20260812 19:23:46.875798  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:46.807157 12883 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:46.808441 12929 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260812 19:23:46.809142 12937 log.cc:924] Time spent T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260812 19:23:46.811924 12406 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:46.813799 12919 consensus_queue.cc:1046] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:46.715289 12355 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
W20260812 19:23:46.815250 12940 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260812 19:23:46.815295  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:46.857905 12592 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:46.889607  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:46.891676 12620 consensus_meta.cc:287] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.047s	user 0.000s	sys 0.023s
I20260812 19:23:46.876575 12894 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:46.894860 12685 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260812 19:23:46.979080  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 268267us
W20260812 19:23:46.984877  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 304905us
I20260812 19:23:46.986624  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:46.988538  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 99042.7us
I20260812 19:23:46.990379  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:46.890873 12883 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:47.004253  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 493) took 1130 ms. Trace:
I20260812 19:23:46.976240 12685 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:47.004933  6483 rpcz_store.cc:276] 0812 19:23:45.873721 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:45.874184 (+   463us) service_pool.cc:227] Handling call
0812 19:23:45.921994 (+ 47810us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:45.922397 (+   403us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:45.922429 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:45.922865 (+   436us) log.cc:842] Serialized 26 byte log entry
0812 19:23:46.530358 (+607493us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:46.530451 (+    93us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.530746 (+   295us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:47.003916 (+473170us) raft_consensus.cc:1671] finished
0812 19:23:47.003940 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:47.004154 (+   214us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":48312,"raft.queue_time_us":90,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":21070,"thread_start_us":468696,"threads_started":1,"wal-append.queue_time_us":648018}
I20260812 19:23:47.009312 12335 tablet_bootstrap.cc:492] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 19:23:46.971029 12620 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:47.021557  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1788) took 1810 ms. Trace:
I20260812 19:23:47.021939  6349 rpcz_store.cc:276] 0812 19:23:45.211515 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:46.354034 (+1142519us) service_pool.cc:227] Handling call
0812 19:23:46.354407 (+   373us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:46.493411 (+139004us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:46.493459 (+    48us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:46.494163 (+   704us) log.cc:842] Serialized 52 byte log entry
0812 19:23:46.619897 (+125734us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:46.619940 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.620011 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:47.021291 (+401280us) raft_consensus.cc:1671] finished
0812 19:23:47.021318 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:47.021506 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":25701,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":191664,"threads_started":2,"wal-append.queue_time_us":172813}
I20260812 19:23:47.009763 12554 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:47.016100 12685 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:47.009313 12851 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260812 19:23:46.994894 12435 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260812 19:23:47.011579 12957 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:47.076965  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 261738us
I20260812 19:23:47.070395  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:47.035336  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 45043.1us
I20260812 19:23:47.038354  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:47.078796  6473 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:23:47.079388  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:47.057646  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 64844.1us
I20260812 19:23:47.081854  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:47.067802  6235 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
W20260812 19:23:47.027854 12581 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260812 19:23:47.092561  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:47.034255 12355 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:47.096712  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:47.104573  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:47.029613 12406 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:47.070961 12946 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:47.103843 12919 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:46.995033 12894 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:47.100503 12355 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:47.106685 12880 consensus_queue.cc:1046] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260812 19:23:47.141935 12592 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:47.106542 12406 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:23:47.137241 12274 consensus_meta.cc:287] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.609s	user 0.017s	sys 0.006s
I20260812 19:23:47.123953 12946 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:47.163110 12335 tablet_bootstrap.cc:492] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:23:47.164567 12955 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.171s
I20260812 19:23:47.162418 12919 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:47.165338 12554 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:47.172900 12355 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:47.174638 12406 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:23:47.201422  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 97051.1us
W20260812 19:23:47.193593  6342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2010) took 2205 ms (client timeout 2069 ms). Trace:
I20260812 19:23:47.091573 12957 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:47.186924 12946 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:47.197027 12919 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:47.199702 12446 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:47.195983 12554 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:47.175727 12917 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.216s
W20260812 19:23:47.212194  6342 rpcz_store.cc:269] 0812 19:23:44.981129 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:45.717581 (+736452us) service_pool.cc:227] Handling call
0812 19:23:47.185887 (+1468306us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b540009f6d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:47.186011 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1600834816}
I20260812 19:23:47.212532 12335 ts_tablet_manager.cc:1397] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 2.388s	user 0.059s	sys 0.012s
I20260812 19:23:47.179057 12274 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:47.213860  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:47.216933 12592 raft_consensus.cc:3032] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:47.216069 12883 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:47.247303  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:47.246556  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 167237us
I20260812 19:23:47.232410 12620 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:47.233731 12446 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:47.250000  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1784) took 2034 ms. Trace:
I20260812 19:23:47.250694  6359 rpcz_store.cc:276] 0812 19:23:45.208515 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:45.932913 (+724398us) service_pool.cc:227] Handling call
0812 19:23:45.933198 (+   285us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:46.476404 (+543206us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:47.242540 (+766136us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b540003f7d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:47.242793 (+   253us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1188996352}
I20260812 19:23:47.227602 12554 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:23:47.256903  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 157455us
I20260812 19:23:47.260382  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:23:47.264819 12482 consensus_meta.cc:287] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.791s	user 0.019s	sys 0.003s
I20260812 19:23:47.268177 12644 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:23:47.268625 12644 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:47.269025 12644 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:23:47.269063 12952 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:47.270543 12972 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:47.239555 12592 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:47.250155 12446 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:47.249801 12575 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:47.271068 12972 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:47.296444 12991 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:47.260821 12883 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 19:23:47.286550 12666 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.662s	user 0.006s	sys 0.006s
I20260812 19:23:47.280616 12446 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:47.298740 12956 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:47.265574 12482 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:47.300298 12972 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:23:47.356942  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 75161.7us
I20260812 19:23:47.357574  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:47.358929 12960 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.194s	user 0.000s	sys 0.002s
I20260812 19:23:47.363646  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:47.318868 12982 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260812 19:23:47.367097  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 113431us
I20260812 19:23:47.338042 12909 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:47.377868 12982 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:47.337826 12666 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:47.476543  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 154311us
W20260812 19:23:47.526908  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 445852us
I20260812 19:23:47.466528 12908 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:47.468617 12909 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:47.472371 12974 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election won for term 8
W20260812 19:23:47.544456  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 173447us
I20260812 19:23:47.362028 12435 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
W20260812 19:23:47.588960  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 63526.5us
W20260812 19:23:47.600840  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 54007.5us
W20260812 19:23:47.600957  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55188.1us
I20260812 19:23:47.488528 12982 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:47.360277 12956 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:47.368726 12592 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:47.623282  6465 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: [10.4-10.4]
W20260812 19:23:47.587868 12804 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.980s	user 0.015s	sys 0.007s
I20260812 19:23:47.636150  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:47.637995  6230 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260812 19:23:47.638181  6242 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:47.626720  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:47.627069  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:47.629145  6178 connection.cc:232] RPC call timeout handler was delayed by -1.3737138151191175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260812 19:23:47.530189 13021 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:47.539706 13006 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:47.612596 12803 consensus_meta.cc:287] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.753s	user 0.013s	sys 0.004s
I20260812 19:23:47.638367  6230 pending_rounds.cc:76] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 3
I20260812 19:23:47.659137  6230 pending_rounds.cc:97] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260812 19:23:47.659438  6230 raft_consensus.cc:2866] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:47.546743 12880 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:47.646080  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:47.661134  6236 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
W20260812 19:23:47.647830 12849 consensus_meta.cc:287] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.095s	user 0.018s	sys 0.005s
I20260812 19:23:47.647142 13021 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:47.648587  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:47.662504  6465 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
W20260812 19:23:47.644397  6178 connection.cc:232] RPC call timeout handler was delayed by -1.3397190300747752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260812 19:23:47.611178 12852 consensus_meta.cc:287] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.764s	user 0.013s	sys 0.000s
I20260812 19:23:47.538545 12977 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:23:47.631090 12958 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.251s	user 0.002s	sys 0.000s
I20260812 19:23:47.664669  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:47.664858  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:47.693550  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2848190299700946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
I20260812 19:23:47.696971  6465 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260812 19:23:47.703109  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:47.693672  6347 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:47.700901  6344 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:47.723249  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:47.724030  6230 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:47.724115  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:47.727458  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:47.729169  6465 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 11: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:23:47.730521  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2596190301701427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260812 19:23:47.731359  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.538s (SENT) [suppressed 36 similar messages]
I20260812 19:23:47.736837  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:47.642310 12974 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:47.739775  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:47.642177 13015 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:47.669171 13021 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:47.658177 12804 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:47.772862  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:47.774497  6242 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
W20260812 19:23:47.772110  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 145534us
I20260812 19:23:47.702139 12575 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:47.631387 12936 consensus_queue.cc:1046] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260812 19:23:47.765093  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:47.768476  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:47.793298  6354 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:23:47.745682 12338 consensus_meta.cc:287] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 1.102s	user 0.013s	sys 0.009s
W20260812 19:23:47.766813 12458 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.006s	sys 0.007s
I20260812 19:23:47.609647 12908 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:47.800194 13009 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260812 19:23:47.758010 13015 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:47.767481  7593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 521) took 1532 ms. Trace:
I20260812 19:23:47.778379  6230 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:47.777535  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:23:47.779804 12992 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.399s	user 0.000s	sys 0.002s
W20260812 19:23:47.780177 12986 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.418s	user 0.001s	sys 0.000s
I20260812 19:23:47.780519 12921 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260812 19:23:47.779795 12962 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.441s	user 0.001s	sys 0.001s
I20260812 19:23:47.738973  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:47.790567  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:47.697199 12849 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:47.632777 13010 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.156s
I20260812 19:23:47.706415 12977 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:47.664606 12803 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:47.800124 12458 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.006s	sys 0.008s
I20260812 19:23:47.725844 12274 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:47.801928  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:47.702325 12957 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:47.706233 12852 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:47.695428 12880 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:47.770833 12482 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:47.664547 13006 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:47.812106 12575 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:47.835008 12918 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.031s	user 0.010s	sys 0.004s
I20260812 19:23:47.806512 12338 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:47.773332 12644 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:47.854676  6477 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:47.860643  6344 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:47.800429 12974 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:47.806918 13015 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:47.886349  6347 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
W20260812 19:23:47.882148 12808 consensus_meta.cc:287] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.045s	user 0.017s	sys 0.006s
W20260812 19:23:47.862043 13017 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.380s	user 0.001s	sys 0.000s
I20260812 19:23:47.862483 12988 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:47.871996 12482 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:47.848063  7594 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
W20260812 19:23:47.890010 12923 consensus_meta.cc:287] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.057s	user 0.014s	sys 0.000s
I20260812 19:23:47.920477 12923 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:47.907447  7603 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
I20260812 19:23:47.863801 12956 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:47.912623  7600 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7. Ops: []
W20260812 19:23:47.863246 12894 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.010s	sys 0.000s
I20260812 19:23:47.806041  7593 rpcz_store.cc:276] 0812 19:23:46.235431 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:46.245838 (+ 10407us) service_pool.cc:227] Handling call
0812 19:23:46.660267 (+414429us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:46.711474 (+ 51207us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:47.745426 (+1033952us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b540019b250. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:47.767398 (+ 21972us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":804811008}
W20260812 19:23:47.923132 12894 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.011s	sys 0.000s
I20260812 19:23:47.924934 12923 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:47.928475  6344 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:47.844560 13041 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260812 19:23:47.916545 13027 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260812 19:23:47.880334 12575 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:47.917043 12489 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:47.979956 13011 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
W20260812 19:23:47.985975 13001 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.338s	user 0.001s	sys 0.001s
I20260812 19:23:47.882777 12918 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:48.013445  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 282107us
I20260812 19:23:47.985153 12921 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:47.912854 12808 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:48.001405 12955 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.005s	sys 0.004s
I20260812 19:23:48.025147 12908 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:48.036119  6352 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.008s	sys 0.004s
W20260812 19:23:48.036474  6352 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.008s	sys 0.004s
W20260812 19:23:48.023706  6178 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.701s (SENT)
W20260812 19:23:48.022715 12976 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.009s	sys 0.023s
I20260812 19:23:48.011072 12856 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:48.037091  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 517) took 2149 ms. Trace:
I20260812 19:23:48.039315  6178 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:48.002517 13038 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:48.046289  6352 rpcz_store.cc:276] 0812 19:23:45.887522 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:46.626907 (+739385us) service_pool.cc:227] Handling call
0812 19:23:46.627183 (+   276us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:46.627364 (+   181us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:23:46.669078 (+ 41714us) log.cc:842] Serialized 14 byte log entry
0812 19:23:46.869555 (+200477us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b18001f3a20. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff57b 00007f98f778288a
0812 19:23:48.036747 (+1167192us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:48.036804 (+    57us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:48.036850 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:48.036916 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:48.037031 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":40238,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":460822,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":19138,"spinlock_wait_cycles":4888320,"thread_start_us":1166858,"threads_started":2,"wal-append.queue_time_us":817053}
I20260812 19:23:48.047572  6228 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260812 19:23:48.026734 12955 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.006s	sys 0.004s
W20260812 19:23:48.042940 12976 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.010s	sys 0.023s
I20260812 19:23:48.036881 13052 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:48.069300  6236 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
W20260812 19:23:48.071138 13026 log.cc:924] Time spent T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260812 19:23:48.055688 13058 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:48.073019 12977 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:48.052356 12804 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.075721 12869 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:48.071271 13032 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260812 19:23:48.048604 12856 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:23:48.110673  6235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2005) took 2228 ms (client timeout 2808 ms). Trace:
W20260812 19:23:48.111227  6235 rpcz_store.cc:269] 0812 19:23:45.881954 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:45.883035 (+  1081us) service_pool.cc:227] Handling call
0812 19:23:48.110464 (+2227429us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400163fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:48.110583 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2625988992}
W20260812 19:23:48.115353  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 337860us
I20260812 19:23:48.117327 13041 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:48.117585  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:48.118177 12666 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.117928 13041 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:48.118757 12923 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260812 19:23:48.119568  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 454637us
I20260812 19:23:48.126215  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:48.126391 12943 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:48.127107 12943 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:48.128517 12955 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:48.129441 12943 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:48.137007  6417 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:48.057216 12849 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.056639 12945 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:48.067226 12803 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:48.161185  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 43757.6us
I20260812 19:23:48.024648 12921 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:48.110849 13001 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260812 19:23:48.160559 12955 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:48.136793 12852 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:48.326864  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.008s	sys 0.030s
W20260812 19:23:48.327347  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.008s	sys 0.030s
W20260812 19:23:48.248809  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 52170.3us
I20260812 19:23:48.159336 12338 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:48.298041  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 279084us
I20260812 19:23:48.165548 12644 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:48.332906  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2029190300963819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260812 19:23:48.333341  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2002190300263464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
I20260812 19:23:48.195242 12849 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:48.334911  6178 connection.cc:232] RPC call timeout handler was delayed by -1.0148190301842988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
I20260812 19:23:48.338114  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:48.059226 12335 raft_consensus.cc:348] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a [term 9 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.342259  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 519) took 1264 ms. Trace:
W20260812 19:23:48.343777  6178 leader_election.cc:334] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.510s (SENT)
I20260812 19:23:48.345443  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:48.345423  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 495) took 1312 ms. Trace:
I20260812 19:23:48.347293  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:48.358616  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:48.217262 13006 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:48.298889 12955 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:48.342701  6350 rpcz_store.cc:276] 0812 19:23:47.078262 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:47.078418 (+   156us) service_pool.cc:227] Handling call
0812 19:23:47.095057 (+ 16639us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:47.095397 (+   340us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:47.095430 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:47.103314 (+  7884us) log.cc:842] Serialized 26 byte log entry
0812 19:23:47.224893 (+121579us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:47.239658 (+ 14765us) log.cc:842] Serialized 14 byte log entry
0812 19:23:47.308122 (+ 68464us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:47.308260 (+   138us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:48.342033 (+1033773us) raft_consensus.cc:1671] finished
0812 19:23:48.342057 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:48.342194 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":25147,"prepare.queue_time_us":22211,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":566651,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":36933,"thread_start_us":115201,"threads_started":2,"wal-append.queue_time_us":366368}
I20260812 19:23:48.351570  6482 rpcz_store.cc:276] 0812 19:23:47.032590 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:47.033109 (+   519us) service_pool.cc:227] Handling call
0812 19:23:47.076320 (+ 43211us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:47.184822 (+108502us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:47.184870 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:47.191934 (+  7064us) log.cc:842] Serialized 26 byte log entry
0812 19:23:47.534798 (+342864us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:47.534848 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:47.534931 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:48.345231 (+810300us) raft_consensus.cc:1671] finished
0812 19:23:48.345250 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:48.345370 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6014,"raft.queue_time_us":182800,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":12241,"thread_start_us":414862,"threads_started":2,"wal-append.queue_time_us":613310}
I20260812 19:23:48.374307  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:48.375559  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:48.108067 13052 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:48.297459 12987 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:48.064491 13038 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.369738  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:23:48.372131  6178 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.705s (SENT)
I20260812 19:23:48.341288  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:48.369052 12685 consensus_meta.cc:287] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.280s	user 0.011s	sys 0.004s
I20260812 19:23:48.384757  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:48.209728 12592 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:48.357926 12803 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:48.356694 12852 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:48.386078 12808 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:48.393987 13046 consensus_queue.cc:1046] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260812 19:23:48.400415 12918 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.418424 12852 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.420246 13075 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:48.420732 13075 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:48.420886 12852 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.421178 13075 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:23:48.394757  7552 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.018s	sys 0.046s
W20260812 19:23:48.421733  7552 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.018s	sys 0.046s
I20260812 19:23:48.394524  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:48.390077 12911 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:48.423359 12355 consensus_meta.cc:287] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.216s	user 0.010s	sys 0.003s
W20260812 19:23:48.423559 13014 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260812 19:23:48.395313 13034 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:48.424048 13034 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:48.423801 12355 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.424497 13034 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:48.426165  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 494) took 1394 ms. Trace:
I20260812 19:23:48.395650  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:48.396337 12984 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:48.397311  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:48.426553  6483 rpcz_store.cc:276] 0812 19:23:47.032167 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:47.032887 (+   720us) service_pool.cc:227] Handling call
0812 19:23:47.077481 (+ 44594us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:47.210242 (+132761us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:47.210376 (+   134us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:47.219213 (+  8837us) log.cc:842] Serialized 52 byte log entry
0812 19:23:47.352081 (+132868us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:47.352124 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:47.352202 (+    78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:48.425957 (+1073755us) raft_consensus.cc:1671] finished
0812 19:23:48.425977 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:48.426107 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6887,"raft.queue_time_us":172610,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":18661,"thread_start_us":215702,"threads_started":2,"wal-append.queue_time_us":794674}
I20260812 19:23:48.428021  6350 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
W20260812 19:23:48.428359 13056 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260812 19:23:48.429149  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:48.429836  6350 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:48.397401 12335 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:23:48.431416 13038 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.377494 12955 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:48.431206 12335 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:23:48.412390 13041 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:48.433459 12335 ts_tablet_manager.cc:1428] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 1.191s	user 0.012s	sys 0.000s
W20260812 19:23:48.433768 12335 ts_tablet_manager.cc:1460] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: Tablet startup took 1203ms
I20260812 19:23:48.436703 13006 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:48.437456 13006 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:48.438051 13006 consensus_queue.cc:1225] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:23:48.412201 12685 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:48.439431 13069 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:48.439929 13069 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:48.440268 13069 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:48.398600 13054 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
I20260812 19:23:48.379491 13059 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:48.441641 13059 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:48.442070  6464 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:48.442541 13059 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.444172  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 502) took 1352 ms. Trace:
I20260812 19:23:48.444522  6464 rpcz_store.cc:276] 0812 19:23:47.092531 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:47.092683 (+   152us) service_pool.cc:227] Handling call
0812 19:23:47.092938 (+   255us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:48.442467 (+1349529us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:48.443942 (+  1475us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003ef8d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:48.444116 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3102230784}
W20260812 19:23:48.403193  6178 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.846s (SENT)
W20260812 19:23:48.446301  6178 leader_election.cc:334] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.874s (SENT)
I20260812 19:23:48.446431 12921 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.386545 12274 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:48.376365 12945 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:48.372013 12575 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:48.415158  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:48.466336  6344 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 8
I20260812 19:23:48.346293 12849 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.441053 12685 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:48.447566  6178 leader_election.cc:334] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.940s (SENT)
I20260812 19:23:48.479583  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:48.403846  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:48.466452 13015 consensus_meta.cc:287] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.000s
I20260812 19:23:48.449366  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:48.485946  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:48.456624 13052 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:48.458076 13021 consensus_meta.cc:287] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.678s	user 0.008s	sys 0.004s
I20260812 19:23:48.458101  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:48.458796 12406 consensus_meta.cc:287] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.247s	user 0.013s	sys 0.000s
I20260812 19:23:48.459053 13035 raft_consensus.cc:3032] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:48.459712  7593 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:44858
W20260812 19:23:48.460110 12446 consensus_meta.cc:287] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.100s	user 0.013s	sys 0.000s
I20260812 19:23:48.402103 12987 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:48.462359 12953 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.489s	user 0.005s	sys 0.014s
W20260812 19:23:48.434054 12335 ts_tablet_manager.cc:1462] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: Trace:
0812 19:23:32.688966 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:32.841315 (+152349us) service_pool.cc:227] Handling call
0812 19:23:33.037840 (+196525us) ts_tablet_manager.cc:928] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
0812 19:23:33.405443 (+367603us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f483e5fe 00007f98fd669a39 00007f98f485b8bb 00007f98f485862a 00007f98f4858552 00007f98fc669691
0812 19:23:43.705283 (+10299840us) tablet_copy_client.cc:361] Tablet copy session begun
0812 19:23:44.079436 (+374153us) tablet_metadata.cc:641] Metadata flushed
0812 19:23:44.153649 (+ 74213us) tablet_copy_client.cc:490] Wrote new tablet metadata
0812 19:23:44.581168 (+427519us) tablet_copy_client.cc:411] Wrote new consensus metadata
0812 19:23:44.613934 (+ 32766us) tablet_replica.cc:205] Creating consensus instance
0812 19:23:44.625353 (+ 11419us) ts_tablet_manager.cc:983] Replica registered.
0812 19:23:44.625528 (+   175us) inbound_call.cc:173] Queueing success response
0812 19:23:44.824425 (+198897us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0812 19:23:47.249802 (+2425377us) ts_tablet_manager.cc:1429] Starting tablet replica
0812 19:23:47.469585 (+219783us) tablet_replica.cc:259] Starting instrumentation
0812 19:23:47.740572 (+270987us) tablet_replica.cc:278] Starting consensus
Metrics: {"dns_us":16853,"mutex_wait_us":18456,"raft.queue_time_us":4056,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":14976,"spinlock_wait_cycles":317527808,"tablet-copy.queue_time_us":168994,"tablet-download-pool.queue_time_us":271,"tablet-download-pool.run_cpu_time_us":1131,"tablet-download-pool.run_wall_time_us":76719,"thread_start_us":535976,"threads_started":2}
W20260812 19:23:48.465881 12972 consensus_meta.cc:287] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.091s	user 0.007s	sys 0.004s
I20260812 19:23:48.467919  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:48.481055  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 77323.2us
I20260812 19:23:48.656339  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:48.399956 12946 consensus_meta.cc:287] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.167s	user 0.013s	sys 0.000s
W20260812 19:23:48.450678 12554 consensus_meta.cc:287] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.184s	user 0.007s	sys 0.005s
W20260812 19:23:48.454548 12919 consensus_meta.cc:287] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.225s	user 0.003s	sys 0.006s
W20260812 19:23:48.469046 12982 consensus_meta.cc:287] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.773s	user 0.000s	sys 0.010s
I20260812 19:23:48.493506  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:48.466217 12355 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.483058 13082 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:48.499140  7600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 516) took 1209 ms. Trace:
I20260812 19:23:48.667025  7600 rpcz_store.cc:276] 0812 19:23:47.290278 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:47.299245 (+  8967us) service_pool.cc:227] Handling call
0812 19:23:47.337867 (+ 38622us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:47.923056 (+585189us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:48.498892 (+575836us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54005ce254. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:48.499078 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1321273600}
I20260812 19:23:48.506937 13010 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:48.503744  6350 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:23:48.492100 12620 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:48.653251  7593 raft_consensus.cc:595] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:48.659341 13076 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:48.499809 12685 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 19:23:48.670140 12909 consensus_meta.cc:287] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.060s	user 0.012s	sys 0.000s
I20260812 19:23:48.498005 13035 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:48.671551  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:48.660432 12581 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:48.675978  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:48.663272 12972 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:48.682392  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 188946us
W20260812 19:23:48.683533  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 235971us
I20260812 19:23:48.662302 12921 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:48.491827 13015 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.497071  6344 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
W20260812 19:23:48.719619  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 43772.1us
W20260812 19:23:48.720846  6178 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.946s (SENT)
I20260812 19:23:48.686483  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:48.680835  7593 raft_consensus.cc:603] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:48.504547 12406 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:48.653378 12908 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:48.509884 12446 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:48.507365 13021 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.720949  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1801) took 1092 ms. Trace:
I20260812 19:23:48.721288  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:48.723507  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1806) took 1093 ms. Trace:
I20260812 19:23:48.662729 12919 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.724334 12880 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:48.662549 12554 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.688751 13076 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.720626 12848 raft_consensus.cc:3032] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:48.723225  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:48.681463 13006 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:48.726388  6349 rpcz_store.cc:276] 0812 19:23:47.629900 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:48.694697 (+1064797us) service_pool.cc:227] Handling call
0812 19:23:48.723016 (+ 28319us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:48.723197 (+   181us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:48.723236 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:48.723280 (+    44us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:23:48.723309 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:48.723362 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:48.723455 (+    93us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:48.728114 12919 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.737888  6349 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260812 19:23:48.693663 12909 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:48.738965 13034 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.726241  6352 rpcz_store.cc:276] 0812 19:23:47.628221 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:48.051281 (+423060us) service_pool.cc:227] Handling call
0812 19:23:48.051631 (+   350us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:48.053971 (+  2340us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:48.053998 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:48.078086 (+ 24088us) log.cc:842] Serialized 26 byte log entry
0812 19:23:48.347482 (+269396us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:23:48.690358 (+342876us) log.cc:842] Serialized 14 byte log entry
0812 19:23:48.720656 (+ 30298us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:48.720733 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:48.720774 (+    41us) raft_consensus.cc:1671] finished
0812 19:23:48.720782 (+     8us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:48.720894 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":37370,"raft.queue_time_us":2029,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":8523,"thread_start_us":473907,"threads_started":2,"wal-append.queue_time_us":253991}
I20260812 19:23:48.728920  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:48.740875 12909 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:48.741050 13034 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.661764 12982 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.748744 12982 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:48.749028  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:48.751197 12406 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:48.751297 13082 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:48.751865 13082 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:48.752208 13082 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:48.752974 12849 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.753436  6473 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:48.662770 12946 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.755970  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2021) took 3759 ms. Trace:
I20260812 19:23:48.756273  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:48.757529  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:48.732226  6178 leader_election.cc:334] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.958s (SENT)
W20260812 19:23:48.778730  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 46523.4us
I20260812 19:23:48.778848  6350 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:48.759811  6352 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:23:48.763656  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:48.780857  6464 raft_consensus.cc:2354] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
I20260812 19:23:48.780963  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:48.767462  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.022s	sys 0.029s
I20260812 19:23:48.760665  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:48.781870  6352 raft_consensus.cc:2396] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260812 19:23:48.783212  6178 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.983s (SENT)
W20260812 19:23:48.782209  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.022s	sys 0.029s
I20260812 19:23:48.756364  6345 rpcz_store.cc:276] 0812 19:23:44.997061 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:45.885451 (+888390us) service_pool.cc:227] Handling call
0812 19:23:45.885739 (+   288us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:45.920873 (+ 35134us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:23:46.536433 (+615560us) log.cc:842] Serialized 14 byte log entry
0812 19:23:46.738256 (+201823us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:46.795864 (+ 57608us) log.cc:842] Serialized 26 byte log entry
0812 19:23:46.796054 (+   190us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:46.796100 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:46.796176 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:48.461704 (+1665528us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:48.755678 (+293974us) raft_consensus.cc:1671] finished
0812 19:23:48.755792 (+   114us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:48.755915 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":43231,"prepare.queue_time_us":489126,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":34955,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":83528,"spinlock_wait_cycles":10015488,"thread_start_us":729310,"threads_started":2,"wal-append.queue_time_us":335173}
W20260812 19:23:48.783933  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 596754us
I20260812 19:23:48.783681  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:48.786389  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:48.787746  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:48.788728  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:48.789289  6349 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:48.792815  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:48.793354  6241 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260812 19:23:48.793571  6238 raft_consensus.cc:2354] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
I20260812 19:23:48.794510  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:48.796279  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:48.797725  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:48.785794 12909 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:48.799664  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:48.799815 12909 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.800366  6238 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:48.800683  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:48.801251  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:48.801930 12909 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:48.802040  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:48.802590 12979 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.483s	user 0.010s	sys 0.004s
W20260812 19:23:48.802856 13100 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260812 19:23:48.804034  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 444) took 1767 ms. Trace:
I20260812 19:23:48.804688 12803 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:48.804574  6224 rpcz_store.cc:276] 0812 19:23:47.036408 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:47.036565 (+   157us) service_pool.cc:227] Handling call
0812 19:23:47.036869 (+   304us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:47.037286 (+   417us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:23:47.037324 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:47.037745 (+   421us) log.cc:842] Serialized 26 byte log entry
0812 19:23:47.109990 (+ 72245us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:47.110027 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:47.110099 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:48.801870 (+1691771us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:48.803711 (+  1841us) raft_consensus.cc:1671] finished
0812 19:23:48.803734 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:48.803955 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1142,"raft.queue_time_us":70978,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":14219,"spinlock_wait_cycles":4036992,"thread_start_us":71850,"threads_started":1,"wal-append.queue_time_us":206159}
I20260812 19:23:48.807210  6473 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 11: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:48.756304 12946 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:48.808135  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:48.786026 12919 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:48.810830  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:48.802882  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:48.804104  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 520) took 1181 ms. Trace:
I20260812 19:23:48.801383  6353 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260812 19:23:48.811728  6483 raft_consensus.cc:2354] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
I20260812 19:23:48.810971  6481 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260812 19:23:48.812779  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:48.813409  6178 leader_election.cc:334] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.134s (SENT)
I20260812 19:23:48.814551  6178 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:48.814975  6470 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:48.814600  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:48.816452  6481 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:48.817412  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 450) took 1726 ms. Trace:
I20260812 19:23:48.817781  6352 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:48.817844  6228 rpcz_store.cc:276] 0812 19:23:47.090937 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:47.091133 (+   196us) service_pool.cc:227] Handling call
0812 19:23:47.106348 (+ 15215us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:48.050886 (+944538us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:48.817136 (+766250us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b540027c9d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:48.817342 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2164052736}
I20260812 19:23:48.813422  6465 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:48.809608  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1802) took 1181 ms. Trace:
I20260812 19:23:48.822489  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:48.811966  6359 rpcz_store.cc:276] 0812 19:23:47.622266 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:47.623287 (+  1021us) service_pool.cc:227] Handling call
0812 19:23:47.623623 (+   336us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:47.786140 (+162517us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:47.786214 (+    74us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:47.787179 (+   965us) log.cc:842] Serialized 26 byte log entry
0812 19:23:48.077321 (+290142us) spinlock_profiling.cc:243] Waited 8.13 ms on lock 0x7b1800332b00. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:23:48.483515 (+406194us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:48.483571 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:48.483669 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:48.802234 (+318565us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:48.803906 (+  1672us) raft_consensus.cc:1671] finished
0812 19:23:48.803925 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:48.804046 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26211,"raft.queue_time_us":234321,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":3589,"spinlock_wait_cycles":81606784,"thread_start_us":560659,"threads_started":2,"wal-append.queue_time_us":861433}
I20260812 19:23:48.824023  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:48.785015 12856 consensus_meta.cc:287] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.647s	user 0.005s	sys 0.005s
I20260812 19:23:48.855679  6481 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:48.825570  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:48.731305 12848 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:48.819592  6342 rpcz_store.cc:276] 0812 19:23:47.628524 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:48.122145 (+493621us) service_pool.cc:227] Handling call
0812 19:23:48.199894 (+ 77749us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:48.200241 (+   347us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:48.200260 (+    19us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:48.200583 (+   323us) log.cc:842] Serialized 26 byte log entry
0812 19:23:48.625323 (+424740us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:48.625403 (+    80us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:48.625515 (+   112us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:48.809401 (+183886us) raft_consensus.cc:1671] finished
0812 19:23:48.809419 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:48.809553 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2960,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":125385,"thread_start_us":152781,"threads_started":1,"wal-append.queue_time_us":504162}
I20260812 19:23:48.819365 12982 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:48.925135  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:48.925964  6241 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:48.827366  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:48.828125 13006 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:48.777750 12908 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:48.733431 12923 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:48.731698 12880 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:23:48.730773 12554 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.783258 12852 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:48.945055  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:48.945510  6242 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260812 19:23:48.829061 12991 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:48.829432  6178 leader_election.cc:334] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.146s (SENT)
I20260812 19:23:48.831615 12620 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:48.835217 13046 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:48.835927 12446 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:48.837189  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:48.963934  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:48.964802  6482 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 9: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:48.965581  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:48.837203 12972 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.838447 13021 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.736308 13069 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.968729 13069 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.717862 12581 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:48.820838 13035 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.969751  6224 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:48.970374 13035 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:48.733443 12955 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:48.842617 13076 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:48.729206 13015 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.782840 12849 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260812 19:23:48.827271  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:48.732247 12987 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:48.809088 12919 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:23:48.850868  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 54249.1us
I20260812 19:23:48.835266  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:48.989223  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:48.990152  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 154981us
I20260812 19:23:48.991081  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:48.993062  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:48.862473  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:48.824679  6232 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:48.911777  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:48.913385  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:48.914330  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:48.916921  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 90323.2us
I20260812 19:23:48.919231 13045 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:23:48.931891  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:49.012558  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:49.013379  6349 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:49.012475  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:48.932845  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:49.015846  6483 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:48.933734  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:49.016403  6241 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:48.923507  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:49.017386  6481 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:48.947947  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:48.952490 12991 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.910238 12856 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.953503 12923 raft_consensus.cc:686] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:48.941025 12982 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:48.956990 12908 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:48.966645  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:49.035733  6297 leader_election.cc:398] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
I20260812 19:23:48.948791  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:48.980955  6342 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:48.942636 12973 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:48.994799  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:48.997603  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:49.011680  6345 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:48.936288  6474 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:49.017446  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:49.019352  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 198086us
I20260812 19:23:49.019245  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:49.020236  6470 raft_consensus.cc:2379] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:49.025926  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:49.028090  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:49.036470  6297 leader_election.cc:401] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260812 19:23:49.120167  6178 leader_election.cc:334] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.177s (SENT)
I20260812 19:23:48.940817 13006 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.052886  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:49.120908  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:49.119655  6349 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:49.126199  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:49.120461  6241 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
W20260812 19:23:49.121812  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 123061us
I20260812 19:23:49.128047  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:49.129500  6349 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:49.129606  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:49.130265  6470 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:49.130517  6359 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:49.133111  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:49.027252 12620 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:49.011332 12919 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:49.148437  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:49.148665  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:49.148833  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:49.149112  6474 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:49.130402  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:49.129683  6481 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:49.152786  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:49.019551 13015 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:23:49.035914 13021 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:49.161931  6473 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:49.149333  6482 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:49.163762  6482 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:23:49.029583 12987 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:49.248325 12982 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:49.250447 12856 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:49.144940 13046 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
W20260812 19:23:49.260012 13082 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.507s	user 0.005s	sys 0.005s
I20260812 19:23:49.155201  7603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 522) took 2495 ms. Trace:
I20260812 19:23:49.260808  7603 rpcz_store.cc:276] 0812 19:23:46.660003 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:46.663104 (+  3101us) service_pool.cc:227] Handling call
0812 19:23:46.671930 (+  8826us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:47.922631 (+1250701us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:49.154968 (+1232337us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002e86d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:49.155142 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2840906624}
I20260812 19:23:49.262166 12803 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260812 19:23:49.151294 13075 consensus_meta.cc:287] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.723s	user 0.010s	sys 0.003s
I20260812 19:23:49.156930  6349 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:23:49.161247 13103 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260812 19:23:49.143139  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 117894us
I20260812 19:23:49.168475  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:49.324404  6241 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:49.159133 13015 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:49.123286 12908 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:23:49.260140  6473 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:49.139868 12592 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:49.271341  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:49.272256  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:49.337221 13006 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:49.337932 12581 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:49.280018  6359 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:23:49.292075  6228 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:49.343035  6359 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260812 19:23:49.345394  6359 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260812 19:23:49.355651  6297 leader_election.cc:398] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
I20260812 19:23:49.356227  6297 leader_election.cc:401] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260812 19:23:49.370987 12923 consensus_queue.cc:237] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.375494 12849 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:49.376274 12991 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:49.376325 12849 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:49.377002  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:49.377816  6241 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:49.321321 13075 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.379251 12849 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:49.379832 12849 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:49.381141 13075 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:49.381560 12919 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.381910 13075 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:49.382844  6352 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:49.164289  6470 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:49.016881 12848 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.135618 12303 consensus_queue.cc:1046] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.189s
I20260812 19:23:49.328934 13015 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:49.319234 13021 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:49.138315 12973 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.318007 12620 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260812 19:23:49.319582 12987 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:49.156698  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:49.340803  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:49.162236  7594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 518) took 1022 ms. Trace:
I20260812 19:23:49.383704  6238 raft_consensus.cc:2396] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260812 19:23:49.019654 12446 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:23:49.122090  6232 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:49.260808 13082 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.401629  6477 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:49.402951  7594 rpcz_store.cc:276] 0812 19:23:48.133841 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:48.142908 (+  9067us) service_pool.cc:227] Handling call
0812 19:23:48.299687 (+156779us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:48.345153 (+ 45466us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:23:48.673655 (+328502us) log.cc:842] Serialized 14 byte log entry
0812 19:23:49.034606 (+360951us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:49.044063 (+  9457us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:23:49.122818 (+ 78755us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:49.140392 (+ 17574us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:49.156209 (+ 15817us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":51980,"prepare.queue_time_us":77104,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":34,"raft.queue_time_us":43894,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":101134,"thread_start_us":539506,"threads_started":2}
I20260812 19:23:49.405162 12987 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.397194 13035 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:49.422434 13035 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:49.417081 12959 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:23:49.424881 12959 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:49.424995 13035 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:49.426280  6477 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:49.305452  6474 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:49.419660 12973 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:49.420455 13021 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.407827  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:49.401602 12955 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:49.430128  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:49.430756 12973 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:49.426163  6241 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:23:49.431088  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:49.442207  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:49.443225  6465 raft_consensus.cc:2354] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8.
W20260812 19:23:49.436004 13070 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.989s	user 0.015s	sys 0.044s
W20260812 19:23:49.437171  6347 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1805) took 1807 ms (client timeout 1963 ms). Trace:
I20260812 19:23:49.417028 12848 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:49.448848  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:49.434825 13035 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:49.445911  6347 rpcz_store.cc:269] 0812 19:23:47.629504 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:47.736258 (+106754us) service_pool.cc:227] Handling call
0812 19:23:49.436997 (+1700739us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540036db54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:49.437111 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":340659456}
I20260812 19:23:49.452993  6347 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:49.439615  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:49.445528 12973 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:49.458597  6347 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:49.458719  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:49.460752  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:49.452473 12620 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:49.462531  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:49.465909  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:49.460655 12973 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:49.447306 12446 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260812 19:23:49.463706 13075 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:49.464927 13034 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:49.465754 13082 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:49.466938 12856 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:49.439563 12959 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:49.455206 13035 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:49.474403 13044 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.428s	user 0.012s	sys 0.016s
I20260812 19:23:49.465672 12620 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:49.483482 12995 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.013s	sys 0.045s
I20260812 19:23:49.472535 12849 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
W20260812 19:23:49.495410  6236 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.004s	sys 0.058s
I20260812 19:23:49.491676  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:49.488467 13075 raft_consensus.cc:686] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:49.516758  6232 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 9: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:49.517836  6241 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:49.484210 12919 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:49.517174  6236 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.004s	sys 0.058s
I20260812 19:23:49.491499 13034 raft_consensus.cc:686] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:49.525631  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:49.512996 13083 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.095s	user 0.017s	sys 0.018s
I20260812 19:23:49.498428 12856 raft_consensus.cc:686] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:23:49.515470 12995 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.014s	sys 0.045s
W20260812 19:23:49.528661  6464 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.017s	sys 0.043s
I20260812 19:23:49.515311 12959 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
W20260812 19:23:49.532373  6464 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.017s	sys 0.043s
I20260812 19:23:49.533107  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:49.528478  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 492665us
I20260812 19:23:49.534571  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:49.542420  6297 leader_election.cc:398] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
I20260812 19:23:49.533910  6238 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:49.545189  6241 raft_consensus.cc:2396] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260812 19:23:49.545117  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:49.546162  6238 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:49.547170  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:49.547991  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:49.550011  6238 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:49.559268  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:49.566640  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:49.567049  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:49.567891  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:49.572197  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:49.576831  6232 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:23:49.578202  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:49.579090  6232 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:49.574196  6238 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:49.580634  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 498) took 2537 ms. Trace:
I20260812 19:23:49.584084  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:49.585079  6238 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:49.566464 12274 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:49.588797 12274 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:49.589221 12274 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:49.587776  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:49.582916  6500 tablet_copy_service.cc:342] P bdfa5579d4534c618c00db6b4a841c81: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-529ed979cd2842acb5bc24debb151b93 received from {username='slave'} at 127.0.0.1:33386
I20260812 19:23:49.592564  6500 tablet_copy_service.cc:433] P bdfa5579d4534c618c00db6b4a841c81: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-529ed979cd2842acb5bc24debb151b93 on tablet 529ed979cd2842acb5bc24debb151b93 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:49.593873 13035 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:49.596021  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:49.596801  6242 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:49.562328 12446 consensus_queue.cc:1046] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260812 19:23:49.566252 12849 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:49.569579 13033 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:49.583431  6475 rpcz_store.cc:276] 0812 19:23:47.043080 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:47.068419 (+ 25339us) service_pool.cc:227] Handling call
0812 19:23:47.068815 (+   396us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:47.474673 (+405858us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:47.474711 (+    38us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:47.533947 (+ 59236us) log.cc:842] Serialized 52 byte log entry
0812 19:23:47.656982 (+123035us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:47.811625 (+154643us) log.cc:842] Serialized 14 byte log entry
0812 19:23:47.929287 (+117662us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:47.929385 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:49.448276 (+1518891us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:49.569964 (+121688us) raft_consensus.cc:1671] finished
0812 19:23:49.580408 (+ 10444us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:49.580572 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":43029,"prepare.queue_time_us":324493,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":4605,"raft.queue_time_us":256886,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":8036,"spinlock_wait_cycles":6922496,"thread_start_us":617168,"threads_started":4,"wal-append.queue_time_us":460345}
I20260812 19:23:49.599359 12620 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:49.603051  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:49.598835 12856 consensus_queue.cc:237] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.580384 12972 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:49.588014  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:49.608181  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:49.610416  6232 raft_consensus.cc:2396] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260812 19:23:49.566591 12906 consensus_queue.cc:1046] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260812 19:23:49.583822 13075 consensus_queue.cc:237] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.787374  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:49.661862  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:49.587496 12919 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:49.784631  6242 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:49.764943  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 526) took 1608 ms. Trace:
I20260812 19:23:49.615564  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:49.766381  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:49.857626  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:49.858336  6232 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:49.606222 12446 consensus_queue.cc:1225] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer f4ef77b3328a44e8a21dd902b370e25a log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260812 19:23:49.860227 12446 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:49.856618 12919 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.857347 12976 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:49.846607  6238 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:49.861338 12976 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.604187 13034 consensus_queue.cc:237] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.864050 12976 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:49.864403  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2028) took 1102 ms. Trace:
I20260812 19:23:49.606462 12849 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:49.865937  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:49.868791  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:49.869622  6242 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:49.868724  6238 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:49.865813  6344 rpcz_store.cc:276] 0812 19:23:48.156042 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:48.724864 (+568822us) service_pool.cc:227] Handling call
0812 19:23:48.792922 (+ 68058us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:48.948003 (+155081us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:48.948035 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:48.948077 (+    42us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:23:48.948108 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:49.764640 (+816532us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400061154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:49.764697 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:49.764866 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":356157696}
I20260812 19:23:49.866633  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 524) took 2238 ms. Trace:
I20260812 19:23:49.864845  6236 rpcz_store.cc:276] 0812 19:23:48.761472 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:48.761600 (+   128us) service_pool.cc:227] Handling call
0812 19:23:48.801849 (+ 40249us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:48.813166 (+ 11317us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:48.813195 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:48.813599 (+   404us) log.cc:842] Serialized 26 byte log entry
0812 19:23:49.524016 (+710417us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:49.524058 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:49.524133 (+    75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:49.864188 (+340055us) raft_consensus.cc:1671] finished
0812 19:23:49.864207 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:49.864347 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10878,"raft.queue_time_us":17064,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":7870,"thread_start_us":710111,"threads_started":1,"wal-append.queue_time_us":854341}
I20260812 19:23:49.604897 12435 consensus_queue.cc:1046] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.282s
I20260812 19:23:49.877172  6354 rpcz_store.cc:276] 0812 19:23:47.627819 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:47.797571 (+169752us) service_pool.cc:227] Handling call
0812 19:23:47.828609 (+ 31038us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:47.828997 (+   388us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:47.829025 (+    28us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:47.844087 (+ 15062us) log.cc:842] Serialized 52 byte log entry
0812 19:23:49.848867 (+2004780us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b18003a0060. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411
0812 19:23:49.849175 (+   308us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:23:49.849229 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:49.849323 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:49.849386 (+    63us) raft_consensus.cc:1671] finished
0812 19:23:49.849402 (+    16us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:49.866550 (+ 17148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":30730,"raft.queue_time_us":67070,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":16901,"spinlock_wait_cycles":59823488,"thread_start_us":51881,"threads_started":1,"wal-append.queue_time_us":331671,"wal-append.run_cpu_time_us":2103,"wal-append.run_wall_time_us":1194274}
I20260812 19:23:49.885073 12851 raft_consensus.cc:3032] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:49.885488 12851 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:49.886029  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2049) took 1094 ms. Trace:
I20260812 19:23:49.886411  6354 rpcz_store.cc:276] 0812 19:23:48.791433 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.884980 (+1093547us) service_pool.cc:227] Handling call
0812 19:23:49.885336 (+   356us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:49.885633 (+   297us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:49.885663 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:49.885756 (+    93us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:49.885789 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:49.885847 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:49.885976 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:49.665697 13077 log.cc:924] Time spent T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.267s	user 0.014s	sys 0.036s
I20260812 19:23:49.891008  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:49.609972 13033 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:49.896822 13040 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.497s	user 0.014s	sys 0.035s
I20260812 19:23:49.897599 13033 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:49.666268  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:49.903288  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 447) took 2829 ms. Trace:
I20260812 19:23:49.903836  6229 rpcz_store.cc:276] 0812 19:23:47.073612 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:47.073780 (+   168us) service_pool.cc:227] Handling call
0812 19:23:47.074121 (+   341us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:47.398514 (+324393us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:23:47.473415 (+ 74901us) log.cc:842] Serialized 14 byte log entry
0812 19:23:47.740455 (+267040us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:47.789760 (+ 49305us) log.cc:842] Serialized 26 byte log entry
0812 19:23:47.789930 (+   170us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:47.789976 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:47.790066 (+    90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:48.434250 (+644184us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b48001110d8. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fc61f7f1 00007f98fc6168e7 00007f98fc61677a 00007f98fc70a95f 00007f98fc70a627 00007f98fc71eb2c 00007f98fc71ead8 00007f98fc71ea58 00007f98fc71ea13 00007f98fc71dcbc 00007f98fb69fbe6
0812 19:23:49.896235 (+1461985us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:49.903010 (+  6775us) raft_consensus.cc:1671] finished
0812 19:23:49.903034 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:49.903210 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5943,"prepare.queue_time_us":74282,"prepare.run_cpu_time_us":14549,"prepare.run_wall_time_us":80817,"raft.queue_time_us":183813,"raft.run_cpu_time_us":13929,"raft.run_wall_time_us":1278954,"spinlock_wait_cycles":48753792,"thread_start_us":484087,"threads_started":2,"wal-append.queue_time_us":873601}
I20260812 19:23:49.906708  6352 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:49.907846  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:49.907902  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:49.908762  6236 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:49.800122 13069 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:49.661921 13041 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:49.910497  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:49.665961 12972 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:23:49.912231  6349 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.012s	sys 0.016s
I20260812 19:23:49.922631  6345 raft_consensus.cc:595] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:49.855805 13015 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.935088  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:49.935930  6229 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 10
I20260812 19:23:49.908605  6238 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:49.926358 12973 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:49.932947  6347 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:49.886335 12851 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:49.934170  6349 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.012s	sys 0.016s
W20260812 19:23:49.933326  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.019s	sys 0.035s
I20260812 19:23:49.961432  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:23:49.942420 13021 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.011s	sys 0.026s
W20260812 19:23:49.945166  6483 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.015s	sys 0.015s
I20260812 19:23:49.954097  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:23:49.985817  6483 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.015s	sys 0.015s
I20260812 19:23:49.956630  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:49.956084  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.019s	sys 0.035s
I20260812 19:23:49.950541  6236 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:49.970783  6232 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:23:49.990610  6352 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:23:49.990948  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:49.994773  6232 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:49.997548  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2057) took 1171 ms. Trace:
I20260812 19:23:50.000664  6232 rpcz_store.cc:276] 0812 19:23:48.826477 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.990553 (+1164076us) service_pool.cc:227] Handling call
0812 19:23:49.997473 (+  6920us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:49.987438  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2053) took 1202 ms. Trace:
I20260812 19:23:50.012557  6238 rpcz_store.cc:276] 0812 19:23:48.785311 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.956255 (+1170944us) service_pool.cc:227] Handling call
0812 19:23:49.987363 (+ 31108us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:50.014127  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:50.014974  6238 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:50.030390  6238 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:50.033658  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:50.010897  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:49.980919  6242 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:50.047199  6238 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:50.048349  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:49.935470  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:50.052147  6229 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
W20260812 19:23:49.984625 13021 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.011s	sys 0.027s
I20260812 19:23:49.965893 13082 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260812 19:23:50.061244  6235 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.000s	sys 0.067s
W20260812 19:23:50.062561  6235 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.000s	sys 0.068s
I20260812 19:23:50.055893  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2054) took 1266 ms. Trace:
I20260812 19:23:50.063498  6238 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:50.058713  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:50.056288  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:50.063908  6236 rpcz_store.cc:276] 0812 19:23:48.789725 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.004547 (+1214822us) service_pool.cc:227] Handling call
0812 19:23:50.055829 (+ 51282us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:23:50.066020  6465 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.025s	sys 0.018s
W20260812 19:23:50.067552  6465 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.025s	sys 0.018s
I20260812 19:23:50.072309  6238 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260812 19:23:50.075286  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2064) took 1133 ms. Trace:
I20260812 19:23:50.004134 12919 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:49.929626 13069 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:50.076284  6238 rpcz_store.cc:276] 0812 19:23:48.942073 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.071548 (+1129475us) service_pool.cc:227] Handling call
0812 19:23:50.072012 (+   464us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:50.074425 (+  2413us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.075212 (+   787us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:50.052772 12851 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:50.084206  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:50.087355  7600 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:50.085158  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:50.089913  6242 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:23:50.099210  6230 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.000s	sys 0.015s
W20260812 19:23:50.099952  6230 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.000s	sys 0.015s
W20260812 19:23:50.003327  6178 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.015s	sys 0.028s
W20260812 19:23:50.102917  6178 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.016s	sys 0.028s
W20260812 19:23:50.103359  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 974507us
W20260812 19:23:50.113256  6178 leader_election.cc:334] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.209s (SENT)
I20260812 19:23:50.114007  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:50.133867  6236 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260812 19:23:50.134826  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2060) took 1217 ms. Trace:
I20260812 19:23:50.135227  6236 rpcz_store.cc:276] 0812 19:23:48.917046 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.064643 (+1147597us) service_pool.cc:227] Handling call
0812 19:23:50.133474 (+ 68831us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:50.134453 (+   979us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.134756 (+   303us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:49.986413 12274 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:50.146453  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1810) took 1804 ms. Trace:
I20260812 19:23:50.146606  6359 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:50.160225  6350 rpcz_store.cc:276] 0812 19:23:48.342467 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:48.680258 (+337791us) service_pool.cc:227] Handling call
0812 19:23:50.146100 (+1465842us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b54003b15d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:50.146365 (+   265us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":109256064}
W20260812 19:23:50.101151 12923 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.000s	sys 0.035s
I20260812 19:23:50.181797  6242 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:50.183368  6232 raft_consensus.cc:1203] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 7.4->[8.5-12.7]   Dedup: 8.5->[10.6-12.7]
I20260812 19:23:50.190922  6232 pending_rounds.cc:76] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 5
I20260812 19:23:50.191200  6232 pending_rounds.cc:97] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260812 19:23:50.191459  6232 raft_consensus.cc:2866] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:23:50.085853 13007 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.282s	user 0.021s	sys 0.068s
I20260812 19:23:50.193750  6236 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10. Ops: []
W20260812 19:23:50.194104 12923 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.000s	sys 0.036s
I20260812 19:23:50.196215  6482 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260812 19:23:50.196336 12973 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:50.197991  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2057) took 1173 ms. Trace:
I20260812 19:23:50.198330  6482 rpcz_store.cc:276] 0812 19:23:49.024828 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.201296 (+176468us) service_pool.cc:227] Handling call
0812 19:23:49.201850 (+   554us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:50.196607 (+994757us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.197733 (+  1126us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b540003c5d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:50.197930 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2286179200}
I20260812 19:23:50.200630  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:23:50.194391 13111 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.679s	user 0.006s	sys 0.000s
W20260812 19:23:50.194555  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 81338.9us
I20260812 19:23:50.201826  7593 raft_consensus.cc:2379] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 12: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
W20260812 19:23:50.202019  6178 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.270s (SENT)
W20260812 19:23:50.203079  6178 leader_election.cc:334] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.406s (SENT)
W20260812 19:23:50.203358 13087 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.804s	user 0.024s	sys 0.009s
W20260812 19:23:50.204241  6178 leader_election.cc:334] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.972s (SENT)
I20260812 19:23:50.204686  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:50.206096  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:50.206462 13074 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 1.755s	user 0.015s	sys 0.020s
I20260812 19:23:50.153352  6298 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:50.207077  6236 raft_consensus.cc:2396] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260812 19:23:50.207818  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 54574.2us
I20260812 19:23:50.215546  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2033) took 1426 ms. Trace:
I20260812 19:23:50.216130  6224 rpcz_store.cc:276] 0812 19:23:48.764210 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:48.806594 (+ 42384us) service_pool.cc:227] Handling call
0812 19:23:50.190820 (+1384226us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400005354. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:50.190957 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":369902976}
I20260812 19:23:50.215051 12973 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:50.152566 12959 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260812 19:23:50.208233 13007 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.418s	user 0.021s	sys 0.069s
I20260812 19:23:50.229808  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:50.231789  6350 raft_consensus.cc:2396] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260812 19:23:50.190012 13033 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260812 19:23:50.219508 12894 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:50.079056 12972 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:50.246902  7600 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
W20260812 19:23:50.250494  6178 leader_election.cc:334] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 3.032s (SENT)
I20260812 19:23:50.251217  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:50.229168 12849 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:50.244415 13118 log.cc:924] Time spent T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260812 19:23:50.240993  6482 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:50.215332 12446 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:50.265380  6482 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
W20260812 19:23:50.257863 12848 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.807s	user 0.014s	sys 0.000s
W20260812 19:23:50.269977  6178 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 3.115s (SENT)
W20260812 19:23:50.272423  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 416195us
I20260812 19:23:50.274322  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:50.269479 12976 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:50.267970 13015 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:50.273413 13048 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.005s	sys 0.039s
W20260812 19:23:50.299487 13048 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.005s	sys 0.040s
I20260812 19:23:50.279460 12919 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:50.305341  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:50.270103 12446 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:50.310108  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:50.314065  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:50.316553  6470 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.001s	sys 0.026s
W20260812 19:23:50.317728  6470 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.001s	sys 0.027s
I20260812 19:23:50.319502  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:50.329787  6477 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.018s	sys 0.012s
I20260812 19:23:50.330217  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:50.331944  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:50.330271  6477 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.018s	sys 0.012s
I20260812 19:23:50.305958 13069 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:50.316301 12995 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.016s	sys 0.011s
I20260812 19:23:50.316107 12976 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:50.315709 12274 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:50.316500 12575 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.017s	sys 0.010s
I20260812 19:23:50.332574 13007 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election won for term 10
W20260812 19:23:50.353888  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 738375us
W20260812 19:23:50.345023 13051 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 1.896s	user 0.031s	sys 0.030s
I20260812 19:23:50.333635 12894 raft_consensus.cc:2741] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260812 19:23:50.344624 13131 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.135s	user 0.001s	sys 0.001s
I20260812 19:23:50.335610 13149 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:50.365417  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:50.308109 12919 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:50.348199 13127 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260812 19:23:50.344319 12959 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260812 19:23:50.357036 13129 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.123s	user 0.001s	sys 0.001s
W20260812 19:23:50.348527 12995 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.017s	sys 0.011s
W20260812 19:23:50.358139 12575 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.018s	sys 0.010s
W20260812 19:23:50.372081 12856 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.012s	sys 0.033s
W20260812 19:23:50.383548 13101 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 1.653s	user 0.007s	sys 0.019s
W20260812 19:23:50.384363 13133 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260812 19:23:50.376358 13059 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.931s	user 0.016s	sys 0.040s
I20260812 19:23:50.384030 12943 raft_consensus.cc:3032] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:50.349546 12976 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:50.406236 13033 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260812 19:23:50.438071 13059 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.992s	user 0.016s	sys 0.040s
W20260812 19:23:50.402926 13135 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260812 19:23:50.406014 13132 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260812 19:23:50.446740 12976 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
W20260812 19:23:50.413112 12856 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.012s	sys 0.033s
I20260812 19:23:50.387225  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1786) took 1575 ms. Trace:
I20260812 19:23:50.451146  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 523) took 2824 ms. Trace:
I20260812 19:23:50.548583  6353 rpcz_store.cc:276] 0812 19:23:47.626543 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:47.626699 (+   156us) service_pool.cc:227] Handling call
0812 19:23:47.658289 (+ 31590us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:48.820538 (+1162249us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.450810 (+1630272us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001cd4d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:50.451080 (+   270us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2610934016}
W20260812 19:23:50.453334  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45031.5us
I20260812 19:23:50.398952  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:50.444638 13067 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 2.053s	user 0.015s	sys 0.040s
I20260812 19:23:50.410813 13149 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:50.459897  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2034) took 1689 ms. Trace:
W20260812 19:23:50.561918 13160 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260812 19:23:50.562177  6349 rpcz_store.cc:276] 0812 19:23:48.770831 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.313738 (+542907us) service_pool.cc:227] Handling call
0812 19:23:49.314122 (+   384us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:49.344664 (+ 30542us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:49.344719 (+    55us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:49.345258 (+   539us) log.cc:842] Serialized 26 byte log entry
0812 19:23:49.955603 (+610345us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:49.955660 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:49.955774 (+   114us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:50.459572 (+503798us) raft_consensus.cc:1671] finished
0812 19:23:50.459602 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:50.459807 (+   205us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":30006,"raft.queue_time_us":30931,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":14287,"thread_start_us":552411,"threads_started":1,"wal-append.queue_time_us":783912}
I20260812 19:23:50.413800 13007 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:23:50.564142 13166 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260812 19:23:50.565155 13134 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260812 19:23:50.564936 13007 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:50.566624  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 451) took 2443 ms. Trace:
W20260812 19:23:50.567337 13144 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260812 19:23:50.561990 13149 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:50.568936 13163 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260812 19:23:50.570168  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2065) took 1033 ms. Trace:
I20260812 19:23:50.570567  6470 rpcz_store.cc:276] 0812 19:23:49.537214 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.537407 (+   193us) service_pool.cc:227] Handling call
0812 19:23:49.537838 (+   431us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:49.555244 (+ 17406us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:49.555278 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:49.565725 (+ 10447us) log.cc:842] Serialized 26 byte log entry
0812 19:23:50.318249 (+752524us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:50.318306 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.318400 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:50.569925 (+251525us) raft_consensus.cc:1671] finished
0812 19:23:50.569946 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:50.570098 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":589,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":6829,"thread_start_us":710921,"threads_started":1,"wal-append.queue_time_us":785655}
I20260812 19:23:50.437824 12943 raft_consensus.cc:729] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:23:50.413960  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 82115.8us
I20260812 19:23:50.572757  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2061) took 1107 ms. Trace:
W20260812 19:23:50.449573 12974 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.031s	user 0.018s	sys 0.042s
I20260812 19:23:50.573166  6465 rpcz_store.cc:276] 0812 19:23:49.465128 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.465271 (+   143us) service_pool.cc:227] Handling call
0812 19:23:49.465623 (+   352us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:49.465994 (+   371us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:49.466038 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:49.466610 (+   572us) log.cc:842] Serialized 26 byte log entry
0812 19:23:50.068032 (+601422us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:50.068085 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.068192 (+   107us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:50.572528 (+504336us) raft_consensus.cc:1671] finished
0812 19:23:50.572548 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:50.572688 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":863,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":5599,"thread_start_us":580670,"threads_started":1,"wal-append.queue_time_us":832814}
I20260812 19:23:50.584146 12856 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:50.611645 12856 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:50.612216 12856 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:50.631587 12446 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:50.636407 13122 consensus_queue.cc:1046] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:23:50.636606 12943 consensus_queue.cc:260] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:50.638053 12943 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:50.638417  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2049) took 1174 ms. Trace:
I20260812 19:23:50.638952  6224 rpcz_store.cc:276] 0812 19:23:49.464371 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.217132 (+752761us) service_pool.cc:227] Handling call
0812 19:23:50.217494 (+   362us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:50.217891 (+   397us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:50.217937 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:50.218489 (+   552us) log.cc:842] Serialized 26 byte log entry
0812 19:23:50.393487 (+174998us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:50.393549 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.393659 (+   110us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:50.638110 (+244451us) raft_consensus.cc:1671] finished
0812 19:23:50.638141 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:50.638340 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":139,"thread_start_us":160360,"threads_started":1,"wal-append.queue_time_us":412642}
I20260812 19:23:50.641999  6224 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260812 19:23:50.646428  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 458) took 1059 ms. Trace:
I20260812 19:23:50.647099  6224 rpcz_store.cc:276] 0812 19:23:49.587195 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.641177 (+1053982us) service_pool.cc:227] Handling call
0812 19:23:50.641599 (+   422us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:50.642452 (+   853us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.646349 (+  3897us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:50.595602  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:50.655817  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 60454.4us
I20260812 19:23:50.550477 13151 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:50.567183  6235 rpcz_store.cc:276] 0812 19:23:48.123465 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:48.123693 (+   228us) service_pool.cc:227] Handling call
0812 19:23:48.188871 (+ 65178us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:48.189304 (+   433us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:48.189342 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:48.189907 (+   565us) log.cc:842] Serialized 26 byte log entry
0812 19:23:49.494814 (+1304907us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b18002c15e0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:23:50.064224 (+569410us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:23:50.064280 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.064374 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:50.566304 (+501930us) raft_consensus.cc:1671] finished
0812 19:23:50.566331 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:50.566556 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":190,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":7522,"spinlock_wait_cycles":26739456,"thread_start_us":568870,"threads_started":1,"wal-append.queue_time_us":2043975}
I20260812 19:23:50.548509  6464 rpcz_store.cc:276] 0812 19:23:48.811845 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:48.815502 (+  3657us) service_pool.cc:227] Handling call
0812 19:23:48.815839 (+   337us) raft_consensus.cc:1457] Updating replica for 3 ops
0812 19:23:48.853283 (+ 37444us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:48.853328 (+    45us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0812 19:23:48.910079 (+ 56751us) log.cc:842] Serialized 78 byte log entry
0812 19:23:49.532933 (+622854us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:49.566442 (+ 33509us) log.cc:842] Serialized 14 byte log entry
0812 19:23:49.566784 (+   342us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:49.566880 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:50.205442 (+638562us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b18002bdb00. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:23:50.371287 (+165845us) raft_consensus.cc:1671] finished
0812 19:23:50.376500 (+  5213us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:50.387156 (+ 10656us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":104765,"prepare.queue_time_us":36250,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":42,"raft.queue_time_us":102696,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":259,"spinlock_wait_cycles":12755200,"thread_start_us":593878,"threads_started":1,"wal-append.queue_time_us":1127727}
W20260812 19:23:50.615566 13150 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
W20260812 19:23:50.638814 12303 consensus_queue.cc:1159] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdfa5579d4534c618c00db6b4a841c81" responder_term: 11 status { last_received { term: 10 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:23:50.659883  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:23:50.657850 12974 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.240s	user 0.018s	sys 0.049s
I20260812 19:23:50.670679 13033 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:50.409363 12894 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election won for term 11
W20260812 19:23:50.550150 13121 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260812 19:23:50.640826 13159 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.238s	user 0.001s	sys 0.001s
W20260812 19:23:50.566686 13137 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260812 19:23:50.577698 13067 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 2.190s	user 0.015s	sys 0.041s
W20260812 19:23:50.577032  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 178207us
I20260812 19:23:50.671161 13033 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:50.675033 12435 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:23:50.675452 12919 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:50.675141 12446 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:50.689596  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:50.664753 13197 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:50.707132  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:50.668810 12973 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:50.709365  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:50.710990 12274 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:23:50.711314  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:50.711644 12274 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:50.711897  7594 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260812 19:23:50.712304  7593 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:50.712505  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49464 (request call id 62) took 1869 ms. Trace:
I20260812 19:23:50.712885  6345 rpcz_store.cc:276] 0812 19:23:48.843200 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.138098 (+294898us) service_pool.cc:227] Handling call
0812 19:23:50.712313 (+1574215us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b54001bfdd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7772bc3 00007f98fc6bc81a 00007f98f5dbbd04 00007f98f5dbbc92 00007f98f5dbbbc1 00007f98f5dbbb3c 00007f98f5dbadf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:50.712419 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1348627200}
I20260812 19:23:50.712651 12274 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:50.719143  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2056) took 1694 ms. Trace:
I20260812 19:23:50.719519  6417 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:50.721033  6417 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:50.722020  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2043) took 1932 ms. Trace:
I20260812 19:23:50.667135 13151 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:50.722848  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 448565us
I20260812 19:23:50.722863 13069 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:50.723891 13069 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:50.724294 13069 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:23:50.725435  6473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2055) took 1701 ms (client timeout 1935 ms). Trace:
W20260812 19:23:50.725625  6241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2045) took 1295 ms (client timeout 1515 ms). Trace:
I20260812 19:23:50.726282  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:50.726702  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2024) took 3117 ms. Trace:
I20260812 19:23:50.726925  6242 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 11. Current term is 12. Ops: []
I20260812 19:23:50.727146 13124 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:50.727589 12955 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:23:50.719391 12856 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:50.727932 13124 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:50.728150  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 454) took 1168 ms. Trace:
I20260812 19:23:50.728336 13124 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:50.728616  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 510) took 1181 ms. Trace:
I20260812 19:23:50.728499  6242 rpcz_store.cc:276] 0812 19:23:49.559423 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.235938 (+676515us) service_pool.cc:227] Handling call
0812 19:23:50.726749 (+490811us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:50.727427 (+   678us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.727983 (+   556us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b540035f550. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:50.728100 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1100138752}
I20260812 19:23:50.729750 12856 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:50.729149  6474 rpcz_store.cc:276] 0812 19:23:49.547477 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.570067 (+ 22590us) service_pool.cc:227] Handling call
0812 19:23:49.586038 (+ 15971us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:49.586245 (+   207us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:23:50.093987 (+507742us) log.cc:842] Serialized 14 byte log entry
0812 19:23:50.728307 (+634320us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:50.728367 (+    60us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:23:50.728407 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.728464 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:50.728562 (+    98us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":391019,"prepare.queue_time_us":176989,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"thread_start_us":684193,"threads_started":2,"wal-append.queue_time_us":302548}
I20260812 19:23:50.727532  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2067) took 1577 ms. Trace:
I20260812 19:23:50.724227  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:50.731040  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 514) took 1170 ms. Trace:
I20260812 19:23:50.710197 12446 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:50.729785  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 513) took 1169 ms. Trace:
I20260812 19:23:50.731518  6475 rpcz_store.cc:276] 0812 19:23:49.560557 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.661921 (+101364us) service_pool.cc:227] Handling call
0812 19:23:49.662275 (+   354us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:49.662523 (+   248us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:23:49.760949 (+ 98426us) log.cc:842] Serialized 14 byte log entry
0812 19:23:50.460496 (+699547us) log.cc:842] Serialized 14 byte log entry
0812 19:23:50.730726 (+270230us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:50.730774 (+    48us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:23:50.730823 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.730887 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:50.730992 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":382797,"prepare.queue_time_us":130213,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":384084,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":153,"thread_start_us":589114,"threads_started":2,"wal-append.queue_time_us":527360}
I20260812 19:23:50.733466 13165 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:50.734167 12446 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:50.734395 12909 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:50.734665 13196 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260812 19:23:50.735136 12851 consensus_meta.cc:287] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.008s
I20260812 19:23:50.736068 12909 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:50.730566  6232 rpcz_store.cc:276] 0812 19:23:49.149902 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.092279 (+942377us) service_pool.cc:227] Handling call
0812 19:23:50.183100 (+ 90821us) raft_consensus.cc:1457] Updating replica for 3 ops
0812 19:23:50.193485 (+ 10385us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:23:50.375584 (+182099us) log.cc:842] Serialized 14 byte log entry
0812 19:23:50.688476 (+312892us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:50.703193 (+ 14717us) log.cc:842] Serialized 52 byte log entry
0812 19:23:50.703442 (+   249us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:50.703494 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.703596 (+   102us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:50.727317 (+ 23721us) raft_consensus.cc:1671] finished
0812 19:23:50.727336 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:50.727475 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":214604,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":720,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":493902,"threads_started":2,"wal-append.queue_time_us":259103}
I20260812 19:23:50.737027 12909 consensus_queue.cc:1046] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 19:23:50.739430 12923 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:50.740161 12923 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:23:50.741561  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:50.742205  6235 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 12
I20260812 19:23:50.702489 13033 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:50.728766 13124 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:23:50.725826  6473 rpcz_store.cc:269] 0812 19:23:49.024268 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.052535 (+ 28267us) service_pool.cc:227] Handling call
0812 19:23:50.725222 (+1672687us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b54002d2654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:50.725336 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":80144256}
I20260812 19:23:50.744774  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:50.726090  6241 rpcz_store.cc:269] 0812 19:23:49.430285 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.448582 (+ 18297us) service_pool.cc:227] Handling call
0812 19:23:50.725432 (+1276850us) spinlock_profiling.cc:243] Waited 68.1 ms on lock 0x7b540035f554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:50.725566 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":156707200}
I20260812 19:23:50.732951  6477 rpcz_store.cc:276] 0812 19:23:49.560324 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.582107 (+ 21783us) service_pool.cc:227] Handling call
0812 19:23:49.582403 (+   296us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:49.582601 (+   198us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:23:50.366517 (+783916us) log.cc:842] Serialized 14 byte log entry
0812 19:23:50.729326 (+362809us) log.cc:842] Serialized 14 byte log entry
0812 19:23:50.729484 (+   158us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:50.729525 (+    41us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:50.729566 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.729627 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:50.729732 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":232669,"prepare.queue_time_us":85180,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":191023,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":902184,"threads_started":2,"wal-append.queue_time_us":279930}
I20260812 19:23:50.719597  6481 rpcz_store.cc:276] 0812 19:23:49.024566 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.163378 (+138812us) service_pool.cc:227] Handling call
0812 19:23:49.163717 (+   339us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:49.163962 (+   245us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:23:49.318257 (+154295us) log.cc:842] Serialized 14 byte log entry
0812 19:23:49.925479 (+607222us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b18000d7140. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff57b 00007f98f778288a
0812 19:23:50.275505 (+350026us) log.cc:842] Serialized 14 byte log entry
0812 19:23:50.685582 (+410077us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b18000d7140. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c764 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:23:50.718572 (+ 32990us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b18000d7140. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f47d34ca 00007f98fdea8f99 00007f98f4697990 00007f98f4859864 00007f98f4859155 00007f98f77703d0 00007f98f7782576 00007f98f77930d7 00007f98f7793058
0812 19:23:50.718750 (+   178us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:50.718802 (+    52us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:50.718852 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.718928 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:50.719075 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":443039,"prepare.queue_time_us":154215,"prepare.run_cpu_time_us":172,"prepare.run_wall_time_us":4305,"raft.queue_time_us":453074,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":4693,"spinlock_wait_cycles":16088192,"thread_start_us":349549,"threads_started":1,"wal-append.queue_time_us":1038599}
I20260812 19:23:50.714775  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:50.727068  6230 rpcz_store.cc:276] 0812 19:23:47.609132 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:47.824249 (+215117us) service_pool.cc:227] Handling call
0812 19:23:47.824698 (+   449us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:47.871965 (+ 47267us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:47.872005 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:49.492982 (+1620977us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b2c0006c608. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:23:49.497076 (+  4094us) log.cc:842] Serialized 26 byte log entry
0812 19:23:50.100524 (+603448us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:23:50.100578 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.100682 (+   104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:50.726357 (+625675us) raft_consensus.cc:1671] finished
0812 19:23:50.726377 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:50.726620 (+   243us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20625,"raft.queue_time_us":140097,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":10108,"spinlock_wait_cycles":55903488,"thread_start_us":567787,"threads_started":1,"wal-append.queue_time_us":769830}
I20260812 19:23:50.722401  6347 rpcz_store.cc:276] 0812 19:23:48.789500 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.480738 (+691238us) service_pool.cc:227] Handling call
0812 19:23:49.481112 (+   374us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:49.954522 (+473410us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.720680 (+766158us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b54001b2c20. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7708730 00007f98f777bb42 00007f98f7777f26 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:23:50.721788 (+  1108us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54001bfdd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:50.721964 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1063738112}
W20260812 19:23:50.752187  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 94541.7us
W20260812 19:23:50.780730  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 96403.2us
I20260812 19:23:50.784945  6353 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260812 19:23:50.787658  6347 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:50.789369  6417 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:50.789640  6350 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:50.709993 12919 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:50.793318  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:50.797147  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:50.796885  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:50.801294  6345 raft_consensus.cc:595] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:50.801654  6345 raft_consensus.cc:603] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260812 19:23:50.796864  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 82243.8us
I20260812 19:23:50.798386  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:50.784541  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:50.802984  6344 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:50.803932  6347 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260812 19:23:50.804358  6347 pending_rounds.cc:76] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 3
I20260812 19:23:50.804669  6347 pending_rounds.cc:97] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260812 19:23:50.805034  6347 raft_consensus.cc:2866] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:23:50.810830  6178 connection.cc:232] RPC call timeout handler was delayed by -2.2602891200222075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.43010000000000004s for a response
W20260812 19:23:50.811885  6178 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.152s (SENT)
I20260812 19:23:50.742851 12991 raft_consensus.cc:3032] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:50.813549  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:50.818545  6347 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:50.819154  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:50.742620 12923 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:50.819396  6178 leader_election.cc:334] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 3.357s (SENT)
I20260812 19:23:50.820060  6345 raft_consensus.cc:2354] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11.
I20260812 19:23:50.814365  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:50.831439  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:50.829317  6235 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:23:50.831877  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:50.832932  6230 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:50.834287  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:50.819036  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:50.724267 13151 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:50.845718  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:50.846313  6353 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:50.837036  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:50.789031 12988 raft_consensus.cc:3032] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:50.799906 12919 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:50.852623  6344 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
W20260812 19:23:50.855427  6178 connection.cc:232] RPC call timeout handler was delayed by -1.7710700898896903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260812 19:23:50.855979  6178 connection.cc:232] RPC call timeout handler was delayed by -1.6675700899213552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260812 19:23:50.856334  6178 connection.cc:232] RPC call timeout handler was delayed by -1.6180700899567455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
W20260812 19:23:50.856675  6178 connection.cc:232] RPC call timeout handler was delayed by -1.5154700898565352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
W20260812 19:23:50.857115  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2157700899988413s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
I20260812 19:23:50.817916 12446 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:50.817868 12685 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:50.865108  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 457) took 1282 ms. Trace:
I20260812 19:23:50.865916  6349 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260812 19:23:50.898346  6342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2053) took 2072 ms (client timeout 2217 ms). Trace:
I20260812 19:23:50.818594 12991 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:23:50.900635  6342 rpcz_store.cc:269] 0812 19:23:48.826246 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:48.910514 (+ 84268us) service_pool.cc:227] Handling call
0812 19:23:50.898116 (+1987602us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b540036d154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:50.898281 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":72927488}
I20260812 19:23:50.849874 12894 raft_consensus.cc:686] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:50.900508  6236 rpcz_store.cc:276] 0812 19:23:49.582804 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.453138 (+870334us) service_pool.cc:227] Handling call
0812 19:23:50.548755 (+ 95617us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:50.549019 (+   264us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:23:50.640187 (+ 91168us) log.cc:842] Serialized 14 byte log entry
0812 19:23:50.864777 (+224590us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:50.864835 (+    58us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:23:50.864880 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:50.864945 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:50.865058 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":66911,"prepare.queue_time_us":97068,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"thread_start_us":213430,"threads_started":1}
I20260812 19:23:50.848394 12856 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:50.844749 13165 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:50.848685 12923 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:23:50.952873  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:50.953647  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:50.849366 12988 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:50.843575 12435 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:23:50.858472 13151 consensus_queue.cc:1046] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260812 19:23:50.865072 12973 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:50.986232  6344 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260812 19:23:50.986543  6353 raft_consensus.cc:2379] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:50.858831 12919 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:50.893779 12936 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:23:50.991176  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:50.972963  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:50.864339 13007 raft_consensus.cc:2741] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260812 19:23:50.898097 12909 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:50.848796 12851 consensus_queue.cc:1046] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260812 19:23:50.900741 13022 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:50.954301 13197 raft_consensus.cc:686] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:50.955811 12685 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:51.051244 12457 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.011s	sys 0.041s
I20260812 19:23:50.956490 12446 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:50.960922 13196 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:51.013960  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:51.160138  6342 raft_consensus.cc:2379] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:23:51.004081  6228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2062) took 2086 ms (client timeout 2084 ms). Trace:
I20260812 19:23:51.064558  6349 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:51.033783  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:51.161235  6228 rpcz_store.cc:269] 0812 19:23:48.917695 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.119008 (+201313us) service_pool.cc:227] Handling call
0812 19:23:51.003793 (+1884785us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54000ff0d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:51.003976 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":318216064}
W20260812 19:23:51.161988  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 128320us
I20260812 19:23:51.162884  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:51.164660  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:23:51.006054 13040 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260812 19:23:51.092023  6347 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
W20260812 19:23:51.097289  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 55992.2us
I20260812 19:23:50.970995 12856 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:51.059266 13214 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:23:51.004717 12923 raft_consensus.cc:686] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:51.131038  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:51.096786 13151 consensus_queue.cc:1225] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer f4ef77b3328a44e8a21dd902b370e25a log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260812 19:23:51.142266 12457 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.016s	sys 0.041s
I20260812 19:23:51.173990 12856 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:51.041543 12991 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:51.161350 13135 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260812 19:23:51.136885 13169 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:51.123270 12909 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:51.204177  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 459) took 1024 ms. Trace:
I20260812 19:23:51.188531  6477 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:51.073218 12988 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.086588 13165 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:51.215452  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 351596us
W20260812 19:23:51.221909  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 368865us
I20260812 19:23:51.138136 13022 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.109064 12894 consensus_queue.cc:237] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.169965 12936 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260812 19:23:51.243714  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:51.245699  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:51.173477 13207 consensus_queue.cc:1046] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260812 19:23:51.171864 13196 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.258435  6224 rpcz_store.cc:276] 0812 19:23:50.179484 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.648667 (+469183us) service_pool.cc:227] Handling call
0812 19:23:50.649065 (+   398us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:50.649303 (+   238us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:23:50.819525 (+170222us) log.cc:842] Serialized 14 byte log entry
0812 19:23:51.187352 (+367827us) log.cc:842] Serialized 14 byte log entry
0812 19:23:51.203715 (+ 16363us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:51.203771 (+    56us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:23:51.203892 (+   121us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:51.203972 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:51.204112 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16119,"prepare.queue_time_us":125469,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":70,"raft.queue_time_us":98059,"thread_start_us":451161,"threads_started":2}
I20260812 19:23:51.229368 13169 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:51.311305  6350 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
W20260812 19:23:51.286806  6352 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 530) took 1740 ms (client timeout 1661 ms). Trace:
W20260812 19:23:51.324364  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 56282.5us
W20260812 19:23:51.349412  6352 rpcz_store.cc:269] 0812 19:23:49.546228 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.766091 (+219863us) service_pool.cc:227] Handling call
0812 19:23:51.286572 (+1520481us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b54004083d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:51.286721 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":111781120}
I20260812 19:23:51.260767 13217 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260812 19:23:51.260514 12976 consensus_meta.cc:287] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.004s
W20260812 19:23:51.267253 12943 consensus_meta.cc:287] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.003s
I20260812 19:23:51.275597 12909 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:51.385072 12909 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:51.385612 12909 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.387890 12909 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:51.389997 13228 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260812 19:23:51.392400  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2066) took 2357 ms. Trace:
I20260812 19:23:51.236649 13197 consensus_queue.cc:237] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.392765  6238 rpcz_store.cc:276] 0812 19:23:49.035486 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.087734 (+1052248us) service_pool.cc:227] Handling call
0812 19:23:50.088489 (+   755us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:50.243691 (+155202us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:50.243723 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:50.758917 (+515194us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b2c0006c608. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:23:50.759305 (+   388us) log.cc:842] Serialized 26 byte log entry
0812 19:23:51.096101 (+336796us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:51.096224 (+   123us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:51.096378 (+   154us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:51.392037 (+295659us) raft_consensus.cc:1671] finished
0812 19:23:51.392058 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:51.392331 (+   273us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4030,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":7577,"spinlock_wait_cycles":2421504,"thread_start_us":275917,"threads_started":1,"wal-append.queue_time_us":447922}
W20260812 19:23:51.396685 13200 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260812 19:23:51.247720 12446 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:51.286262 13204 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260812 19:23:51.276968 12575 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:23:51.287047 13224 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:51.261327 12923 consensus_queue.cc:237] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:51.383430 13196 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:51.285771 13220 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260812 19:23:51.256837 13219 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260812 19:23:51.278395 13069 consensus_meta.cc:287] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.000s
I20260812 19:23:51.378159 12919 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.286562 13050 raft_consensus.cc:3032] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:51.274821 13022 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:51.421847  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:51.289834 13082 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:51.257244 13198 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.149s
I20260812 19:23:51.353804 12685 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:51.423062 13214 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:51.288374 13124 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.376210 12936 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260812 19:23:51.377506 13217 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:51.407234 12976 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.454316  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:51.460618  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 296026us
I20260812 19:23:51.462028  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:51.430270 13050 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:51.446120 13046 raft_consensus.cc:3032] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:23:51.437808 12973 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:51.430509 12575 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:51.447196 13082 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:51.487752  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:51.488435  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 276435us
W20260812 19:23:51.457763 13180 log.cc:924] Time spent T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.919s	user 0.015s	sys 0.000s
I20260812 19:23:51.456081 13217 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:51.463795  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:51.493713  6178 leader_election.cc:398] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8.
I20260812 19:23:51.500991  6178 leader_election.cc:401] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260812 19:23:51.430456 13069 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.494493  7603 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260812 19:23:51.495087  6417 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:51.511778  6354 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.005s	sys 0.013s
W20260812 19:23:51.526835  6354 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.005s	sys 0.013s
I20260812 19:23:51.464097 12685 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:51.518106  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:23:51.512238  6481 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.005s	sys 0.012s
W20260812 19:23:51.533110  6481 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.006s	sys 0.012s
I20260812 19:23:51.488059 13046 raft_consensus.cc:729] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:51.537133  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:51.464108 13236 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:51.484344 13239 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:51.541298  6178 leader_election.cc:398] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11.
I20260812 19:23:51.542100  6178 leader_election.cc:401] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260812 19:23:51.543148  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:51.450770 13214 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.548624  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:51.533511 13219 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
W20260812 19:23:51.524431 13149 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.003s	sys 0.015s
I20260812 19:23:51.538762 13196 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:23:51.525563 13224 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:51.559034 13219 consensus_queue.cc:1225] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:23:51.565505  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:51.587433  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 515) took 2026 ms. Trace:
I20260812 19:23:51.591233  6349 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:23:51.591583  6483 rpcz_store.cc:276] 0812 19:23:49.560795 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.003194 (+442399us) service_pool.cc:227] Handling call
0812 19:23:50.063273 (+ 60079us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:50.063495 (+   222us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:23:50.088880 (+ 25385us) log.cc:842] Serialized 14 byte log entry
0812 19:23:51.290822 (+1201942us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b18003c2620. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff57b 00007f98f778288a
0812 19:23:51.586964 (+296142us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:51.587040 (+    76us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:23:51.587100 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:51.587197 (+    97us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:51.587363 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6670,"prepare.queue_time_us":25129,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":24711,"spinlock_wait_cycles":10468736,"thread_start_us":254348,"threads_started":1}
I20260812 19:23:51.592875  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:51.567027  6229 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.004s	sys 0.008s
I20260812 19:23:51.550058 12685 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260812 19:23:51.593665  6229 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.004s	sys 0.008s
I20260812 19:23:51.548216 12880 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:51.544906 13236 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:51.525461 13022 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:23:51.550906 12973 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.564494  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:51.539541 13233 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8.
W20260812 19:23:51.583839 13149 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.005s	sys 0.017s
I20260812 19:23:51.546955 13007 consensus_queue.cc:1046] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260812 19:23:51.564880 12936 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260812 19:23:51.588048 13227 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:23:51.616179 13243 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
W20260812 19:23:51.638756  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 394967us
I20260812 19:23:51.600553 13236 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:51.620597 12685 raft_consensus.cc:2741] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260812 19:23:51.659339  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:51.634526 13169 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:51.634588 13233 raft_consensus.cc:3032] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Stepping down as leader of term 8
W20260812 19:23:51.692215  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 186569us
I20260812 19:23:51.662421  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:51.586385 12575 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:51.709050  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 47886.4us
I20260812 19:23:51.633343 13196 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:51.547132 13050 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:51.653601 12446 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:51.691187  7593 raft_consensus.cc:2379] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 12: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
W20260812 19:23:51.650516  6242 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.014s
I20260812 19:23:51.664940 13153 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:51.662220 13223 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260812 19:23:51.741182  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 148364us
I20260812 19:23:51.690119 12976 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:51.761715  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:51.662400 12919 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:51.596863 13046 consensus_queue.cc:260] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:51.750393  6242 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.003s	sys 0.014s
I20260812 19:23:51.750339 13229 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:51.750144 13007 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260812 19:23:51.759351  6172 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.007s	sys 0.008s
W20260812 19:23:51.775660  6172 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.007s	sys 0.009s
I20260812 19:23:51.750819  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:51.709590 13069 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:51.708148 13233 raft_consensus.cc:729] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:51.778820 13233 consensus_queue.cc:260] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.777062 13229 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.781924 13229 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:51.782852 13233 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:51.784657 13214 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:51.785033  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2032) took 3021 ms. Trace:
I20260812 19:23:51.785436  6229 rpcz_store.cc:276] 0812 19:23:48.763217 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.053165 (+1289948us) service_pool.cc:227] Handling call
0812 19:23:50.053566 (+   401us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:50.054000 (+   434us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:50.054033 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:50.062744 (+  8711us) log.cc:842] Serialized 26 byte log entry
0812 19:23:50.778632 (+715888us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b1800194320. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:23:51.595684 (+817052us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:23:51.653079 (+ 57395us) log.cc:842] Serialized 14 byte log entry
0812 19:23:51.661819 (+  8740us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:51.662034 (+   215us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:51.784718 (+122684us) raft_consensus.cc:1671] finished
0812 19:23:51.784842 (+   124us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:51.784975 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7990,"prepare.queue_time_us":57115,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":11311,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":5930,"spinlock_wait_cycles":60871296,"thread_start_us":816714,"threads_started":1,"wal-append.queue_time_us":1642551}
I20260812 19:23:51.746186 12446 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.791028 12446 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:51.791298 13255 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260812 19:23:51.749400 13122 consensus_queue.cc:1046] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
W20260812 19:23:51.792958 13244 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260812 19:23:51.793247  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2076) took 1052 ms. Trace:
I20260812 19:23:51.711561 13124 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:51.794592 13050 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:51.793668  6242 rpcz_store.cc:276] 0812 19:23:50.740515 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.742132 (+  1617us) service_pool.cc:227] Handling call
0812 19:23:50.742471 (+   339us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:50.999013 (+256542us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:23:51.042280 (+ 43267us) log.cc:842] Serialized 14 byte log entry
0812 19:23:51.792896 (+750616us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:51.792948 (+    52us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:51.793000 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:51.793065 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:51.793186 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":48009,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":5239,"raft.queue_time_us":27009,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":906418,"threads_started":2,"wal-append.queue_time_us":648621}
I20260812 19:23:51.796785 12446 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:23:51.796856 13046 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
W20260812 19:23:51.796016  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 45371.6us
I20260812 19:23:51.742340 13250 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:51.811793  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:51.819180  6481 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:23:51.814215  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 277149us
I20260812 19:23:51.816710  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:51.820550  6238 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:23:51.816938  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:51.822890  6475 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:51.823696  6475 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:51.826336  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:51.826619  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:51.827121  6483 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:51.827379  6342 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:51.828601  6238 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:23:51.824651  6475 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.831073  6475 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:51.834539  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:51.836679  6464 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260812 19:23:51.837441  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:51.837596  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2037) took 3065 ms. Trace:
I20260812 19:23:51.838042  6359 rpcz_store.cc:276] 0812 19:23:48.771852 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:49.400112 (+628260us) service_pool.cc:227] Handling call
0812 19:23:50.146339 (+746227us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:50.181362 (+ 35023us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:51.837395 (+1656033us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54003b15d0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:51.837539 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1714566016}
I20260812 19:23:51.839218  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:51.836621  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:51.839967  6230 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:51.840415  6474 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:51.841173  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:51.809693 13153 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:51.746205 13196 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.819249 13189 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:51.818825 13250 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:51.849484  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:51.828318 13007 consensus_queue.cc:1046] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.008s
I20260812 19:23:51.830215 12976 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:51.856505  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:51.867005  6464 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 11: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:51.861738  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:51.855244 13250 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:51.873966  6464 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260812 19:23:51.875440  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:51.876406  6465 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:51.881584  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:51.884402  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:51.884697  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:51.886875  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:51.887755  6242 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:51.891779  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:51.892587  6228 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:51.894058  6483 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:51.897182  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:51.826375 13214 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
W20260812 19:23:51.865545 12856 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.641s	user 0.005s	sys 0.006s
I20260812 19:23:51.934521 12856 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.936883 12856 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:51.830494 13082 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:51.853391 13189 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:51.827138  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:51.901167  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:51.934947 13238 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:51.877332  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:51.970995  6464 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:23:51.969625  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:51.989780  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 162727us
I20260812 19:23:51.990885  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:51.899773 13237 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:51.985754  6481 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:52.010499  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:52.013687  6464 raft_consensus.cc:2396] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260812 19:23:52.016121  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 138854us
I20260812 19:23:51.900583 13224 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:51.938978 13082 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:51.971712 13189 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:52.027010  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:52.027676  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:51.987406 13233 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:52.055725  6230 raft_consensus.cc:2396] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260812 19:23:52.058413  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 285743us
I20260812 19:23:51.872990 12976 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.008193 12923 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:52.059512  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:52.012094 13231 raft_consensus.cc:3032] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:52.064962  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:52.066095  6297 connection.cc:232] RPC call timeout handler was delayed by -1.0354868709109724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
I20260812 19:23:52.066979  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:52.067914  6230 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:52.068480  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:52.069036  6238 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:52.068861  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:52.057142  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 463) took 1208 ms. Trace:
W20260812 19:23:52.072659  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 45115.8us
W20260812 19:23:52.060900 13033 consensus_meta.cc:287] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 1.270s	user 0.010s	sys 0.005s
I20260812 19:23:52.017007 12973 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:52.061780  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:52.099738  6229 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260812 19:23:52.111714  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:52.070593  6236 rpcz_store.cc:276] 0812 19:23:50.849051 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.967905 (+118854us) service_pool.cc:227] Handling call
0812 19:23:51.015076 (+ 47171us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:51.015358 (+   282us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:23:51.060913 (+ 45555us) log.cc:842] Serialized 14 byte log entry
0812 19:23:51.799976 (+739063us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b18003d5dc0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f4859155 00007f98f77703d0 00007f98f7782576 00007f98f77930d7 00007f98f7793058
0812 19:23:52.056676 (+256700us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:52.056743 (+    67us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:52.056814 (+    71us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:52.056907 (+    93us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:52.057073 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":51679,"prepare.queue_time_us":44938,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":180794,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":7188,"spinlock_wait_cycles":42514304,"thread_start_us":256547,"threads_started":1}
I20260812 19:23:52.015901 13277 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:52.074172  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:52.019999  6228 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:52.028071 12446 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:52.117674  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 43558.7us
I20260812 19:23:52.128575  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:52.114941 13069 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:52.066457 13214 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:52.025560 13007 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:52.132578  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:52.076942 13279 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:23:52.066643 13231 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:52.009505 13238 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:52.147099 13282 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260812 19:23:52.149694 12988 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:52.133844 13234 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:23:52.150863  6353 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:52.138877  6352 raft_consensus.cc:2362] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13. Re-sending same reply.
W20260812 19:23:52.145634 13273 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260812 19:23:52.145516  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:52.146003 13022 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:52.146112  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:52.147166 13271 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260812 19:23:52.111797 13033 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.137823 13124 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:23:52.156154 13236 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.157353 13033 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:52.157580  7600 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:52.063540 13233 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.099097 12923 raft_consensus.cc:686] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:52.077991 12919 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:52.071302 13075 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:52.074687 12274 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:52.158092 12956 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:52.130723 12482 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:52.057230 13224 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.138469 13214 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:23:52.162719 12880 consensus_meta.cc:287] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.000s
I20260812 19:23:52.157990 12974 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:23:52.118764 12973 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.133827 12446 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.137579 13069 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.119154 13281 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
W20260812 19:23:52.178359 13217 consensus_meta.cc:287] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.004s
I20260812 19:23:52.017581 13237 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.185647 13231 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.016321 13153 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:52.185773 13243 consensus_meta.cc:287] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
I20260812 19:23:52.159611 13007 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.185500 13224 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.178993 12919 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.212953 13236 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.212864 13231 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:52.187865 13214 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:52.180799 13075 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.217301 13075 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.211926 13069 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.190220 12974 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:52.191325 12880 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11.
I20260812 19:23:52.200361 12976 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.142962 13277 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260812 19:23:52.197589 13196 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:52.202845 12972 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.656s	user 0.017s	sys 0.029s
I20260812 19:23:52.168259 13278 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.036s
I20260812 19:23:52.207032 13243 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:52.188336 12956 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:52.228739 12972 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.683s	user 0.017s	sys 0.029s
I20260812 19:23:52.234160 13237 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.241074 12956 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:52.203652 13217 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:52.252140 13283 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.123s	user 0.002s	sys 0.000s
I20260812 19:23:52.254276 13233 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:52.255235 13217 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:52.257985 13250 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.260330 13250 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:52.260967 13254 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.514s	user 0.000s	sys 0.002s
I20260812 19:23:52.295874  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 462) took 1452 ms. Trace:
I20260812 19:23:52.297086  6232 rpcz_store.cc:276] 0812 19:23:50.842854 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.865293 (+ 22439us) service_pool.cc:227] Handling call
0812 19:23:50.952399 (+ 87106us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:51.790844 (+838445us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b180040e700. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f4859155 00007f98f77703d0 00007f98f7770f6b 00007f98f777b78b
0812 19:23:51.790995 (+   151us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:51.791017 (+    22us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:51.791521 (+   504us) log.cc:842] Serialized 52 byte log entry
0812 19:23:52.041291 (+249770us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:23:52.293603 (+252312us) log.cc:842] Serialized 14 byte log entry
0812 19:23:52.294394 (+   791us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:52.294575 (+   181us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:52.294748 (+   173us) raft_consensus.cc:1671] finished
0812 19:23:52.294971 (+   223us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:52.295499 (+   528us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6110,"prepare.queue_time_us":28316,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":250839,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":17898,"spinlock_wait_cycles":4388608,"thread_start_us":747772,"threads_started":3,"wal-append.queue_time_us":392741}
I20260812 19:23:52.302613  6242 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:52.317387  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:52.321427  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:52.328846  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:52.330436  6342 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:52.330972  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:52.330965  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:52.334522  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:52.340380  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:52.344331  6352 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:52.345486  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:52.175578  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:52.352412  6242 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:52.356839  6481 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:52.357069  7600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 524) took 1665 ms. Trace:
I20260812 19:23:52.357443  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:52.358472  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:52.359841  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:52.224852 12446 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:52.223054 12919 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:52.228259 12973 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:52.383256 13046 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:52.492199 13046 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:52.492887 13046 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:52.382937 13075 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:23:52.184203 12274 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.231905 12923 consensus_queue.cc:237] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.425127 13239 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:52.461318  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:52.499975  7594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 528) took 1467 ms. Trace:
I20260812 19:23:52.500523  7594 rpcz_store.cc:276] 0812 19:23:51.032079 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:51.042333 (+ 10254us) service_pool.cc:227] Handling call
0812 19:23:52.461023 (+1418690us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b5800005498. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824bce 000000000034aea9 00007f98fc644a30 00007f98fc70a7b4 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:23:52.499851 (+ 38828us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":54998784}
I20260812 19:23:52.464449 13238 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.469828 12482 raft_consensus.cc:3032] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:52.502995 12482 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:52.504727 12482 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.507066 12972 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:52.508791 13082 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:52.509549 13082 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.512630 13082 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.513383 12991 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:52.517302 13252 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:52.518095  7603 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:23:52.518266 13252 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.244720 12974 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.520905 12974 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:23:52.521163 13272 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.510s	user 0.002s	sys 0.000s
I20260812 19:23:52.521729 13252 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.523666 13290 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:52.524353 13290 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.488754  6229 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:52.498862 12274 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.516853 13069 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:52.535772 12880 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:52.536613 12880 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.539422 12482 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:52.540829  6224 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:52.544370 12435 raft_consensus.cc:3032] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:23:52.544899  6347 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260812 19:23:52.478861  7600 rpcz_store.cc:276] 0812 19:23:50.691511 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.691708 (+   197us) service_pool.cc:227] Handling call
0812 19:23:50.692125 (+   417us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:52.158057 (+1465932us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:52.356379 (+198322us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540019b254. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:52.356823 (+   444us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3369750912}
I20260812 19:23:52.575042 12880 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.576903 13007 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:52.581338  6178 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.538s (SENT)
I20260812 19:23:52.584268  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:52.584473  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:52.586889 13007 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:52.592937  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:52.544955 12435 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:52.613894  7603 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:52.609184  6350 raft_consensus.cc:595] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:52.607307 12972 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:52.646158  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:52.662840  6178 leader_election.cc:334] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.619s (SENT)
I20260812 19:23:52.666122  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:52.669672  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 48774.5us
I20260812 19:23:52.670985  6179 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:23:52.672387 13321 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
I20260812 19:23:52.674270 12446 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 19:23:52.680058  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 504387us
I20260812 19:23:52.683848 13298 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:23:52.684450 13298 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:52.684969 13298 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:52.686581  6235 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:52.663992 13267 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:52.688066 13251 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:52.688282 13267 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.689332 13251 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.690259  6347 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:52.695021 13279 raft_consensus.cc:2741] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260812 19:23:52.691547  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 362955us
I20260812 19:23:52.706279  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:52.697196  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:52.717864  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:52.721325 12917 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:52.732249 12917 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:23:52.732635 13328 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260812 19:23:52.723862 13219 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:52.722637 13259 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260812 19:23:52.735630 12959 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:52.735108 13219 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:52.733762 12917 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.737898 13219 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.739401 13219 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:52.738575 12917 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:52.740566  7600 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
W20260812 19:23:52.735064  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 87610.9us
I20260812 19:23:52.763209  6238 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:52.770845 13124 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:52.771771 13124 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:52.772971 13214 consensus_meta.cc:287] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.004s
I20260812 19:23:52.773739 13214 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:52.774447 12988 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.009s
W20260812 19:23:52.762012  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.660s (SENT) [suppressed 11 similar messages]
I20260812 19:23:52.794309 13290 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.794025 12972 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.777922 13124 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:52.803714 12909 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:52.804418 12909 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.804908  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:52.805652  6229 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:23:52.782137 13046 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.807693  6359 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:52.808388  6353 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260812 19:23:52.808579  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:52.810725  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:52.811210  6349 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260812 19:23:52.811923  6347 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:52.810071  6344 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260812 19:23:52.799305  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:52.814313  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:52.799854 13251 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:52.826690  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:52.826592  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:52.808579 13046 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.765816 12435 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.823302 13267 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.832907  6238 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:52.842603  6241 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:52.844920  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:52.845206  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:52.845784  6354 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:52.847561 13241 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:52.848065 13241 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:52.848462 13241 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:52.849143  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2080) took 2103 ms. Trace:
I20260812 19:23:52.849565  6235 rpcz_store.cc:276] 0812 19:23:50.745340 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:50.832345 (+ 87005us) service_pool.cc:227] Handling call
0812 19:23:50.832629 (+   284us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:52.687223 (+1854594us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:52.848856 (+161633us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54000f4bd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:52.849077 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4103967104}
I20260812 19:23:52.851972  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2061) took 1035 ms. Trace:
I20260812 19:23:52.852367  6224 rpcz_store.cc:276] 0812 19:23:51.816584 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:51.816703 (+   119us) service_pool.cc:227] Handling call
0812 19:23:52.851746 (+1035043us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54002fd854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:52.851901 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1096841472}
W20260812 19:23:52.853873 13189 consensus_meta.cc:287] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.793s	user 0.000s	sys 0.016s
I20260812 19:23:52.859009  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:52.857614  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:52.860993 12936 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:52.868017 13214 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.874907 12435 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:52.877842  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:52.880857  6235 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260812 19:23:52.879175  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:52.882427  6354 raft_consensus.cc:2396] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260812 19:23:52.881616  6241 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:52.882612  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:52.883584  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:52.885020  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:52.896592  6224 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:52.897845  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:52.898682  6235 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:52.901058 12338 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:52.901398  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49464 (request call id 64) took 1590 ms. Trace:
I20260812 19:23:52.901666 12338 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:52.901830  6350 rpcz_store.cc:276] 0812 19:23:51.310968 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:51.311129 (+   161us) service_pool.cc:227] Handling call
0812 19:23:52.901171 (+1590042us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54004092d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7772bc3 00007f98fc6bc81a 00007f98f5dbbd04 00007f98f5dbbc92 00007f98f5dbbbc1 00007f98f5dbbb3c 00007f98f5dbadf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:52.901314 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2642769280}
I20260812 19:23:52.902804 12338 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.904778  6242 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260812 19:23:52.895428 13298 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.854385 13189 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:52.913017  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:52.861985 12936 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:52.910435  6058 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 195) took 16667 ms (client timeout 15000 ms). Trace:
I20260812 19:23:52.886552 12909 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:52.916390  6054 catalog_manager.cc:5495] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
W20260812 19:23:52.920573 13338 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.085s	user 0.000s	sys 0.002s
I20260812 19:23:52.921480  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:52.922711  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:52.924942  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:52.926970  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260812 19:23:52.939105  6359 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:52.940253  6241 raft_consensus.cc:2354] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10.
I20260812 19:23:52.941679 13046 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:52.939993  6054 catalog_manager.cc:5495] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 5 to 8, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 8 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:52.942034  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:23:52.943181  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:52.942203 13046 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:52.952184  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:23:52.956043 13325 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:52.956091 13298 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:52.949581  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:52.958340  6229 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:23:52.959517  6224 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13. Ops: []
I20260812 19:23:52.969695  6242 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260812 19:23:52.952106 13046 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:52.971246  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:52.972100  7600 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:52.977077  6054 catalog_manager.cc:5495] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 9 to 10, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 10 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:52.978773 13189 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.980159  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:52.979652  6054 catalog_manager.cc:5495] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 5 to 8, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 8 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:52.981369 13169 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:23:52.982017 13169 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:52.983116 13169 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.988467  6232 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:52.990932 13290 consensus_queue.cc:1046] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:23:52.956907 13325 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.992374 12851 raft_consensus.cc:3032] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:52.992786 12851 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:52.993202 12936 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:52.993614 13325 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:52.995223  6344 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:52.993786 12851 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:52.981685  6054 catalog_manager.cc:5495] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 7 to 9, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 9 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
W20260812 19:23:53.003988 13336 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.172s	user 0.003s	sys 0.000s
I20260812 19:23:53.007133  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:53.005036  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:53.002483  6416 connection.cc:232] RPC call timeout handler was delayed by -1.9418861828744411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2217s for a response
I20260812 19:23:53.008204  6344 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:23:53.019363  6054 catalog_manager.cc:5495] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 9 to 11, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 11 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
W20260812 19:23:53.036098  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 274119us
I20260812 19:23:53.016604 12851 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:23:52.930416  6058 rpcz_store.cc:269] 0812 19:23:36.243171 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:36.244261 (+  1090us) service_pool.cc:227] Handling call
0812 19:23:52.910168 (+16665907us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:46.412615 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:46.586943 (+174328us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:46.590516 (+  3573us) write_op.cc:435] Acquired schema lock
0812 19:23:46.596777 (+  6261us) tablet.cc:660] Decoding operations
0812 19:23:46.737792 (+141015us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:46.743827 (+  6035us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:46.788706 (+ 44879us) tablet.cc:683] Acquiring locks for 4 operations
0812 19:23:46.820911 (+ 32205us) tablet.cc:699] Row locks acquired
0812 19:23:46.820940 (+    29us) write_op.cc:260] PREPARE: finished
0812 19:23:46.821183 (+   243us) write_op.cc:270] Start()
0812 19:23:46.821353 (+   170us) write_op.cc:276] Timestamp: P: 1786562626821119 usec, L: 0
0812 19:23:46.821385 (+    32us) op_driver.cc:331] REPLICATION: starting
0812 19:23:46.822300 (+   915us) log.cc:842] Serialized 1682 byte log entry
0812 19:23:48.341343 (+1519043us) op_driver.cc:444] REPLICATION: finished
0812 19:23:50.313061 (+1971718us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f483e5fe 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98fb188410
0812 19:23:50.631921 (+318860us) write_op.cc:301] APPLY: starting
0812 19:23:50.632015 (+    94us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:50.634510 (+  2495us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:50.634530 (+    20us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:51.239314 (+604784us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:51.264443 (+ 25129us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0812 19:23:51.279440 (+ 14997us) write_op.cc:312] APPLY: finished
0812 19:23:51.379638 (+100198us) log.cc:842] Serialized 49 byte log entry
0812 19:23:51.708861 (+329223us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:51.740496 (+ 31635us) write_op.cc:454] Released schema lock
0812 19:23:51.753863 (+ 13367us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:51.812997 (+ 59134us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:51.819632 (+  6635us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":971602,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":2263791,"apply.run_cpu_time_us":53832,"apply.run_wall_time_us":1197795,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20871,"num_ops":4,"prepare.queue_time_us":213296,"prepare.run_cpu_time_us":50712,"prepare.run_wall_time_us":624730,"raft.queue_time_us":305717,"raft.run_cpu_time_us":57960,"raft.run_wall_time_us":2487647,"replication_time_us":1515581,"spinlock_wait_cycles":32556416,"thread_start_us":3063509,"threads_started":5,"wal-append.queue_time_us":808316,"wal-append.run_cpu_time_us":32946,"wal-append.run_wall_time_us":1965502}]]}
I20260812 19:23:53.041200  6054 catalog_manager.cc:5495] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 7 to 8, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 8 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:53.043268 12956 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:53.051122  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.054028  6224 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 11. Current term is 12. Ops: []
I20260812 19:23:53.056318  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:53.038866  7600 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:23:53.052742  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:53.058734  6344 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:23:53.044042  6054 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 10 to 12, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 12 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:53.066226  6179 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:53.051925  6475 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:23:53.089574  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:53.076154  6054 catalog_manager.cc:5495] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 9 to 10, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 10 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:53.085747  6232 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:23:53.096213  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:53.096973  7603 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:53.090374  7600 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:23:53.103161  6054 catalog_manager.cc:5495] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 6 to 7, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 7 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:23:53.109573  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.089740 13189 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:53.120687  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:53.127276  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:53.105837 13298 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:53.135344  7593 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:23:53.145685  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:53.149885 13298 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:53.153134 13298 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:53.131075 13267 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260812 19:23:53.162220 13241 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:53.162992  6417 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:53.164335  6417 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:53.164852 13241 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:53.165359  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.166744 13252 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:23:53.167327 13252 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:53.167797 13252 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:53.169147 12906 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:53.169579 12906 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:53.169905 12906 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:53.177578  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:53.178519  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:53.178875  6344 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260812 19:23:53.179425  6342 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:53.177712  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:53.179848 13208 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:23:53.180415  6349 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:53.180559  6298 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:23:53.181354  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 62220.4us
I20260812 19:23:53.182369  6298 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:53.182909 12972 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:53.183403  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.183573 12972 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:53.184206  6477 raft_consensus.cc:2354] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:23:53.184748 13082 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:53.185230 13082 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:53.185384 13196 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:53.185742 13082 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:53.185899 13196 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:53.186411 13196 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:53.180428 13208 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:53.188089 13208 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:53.189739 12923 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:53.190276 12923 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:53.190724 12923 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:53.188643 13069 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:53.191457 13069 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:53.193605 13069 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:53.197158 13196 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:53.184136 12972 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:53.136361  6054 catalog_manager.cc:5495] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 9 to 10, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 10 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:23:53.214195  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:53.215309  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:53.213407  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:53.219923  6178 leader_election.cc:334] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.785s (SENT)
I20260812 19:23:53.226859  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.215126  6349 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:23:53.228209  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:53.222687  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:53.123390 13325 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260812 19:23:53.205659 13169 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:53.236147 13169 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:53.240209  6054 catalog_manager.cc:5495] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 10 to 11, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 11 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:23:53.132166 13189 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:53.244719 12909 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:53.245368 12909 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:53.245828 13189 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:53.247593 12909 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:53.222035  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:53.218570 12956 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:53.271692  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.291072  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.293835  6477 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260812 19:23:53.299381  6232 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:53.273152 12956 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:53.317411 13219 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:53.318287  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:53.301041  6473 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:53.317703  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.329209  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.329953  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:53.334734  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.337393  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.343963  6475 raft_consensus.cc:2354] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
I20260812 19:23:53.347831  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:53.327148 12936 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:53.355168  6473 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:53.355552 12936 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:53.356555  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.357270  6474 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:53.357765 12936 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:53.359344  6474 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260812 19:23:53.359747  6474 pending_rounds.cc:76] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 5
I20260812 19:23:53.359990  6474 pending_rounds.cc:97] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260812 19:23:53.360230  6474 raft_consensus.cc:2866] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:53.355196 13169 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:53.361635 12909 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:53.362325 12909 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:53.364670 12909 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:53.365590  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.369426 13082 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:53.371001  6477 raft_consensus.cc:2354] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11.
I20260812 19:23:53.371731  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:53.372704  6228 raft_consensus.cc:2379] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 9: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:53.373989  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:53.353272 13219 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:53.382350 13219 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:53.383669  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:53.393976  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 183166us
I20260812 19:23:53.385588  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.388804 12956 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:53.396756  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:53.397161  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:53.397293  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.398478  6473 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:23:53.401417  6481 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:53.401889  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:53.402549  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.404947  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:53.407433  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:53.406718  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:53.408895  6224 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:53.409361  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:53.412787  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.410127  6236 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:23:53.417761  6473 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:53.414885 13214 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:53.430976  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.432612  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.433451  6477 raft_consensus.cc:2396] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260812 19:23:53.429752  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:53.434154  6178 leader_election.cc:334] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.937s (SENT)
I20260812 19:23:53.444067  6473 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:23:53.445609  6473 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260812 19:23:53.428027 12923 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:53.447474  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:53.447836  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:53.448550  6350 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:23:53.448716  6481 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:53.449060 12923 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:53.451804  6178 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.189s (SENT)
W20260812 19:23:53.453002  6178 leader_election.cc:334] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.206s (SENT)
I20260812 19:23:53.453490  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:53.455065 13196 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:53.466223  6481 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260812 19:23:53.425524 13267 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:53.468966  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.470538  6475 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:53.476500 13151 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:53.476984 13151 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:23:53.478210  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 332586us
I20260812 19:23:53.476999 13082 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:53.469801  6482 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:53.453959 12906 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:53.490445  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.492128  7600 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 12: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:53.494948  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:53.428000 13214 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:53.501394  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.491130  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:53.507639  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:53.511682  6354 raft_consensus.cc:2396] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260812 19:23:53.513634  6477 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 7.
I20260812 19:23:53.514966  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:53.515813  6482 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:53.516713  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:53.517515  6344 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:53.487443 12936 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:53.521448  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:53.525592  7603 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:53.532163  7593 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:53.544162  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:53.545032  7600 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 7.
I20260812 19:23:53.541474  6342 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:53.516759 13189 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:53.552438  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.555506  6481 raft_consensus.cc:2396] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 13 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260812 19:23:53.556740  6298 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:53.477874 13151 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:53.547971  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:53.550311  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.537099 13267 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:53.575366  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.581086  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:53.582792  6342 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:53.572062 13069 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:53.622687  6354 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260812 19:23:53.654553  6230 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:23:53.656015  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.564851 13189 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:53.567826 13252 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:53.653165  7594 raft_consensus.cc:2354] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
I20260812 19:23:53.666743 12906 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:53.669229 12457 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:23:53.670009 13267 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:53.670766 13351 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260812 19:23:53.671758  6477 raft_consensus.cc:2396] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260812 19:23:53.653487 13069 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:53.680322 13069 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:53.668516 13046 consensus_meta.cc:287] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.664s	user 0.013s	sys 0.000s
I20260812 19:23:53.684002  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.684780  6481 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:53.690714  6344 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:53.692690  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:53.711683  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:53.712677  6481 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:53.719470  6298 leader_election.cc:398] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
I20260812 19:23:53.719950  6298 leader_election.cc:401] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260812 19:23:53.721359  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:53.678052 12972 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:53.727028  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:53.666625 13250 consensus_queue.cc:1046] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.201s
I20260812 19:23:53.731513  6477 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:53.718134 12851 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:53.690778 13046 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:53.729691 12457 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 19:23:53.745914  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 292951us
I20260812 19:23:53.730837 13325 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
I20260812 19:23:53.733873 13214 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:53.751102  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:53.749573  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:53.753321  6242 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:53.755864  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.758046  6477 raft_consensus.cc:2396] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260812 19:23:53.732928 13298 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:53.727000 13153 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.184s
I20260812 19:23:53.746321 12972 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:53.761940  6229 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260812 19:23:53.765089  6230 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260812 19:23:53.768544  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:53.770852 12923 consensus_queue.cc:1046] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:53.773561  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:53.781301  6232 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:53.782015  6359 raft_consensus.cc:2354] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10.
I20260812 19:23:53.754899 12851 raft_consensus.cc:686] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:53.791100  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:53.781363 12956 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:53.798955  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:53.802031 13360 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260812 19:23:53.800884  6477 raft_consensus.cc:2354] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11.
I20260812 19:23:53.792758 13153 consensus_queue.cc:1225] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Peer f4ef77b3328a44e8a21dd902b370e25a log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260812 19:23:53.818370  7594 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260812 19:23:53.823542  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55127.5us
I20260812 19:23:53.809706 13252 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:53.830427  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.818819 13214 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:23:53.813531 12923 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:53.834867  6477 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:53.833529  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:53.797044 12936 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260812 19:23:53.798787 12906 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260812 19:23:53.819259 13189 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:53.798578 12338 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260812 19:23:53.810164 13298 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:53.847472  7594 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: [11.10-12.11]
I20260812 19:23:53.848568 13376 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
I20260812 19:23:53.856801  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.838491 13325 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:53.853814 13069 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:53.854629 13214 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:53.861004 13189 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:23:53.874161  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:53.884379  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:53.871421 12955 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:53.904812 13364 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260812 19:23:53.907092  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.911376  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:53.886997 13208 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:53.871335 13325 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:53.883940 13189 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:53.886097 13046 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:53.916129 13208 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:53.936704  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:23:53.937077  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 65008.7us
I20260812 19:23:53.935557  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:53.935433  7603 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:53.876165 12851 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:53.939224  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:53.939617  6178 leader_election.cc:334] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.610s (SENT)
I20260812 19:23:53.925240 13189 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:23:53.944155  6417 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:53.937829  6359 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:23:53.910318 12955 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:53.946810  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:53.947451  6465 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:53.912705 13250 consensus_queue.cc:1046] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260812 19:23:53.930681 12923 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:53.930635 12972 raft_consensus.cc:2741] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260812 19:23:53.941485 13208 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:53.958640  6342 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:23:53.960805  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:53.962487  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:53.965720  6482 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:23:53.966359  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:53.968353  6477 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:53.969551  6475 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:53.970266  6473 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:53.974459  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:53.976814 13372 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260812 19:23:53.980775  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45700.1us
I20260812 19:23:53.983987  6482 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260812 19:23:53.972630 13365 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260812 19:23:53.971009 13353 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.355s	user 0.006s	sys 0.001s
I20260812 19:23:53.972357 12338 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:23:53.992337  6477 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:53.974537 13362 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:53.995888 13298 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:54.003074  6178 leader_election.cc:334] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.925s (SENT)
I20260812 19:23:53.959705 13219 consensus_queue.cc:1046] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
W20260812 19:23:54.008497 13382 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.082s	user 0.001s	sys 0.002s
I20260812 19:23:54.008666  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:54.009318  7603 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:54.010334  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 140259us
I20260812 19:23:53.968349 13214 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.013197  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.018005 12923 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:54.020773 13267 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:54.023216 13267 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.023880  6470 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:23:54.025179  6470 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:54.021148 13250 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260812 19:23:54.027213 13151 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:54.006765 12338 raft_consensus.cc:686] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:54.028692 12338 consensus_queue.cc:237] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:54.019115 12936 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:54.025326 13267 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:54.034729 13378 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:54.040938 13378 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.043844 12976 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:54.044385 12976 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:54.010058 13362 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:54.049715 13196 raft_consensus.cc:3032] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:54.050098 13196 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:54.050731 13362 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:54.050993 13196 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.052368 13196 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:54.056231 13378 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:54.010361 13069 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:54.021611  6475 pending_rounds.cc:76] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 6
I20260812 19:23:54.063038  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2099) took 1118 ms. Trace:
I20260812 19:23:54.040205  6232 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:23:54.059579  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:54.061400  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.018584 12923 raft_consensus.cc:686] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:54.078238  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:54.063146  6475 pending_rounds.cc:97] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.7
I20260812 19:23:54.081113  6475 raft_consensus.cc:2894] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Aborting config change with OpId 8.7: Aborted: Op aborted by new leader
I20260812 19:23:54.046528 12976 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:54.086942  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 149037us
I20260812 19:23:54.087599  6350 raft_consensus.cc:3032] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:23:54.021072 13298 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:54.088114  6350 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:54.092396  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:54.063489  6241 rpcz_store.cc:276] 0812 19:23:52.945117 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:52.946612 (+  1495us) service_pool.cc:227] Handling call
0812 19:23:52.963758 (+ 17146us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:52.968654 (+  4896us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:52.968702 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:52.987131 (+ 18429us) log.cc:842] Serialized 26 byte log entry
0812 19:23:53.250018 (+262887us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:53.250052 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:53.250119 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:53.919985 (+669866us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:54.057811 (+137826us) raft_consensus.cc:1671] finished
0812 19:23:54.057834 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:54.062957 (+  5123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":78822272,"thread_start_us":262510,"threads_started":1,"wal-append.queue_time_us":577360}
I20260812 19:23:54.106722  7603 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:54.109390  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.113029  6475 raft_consensus.cc:2866] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:54.118072  6481 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:23:54.122634  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:54.126091  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:54.126412  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:54.127223  6344 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:23:54.123584  6228 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:54.112735  6350 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:54.094214 13325 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:54.109481 12976 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:54.153591  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:54.109405 13069 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260812 19:23:54.155071  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 93751.7us
I20260812 19:23:54.156034  6350 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:54.159447  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:54.165093  6242 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:54.160095  6342 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:23:54.127236  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:54.172924  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 230556us
I20260812 19:23:54.151866 13252 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:23:54.155817 12976 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:54.112898 13298 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:54.190042  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 80732.5us
I20260812 19:23:54.168237 12955 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:54.217301  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.217661  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:54.221840 13298 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:54.222018 13380 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260812 19:23:54.171790 13394 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:23:54.223838  6298 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:54.230445  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:54.191561 13252 raft_consensus.cc:686] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 13 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:54.232571  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:33372 (request call id 10) took 29617 ms. Trace:
W20260812 19:23:54.234829  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 87640.2us
I20260812 19:23:54.232960  6465 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:54.188910 12976 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:54.218638 13214 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:54.215564 13219 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:54.188858  7594 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:23:54.234347  6475 rpcz_store.cc:276] 0812 19:23:24.606479 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:24.607745 (+  1266us) service_pool.cc:227] Handling call
0812 19:23:26.944321 (+2336576us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b4c0035c040. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f5b47210 00007f98f5b57fb2 00007f98f5b1eac5 00007f98f5b4571d 00007f98f5b45383 00007f98f76f1a79 00007f98f76f18d4 00007f98f7757e6e 00007f98f7773acc 00007f98f7774ada 00007f98f7773c8b
0812 19:23:26.946292 (+  1971us) log.cc:842] Serialized 492 byte log entry
0812 19:23:27.725394 (+779102us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b54000265a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7709a4f 00007f98f76f2545 00007f98f76f7771 00007f98f76f76f9 00007f98f76f7689 00007f98f76f7651 00007f98f76f681d 00007f98fdab4204 00007f98fdab4039 00007f98f485c6b6
0812 19:23:54.190918 (+26465524us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":50862,"raft.queue_time_us":5076,"raft.run_cpu_time_us":2380,"raft.run_wall_time_us":629480,"spinlock_wait_cycles":10680576,"thread_start_us":177461,"threads_started":1,"wal-append.queue_time_us":227627,"wal-append.run_cpu_time_us":2451,"wal-append.run_wall_time_us":1100596}
I20260812 19:23:54.237845  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:54.229913 12955 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:54.233251 13069 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:54.227439 13394 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:54.236692 13325 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election won for term 8
W20260812 19:23:54.249221  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 59925.8us
I20260812 19:23:54.235067 13362 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:54.260684  6238 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
W20260812 19:23:54.254832  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 145469us
I20260812 19:23:54.268102  6345 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260812 19:23:54.247926 12906 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:54.271584  6178 leader_election.cc:334] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 3.085s (SENT)
I20260812 19:23:54.274751 12851 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:54.275490 12851 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:54.276964  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:54.277683  6354 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:54.285499 13208 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.286796 13399 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:54.265230 13362 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:54.288978 13362 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:54.257771 12955 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.292958 12955 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:54.191113 12923 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:54.299599  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.305747  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.307729 13391 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:23:54.308209 13391 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:54.308604 13391 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:54.308966 13219 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:54.245155 13214 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.313585  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:54.315255 13404 log.cc:924] Time spent T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260812 19:23:54.314702 13252 consensus_queue.cc:237] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:54.315271 13386 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260812 19:23:54.316025 13398 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260812 19:23:54.312040 12955 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260812 19:23:54.317698 13394 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.319029 12955 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:23:54.319209 13394 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:54.322993  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.323998 13153 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:54.321738 12972 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:54.326642  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:54.327015  6138 auto_rebalancer.cc:254] failed to send replica move request: Aborted: Op aborted by new leader
I20260812 19:23:54.327224 12955 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:54.271894 13325 raft_consensus.cc:686] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:54.339785  6416 leader_election.cc:398] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10.
I20260812 19:23:54.340312  6416 leader_election.cc:401] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260812 19:23:54.303324 13378 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:54.312160 13151 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:54.312032 13219 raft_consensus.cc:3032] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:54.350168  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.298794 12906 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:54.306860 13399 consensus_queue.cc:1046] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260812 19:23:54.348403 12972 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:23:54.347461 12936 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 19:23:54.362342 13402 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260812 19:23:54.367481  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:54.368825  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:54.369601  6229 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:54.369805 12972 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:23:54.352622 13196 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10.
I20260812 19:23:54.362921  6242 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260812 19:23:54.373814  6359 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260812 19:23:54.371917  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:54.371254  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:54.382112  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 116849us
I20260812 19:23:54.352855 13219 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:23:54.383177  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 149179us
I20260812 19:23:54.361469 12851 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:54.388574  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:54.388759  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:54.391865 13214 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:54.394877  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:54.390403 13325 consensus_queue.cc:237] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:54.393433 13069 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:23:54.395658  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:54.401839  6349 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 12: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:54.384138 12936 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:54.353006 13378 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.399669  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.399889  6229 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 11: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:54.398823  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:54.399703 13208 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:54.409480  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:54.394029 13082 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260812 19:23:54.439752  6342 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: [11.4-11.4]
I20260812 19:23:54.441139  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:54.442723  6345 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 12: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:23:54.444543  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:54.450879  6350 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:54.452829  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1817) took 1038 ms. Trace:
I20260812 19:23:54.457695  6344 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:23:54.473083  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:54.455641 13069 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:54.477495  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:54.475039  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 79680.2us
I20260812 19:23:54.475310  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:54.460418  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 529ed979cd2842acb5bc24debb151b93, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.478998  6230 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:54.481948  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:54.479030  6242 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
W20260812 19:23:54.479205  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 529ed979cd2842acb5bc24debb151b93, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.468225 13298 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:54.439386 12936 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.400056 12955 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.477025 13069 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:54.494925  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.481591 13399 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:54.488713  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.457028 13208 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260812 19:23:54.489763  6349 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:54.561416 12906 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:54.572153  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 77321.3us
W20260812 19:23:54.583950  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 84766.7us
I20260812 19:23:54.584455  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:54.559429 13423 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260812 19:23:54.470510 13391 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:54.495512 13069 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:54.563699 12976 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.592674  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:54.477643 13219 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.575495  6350 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:54.485807 13252 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260812 19:23:54.582448 13415 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260812 19:23:54.579160 13387 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260812 19:23:54.491798 13298 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:54.607571  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 118992us
I20260812 19:23:54.565778 13376 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260812 19:23:54.592478 13151 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260812 19:23:54.597411 13189 consensus_meta.cc:287] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.629s	user 0.012s	sys 0.000s
I20260812 19:23:54.642521  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.642729  6178 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:54.613300 13419 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260812 19:23:54.604054 13408 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:23:54.604292 12955 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:54.644039 13151 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:54.689762  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1818) took 1268 ms. Trace:
I20260812 19:23:54.690323  6475 rpcz_store.cc:276] 0812 19:23:53.421716 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:53.989620 (+567904us) service_pool.cc:227] Handling call
0812 19:23:54.007242 (+ 17622us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:54.246838 (+239596us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:54.246868 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:54.247280 (+   412us) log.cc:842] Serialized 26 byte log entry
0812 19:23:54.388624 (+141344us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:23:54.388660 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:54.388724 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:54.689485 (+300761us) raft_consensus.cc:1671] finished
0812 19:23:54.689514 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:54.689683 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1284864,"thread_start_us":140956,"threads_started":1,"wal-append.queue_time_us":138681}
I20260812 19:23:54.705407 13403 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:54.705948 13403 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:54.678825 12972 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:54.680996 13219 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:54.682096 13430 raft_consensus.cc:3032] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:23:54.695179 13151 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:54.694634 12956 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:23:54.706395 13403 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:54.651530 13189 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.571626 13399 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:54.693189 13408 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:54.697623 13378 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:54.735988  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:54.698302 13153 consensus_queue.cc:1046] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.037s
I20260812 19:23:54.714460 13430 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:23:54.762360  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 119757us
I20260812 19:23:54.763542  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.768064  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:54.775624  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:54.775624  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.761437 12936 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:54.779232  6178 leader_election.cc:398] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11.
I20260812 19:23:54.761377 12972 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:54.770498 13415 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:54.453573  6464 rpcz_store.cc:276] 0812 19:23:53.414328 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:53.978115 (+563787us) service_pool.cc:227] Handling call
0812 19:23:53.992070 (+ 13955us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:54.014374 (+ 22304us) raft_consensus.cc:1520] Early marking committed up to index 6
0812 19:23:54.058490 (+ 44116us) log.cc:842] Serialized 14 byte log entry
0812 19:23:54.412235 (+353745us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b1800487360. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff57b
0812 19:23:54.452236 (+ 40001us) log.cc:842] Serialized 14 byte log entry
0812 19:23:54.452446 (+   210us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:54.452499 (+    53us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:23:54.452552 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:54.452632 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:54.452761 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":49049,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":23301,"spinlock_wait_cycles":27197184,"thread_start_us":106273,"threads_started":1,"wal-append.queue_time_us":134582}
I20260812 19:23:54.790731  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:23:54.791095 13412 raft_consensus.cc:3032] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:54.791489  7594 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:54.791673 13452 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:54.792238 13452 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:54.792598 13452 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:54.795235 13196 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:23:54.775766 13440 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:54.744405 13408 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:54.802124  7594 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:23:54.780401 12976 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:54.777972 13391 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:54.805124  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.812136 13430 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.818428  6179 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:23:54.844483  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 163838us
I20260812 19:23:54.782032 12956 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:23:54.816198 13069 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.791592 13412 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:23:54.857570  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 52513.4us
I20260812 19:23:54.858332  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:54.861743  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 86194us
I20260812 19:23:54.865130  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:54.866587  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.867262 13189 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:54.868046 13189 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:54.868707 13394 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:54.869240 13394 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.871268 13394 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:54.871938 12956 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:54.872488 12956 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:54.873534 12956 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.775614 13455 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260812 19:23:54.875352 13378 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:23:54.876137 13399 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:54.874862 13376 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:54.847074 13298 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:54.858934 13449 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:23:54.879042 13449 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:54.879417 13449 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:54.882535 12936 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:23:54.882334 13412 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.883510 13412 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:54.884096 13394 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:54.884703 13394 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:54.855931 13444 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
W20260812 19:23:54.845922 13362 consensus_meta.cc:287] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.002s
I20260812 19:23:54.888423  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:23:54.889967  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 71659.5us
I20260812 19:23:54.900051  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:54.903962 13208 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:54.904800 12976 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:54.905308 12976 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:54.905712 12976 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:54.864029 13391 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260812 19:23:54.915724  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 323115us
I20260812 19:23:54.923142  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:54.924078  6359 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:23:54.893780 13298 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:23:54.817562 13440 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.937090  6474 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260812 19:23:54.940785  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:54.952255  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:54.953030  6350 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260812 19:23:54.955659  6481 raft_consensus.cc:3032] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:23:54.956082  6481 raft_consensus.cc:729] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:54.891808 13362 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:54.958921  7594 raft_consensus.cc:1226] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 13 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13. Ops: []
I20260812 19:23:54.965628  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:54.966478  7603 raft_consensus.cc:2354] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8.
I20260812 19:23:54.936759 13456 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:54.970551  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:54.972597  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:54.978638  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:54.982406  6230 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260812 19:23:54.985647  6241 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260812 19:23:54.985924  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 54424.5us
I20260812 19:23:54.955335 13208 raft_consensus.cc:686] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:54.968449 13394 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:54.968811 13408 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:54.986410  6481 consensus_queue.cc:260] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:54.929247 12972 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:54.999771  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:55.000532  6359 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:54.982508 13399 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:55.003137  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260812 19:23:55.005132 13431 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.449s	user 0.003s	sys 0.000s
I20260812 19:23:55.005226 13362 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:55.011282  6481 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:55.028355  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:54.986083 13196 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:55.040475  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:55.040568  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:54.989605 13298 raft_consensus.cc:686] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:55.042765  6417 leader_election.cc:398] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8.
I20260812 19:23:55.043148  6417 leader_election.cc:401] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:23:55.044894 13461 raft_consensus.cc:2741] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260812 19:23:55.049333 13458 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:55.050211 13458 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:55.051484 13458 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.052659 13082 raft_consensus.cc:3032] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:55.053120 13082 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:55.053943  7603 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:23:55.060402  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:54.992161 12457 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260812 19:23:55.067082  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:55.067943  6241 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:55.077689  6481 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260812 19:23:55.078042  6481 pending_rounds.cc:76] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 9
I20260812 19:23:55.078248  6481 pending_rounds.cc:97] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260812 19:23:55.078469  6481 raft_consensus.cc:2866] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:55.079150  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:55.095700  6345 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:55.097373 12976 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.080958  6347 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
I20260812 19:23:55.099978  6347 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260812 19:23:55.101217 13415 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:55.053900 13082 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.031100 13153 consensus_queue.cc:1046] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260812 19:23:55.085616 13151 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.042555 13446 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260812 19:23:55.059010 13069 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:55.089884 13440 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:55.042892 13391 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:55.042376 13241 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260812 19:23:54.980399 13456 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.092998 13298 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:55.067108 13219 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260812 19:23:55.082980  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:55.135983  6344 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:23:55.102142  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:55.126210 13463 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260812 19:23:55.109053  6359 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:55.062939 13196 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 8
I20260812 19:23:55.082836 13208 consensus_queue.cc:237] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.116421  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:55.144801  6354 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:55.113306  6241 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:55.128293  6345 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:23:55.146736  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:55.147727  6345 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:55.149118  6345 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260812 19:23:55.134157 13469 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260812 19:23:55.153000 13430 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:55.128575  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:55.154891  6352 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:55.155541 13151 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:55.131673 13391 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:55.163347 13466 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260812 19:23:55.163584  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:55.102578  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:23:55.165534  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 63052.7us
I20260812 19:23:55.166257  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:55.167092  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:55.138497  6342 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:55.170934 13153 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:23:55.171213  6354 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:23:55.174829 13325 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:23:55.175562 13153 raft_consensus.cc:2741] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260812 19:23:55.175693  7600 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:23:55.171258 13082 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:55.176513  7600 raft_consensus.cc:595] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:55.136735 13455 raft_consensus.cc:3032] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:23:55.180390 13455 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:55.181295 13455 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:55.183208  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 04c512eaceae43d2a378065361eb4854, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:55.183573  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 04c512eaceae43d2a378065361eb4854, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.140859  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:55.190819  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 50042.3us
I20260812 19:23:55.143114  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:55.195423  6359 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:55.172183 13459 raft_consensus.cc:2741] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260812 19:23:55.200405  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet fd2a75ee87424ce9809bec32f2ae38fa, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:55.200964  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet fd2a75ee87424ce9809bec32f2ae38fa, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.210004  6342 pending_rounds.cc:76] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 10
I20260812 19:23:55.210405  6342 pending_rounds.cc:97] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260812 19:23:55.210633  6342 raft_consensus.cc:2866] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:55.173275  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:55.118047 13189 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:23:55.197331  6344 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:23:55.173926 13376 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260812 19:23:55.222769  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 49563.8us
I20260812 19:23:55.222942  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:55.230049  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:55.231472  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:55.232268  6241 raft_consensus.cc:2354] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
W20260812 19:23:55.236398  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 265968us
I20260812 19:23:55.235746  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.237674  6230 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:23:55.237771  6232 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260812 19:23:55.198751 13474 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:55.244547  6477 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:55.222224 13455 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:55.238744  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:23:55.238760  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 75261.9us
I20260812 19:23:55.239713  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:55.241454  6359 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:23:55.242128  6475 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:23:55.243065  6238 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260812 19:23:55.243232  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:55.141177 12457 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260812 19:23:55.138154 13461 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.098s
I20260812 19:23:55.238158  6228 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:23:55.248111  6464 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:23:55.249109  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:55.256992  6482 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 10: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:55.228295 13214 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:23:55.233359 12976 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:55.233820 12972 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:55.267253  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:55.268659 13456 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:55.263309  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:55.276691  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:55.277423  6482 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:55.240814 13376 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:23:55.269744  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:55.270040  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 4995e2d6140a4fa3a2dadad444b9a924, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:55.280529  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 4995e2d6140a4fa3a2dadad444b9a924, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.252562 12338 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:55.277707  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:55.270306  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:55.279999  6353 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:55.287590  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:55.256853 13474 raft_consensus.cc:686] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:55.305598  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:55.271900 13391 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:55.323633  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:55.328701  6236 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:55.324213  6235 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 11: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:23:55.276505 13214 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:55.264465 12906 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260812 19:23:55.335129  6482 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:55.337610  7593 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260812 19:23:55.325084 13189 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260812 19:23:55.340449  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 73294.7us
I20260812 19:23:55.344238  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:55.350809  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:55.330346 12923 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:23:55.328912 13376 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:55.337045 13449 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.362237 13474 consensus_queue.cc:237] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.347865 13189 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:55.372845 13189 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:55.361603  6416 leader_election.cc:398] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10.
W20260812 19:23:55.377427 13479 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260812 19:23:55.377934  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:55.379043 13219 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260812 19:23:55.339690 13452 consensus_meta.cc:287] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.547s	user 0.013s	sys 0.000s
I20260812 19:23:55.385025  6473 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:55.384766 13219 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:55.351799 13490 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260812 19:23:55.427172 13494 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260812 19:23:55.366676 13449 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:55.427088 13490 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:55.417917 13456 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:55.431850 13219 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:55.458817  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:55.464433  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:55.474445  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:55.389436 13452 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.439512 13490 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:55.461598 13376 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.456719 13456 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:55.484850 13412 consensus_meta.cc:287] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.601s	user 0.013s	sys 0.000s
I20260812 19:23:55.483520 13219 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:55.560230  6238 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260812 19:23:55.560598 13412 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:23:55.561043 13412 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:55.546023 12972 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:55.561443 13412 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:55.564078 13452 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:55.556505  6236 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
W20260812 19:23:55.512315 13403 consensus_meta.cc:287] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.770s	user 0.008s	sys 0.004s
I20260812 19:23:55.546551  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:55.547128  6354 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260812 19:23:55.461148 13214 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.508462 13394 raft_consensus.cc:2741] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260812 19:23:55.508220 13464 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:55.621809  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:55.543349 13501 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260812 19:23:55.516430 12338 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:23:55.583295 12955 consensus_meta.cc:287] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.888s	user 0.014s	sys 0.000s
I20260812 19:23:55.508355 13440 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260812 19:23:55.606176 13399 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:55.624651 13464 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:23:55.656394  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 109948us
I20260812 19:23:55.660092  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:55.564225 12972 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.534157 13189 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.606761 13403 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:55.658155 13453 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:55.659112 13298 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:23:55.713845  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 74406.5us
W20260812 19:23:55.714768  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 240438us
I20260812 19:23:55.663431 13464 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
W20260812 19:23:55.717967  6178 leader_election.cc:334] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.583s (SENT)
I20260812 19:23:55.719525  6473 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260812 19:23:55.723218  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:55.719466  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.724480  6482 raft_consensus.cc:2396] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260812 19:23:55.724700  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.652366 13153 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260812 19:23:55.681556 12955 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:55.730983  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.732391  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.732831  7594 raft_consensus.cc:2354] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12.
W20260812 19:23:55.734601  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 74627.6us
I20260812 19:23:55.736248  6473 raft_consensus.cc:2379] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:55.737112  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.737321  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.663154 13399 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.733136  6470 raft_consensus.cc:2362] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12. Re-sending same reply.
I20260812 19:23:55.734083  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:55.809995  6483 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:55.754191  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.811244  6482 raft_consensus.cc:2362] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10. Re-sending same reply.
I20260812 19:23:55.812340  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.777338  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.750634  6464 raft_consensus.cc:2396] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260812 19:23:55.730197 13153 consensus_queue.cc:1225] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer f4ef77b3328a44e8a21dd902b370e25a log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260812 19:23:55.816511  6482 raft_consensus.cc:2396] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260812 19:23:55.825044  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.825136  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.828253  6473 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:55.830685  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.831863  6470 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
W20260812 19:23:55.838953  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 103444us
I20260812 19:23:55.726420 13298 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.733706 12955 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:55.858271  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:55.865386  6179 leader_election.cc:398] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12.
I20260812 19:23:55.865942  6179 leader_election.cc:401] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:23:55.868247  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:55.869845  6464 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:55.836843 13458 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:23:55.877657  6474 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260812 19:23:55.880769  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.870921 13469 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:55.883600  6470 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:55.870889 13325 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
W20260812 19:23:55.892491  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 174553us
W20260812 19:23:55.893424  6178 leader_election.cc:334] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.833s (SENT)
I20260812 19:23:55.893836  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:55.882297 13459 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260812 19:23:55.895228 13511 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260812 19:23:55.897110 12955 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:55.897753 13512 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260812 19:23:55.882319 12936 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 12
W20260812 19:23:55.902750 13196 consensus_meta.cc:287] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.003s
I20260812 19:23:55.903294 13196 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 7. Current term is 8.
I20260812 19:23:55.903703 13208 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:55.904408  6481 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:55.905776  6475 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260812 19:23:55.895185 13459 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:23:55.875291 13507 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260812 19:23:55.875972 13514 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260812 19:23:55.729992 12338 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:55.939453  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.940997  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.931258  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:55.942973  6481 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
W20260812 19:23:55.925376  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 67250.8us
I20260812 19:23:55.917289  7594 pending_rounds.cc:76] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Aborting all ops after (but not including) 5
I20260812 19:23:55.944811  7594 pending_rounds.cc:97] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260812 19:23:55.945178  7594 raft_consensus.cc:2866] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:55.926903  7600 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260812 19:23:55.921640 13459 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:55.928053  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:55.931361  6354 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:23:55.932260 12956 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 19:23:55.932746  6483 raft_consensus.cc:2396] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260812 19:23:55.952263  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:55.957005  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:55.959455  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:55.967427  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:55.968096  6235 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:23:55.969386  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:55.970598  6481 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:55.972627  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:55.979370  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:55.980314  6242 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:55.917371 13456 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:55.982291  6354 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:55.983222  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:55.989564  6229 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:23:55.975425  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:55.992123  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:55.992941  6470 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:23:55.993108  6230 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260812 19:23:55.961642  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:55.961110 12955 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:56.024101 13153 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260812 19:23:56.024367  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 63027.7us
I20260812 19:23:56.024158 12955 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.027199 12955 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:56.030742  6349 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260812 19:23:55.969348 13474 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260812 19:23:56.034977 13153 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:56.037945  6297 leader_election.cc:398] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
I20260812 19:23:56.040520  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:56.041898  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:23:55.988298 13430 consensus_meta.cc:287] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.831s	user 0.013s	sys 0.001s
I20260812 19:23:55.977782 13458 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:56.021932  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:55.998620  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:56.043109  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:56.052852  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:56.053160  6241 raft_consensus.cc:2396] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260812 19:23:55.998260  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:56.049047  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:56.054581  6344 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:56.045289 13196 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260812 19:23:56.029137 13419 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260812 19:23:56.053061  6481 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:23:56.020496 13189 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:56.056617  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:56.046358 12955 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260812 19:23:56.058512 13527 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260812 19:23:56.049533 13490 consensus_meta.cc:287] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.006s
I20260812 19:23:56.076485  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:56.076717  6359 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:23:56.090952  6349 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:56.050447 13403 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:56.050843 13458 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:56.070402 13519 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:23:56.089354  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:56.091286  6481 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260812 19:23:56.099769  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:56.110267  6354 raft_consensus.cc:2396] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260812 19:23:56.080324 13153 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:56.080101 13069 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:56.103052  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:56.080680 13456 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260812 19:23:56.124742 13521 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260812 19:23:56.091781 13399 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:56.046037 13464 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.132622 13298 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:56.134194 13464 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:56.115178 13151 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:56.134713 13519 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:56.135221  6477 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:23:56.135061 13151 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.137194 13151 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:56.137300  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:56.138180 13412 consensus_meta.cc:287] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.002s
I20260812 19:23:56.082003 13196 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260812 19:23:56.138252  6482 raft_consensus.cc:2396] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260812 19:23:56.116371 13219 consensus_meta.cc:287] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.009s
I20260812 19:23:56.113576 13458 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:56.145457  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:56.151952  6354 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:23:55.997291 13452 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260812 19:23:56.150624  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:56.222573  6481 raft_consensus.cc:2396] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260812 19:23:56.049022 13449 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260812 19:23:56.162994  6344 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:23:56.124765 12936 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12.
W20260812 19:23:56.230820  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 127850us
I20260812 19:23:56.127125 13153 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:56.243038  6235 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:56.244567  6349 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:23:56.185889 13399 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:56.114812 13490 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.120692 13469 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260812 19:23:56.219957 13376 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:56.246897 13153 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:56.256794 13196 consensus_queue.cc:1225] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer 54f83319db6b49929cc8f18a66a66975 log is divergent from this leader: its last log entry 10.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260812 19:23:56.256994  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:56.258386  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:56.184698 13412 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.254848 13399 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.264106  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:56.225663 13219 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.291930  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:56.265527  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:56.267135  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:56.293921  6238 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 11: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:23:56.267647 13533 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260812 19:23:56.267928  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:56.268720  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:56.269462  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:56.270082  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:56.298893  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:56.274349  6464 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:56.300089  6482 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260812 19:23:56.298552  6230 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
W20260812 19:23:56.277076  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 131747us
I20260812 19:23:56.248896 13298 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:23:56.282199  6242 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:23:56.140240 13069 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.282807  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:56.286751 13464 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:56.281479  6470 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:23:56.303821  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:56.306236  6344 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260812 19:23:56.312742  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:56.313438  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:56.292865  6474 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:56.135253 13519 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.418263  6224 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:23:56.328415  6481 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:23:56.414201  6229 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:56.379679  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:56.285866 12955 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:56.316407 12923 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:56.320291 12976 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.091s
I20260812 19:23:56.312215 13430 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260812 19:23:56.387328  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 256020us
I20260812 19:23:56.317317 13474 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:23:56.328073 13464 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:56.320518 13208 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:56.286922 13376 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.409438  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:56.444797  6228 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:56.320592 13196 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:56.290980 13403 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election won for term 12
W20260812 19:23:56.419494  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 106136us
I20260812 19:23:56.480484  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:56.420224  6347 raft_consensus.cc:595] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:56.428906 13069 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:56.418260 13456 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:23:56.445365 13464 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:56.421357 12972 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:56.495985  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:56.435501 13430 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:56.446400 13469 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:56.523154  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:56.446956 13208 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:56.529940 13430 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:56.435130 12955 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.498967 13214 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:56.494059 13456 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:23:56.546038 13535 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260812 19:23:56.546361 13540 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260812 19:23:56.553087 13376 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:56.553710 13490 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:56.438184 12923 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:56.556478  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 119588us
I20260812 19:23:56.528406 13474 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:56.527243 13403 raft_consensus.cc:686] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:23:56.483918 13196 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.539889 13208 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:56.591485  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:56.554311 13412 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:56.518250 13069 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260812 19:23:56.583849 13474 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:56.597052  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:56.588389 12976 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:23:56.588801 13547 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:56.571969 13548 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:56.613817  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:56.540215 12972 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.592475 13572 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:56.598304 13219 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:56.611450 13474 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:56.584636 13214 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:56.596421 13440 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260812 19:23:56.596168 13394 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260812 19:23:56.657625  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 134583us
I20260812 19:23:56.610458 13412 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:56.669119 13069 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:56.669788 13551 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260812 19:23:56.672228  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:56.598507 13490 consensus_queue.cc:1046] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260812 19:23:56.628376 13547 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:56.668996 13399 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:56.694132 13539 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.303s	user 0.000s	sys 0.006s
W20260812 19:23:56.717365  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45251.2us
I20260812 19:23:56.721453 12976 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:56.722024 12976 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:56.721740 13547 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.722466 12976 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:23:56.735574 13550 log.cc:924] Time spent T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260812 19:23:56.736765 13559 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260812 19:23:56.738559 13553 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260812 19:23:56.723745  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:56.727747 13579 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:56.710843 13519 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:56.741981  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 128283us
I20260812 19:23:56.698230 13219 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260812 19:23:56.739547 13558 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260812 19:23:56.747303  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 174716us
I20260812 19:23:56.697247 13412 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:56.745100  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:56.745496 13578 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Stepping down as leader of term 11
W20260812 19:23:56.739886 13537 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.327s	user 0.001s	sys 0.001s
I20260812 19:23:56.754032  6228 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:56.758628  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:56.760346  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:56.762030  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:56.633515 13548 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.746797 13399 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:23:56.650805 13456 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.706246 13069 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:56.802194  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 93270.8us
I20260812 19:23:56.756753 13412 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:56.668262 13572 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:56.765408 13219 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:56.755306 13578 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:56.682947 13403 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:56.779364 13394 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:56.777501 13490 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:56.813458 12972 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:56.844581 13196 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:56.861258 13537 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260812 19:23:56.853674 13394 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:56.854902 12955 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:56.883438 13564 consensus_queue.cc:1046] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260812 19:23:56.861999 13219 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:56.862824 13579 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260812 19:23:56.936054  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 124618us
W20260812 19:23:56.952458  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 204123us
I20260812 19:23:56.937621 13219 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:56.894452 13394 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:56.968638  6344 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260812 19:23:56.977562  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:56.944270 12923 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:56.982196 13610 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:56.982802  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:56.967597 13399 raft_consensus.cc:686] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:23:56.983429 13556 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260812 19:23:56.983656 13590 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:23:56.967034 13219 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:23:56.987656 13568 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260812 19:23:56.987995 13598 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260812 19:23:56.886066 12972 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
W20260812 19:23:56.986394 13531 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.761s	user 0.000s	sys 0.003s
I20260812 19:23:56.957181 13214 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:57.089010  6235 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:23:57.069573  6242 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260812 19:23:57.080013  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:23:57.084985  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 321799us
I20260812 19:23:56.969053 13430 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.131424  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:57.111284  6470 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260812 19:23:56.982187 13594 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:56.970585 13082 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
W20260812 19:23:57.085417 13537 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260812 19:23:57.142759  6464 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260812 19:23:57.181299  6242 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260812 19:23:57.184825  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:57.185480  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 460127us
I20260812 19:23:57.186353  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:57.157179  6464 pending_rounds.cc:76] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 5
I20260812 19:23:57.187691  6464 pending_rounds.cc:97] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260812 19:23:57.188107  6464 raft_consensus.cc:2866] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:23:57.190698  6229 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 7. Current term is 8. Ops: []
I20260812 19:23:57.185561  6470 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:23:57.199442  6344 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: [11.4-11.4]
I20260812 19:23:57.201696  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:57.132241 13590 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:23:57.258204  6230 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:23:57.258494  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:57.203980  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:57.205606  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:57.261052  6354 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:57.138401 12923 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:57.263960  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:23:57.262145  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 75829.3us
I20260812 19:23:57.264974  6342 raft_consensus.cc:2354] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11.
I20260812 19:23:56.951035 13578 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.270915  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:57.271100  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:57.156461 13069 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:57.155177 13606 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:57.271946  6235 raft_consensus.cc:2396] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260812 19:23:57.156194 13592 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:57.272692  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:57.273200  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:57.273149  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:57.280702  6349 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:57.273113  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:57.293187  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:57.295797  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1856) took 1359 ms. Trace:
I20260812 19:23:57.260315 13548 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:57.296293  6475 rpcz_store.cc:276] 0812 19:23:55.922420 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:55.922581 (+   161us) service_pool.cc:227] Handling call
0812 19:23:55.926551 (+  3970us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:55.926945 (+   394us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:23:55.927324 (+   379us) log.cc:842] Serialized 14 byte log entry
0812 19:23:56.160766 (+233442us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:56.233827 (+ 73061us) log.cc:842] Serialized 26 byte log entry
0812 19:23:56.234007 (+   180us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:23:56.234290 (+   283us) log.cc:842] Serialized 14 byte log entry
0812 19:23:56.281137 (+ 46847us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:56.281238 (+   101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:57.281456 (+1000218us) raft_consensus.cc:1671] finished
0812 19:23:57.281478 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:57.281612 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":94180,"prepare.queue_time_us":2055,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":2901,"raft.queue_time_us":50071,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":46189,"spinlock_wait_cycles":6400,"thread_start_us":232969,"threads_started":1,"wal-append.queue_time_us":363810}
I20260812 19:23:57.307602  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:57.288061  6352 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:57.298204  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 566) took 1609 ms. Trace:
I20260812 19:23:57.314570  6465 rpcz_store.cc:276] 0812 19:23:55.680952 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:55.681078 (+   126us) service_pool.cc:227] Handling call
0812 19:23:55.708568 (+ 27490us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:55.708899 (+   331us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:55.708929 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:55.713572 (+  4643us) log.cc:842] Serialized 26 byte log entry
0812 19:23:55.983000 (+269428us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:55.983054 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:55.983148 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:56.985737 (+1002589us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:57.274218 (+288481us) raft_consensus.cc:1671] finished
0812 19:23:57.274250 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:57.290512 (+ 16262us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":28907,"raft.run_cpu_time_us":5649,"raft.run_wall_time_us":79624,"spinlock_wait_cycles":93380480,"thread_start_us":239031,"threads_started":1,"wal-append.queue_time_us":360664}
I20260812 19:23:57.067312 13610 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.324467  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:57.326901  6230 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:23:57.342242  6465 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260812 19:23:57.358835  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:23:57.327154 13464 consensus_meta.cc:287] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.786s	user 0.013s	sys 0.000s
I20260812 19:23:57.287809 13590 raft_consensus.cc:686] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:57.271776 12923 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.317158 12972 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:57.320295 13455 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:23:57.321094 13548 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:57.379395  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2114) took 1410 ms. Trace:
I20260812 19:23:57.416391  6241 rpcz_store.cc:276] 0812 19:23:55.956579 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:55.956722 (+   143us) service_pool.cc:227] Handling call
0812 19:23:57.366894 (+1410172us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b540027ddd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:57.367043 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":210749312}
I20260812 19:23:57.379873  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1848) took 1644 ms. Trace:
I20260812 19:23:57.160521 13594 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:57.387468 13577 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:23:57.295728 13592 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.337772 13572 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:57.365504 13458 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.123s	user 0.010s	sys 0.004s
I20260812 19:23:57.417809  6477 rpcz_store.cc:276] 0812 19:23:55.722353 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:55.806267 (+ 83914us) service_pool.cc:227] Handling call
0812 19:23:57.366488 (+1560221us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400022954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:57.366687 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":709588352}
W20260812 19:23:57.422295 12976 consensus_meta.cc:287] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.689s	user 0.012s	sys 0.001s
I20260812 19:23:57.452512 13628 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:57.297758 13399 consensus_queue.cc:237] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.386902 13503 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:57.388072 13615 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:57.394328 13610 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:57.379150 13464 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.513891  6464 raft_consensus.cc:2396] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260812 19:23:57.386899 13620 consensus_queue.cc:1046] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.200s
W20260812 19:23:57.489518 13459 consensus_meta.cc:287] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.519s	user 0.014s	sys 0.002s
I20260812 19:23:57.297549 13606 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.420010 12972 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:57.537722  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 230193us
I20260812 19:23:57.538887  6416 leader_election.cc:398] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11.
I20260812 19:23:57.539439  6416 leader_election.cc:401] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260812 19:23:57.432585 13548 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.390729 13611 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.348s
I20260812 19:23:57.388192 13632 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.248s
I20260812 19:23:57.505409 13430 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:57.546111  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 382869us
W20260812 19:23:57.549777  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 258839us
I20260812 19:23:57.476361 12976 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.584296  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:57.470827 13458 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.556574 13561 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:57.647691  6352 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:23:57.593735 13430 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:57.639889  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2398367889691144s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2556s for a response
I20260812 19:23:57.506314 13503 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:57.692651  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 153934us
I20260812 19:23:57.524319 13459 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.694475  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:57.596959 13619 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:57.694711  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 89180.7us
I20260812 19:23:57.516125 13615 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:57.638427 13641 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:57.662659 13082 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:57.638569 13627 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:57.690961 13657 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:57.661098  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 113495us
W20260812 19:23:57.710068 13153 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.418s	user 0.010s	sys 0.006s
I20260812 19:23:57.717036 13577 raft_consensus.cc:686] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:57.727608  6345 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260812 19:23:57.730770  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:57.732677  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:57.740751  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:57.741034  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:57.741603  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:57.741986  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:57.742349  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:57.742396  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:57.503808 13590 consensus_queue.cc:237] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.822774  6352 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
I20260812 19:23:57.823195  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:57.777714  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:57.771485  6238 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:57.771968  6229 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:57.827188  6345 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:23:57.830021  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:57.831071  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:57.769133  6297 leader_election.cc:398] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10.
I20260812 19:23:57.846396  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:57.846792 13667 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:57.847180  6230 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:57.847301 13667 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:57.847668 13667 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:57.713817 13619 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:57.849977 13619 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:57.850523 13619 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:57.851280 13677 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:57.851651 13619 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.851809 13677 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:57.853963 13677 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:57.846133  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:57.656044 13561 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.854938  6235 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:23:57.855726 13619 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:57.856190 13561 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:57.857441 13619 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260812 19:23:57.857865 13633 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260812 19:23:57.858225 13619 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:57.859090  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 577) took 2237 ms. Trace:
W20260812 19:23:57.859830 13612 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260812 19:23:57.859571  6353 rpcz_store.cc:276] 0812 19:23:55.621349 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:55.621476 (+   127us) service_pool.cc:227] Handling call
0812 19:23:55.649685 (+ 28209us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:55.652927 (+  3242us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:55.652953 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:56.082429 (+429476us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b18002b6d80. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a
0812 19:23:56.993111 (+910682us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b2c00012928. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:23:56.993748 (+   637us) log.cc:842] Serialized 26 byte log entry
0812 19:23:57.317775 (+324027us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:57.317845 (+    70us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:57.318049 (+   204us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:57.858861 (+540812us) raft_consensus.cc:1671] finished
0812 19:23:57.858886 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:57.859012 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2845,"raft.queue_time_us":3859,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2114,"spinlock_wait_cycles":6560384,"thread_start_us":323520,"threads_started":1,"wal-append.queue_time_us":509467}
I20260812 19:23:57.862179 13619 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:57.863294 13594 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:57.870937 13464 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:57.871629 13464 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:57.872174 13464 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:57.874943 13654 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260812 19:23:57.877259  6474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1864) took 1945 ms (client timeout 1700 ms). Trace:
W20260812 19:23:57.877651  6474 rpcz_store.cc:269] 0812 19:23:55.928733 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:55.940742 (+ 12009us) service_pool.cc:227] Handling call
0812 19:23:57.874472 (+1933730us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54004452d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:57.874584 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":807586688}
I20260812 19:23:57.846141 13671 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:57.708739 13430 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.772504  6242 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:57.776677 13639 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:57.840651  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 71722.4us
I20260812 19:23:57.699362 13616 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.125s
I20260812 19:23:57.756426 13628 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.166s
I20260812 19:23:57.822774 13153 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:57.764057 13644 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:57.776419 13657 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:57.764232 13641 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:57.850392 13637 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:58.046259 13469 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.496s	user 0.015s	sys 0.000s
I20260812 19:23:57.874507 13464 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:58.032425 13208 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.428s	user 0.009s	sys 0.005s
I20260812 19:23:58.066279 13208 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.066931 13641 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:58.054248 12976 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.068588 13208 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.068681 12976 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:58.069026 13430 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.069144 13208 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:57.907824 12923 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:58.069576 12976 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.071058 13657 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:58.020385 13503 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:58.065444 13644 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:57.933502 13634 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260812 19:23:57.966163 13647 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:58.074251 13644 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:58.065250 13469 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260812 19:23:58.029323 13474 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.325s	user 0.011s	sys 0.001s
I20260812 19:23:57.759716 13082 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.070506 13208 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:57.833492 13394 consensus_meta.cc:287] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.854s	user 0.009s	sys 0.005s
I20260812 19:23:58.083757 13606 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:58.064469  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:57.959116 13670 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:57.884334 13677 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:58.098523  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:58.029748 13548 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.118275 13658 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260812 19:23:58.123108 13585 raft_consensus.cc:979] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:23:58.085845 13430 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:57.960901 13671 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:23:58.158176 13561 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:58.065199 13637 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:58.123100 13670 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:58.158763 13561 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:58.160144 13412 consensus_meta.cc:287] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.311s	user 0.015s	sys 0.000s
I20260812 19:23:58.123991 13458 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.160597 13412 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.083258 13647 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.140347 13298 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:58.112000 13474 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.155964 13585 raft_consensus.cc:1067] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Signalling peer bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:23:58.132615 13616 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:23:58.140347 13153 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:57.777626 13627 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.066319 13639 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:58.153213  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.700s (SENT) [suppressed 8 similar messages]
I20260812 19:23:58.114892 13394 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.160961 13561 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.205088  6465 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:23:58.163620 13151 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:58.203609 13403 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.006s	sys 0.020s
I20260812 19:23:58.166755 13594 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:58.166993 13459 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.216306  6228 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
I20260812 19:23:58.192939 13458 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:58.220546  6238 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:23:58.222620 13616 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:23:58.160612 13670 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:58.195343 13676 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:58.163132 13430 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:58.207479 13628 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:58.246251  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:58.233557  6350 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:23:58.215397 13153 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:58.249231  6353 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:58.218959 13637 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:58.227934 13668 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:58.263588  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:58.256681  6470 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260812 19:23:58.282387  6353 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:23:58.228709 13403 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.007s	sys 0.021s
I20260812 19:23:58.203531 13298 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.270534  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:58.231500 13615 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:58.230343 13644 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:23:58.332623  6475 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.005s	sys 0.039s
W20260812 19:23:58.332041  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 129386us
W20260812 19:23:58.334277  6475 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.005s	sys 0.039s
I20260812 19:23:58.334972  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:58.336036  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:58.224656 13682 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:58.230822 13561 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:58.224579 13688 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:58.341117  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2129) took 1199 ms. Trace:
I20260812 19:23:58.336948  6352 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:23:58.341517  6475 rpcz_store.cc:276] 0812 19:23:57.141301 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:57.382719 (+241418us) service_pool.cc:227] Handling call
0812 19:23:57.390089 (+  7370us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:57.390412 (+   323us) raft_consensus.cc:1520] Early marking committed up to index 6
0812 19:23:57.485339 (+ 94927us) log.cc:842] Serialized 14 byte log entry
0812 19:23:58.334988 (+849649us) log.cc:842] Serialized 14 byte log entry
0812 19:23:58.340754 (+  5766us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:58.340807 (+    53us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:23:58.340855 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:58.340920 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:58.341040 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5525,"prepare.queue_time_us":257438,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"thread_start_us":904380,"threads_started":2}
I20260812 19:23:58.168370 13577 consensus_queue.cc:237] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.248245 12976 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.349249  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:23:58.342803  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.013s	sys 0.035s
I20260812 19:23:58.291878 12923 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:58.228103 13151 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.232602 13594 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.332131  6353 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.368162  6475 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
W20260812 19:23:58.368386  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 215207us
W20260812 19:23:58.354130  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.013s	sys 0.036s
W20260812 19:23:58.369200  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 674770us
I20260812 19:23:58.369345  6353 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:58.370350  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:58.374028  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:58.374169  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:58.374727  6238 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:58.375097  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:58.377786  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:58.379083  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:58.289368 13676 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.358803 13082 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.320152 13671 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.352033 13705 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:58.375699  6230 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:58.384099  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:58.394737  6345 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:58.292241 13458 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:58.395099  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:58.395661  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:58.353686 13590 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260812 19:23:58.385000  6413 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.000s	sys 0.023s
I20260812 19:23:58.395941  6352 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
W20260812 19:23:58.403666  6413 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.000s	sys 0.024s
I20260812 19:23:58.367547 13459 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:23:58.416219  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:23:58.420857  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 43536.5us
I20260812 19:23:58.382856  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:58.400954  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:58.402124  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:58.387799  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:58.384660  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:58.422204  6229 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:58.422406  6242 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:58.386719 13676 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:58.424374 13699 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260812 19:23:58.424516 13298 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.376340 13208 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.416401 13641 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:58.425508 13641 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:23:58.426851  7552 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.012s	sys 0.012s
W20260812 19:23:58.427186  7552 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.012s	sys 0.012s
I20260812 19:23:58.367902 12923 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.427764 13641 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:58.391175 13669 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260812 19:23:58.418020  6475 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260812 19:23:58.292505 13628 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.330085 13668 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.418671 13711 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:58.293422 13153 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.424095 13707 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:58.424708 13676 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:23:58.385903 13602 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260812 19:23:58.402635 13412 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:58.456032 13594 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.460844  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:58.416839  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:58.463577  6230 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:23:58.416139 13151 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.344589 13644 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.401459 13627 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.381287 13697 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:58.442545  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:58.486570 13697 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:58.486829  6242 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 8.
I20260812 19:23:58.487032 13697 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:58.487882  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:58.488500  6242 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 5.
I20260812 19:23:58.440644  6353 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260812 19:23:58.445554 13707 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.445551 13394 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:58.386884 13692 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260812 19:23:58.451354  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:58.429517  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.022s	sys 0.033s
W20260812 19:23:58.509603  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.023s	sys 0.033s
I20260812 19:23:58.453332 13458 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:58.371721 13561 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:58.455252 13639 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.471793  6229 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:23:58.357429 13688 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:58.476838 13701 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:58.477072 13719 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260812 19:23:58.479182 13153 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.394487 13705 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:58.439249 13711 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:58.480724 12923 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:58.385535 12976 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.057s
I20260812 19:23:58.483609 13430 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:58.445583 13517 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:58.484361 13474 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.485178 13628 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.471113 13298 consensus_queue.cc:1046] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260812 19:23:58.346603 13682 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:58.432138 13208 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:23:58.508195  6353 pending_rounds.cc:76] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 5
W20260812 19:23:58.509622  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 47339.7us
I20260812 19:23:58.482467 13668 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:58.519464  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:58.660455  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:58.665227  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:58.665516 13456 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:58.666060 13598 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 19:23:58.667212 13598 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260812 19:23:58.667474 13677 consensus_meta.cc:287] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.000s
I20260812 19:23:58.667572 13598 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:58.667809 13616 raft_consensus.cc:3032] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:23:58.668066 13598 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:23:58.668234 13616 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:58.436107 13082 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
W20260812 19:23:58.605506  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 67c9cd7e3397473ba76fb87340b6c6e0, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:58.684280  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 67c9cd7e3397473ba76fb87340b6c6e0, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.670256  6230 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:58.670288  6353 pending_rounds.cc:97] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260812 19:23:58.704303  6353 raft_consensus.cc:2866] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:23:58.663980 13667 consensus_meta.cc:287] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.816s	user 0.008s	sys 0.003s
I20260812 19:23:58.587687  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:58.669450 13616 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.739064  7594 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:23:58.724852 13617 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:23:58.471570 13219 consensus_meta.cc:287] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.383s	user 0.016s	sys 0.001s
I20260812 19:23:58.735710 13517 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.604460 13629 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:58.755854 13644 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:58.756078 13629 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:58.756807  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:58.757656 13619 consensus_meta.cc:287] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.894s	user 0.007s	sys 0.003s
I20260812 19:23:58.758332  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:58.759110 13616 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:58.759465  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:58.759999 13561 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:58.760257 13705 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.760542  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:23:58.761648  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:58.643291 13726 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260812 19:23:58.499963 13464 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:58.777873  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:58.778577  6349 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:23:58.778769  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:58.604925  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:58.791469  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 375325us
I20260812 19:23:58.792730  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:23:58.793644  6359 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.003s	sys 0.015s
I20260812 19:23:58.574908 13503 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:58.604723 13710 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:58.657266 13707 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:58.748477 13667 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.696806 13701 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:58.692662 13677 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11.
I20260812 19:23:58.697063 13719 consensus_queue.cc:1225] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:23:58.671409 13208 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:58.758098 13619 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:58.814021  6359 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.003s	sys 0.015s
W20260812 19:23:58.814488  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:58.842479  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:58.842988  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:23:58.841920  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:58.605799  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2130) took 1411 ms. Trace:
I20260812 19:23:58.521359 13412 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:23:58.635416 13647 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.825490 13082 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:58.826915 13637 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:58.829356  6242 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:58.846047  6477 rpcz_store.cc:276] 0812 19:23:57.194104 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:57.453371 (+259267us) service_pool.cc:227] Handling call
0812 19:23:57.453840 (+   469us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:57.523860 (+ 70020us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:57.523909 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:57.552592 (+ 28683us) log.cc:842] Serialized 26 byte log entry
0812 19:23:57.769912 (+217320us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:23:57.769936 (+    24us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:57.770013 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:58.460225 (+690212us) raft_consensus.cc:1671] finished
0812 19:23:58.460244 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:58.605718 (+145474us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15505,"raft.queue_time_us":370601,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":18633,"thread_start_us":159655,"threads_started":2,"wal-append.queue_time_us":755809}
W20260812 19:23:58.604387 13554 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.892s	user 0.005s	sys 0.002s
I20260812 19:23:58.754628 13711 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:58.832176  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:58.778980 13644 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:58.761746 13629 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:58.854512  6345 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:58.871538  6230 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:23:58.873003  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1861) took 2932 ms. Trace:
I20260812 19:23:58.877673  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:58.834929 13701 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:58.575078 13627 consensus_queue.cc:1046] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.277s
I20260812 19:23:58.761718 13611 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260812 19:23:58.472951 13676 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:58.912015  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49464 (request call id 65) took 3676 ms. Trace:
I20260812 19:23:58.770512 13219 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.880185  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:58.880309  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 152568us
I20260812 19:23:58.883126  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:58.840687 13707 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:23:58.851594 13208 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:58.888283  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:58.929904  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:58.834218  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:58.816826 13464 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.894239  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:58.876866  6483 rpcz_store.cc:276] 0812 19:23:55.927878 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:55.969118 (+ 41240us) service_pool.cc:227] Handling call
0812 19:23:55.969601 (+   483us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:56.019027 (+ 49426us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:23:56.038992 (+ 19965us) log.cc:842] Serialized 14 byte log entry
0812 19:23:56.295763 (+256771us) log.cc:842] Serialized 14 byte log entry
0812 19:23:56.295968 (+   205us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:58.385962 (+2089994us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b1800395560. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c764 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:23:58.387268 (+  1306us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b1800395560. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c764 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:23:58.389280 (+  2012us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b1800395560. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a
0812 19:23:58.389732 (+   452us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b2c000cda88. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:23:58.390116 (+   384us) log.cc:842] Serialized 26 byte log entry
0812 19:23:58.433033 (+ 42917us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:23:58.433322 (+   289us) log.cc:842] Serialized 14 byte log entry
0812 19:23:58.670962 (+237640us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:58.671047 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:58.859704 (+188657us) raft_consensus.cc:1671] finished
0812 19:23:58.859723 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:58.859857 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":69464,"prepare.queue_time_us":6395,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":136,"raft.queue_time_us":104034,"raft.run_cpu_time_us":626,"raft.run_wall_time_us":44168,"spinlock_wait_cycles":62561536,"thread_start_us":484290,"threads_started":3,"wal-append.queue_time_us":516166,"wal-append.run_cpu_time_us":3111,"wal-append.run_wall_time_us":1299835}
I20260812 19:23:58.933494  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:23:58.933972  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:58.911194  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1865) took 2982 ms. Trace:
I20260812 19:23:58.860522  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:58.934928  6298 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:23:58.935333  6477 raft_consensus.cc:2396] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260812 19:23:58.851328 13710 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:58.898201 13534 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 2.662s	user 0.009s	sys 0.000s
I20260812 19:23:58.889417 13298 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260812 19:23:58.924392  6345 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:23:58.874879 13647 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:58.925786  6353 raft_consensus.cc:2396] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260812 19:23:58.949430  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:58.952204  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:58.922456  6347 rpcz_store.cc:276] 0812 19:23:55.235660 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:55.236528 (+   868us) service_pool.cc:227] Handling call
0812 19:23:58.911797 (+3675269us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540025ec54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7772bc3 00007f98fc6bc81a 00007f98f5dbbd04 00007f98f5dbbc92 00007f98f5dbbbc1 00007f98f5dbbb3c 00007f98f5dbadf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:58.911914 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2606194560}
W20260812 19:23:58.931457  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 97338.4us
I20260812 19:23:58.879745 13639 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:58.954607  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:58.832856 13503 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:58.955605  6352 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:23:58.861017 13628 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260812 19:23:58.939788  6474 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
I20260812 19:23:58.940862  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:58.863809 13082 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:23:58.928372 13453 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 2.666s	user 0.009s	sys 0.053s
I20260812 19:23:58.944310  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:58.948067  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:58.954524  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:58.872715 13637 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.959890  6345 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
I20260812 19:23:58.961227 13637 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:58.961658 13710 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:58.965377 13676 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:58.966509 13519 raft_consensus.cc:3032] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:23:58.967072 13519 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:58.968271 13519 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.969224 12976 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:58.969763 12976 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:23:58.970476 12976 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:58.939567 13629 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260812 19:23:58.953949 13325 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:23:58.975616 13325 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:58.976286 13325 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:23:58.977842 13619 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:58.879262 13644 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.967823 13458 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260812 19:23:58.957000  6477 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:58.981837  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:58.982452  6475 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260812 19:23:58.982636  6477 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:23:58.984586  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:58.984794 13667 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:58.940759 13658 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:23:58.925133 13561 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:58.949715 13647 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:58.944592 13682 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:58.985734  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:58.828105 13617 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.987152 13639 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:58.987951 13082 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:58.989646 13576 raft_consensus.cc:3032] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Stepping down as leader of term 7
I20260812 19:23:58.991387 13503 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:59.143577  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:59.144833  6483 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:58.998950  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:23:59.000768  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 47231.1us
I20260812 19:23:59.000983  6477 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:23:59.003202 13458 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:23:59.146319  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:23:59.001569 13453 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 2.740s	user 0.009s	sys 0.054s
I20260812 19:23:59.009528  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:58.981379 13644 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:59.006251 13688 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:59.071993  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:59.072732  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 128543us
I20260812 19:23:58.937299 13707 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:59.098807  6235 raft_consensus.cc:2396] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 13 because replica has last-logged OpId of term: 11 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260812 19:23:58.934763  6473 rpcz_store.cc:276] 0812 19:23:55.929047 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:56.074129 (+145082us) service_pool.cc:227] Handling call
0812 19:23:56.074494 (+   365us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:23:56.074977 (+   483us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:56.075017 (+    40us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:23:56.082969 (+  7952us) log.cc:842] Serialized 52 byte log entry
0812 19:23:56.405441 (+322472us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:56.438539 (+ 33098us) log.cc:842] Serialized 14 byte log entry
0812 19:23:56.438901 (+   362us) log.cc:842] Serialized 14 byte log entry
0812 19:23:56.652341 (+213440us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:56.652452 (+   111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:58.501479 (+1849027us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b24001eb978. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f46b4cf4 00007f98f46b2dfb 00007f98f4741559 00007f98f47411e5 00007f98f474082d 00007f98f73e346e 00007f98f73fac0c 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551
0812 19:23:58.910881 (+409402us) raft_consensus.cc:1671] finished
0812 19:23:58.910910 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:58.911102 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":801550,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":200123,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":11724,"spinlock_wait_cycles":73090944,"thread_start_us":489324,"threads_started":2,"wal-append.queue_time_us":481107}
I20260812 19:23:58.965405 13219 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:59.126900  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:59.122066  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:58.997951  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:23:59.191476  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 193600us
I20260812 19:23:59.147936  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:59.099115 13647 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:59.196650  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:59.179845  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:59.072664 13658 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:59.181770  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:59.198885  6477 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:23:59.200029  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:59.098556 13719 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260812 19:23:59.193327  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 45479.3us
I20260812 19:23:59.201599  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:59.202843  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:59.198033  6347 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:23:59.203670  6352 raft_consensus.cc:595] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:23:59.204190  6352 raft_consensus.cc:603] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:59.206619  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:59.208472  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:59.210974  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:59.216779  6242 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:23:59.178329 13458 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:59.182904 13682 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:59.220477  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:59.223448  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 507) took 3588 ms. Trace:
I20260812 19:23:59.119827 13561 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:59.241470  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:23:59.210074 13699 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260812 19:23:59.194717 12956 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:59.181280 13576 raft_consensus.cc:729] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:23:59.248926  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:59.227613 13644 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260812 19:23:59.227527 13697 consensus_meta.cc:287] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.740s	user 0.011s	sys 0.004s
I20260812 19:23:59.224177 13637 consensus_queue.cc:1046] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260812 19:23:59.224411 13627 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260812 19:23:59.191617 13707 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:59.239018 13719 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:23:59.243062  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:59.241838 13682 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:59.266038  7594 raft_consensus.cc:2396] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260812 19:23:59.244602  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:23:59.226027  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:23:59.274108  6473 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:59.244863  6235 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:23:59.247201 12956 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:59.245558  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:59.203109 13658 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:23:59.215166 13688 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:23:59.229382  6236 rpcz_store.cc:276] 0812 19:23:55.621702 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:55.621859 (+   157us) service_pool.cc:227] Handling call
0812 19:23:55.650510 (+ 28651us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:55.679769 (+ 29259us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:55.679809 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:55.725007 (+ 45198us) log.cc:842] Serialized 26 byte log entry
0812 19:23:55.917779 (+192772us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:55.917835 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:55.917930 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:23:58.897312 (+2979382us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:23:59.195991 (+298679us) raft_consensus.cc:1671] finished
0812 19:23:59.196020 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:23:59.209870 (+ 13850us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8099,"raft.queue_time_us":28275,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":9079,"spinlock_wait_cycles":51454720,"thread_start_us":67942,"threads_started":1,"wal-append.queue_time_us":345706}
I20260812 19:23:59.281594  6236 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260812 19:23:59.221411 13219 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:23:59.250017  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:59.252672  6483 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:23:59.284034 13219 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:59.246469 13667 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:59.284487 13449 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:23:59.284673  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:59.284513 13219 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:59.285912  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:59.286837 13619 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:23:59.287232 13619 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:59.287575 13619 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:23:59.289075 13676 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:23:59.289947 13676 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:59.279810  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:59.226212  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:59.292941  6347 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260812 19:23:59.271829  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:59.284936 13667 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:59.294907 13667 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:59.295513 13676 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:59.284955 13449 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:59.297479 13449 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:23:59.295758  6417 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:59.298398 13440 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:23:59.302750  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:23:59.304893 13440 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:23:59.305817 13440 raft_consensus.cc:686] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:59.254693 13644 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:59.312884  6417 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:23:59.331507 13208 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:59.259756 13562 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:59.257174 13615 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:59.355185  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:59.265632 13707 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:23:59.361869  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 49108.6us
I20260812 19:23:59.276086 13682 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:59.380395  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:59.381549  6235 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260812 19:23:59.385434  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:23:59.309046 13735 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:23:59.386138  6352 raft_consensus.cc:595] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:23:59.389864  6352 raft_consensus.cc:603] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:23:59.279393 12956 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:23:59.357595 13644 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:59.392988  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:59.394553  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:23:59.264700 13697 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:59.356587 13688 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:23:59.360128 13562 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:23:59.379966 13711 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:23:59.367046 13464 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:23:59.366411 13615 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:59.392324 13735 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:23:59.431833 12851 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:23:59.432996  6236 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260812 19:23:59.415004 13456 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.749s	user 0.012s	sys 0.003s
I20260812 19:23:59.348731 13458 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:59.414573 13562 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:23:59.446131  6172 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.016s	sys 0.016s
W20260812 19:23:59.446667  6172 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.016s	sys 0.016s
I20260812 19:23:59.429903 13735 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:59.422072 13615 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:59.439851 13394 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:59.406487 13619 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:59.385861 13576 consensus_queue.cc:260] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:59.464766  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
W20260812 19:23:59.457091 13768 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260812 19:23:59.460204 13616 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:23:59.393849 13440 consensus_queue.cc:237] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:59.492513 13616 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:59.495585  6353 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:59.455621 13639 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:59.460249 13719 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:59.507110 13616 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:23:59.489665 13561 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:59.539603 13325 consensus_meta.cc:287] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.005s
I20260812 19:23:59.540225 13325 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:23:59.542234  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 149370us
I20260812 19:23:59.471556 13394 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:59.526201 13719 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:59.538128 13576 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:23:59.560880 13775 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260812 19:23:59.561158  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:59.566313  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:23:59.569111 13756 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260812 19:23:59.560168 12976 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.586s	user 0.004s	sys 0.011s
I20260812 19:23:59.475237 13688 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:59.572618  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:23:59.575336 13189 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:23:59.584043 13189 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:59.585155  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:59.587200  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:23:59.588094 13189 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:59.576623 13697 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:23:59.601298 13757 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.190s	user 0.001s	sys 0.001s
I20260812 19:23:59.610940 12851 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260812 19:23:59.633597 13756 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260812 19:23:59.608717 13208 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:59.576928 12976 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:59.669967 13208 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:23:59.670887 13208 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:59.672938 12972 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:59.673866 13208 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:59.675891  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:59.610421 13570 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.077s
I20260812 19:23:59.689263  6353 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 12: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:23:59.655171 13782 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.161s	user 0.002s	sys 0.000s
I20260812 19:23:59.706504  6229 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: []
I20260812 19:23:59.650286 13325 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:23:59.663266 13598 consensus_meta.cc:287] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.995s	user 0.012s	sys 0.005s
I20260812 19:23:59.713824  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:59.665441 12851 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:59.631285 13219 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:59.614615 13449 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:59.735363  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:59.721879  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:59.722411 13719 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:23:59.723835 13578 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:23:59.755504  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:59.724810 12976 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:23:59.667934 13619 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:23:59.730475 13770 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260812 19:23:59.674640 13208 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260812 19:23:59.720062 13598 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:23:59.765148  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2124) took 2693 ms. Trace:
I20260812 19:23:59.776121  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2107) took 2705 ms. Trace:
I20260812 19:23:59.898828  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:23:59.772737  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2133) took 2430 ms. Trace:
I20260812 19:23:59.942519  6474 rpcz_store.cc:276] 0812 19:23:57.342307 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:58.325183 (+982876us) service_pool.cc:227] Handling call
0812 19:23:58.345634 (+ 20451us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:58.969914 (+624280us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:59.772491 (+802577us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b5400073fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:59.772674 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1365935488}
I20260812 19:23:59.776010  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:59.775238  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1868) took 3697 ms. Trace:
I20260812 19:23:59.765290  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:23:59.940840  6228 rpcz_store.cc:276] 0812 19:23:57.070501 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:57.070670 (+   169us) service_pool.cc:227] Handling call
0812 19:23:57.070958 (+   288us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:58.230604 (+1159646us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:59.775880 (+1545276us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400179654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:59.776059 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2633543552}
I20260812 19:23:59.729009 12851 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
W20260812 19:23:59.796463  6473 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.522s	user 0.014s	sys 0.001s
I20260812 19:23:59.952653  6482 rpcz_store.cc:276] 0812 19:23:56.077373 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:56.219381 (+142008us) service_pool.cc:227] Handling call
0812 19:23:56.299603 (+ 80222us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:56.300510 (+   907us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:59.775021 (+3474511us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b54001310d0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:59.775163 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":183572352}
I20260812 19:23:59.983604  6473 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:23:59.984351  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2142) took 1156 ms. Trace:
I20260812 19:23:59.812719  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1869) took 3735 ms. Trace:
I20260812 19:23:59.984588  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:23:59.984941  6481 rpcz_store.cc:276] 0812 19:23:56.077653 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:56.223290 (+145637us) service_pool.cc:227] Handling call
0812 19:23:56.223677 (+   387us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:56.419152 (+195475us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:59.812428 (+3393276us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400073ad4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:59.812643 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":239798016}
W20260812 19:23:59.775167  6241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2125) took 2034 ms (client timeout 1864 ms). Trace:
W20260812 19:23:59.986537  6241 rpcz_store.cc:269] 0812 19:23:57.740282 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:57.740444 (+   162us) service_pool.cc:227] Handling call
0812 19:23:59.774931 (+2034487us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000f50d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:23:59.775079 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2528257920}
I20260812 19:23:59.783708  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:23:59.982829  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:23:59.775549 13755 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260812 19:23:59.991966  6473 rpcz_store.cc:276] 0812 19:23:58.828378 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:59.225607 (+397229us) service_pool.cc:227] Handling call
0812 19:23:59.984276 (+758669us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:23:59.940414  6470 rpcz_store.cc:276] 0812 19:23:57.071573 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:57.260594 (+189021us) service_pool.cc:227] Handling call
0812 19:23:57.275482 (+ 14888us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:58.323301 (+1047819us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:23:59.764763 (+1441462us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54002d2654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:23:59.765065 (+   302us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2236141312}
W20260812 19:23:59.888988 13667 consensus_meta.cc:287] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.594s	user 0.013s	sys 0.001s
I20260812 19:23:59.775986 13456 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:23:59.997809 13456 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:23:59.993046  6482 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:00.000545 13456 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:00.001461  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.003896 13619 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:00.006816  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:00.006999  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.007830  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.008769  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:00.017373  6482 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:00.020876  6353 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:00.027731  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:00.029013  6473 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:00.036298  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:00.037024  6473 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:00.026000  6481 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
W20260812 19:24:00.018630  6230 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.011s	sys 0.034s
W20260812 19:24:00.039005  6230 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.012s	sys 0.034s
W20260812 19:24:00.039839  6298 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.011s	sys 0.017s
W20260812 19:24:00.041966  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.008s	sys 0.036s
W20260812 19:24:00.042088  6298 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.011s	sys 0.017s
W20260812 19:24:00.042513  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.008s	sys 0.036s
I20260812 19:24:00.021829  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.039985  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2134) took 1127 ms. Trace:
I20260812 19:23:59.803900 13564 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:00.033599  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.043844  6230 rpcz_store.cc:276] 0812 19:23:58.912592 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:59.293806 (+381214us) service_pool.cc:227] Handling call
0812 19:23:59.294132 (+   326us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:59.294326 (+   194us) raft_consensus.cc:1520] Early marking committed up to index 6
0812 19:23:59.446841 (+152515us) log.cc:842] Serialized 14 byte log entry
0812 19:24:00.039508 (+592667us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:00.039580 (+    72us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:00.039648 (+    68us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:00.039741 (+    93us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:00.039910 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":394427,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":342,"thread_start_us":744324,"threads_started":2}
I20260812 19:24:00.032712  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.047091  6482 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:00.048239  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.045313  6474 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:00.047549  6470 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:00.049055  6482 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:00.052711  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.053625  6482 raft_consensus.cc:2379] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 6: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:00.054464  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.056396  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.057233  6482 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:00.061331  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:00.080917 12956 consensus_meta.cc:287] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.683s	user 0.012s	sys 0.000s
I20260812 19:24:00.091801  6353 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:24:00.114964  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.115949  6470 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:00.020215 13667 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:00.081574 12956 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:00.181639  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:00.169704 13735 consensus_meta.cc:287] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.699s	user 0.002s	sys 0.011s
I20260812 19:24:00.188550 12851 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:00.187244 12956 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:00.185465  6474 raft_consensus.cc:2396] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 13 because replica has last-logged OpId of term: 11 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260812 19:24:00.196887  6473 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
W20260812 19:24:00.199715  6235 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.018s	sys 0.039s
I20260812 19:24:00.175915 13449 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:00.176014 13522 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:24:00.212018  6235 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.018s	sys 0.039s
I20260812 19:24:00.219162  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2148) took 1350 ms. Trace:
I20260812 19:24:00.060209 13564 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:00.224035 13637 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.013s	sys 0.018s
W20260812 19:24:00.259320 13637 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.013s	sys 0.019s
W20260812 19:24:00.265054 13658 consensus_meta.cc:287] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.909s	user 0.003s	sys 0.011s
I20260812 19:24:00.265856 13658 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:00.229064  6474 rpcz_store.cc:276] 0812 19:23:58.868335 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.093171 (+1224836us) service_pool.cc:227] Handling call
0812 19:24:00.219084 (+125913us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:00.276021  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:00.199373 13647 consensus_meta.cc:287] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.977s	user 0.008s	sys 0.009s
I20260812 19:24:00.191707 13789 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:00.225232 13616 consensus_meta.cc:287] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.695s	user 0.009s	sys 0.005s
W20260812 19:24:00.296453  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.000s	sys 0.027s
W20260812 19:24:00.296904  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.000s	sys 0.027s
W20260812 19:24:00.297219  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 787342us
W20260812 19:24:00.298285  6172 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.014s	sys 0.021s
W20260812 19:24:00.298817  6172 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.014s	sys 0.021s
W20260812 19:24:00.281298 13562 consensus_meta.cc:287] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.826s	user 0.012s	sys 0.007s
W20260812 19:24:00.290752  6175 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.024s
W20260812 19:24:00.326174  6175 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.000s	sys 0.025s
W20260812 19:24:00.289408 13707 consensus_meta.cc:287] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.900s	user 0.014s	sys 0.002s
W20260812 19:24:00.295714 13701 consensus_meta.cc:287] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.376s	user 0.013s	sys 0.005s
I20260812 19:24:00.196287 13735 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:00.283401 13522 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:00.291482 13647 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:00.299394  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.017s	sys 0.011s
W20260812 19:24:00.306828  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.004s	sys 0.012s
W20260812 19:24:00.553828  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.242s	user 0.017s	sys 0.015s
I20260812 19:24:00.530597  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:00.555857  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.004s	sys 0.016s
W20260812 19:24:00.556348  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 925765us
I20260812 19:24:00.522975  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:00.560690  6353 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:00.526309  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:00.295779 13627 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.018s	sys 0.021s
I20260812 19:24:00.625036  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.574501  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:00.577252  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 1.33168e+06us
I20260812 19:24:00.585333  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:00.571385 13719 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:00.509608  7554 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.010s	sys 0.015s
W20260812 19:24:00.628039  7554 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.012s	sys 0.022s
I20260812 19:24:00.628362  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:00.651539  6482 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:00.652877  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:00.655329  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:00.655941  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:24:00.365644 13761 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.020s	sys 0.052s
W20260812 19:24:00.503388 13786 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
W20260812 19:24:00.518436 13682 consensus_meta.cc:287] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.123s	user 0.013s	sys 0.001s
I20260812 19:24:00.659379  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2150) took 1790 ms. Trace:
I20260812 19:24:00.686196  6482 rpcz_store.cc:276] 0812 19:23:58.868997 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.624692 (+1755695us) service_pool.cc:227] Handling call
0812 19:24:00.659172 (+ 34480us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:00.416126 12851 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:00.622311 13592 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:00.660054  6241 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:00.664661  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:00.698995  6228 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:00.667220  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:00.677048  6353 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:24:00.680297  6236 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260812 19:24:00.622402 13578 consensus_meta.cc:287] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.861s	user 0.015s	sys 0.000s
I20260812 19:24:00.347561 13598 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:00.651080 13627 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.313s	user 0.018s	sys 0.025s
W20260812 19:24:00.691860  6345 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.085s	user 0.033s	sys 0.106s
I20260812 19:24:00.623571 12956 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:00.311009 13616 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:00.700683  6347 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:00.700696  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:00.696086  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:00.692107 13761 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.291s	user 0.021s	sys 0.064s
I20260812 19:24:00.704332  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:00.703689  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:00.650707 13666 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:00.708303  6345 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.033s	sys 0.106s
W20260812 19:24:00.698356 13644 consensus_meta.cc:287] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.292s	user 0.006s	sys 0.011s
I20260812 19:24:00.661976 13214 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:00.711556  6477 raft_consensus.cc:2396] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260812 19:24:00.310802 13789 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:00.714308  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:00.714893  6482 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:24:00.715545  6241 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:00.659485 13453 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:00.336113 13562 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:00.348978 13707 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:00.716434  6353 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:00.350823 13701 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:00.706229 13440 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.154s	user 0.009s	sys 0.015s
I20260812 19:24:00.778267  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2111) took 4797 ms. Trace:
I20260812 19:24:00.659798 13719 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:00.832540  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2151) took 1963 ms. Trace:
I20260812 19:24:00.833199  6482 rpcz_store.cc:276] 0812 19:23:58.869321 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.695752 (+1826431us) service_pool.cc:227] Handling call
0812 19:24:00.832463 (+136711us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:00.751199  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:00.835325  6228 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:24:00.697748 13682 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:00.840415  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.774425  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 604) took 1142 ms. Trace:
I20260812 19:24:00.834775  6344 raft_consensus.cc:2396] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260812 19:24:00.827196  6224 rpcz_store.cc:276] 0812 19:23:55.954481 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:55.954643 (+   162us) service_pool.cc:227] Handling call
0812 19:23:55.974217 (+ 19574us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:56.418921 (+444704us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:00.751283 (+4332362us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54002f8854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:00.751557 (+   274us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1020749184}
W20260812 19:24:00.745867 13688 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.013s	sys 0.089s
I20260812 19:24:00.835572  6241 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:24:00.837208  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:00.859314  6482 raft_consensus.cc:2354] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:24:00.861188  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1874) took 1555 ms. Trace:
I20260812 19:24:00.861426  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:00.861650  6482 rpcz_store.cc:276] 0812 19:23:59.305830 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.840077 (+1534247us) service_pool.cc:227] Handling call
0812 19:24:00.861112 (+ 21035us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:00.862875  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:00.863576  6482 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:00.845291  6345 rpcz_store.cc:276] 0812 19:23:59.599102 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:59.599290 (+   188us) service_pool.cc:227] Handling call
0812 19:23:59.599781 (+   491us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:59.600063 (+   282us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:23:59.606215 (+  6152us) log.cc:842] Serialized 14 byte log entry
0812 19:24:00.740671 (+1134456us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:00.740755 (+    84us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:00.740824 (+    69us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:00.740929 (+   105us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:00.741122 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24232,"prepare.queue_time_us":9429,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":58,"thread_start_us":1109678,"threads_started":1}
I20260812 19:24:00.865063  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:00.831562 13440 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.279s	user 0.019s	sys 0.021s
I20260812 19:24:00.867619  6347 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:00.753132 13810 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:00.889490  6474 consensus_meta.cc:287] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.000s
I20260812 19:24:00.750293 13453 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:00.874233  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:00.756718 13808 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:00.880810 13803 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:00.883505 13616 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:00.885136  6482 raft_consensus.cc:2396] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260812 19:24:00.885576  6228 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 6.
I20260812 19:24:00.898437  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1896) took 1232 ms. Trace:
I20260812 19:24:00.899085  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:00.862133  6241 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 12: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:00.900686  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:00.887095 13719 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:00.779337 13627 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.110s
W20260812 19:24:00.891232  6413 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.029s	sys 0.033s
W20260812 19:24:00.906157  6413 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.030s	sys 0.033s
I20260812 19:24:00.723749 13641 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:00.893692 13453 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:00.892614  6224 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:00.756395 13214 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:00.863888 13688 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.022s	sys 0.093s
I20260812 19:24:00.923656 13214 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:00.719074 12956 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:00.741850 13598 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
I20260812 19:24:00.938024 13719 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:00.938862 13719 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:00.940517 13719 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:00.943316 13562 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:00.943614 13808 raft_consensus.cc:686] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:00.947690 13598 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:24:00.948256 13598 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:00.948649 13735 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:00.950874 13707 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:00.893466 13810 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:00.951817 12956 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:00.923488  6464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2127) took 3839 ms (client timeout 2682 ms). Trace:
I20260812 19:24:00.895054  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:00.953045  6464 rpcz_store.cc:269] 0812 19:23:57.083981 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:57.211580 (+127599us) service_pool.cc:227] Handling call
0812 19:24:00.923270 (+3711690us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400450454. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:00.923381 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":528050432}
I20260812 19:24:00.890292  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:00.954528  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.955408  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1893) took 1397 ms. Trace:
I20260812 19:24:00.837683 13452 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:00.898890  6482 rpcz_store.cc:276] 0812 19:23:59.670579 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.862540 (+1191961us) service_pool.cc:227] Handling call
0812 19:24:00.898371 (+ 35831us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:00.906852  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:00.890074  6474 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
W20260812 19:24:00.960351  6474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1872) took 1655 ms (client timeout 2130 ms). Trace:
W20260812 19:24:00.960978  6474 rpcz_store.cc:269] 0812 19:23:59.305045 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.275532 (+970487us) service_pool.cc:227] Handling call
0812 19:24:00.960285 (+684753us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:00.962072  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.724735 13644 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:00.910281 13807 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:00.918282  6228 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260812 19:24:00.921706 13641 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:00.922413  6350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1915) took 3203 ms (client timeout 2475 ms). Trace:
I20260812 19:24:00.922689 13522 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:00.923446  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2128) took 3813 ms. Trace:
I20260812 19:24:00.970604  6465 rpcz_store.cc:276] 0812 19:23:57.110086 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:57.361373 (+251287us) service_pool.cc:227] Handling call
0812 19:23:57.384453 (+ 23080us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:58.219874 (+835421us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:00.923225 (+2703351us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b5400271854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:00.923382 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1886823808}
I20260812 19:24:00.972306  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.973181  6465 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:00.973613  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1898) took 1302 ms. Trace:
I20260812 19:24:00.973960  6465 rpcz_store.cc:276] 0812 19:23:59.671737 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.971873 (+1300136us) service_pool.cc:227] Handling call
0812 19:24:00.973550 (+  1677us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:00.912974 13658 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:00.925832 13701 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:00.927800 13647 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:00.750399 13666 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:00.955258  6345 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:24:00.921633  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2141) took 2544 ms. Trace:
I20260812 19:24:00.955911  6464 rpcz_store.cc:276] 0812 19:23:59.559802 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.954150 (+1394348us) service_pool.cc:227] Handling call
0812 19:24:00.955352 (+  1202us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:24:00.985255  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.029s	sys 0.051s
W20260812 19:24:00.985761  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.029s	sys 0.051s
I20260812 19:24:00.985855  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.986850  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1897) took 1315 ms. Trace:
I20260812 19:24:00.988088  6464 rpcz_store.cc:276] 0812 19:23:59.671245 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.985554 (+1314309us) service_pool.cc:227] Handling call
0812 19:24:00.986781 (+  1227us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:00.989001  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:00.989214 13519 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:00.989693  6464 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:00.990128  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1890) took 1517 ms. Trace:
I20260812 19:24:00.990458  6464 rpcz_store.cc:276] 0812 19:23:59.472695 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.988738 (+1516043us) service_pool.cc:227] Handling call
0812 19:24:00.990077 (+  1339us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:00.991886  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1918) took 3263 ms. Trace:
I20260812 19:24:00.959700  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:00.993397  6464 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260812 19:24:00.993674  6482 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:00.994455  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2137) took 2326 ms. Trace:
I20260812 19:24:00.994817  6464 rpcz_store.cc:276] 0812 19:23:58.667591 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.992731 (+2325140us) service_pool.cc:227] Handling call
0812 19:24:00.993105 (+   374us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:00.994150 (+  1045us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:00.994403 (+   253us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:00.949681 13598 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:00.959194 13615 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.489s	user 0.011s	sys 0.006s
I20260812 19:24:00.921649 13682 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:00.968680  6350 rpcz_store.cc:269] 0812 19:23:57.722360 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:57.753804 (+ 31444us) service_pool.cc:227] Handling call
0812 19:24:00.922168 (+3168364us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b540036e054. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:00.922296 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":926120704}
I20260812 19:24:00.948143 13789 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:00.959684 13810 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:00.964435 13452 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:01.014616  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:01.015408  6465 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:00.905531 13803 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:00.945657 13808 consensus_queue.cc:237] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:00.984920  6229 rpcz_store.cc:276] 0812 19:23:58.377713 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:59.498574 (+1120861us) service_pool.cc:227] Handling call
0812 19:23:59.499033 (+   459us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:59.712623 (+213590us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:00.921418 (+1208795us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540013f454. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:00.921574 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":476641024}
I20260812 19:24:00.962906  6353 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
W20260812 19:24:00.997560  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 1.23224e+06us
I20260812 19:24:00.992334  6342 rpcz_store.cc:276] 0812 19:23:57.728171 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:57.729933 (+  1762us) service_pool.cc:227] Handling call
0812 19:23:57.730281 (+   348us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:58.230924 (+500643us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:58.230960 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:58.231003 (+    43us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:23:58.231036 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:00.991586 (+2760550us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b540003f7d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:00.991635 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:00.991813 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1150799104}
I20260812 19:24:01.024794  6342 raft_consensus.cc:1261] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260812 19:24:01.024693  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:01.005718  6464 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260812 19:24:01.009408  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:01.022279  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:01.026850  6350 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:01.028239  6350 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: []
I20260812 19:24:00.975868 13807 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:01.008944 13637 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.038s	sys 0.070s
W20260812 19:24:01.035128 13637 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.038s	sys 0.071s
I20260812 19:24:01.019065  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:01.029220  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2138) took 2293 ms. Trace:
I20260812 19:24:01.040802  6464 rpcz_store.cc:276] 0812 19:23:58.736256 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.995611 (+2259355us) service_pool.cc:227] Handling call
0812 19:24:01.005440 (+  9829us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:01.028930 (+ 23490us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.029152 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:01.043314  6353 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:01.055121 13452 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:01.057111  6353 raft_consensus.cc:3032] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:24:01.057672  6353 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:01.031312  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2132) took 1258 ms. Trace:
I20260812 19:24:01.032874  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2131) took 1260 ms. Trace:
W20260812 19:24:01.044626  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 349262us
I20260812 19:24:01.026386  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:01.013824 13615 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.060287 13517 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:01.060643 13803 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:01.033629 13682 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:24:01.042621 13598 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:01.061910 13807 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:01.078361  6482 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:01.082683  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1881) took 1686 ms. Trace:
I20260812 19:24:01.063560  6350 rpcz_store.cc:276] 0812 19:23:59.772113 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.027661 (+1255548us) service_pool.cc:227] Handling call
0812 19:24:01.028022 (+   361us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:01.032581 (+  4559us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.032807 (+   226us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:01.025657  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2127) took 1272 ms. Trace:
I20260812 19:24:01.068053  6241 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260812 19:24:01.063457  6345 rpcz_store.cc:276] 0812 19:23:59.772537 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.009037 (+1236500us) service_pool.cc:227] Handling call
0812 19:24:01.031225 (+ 22188us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:01.080452  6228 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
W20260812 19:24:01.080427  6235 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.005s	sys 0.008s
I20260812 19:24:01.066205  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:01.088096  6235 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.005s	sys 0.009s
W20260812 19:24:01.081424  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55151.5us
I20260812 19:24:01.088912  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:01.047786  6179 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.023s	sys 0.061s
W20260812 19:24:01.089833  6179 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.023s	sys 0.061s
W20260812 19:24:01.090293  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 821750us
I20260812 19:24:01.092065  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:01.083086  6482 rpcz_store.cc:276] 0812 19:23:59.399255 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.959382 (+1560127us) service_pool.cc:227] Handling call
0812 19:24:01.082604 (+123222us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:01.085268  6342 rpcz_store.cc:276] 0812 19:23:59.753123 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.023949 (+1270826us) service_pool.cc:227] Handling call
0812 19:24:01.024346 (+   397us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:01.025319 (+   973us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.025603 (+   284us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:01.093684  6241 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:01.095863  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:01.096266  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:01.097347  6241 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:01.083308  6465 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:24:01.100366  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:01.097240  6482 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:24:01.107206  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:01.108209  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:01.105432  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:01.112243  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:01.082391  6353 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.122845  6353 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:01.126986  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:01.129174  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:01.144369  6224 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: [9.5-12.6]
I20260812 19:24:01.144871  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:01.146142  6465 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
I20260812 19:24:01.146708  6230 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260812 19:24:01.110487  6482 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 6.
I20260812 19:24:01.149950  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 579) took 2279 ms. Trace:
I20260812 19:24:01.150419  6482 rpcz_store.cc:276] 0812 19:23:58.870544 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.148927 (+2278383us) service_pool.cc:227] Handling call
0812 19:24:01.149312 (+   385us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:01.149530 (+   218us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:01.149566 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:01.149622 (+    56us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:01.149665 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.149736 (+    71us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:01.149880 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:01.154011  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 580) took 2274 ms. Trace:
I20260812 19:24:01.155197  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:01.156147  6228 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:01.154452  6482 rpcz_store.cc:276] 0812 19:23:58.879905 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.152957 (+2273052us) service_pool.cc:227] Handling call
0812 19:24:01.153362 (+   405us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:01.153602 (+   240us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:01.153639 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:01.153695 (+    56us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:01.153741 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.153819 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:01.153947 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:01.159789  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2140) took 2383 ms. Trace:
I20260812 19:24:01.160327  6465 rpcz_store.cc:276] 0812 19:23:58.776054 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.124075 (+2348021us) service_pool.cc:227] Handling call
0812 19:24:01.124477 (+   402us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:01.159454 (+ 34977us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.159689 (+   235us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:24:01.161509  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 57684.3us
I20260812 19:24:01.162591  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:01.163503  6241 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:01.167591  6342 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:01.081972 13682 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:01.173411  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2135) took 2260 ms. Trace:
I20260812 19:24:01.173933  6235 rpcz_store.cc:276] 0812 19:23:58.913020 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:59.383818 (+470798us) service_pool.cc:227] Handling call
0812 19:23:59.398452 (+ 14634us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:59.398907 (+   455us) raft_consensus.cc:1520] Early marking committed up to index 7
0812 19:24:00.228363 (+829456us) log.cc:842] Serialized 14 byte log entry
0812 19:24:01.162063 (+933700us) log.cc:842] Serialized 14 byte log entry
0812 19:24:01.172992 (+ 10929us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:01.173061 (+    69us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:01.173119 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.173206 (+    87us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:01.173343 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":83780,"prepare.queue_time_us":339665,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":80942,"thread_start_us":1675164,"threads_started":2}
I20260812 19:24:01.169828  6482 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:33386
I20260812 19:24:01.177121  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:01.168676 13682 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:01.178889 13707 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:24:01.179593 13707 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:01.180747 13707 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.182062  6228 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:01.184753  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:01.184825  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:01.185864  6465 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
W20260812 19:24:01.187736  6297 connection.cc:232] RPC call timeout handler was delayed by -1.5824271021410823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2682s for a response
I20260812 19:24:01.189297  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:01.193405 13474 raft_consensus.cc:3032] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:01.194128 13474 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:01.195459 13666 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:01.164466 13822 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:01.198870 13658 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:01.199642 13658 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:01.202867 13562 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:24:01.203449  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:01.204603 13196 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:24:01.204962 13819 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260812 19:24:01.205668 13196 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:24:01.206444 13196 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:01.208231 13811 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260812 19:24:01.207886 13196 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.212355  6482 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:01.212934  6482 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:01.177242 13644 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:01.176983 13522 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 19:24:01.216988  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.019s	sys 0.019s
W20260812 19:24:01.217408  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.019s	sys 0.019s
I20260812 19:24:01.220088  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:01.212527  6474 raft_consensus.cc:2396] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260812 19:24:01.204694  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:01.086934 13821 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:01.100786 13517 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:01.239532  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:01.243795  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 72214.1us
I20260812 19:24:01.263186  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:01.264014  6228 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:01.229583  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:01.268411  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:01.268981  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:01.269721  6229 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 10
I20260812 19:24:01.234422  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:01.275115  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:01.273671  7552 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.009s	sys 0.057s
W20260812 19:24:01.276319  7552 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.009s	sys 0.057s
I20260812 19:24:01.279100  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:01.279843  6224 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:24:01.221561 13472 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.809s	user 0.032s	sys 0.096s
I20260812 19:24:01.281703  6241 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 11: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:01.282294  6228 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260812 19:24:01.288560  6482 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:01.286371  6353 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260812 19:24:01.187107 13789 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:01.322849  6224 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
W20260812 19:24:01.323592  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 62792.5us
I20260812 19:24:01.324044  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:01.284613  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:01.324688  6224 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:01.326484  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:01.326756  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:01.292245  6353 pending_rounds.cc:76] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 4
I20260812 19:24:01.327207  7600 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:01.327484  6353 pending_rounds.cc:97] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260812 19:24:01.327533  6230 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:01.327911  6353 raft_consensus.cc:2866] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:01.328718  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2133) took 1555 ms. Trace:
I20260812 19:24:01.329053  6353 rpcz_store.cc:276] 0812 19:23:59.772913 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.046514 (+1273601us) service_pool.cc:227] Handling call
0812 19:24:01.056965 (+ 10451us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:01.328465 (+271500us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.328662 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:01.330459  6235 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260812 19:24:01.320464  6345 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:01.331506  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:01.294903 13472 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.880s	user 0.032s	sys 0.103s
I20260812 19:24:01.239707 13750 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260812 19:24:01.326882  6179 leader_election.cc:334] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.617s (SENT)
I20260812 19:24:01.344962  6179 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:01.330276  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:01.336126  6229 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:24:01.253827 13822 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:01.329108  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:01.346107  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:01.347069  6241 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 12: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:01.347893  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:01.334719  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:01.319216  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:01.344318  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:01.367894  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:01.368999  6241 raft_consensus.cc:2396] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260812 19:24:01.369004  6353 raft_consensus.cc:2379] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:01.266366 13644 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:01.259865 13821 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:01.374538  6229 raft_consensus.cc:1226] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:01.290783 13807 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:01.287711 13562 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:01.269389 13522 consensus_queue.cc:1046] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260812 19:24:01.282999 13517 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:01.427872  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:01.471313  6235 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:01.195382 13474 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.368089 13808 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:24:01.474581 13808 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:01.333523 13658 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:01.390498 13835 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:01.429155  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:01.431769  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:01.280534 13603 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.121s
I20260812 19:24:01.394163 13821 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:01.280756 13688 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260812 19:24:01.434904  6224 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:01.428066  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:01.486570  6229 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:01.367116 13822 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:01.401882  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:01.376746 12956 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:01.471932  7600 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:01.396627 13701 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:24:01.345068 13671 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:01.349283 13789 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:01.483150  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2139) took 2733 ms. Trace:
I20260812 19:24:01.479350 13808 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:24:01.481864 13453 consensus_meta.cc:287] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.005s
I20260812 19:24:01.368249 13828 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.111s
I20260812 19:24:01.497570  6298 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:01.486835 13474 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:01.421068 13615 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:01.499308  6464 rpcz_store.cc:276] 0812 19:23:58.749419 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.041873 (+2292454us) service_pool.cc:227] Handling call
0812 19:24:01.044954 (+  3081us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:01.045193 (+   239us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:24:01.369989 (+324796us) log.cc:842] Serialized 14 byte log entry
0812 19:24:01.482821 (+112832us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:01.482870 (+    49us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:01.482910 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.482969 (+    59us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:01.483094 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":8645,"thread_start_us":420684,"threads_started":2}
I20260812 19:24:01.468034 13807 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.430688 13505 consensus_queue.cc:1046] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260812 19:24:01.473603 13562 consensus_queue.cc:1046] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260812 19:24:01.521343  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:01.525709  6464 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:01.500541 13835 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:01.540620 13835 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:01.541078 13835 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:01.494781 13822 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:01.503121 13671 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.543265  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 514) took 4468 ms. Trace:
I20260812 19:24:01.500373 12956 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.514622 13453 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.545640  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2136) took 2878 ms. Trace:
I20260812 19:24:01.546051  6475 rpcz_store.cc:276] 0812 19:23:58.666904 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:58.749833 (+ 82929us) service_pool.cc:227] Handling call
0812 19:23:58.799157 (+ 49324us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:58.983160 (+184003us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.545375 (+2562215us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54002d2154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:01.545577 (+   202us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":420598144}
I20260812 19:24:01.547238  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:01.498467 13682 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:01.548677  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:01.530061 13505 raft_consensus.cc:3032] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:01.531258  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1913) took 3920 ms. Trace:
I20260812 19:24:01.536394  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1927) took 3308 ms. Trace:
I20260812 19:24:01.516414 13701 raft_consensus.cc:686] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:24:01.552239  6477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2152) took 2682 ms (client timeout 2134 ms). Trace:
I20260812 19:24:01.549335  6475 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
W20260812 19:24:01.575706  6477 rpcz_store.cc:269] 0812 19:23:58.869636 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:59.199713 (+330077us) service_pool.cc:227] Handling call
0812 19:24:01.552013 (+2352300us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400363b54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:01.552160 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3473854336}
I20260812 19:24:01.576660  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:01.577299  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:01.577678  6475 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:01.571168  6359 rpcz_store.cc:276] 0812 19:23:57.610565 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:57.663605 (+ 53040us) service_pool.cc:227] Handling call
0812 19:23:57.704973 (+ 41368us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:23:57.935600 (+230627us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:57.935647 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:23:57.980711 (+ 45064us) log.cc:842] Serialized 26 byte log entry
0812 19:23:58.841442 (+860731us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:58.841496 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.530847 (+2689351us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54001cded4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:01.530896 (+    49us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:01.530945 (+    49us) raft_consensus.cc:1671] finished
0812 19:24:01.530957 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:01.531197 (+   240us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":79865,"raft.queue_time_us":108409,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":187,"spinlock_wait_cycles":345038592,"thread_start_us":757024,"threads_started":1,"wal-append.queue_time_us":606235,"wal-append.run_cpu_time_us":2095,"wal-append.run_wall_time_us":1002102}
I20260812 19:24:01.578696  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:01.575950  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 145973us
I20260812 19:24:01.580217  6230 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:24:01.581070  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:01.543676  6232 rpcz_store.cc:276] 0812 19:23:57.074645 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:57.074824 (+   179us) service_pool.cc:227] Handling call
0812 19:23:57.084927 (+ 10103us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:57.085134 (+   207us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:23:57.482681 (+397547us) log.cc:842] Serialized 14 byte log entry
0812 19:23:57.703462 (+220781us) log.cc:842] Serialized 14 byte log entry
0812 19:23:59.723064 (+2019602us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b18003e7880. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:24:01.542806 (+1819742us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b18003e7880. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f4859155 00007f98f77703d0 00007f98f7782576 00007f98f77930d7
0812 19:24:01.542908 (+   102us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:01.542960 (+    52us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:01.543000 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.543078 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:01.543204 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3245,"prepare.queue_time_us":504381,"prepare.run_cpu_time_us":203,"prepare.run_wall_time_us":1626,"raft.queue_time_us":526560,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":220,"spinlock_wait_cycles":122451968,"thread_start_us":927426,"threads_started":4,"wal-append.queue_time_us":592905,"wal-append.run_cpu_time_us":3240,"wal-append.run_wall_time_us":1387159}
I20260812 19:24:01.583747  6477 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
W20260812 19:24:01.554311 13838 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260812 19:24:01.580804  6235 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:01.570600  6354 rpcz_store.cc:276] 0812 19:23:58.231942 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:58.232598 (+   656us) service_pool.cc:227] Handling call
0812 19:23:58.232924 (+   326us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:23:58.488038 (+255114us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:23:58.488084 (+    46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:23:58.488140 (+    56us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:23:58.488185 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.536014 (+3047829us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540009ddd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:01.536083 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:01.536310 (+   227us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":260,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":73087,"spinlock_wait_cycles":585836288}
I20260812 19:24:01.585686  6229 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:01.586177  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:01.588701  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:01.590164  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:01.590926  6354 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:01.591413  6464 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:01.591897  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:01.587059  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:01.551342 13828 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:01.596184  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:01.554905 13618 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:01.598893  6477 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 5. Current term is 6. Ops: []
I20260812 19:24:01.571027 13505 raft_consensus.cc:729] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:01.597386  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:01.608496  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:01.617027  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:01.615506  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 582) took 2693 ms. Trace:
W20260812 19:24:01.621021  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 186436us
I20260812 19:24:01.634279  6477 rpcz_store.cc:276] 0812 19:23:58.922791 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.598027 (+2675236us) service_pool.cc:227] Handling call
0812 19:24:01.598581 (+   554us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:01.615183 (+ 16602us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.615436 (+   253us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:01.636971  6477 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:01.618371  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:01.638135 13705 consensus_queue.cc:1046] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:01.606673 13658 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260812 19:24:01.639935 13833 raft_consensus.cc:3032] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:24:01.638546  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 584) took 2348 ms. Trace:
I20260812 19:24:01.642782  6477 rpcz_store.cc:276] 0812 19:23:59.290043 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.636492 (+2346449us) service_pool.cc:227] Handling call
0812 19:24:01.636806 (+   314us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:01.638292 (+  1486us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.638493 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:01.587255 13682 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:01.643442  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 214406us
I20260812 19:24:01.644969  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 585) took 2351 ms. Trace:
I20260812 19:24:01.645052  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:01.650113  6477 rpcz_store.cc:276] 0812 19:23:59.293946 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.644021 (+2350075us) service_pool.cc:227] Handling call
0812 19:24:01.644382 (+   361us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:01.644581 (+   199us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:01.644608 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:01.644677 (+    69us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:01.644721 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.644786 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:01.644907 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:01.651320  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:01.652549  6477 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260812 19:24:01.655087  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:01.655121  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1875) took 2349 ms. Trace:
I20260812 19:24:01.656188  6477 rpcz_store.cc:276] 0812 19:23:59.306103 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.651736 (+2345633us) service_pool.cc:227] Handling call
0812 19:24:01.652240 (+   504us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:01.654797 (+  2557us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.655056 (+   259us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:01.665374  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:01.670656  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:01.635473 13581 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:24:01.673635  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:01.677349  6344 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2128) took 1920 ms (client timeout 2404 ms). Trace:
I20260812 19:24:01.677951  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:01.677776  6344 rpcz_store.cc:269] 0812 19:23:59.757137 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.075970 (+318833us) service_pool.cc:227] Handling call
0812 19:24:01.677123 (+1601153us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54001ce3d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:01.677261 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":641079168}
I20260812 19:24:01.640363 13833 raft_consensus.cc:729] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:01.648178 13615 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:01.703111 13615 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.691387 13831 consensus_queue.cc:1046] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260812 19:24:01.706480 13836 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260812 19:24:01.708382 13671 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:01.671247 13701 consensus_queue.cc:237] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.648499 13644 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:01.712858 13644 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.667382 13453 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:01.697543  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2136) took 1923 ms. Trace:
I20260812 19:24:01.715528 13562 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:01.715883  6350 rpcz_store.cc:276] 0812 19:23:59.773972 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.083840 (+1309868us) service_pool.cc:227] Handling call
0812 19:24:01.084183 (+   343us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:01.084561 (+   378us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:01.084593 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:01.085019 (+   426us) log.cc:842] Serialized 26 byte log entry
0812 19:24:01.286460 (+201441us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:01.472602 (+186142us) log.cc:842] Serialized 14 byte log entry
0812 19:24:01.575700 (+103098us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.575783 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:01.697256 (+121473us) raft_consensus.cc:1671] finished
0812 19:24:01.697295 (+    39us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:01.697471 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2348,"prepare.queue_time_us":268498,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":53894,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":75415,"thread_start_us":353498,"threads_started":3,"wal-append.queue_time_us":195740}
I20260812 19:24:01.718436 13822 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.719614  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:01.720019  6465 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 11: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:01.680017 13670 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260812 19:24:01.720937  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:01.721241 13822 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:01.721652 13670 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:01.722074 13670 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:01.722954 13670 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.723956 13670 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:01.724638  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:01.693917 12956 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:01.726980  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:01.727502  7593 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14. Ops: []
W20260812 19:24:01.730185 13830 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260812 19:24:01.731381  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:01.735327 13849 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260812 19:24:01.665520 13682 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:01.735806  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:01.679519 13578 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:24:01.659807 13707 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:24:01.737941  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:01.738533 13789 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:01.669153 13522 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:01.713402 13615 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:01.727696 13644 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:01.741849  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:01.742471  6235 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 5. Current term is 6. Ops: []
I20260812 19:24:01.744629 13833 consensus_queue.cc:260] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:01.746027 13833 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:24:01.731967  6350 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260812 19:24:01.747900  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:01.741333 13852 consensus_queue.cc:1046] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260812 19:24:01.750085 13852 raft_consensus.cc:3032] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:24:01.750466 13852 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:01.751340 13852 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.752627 13852 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:01.697105 13505 consensus_queue.cc:260] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:01.740892 13688 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:01.739636 13851 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260812 19:24:01.775759 13598 consensus_meta.cc:287] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.689s	user 0.013s	sys 0.000s
I20260812 19:24:01.716003 13517 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:01.776382 13821 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:01.766379  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:01.778550 13641 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:01.781301  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:01.783394 13505 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:01.786608  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:01.769325  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 611) took 1052 ms. Trace:
I20260812 19:24:01.783493  6482 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:01.746188  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:01.788892  6359 rpcz_store.cc:276] 0812 19:24:00.717141 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.635566 (+918425us) service_pool.cc:227] Handling call
0812 19:24:01.768572 (+133006us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:01.768893 (+   321us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:01.768922 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:01.769070 (+   148us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:01.769099 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.769157 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:01.769265 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:24:01.792591  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 172847us
I20260812 19:24:01.793042  6475 raft_consensus.cc:2379] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 11: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:01.796317  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:33386 (request call id 581) took 2897 ms. Trace:
I20260812 19:24:01.796808  6482 rpcz_store.cc:276] 0812 19:23:58.892574 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.158719 (+2266145us) service_pool.cc:227] Handling call
0812 19:24:01.782265 (+623546us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b54004457d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f776fda7 00007f98fc6bbee0 00007f98f5db9784 00007f98f5db9712 00007f98f5db9641 00007f98f5db95bc 00007f98f5db8872 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:01.789068 (+  6803us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":78962560}
I20260812 19:24:01.802806  6359 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 13. Current term is 14. Ops: []
W20260812 19:24:01.804613  6178 connection.cc:232] RPC call timeout handler was delayed by -1.3807981400750577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
W20260812 19:24:01.805064  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2880981401540339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
I20260812 19:24:01.807915  6359 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:01.821583  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:01.822440  7593 raft_consensus.cc:3032] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:01.822932  7593 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:01.795991 13430 raft_consensus.cc:3032] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:24:01.852746  6229 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:01.850919  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:01.824107 13719 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:01.783824 13686 consensus_queue.cc:1046] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260812 19:24:01.871419 13598 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:01.881904 13598 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:01.882155 13854 raft_consensus.cc:3032] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:01.882323 13598 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:01.843420  7593 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:01.884101  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:01.905360  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:01.619292 13618 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:01.825135 13821 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:01.870453  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:01.848376 13430 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:01.852222 13581 raft_consensus.cc:686] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:01.937346  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:01.871176 13828 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:01.930431  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:01.882599 13854 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:01.878883 13570 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
W20260812 19:24:02.040205  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 369600us
I20260812 19:24:02.041675  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:01.936856 13151 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
W20260812 19:24:02.057871  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 127522us
I20260812 19:24:02.059203  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:01.886075 13459 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
W20260812 19:24:01.931241  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 125531us
I20260812 19:24:01.946552  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:01.946023 13573 consensus_queue.cc:1046] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.139s
I20260812 19:24:02.306790  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:02.312534  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 270941us
I20260812 19:24:02.314112  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:01.936522 13658 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:02.077704 13859 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:02.436311 13859 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:02.436950 13859 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:01.870853 13858 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.333s
I20260812 19:24:02.311417 13151 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:02.327965 13682 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260812 19:24:02.541980  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 227912us
I20260812 19:24:02.550014  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:02.555477  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:02.563421  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 504310us
I20260812 19:24:02.309407 12906 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.181s
W20260812 19:24:02.467908 13808 consensus_meta.cc:287] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.951s	user 0.008s	sys 0.006s
W20260812 19:24:02.601874  6238 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2118) took 3903 ms (client timeout 1894 ms). Trace:
W20260812 19:24:02.602357  6238 rpcz_store.cc:269] 0812 19:23:58.698019 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:02.601600 (+3903581us) service_pool.cc:214] Skipping call since client already timed out
0812 19:24:02.601779 (+   179us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260812 19:24:02.382732 13860 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:02.568279 13519 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:24:02.587692 13858 consensus_queue.cc:1225] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:24:02.601579 13453 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260812 19:24:02.626947  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 145093us
W20260812 19:24:02.662971  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 98354.7us
I20260812 19:24:02.610605 13682 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:02.673967  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:02.334479 13430 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:02.383467 13581 consensus_queue.cc:237] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:02.636204 13821 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:02.321784 13854 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:02.398855 13828 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:02.672140 13789 consensus_queue.cc:1046] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:24:02.666980 13519 raft_consensus.cc:686] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:02.684319 13682 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:02.699873 13683 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.000s	sys 0.015s
I20260812 19:24:02.606424 13808 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:02.694820 13453 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:02.683146 13858 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260812 19:24:02.722009 13683 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.000s	sys 0.015s
I20260812 19:24:02.645643 13860 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:02.719128 13682 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:02.723515 13453 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:02.735111 13858 consensus_queue.cc:1225] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer bdfa5579d4534c618c00db6b4a841c81 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260812 19:24:02.742280 13857 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.679s	user 0.000s	sys 0.002s
I20260812 19:24:02.694929 13151 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:02.906944  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.005s	sys 0.009s
I20260812 19:24:02.761065 13453 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:24:02.907656  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.005s	sys 0.009s
W20260812 19:24:02.908212  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 761056us
W20260812 19:24:02.778858 13562 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.066s	sys 0.111s
I20260812 19:24:02.892578  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 609) took 2182 ms. Trace:
W20260812 19:24:02.934995 13562 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.066s	sys 0.112s
I20260812 19:24:02.935379 13863 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:02.699380  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:02.894798  6353 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:24:02.900691  7551 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.002s	sys 0.009s
W20260812 19:24:02.873956  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 158703us
W20260812 19:24:02.797281 13833 consensus_meta.cc:287] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 1.051s	user 0.010s	sys 0.005s
W20260812 19:24:02.760845 13835 consensus_meta.cc:287] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.216s	user 0.001s	sys 0.014s
I20260812 19:24:02.975481 13835 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:02.977557  6224 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260812 19:24:02.781544 13852 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.028s	user 0.009s	sys 0.006s
I20260812 19:24:02.828403 13860 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:02.774679 13876 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.392s	user 0.002s	sys 0.000s
I20260812 19:24:02.824186 13890 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260812 19:24:02.931159 13808 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:02.933017 13894 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:02.984244 13894 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:02.936239 13895 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260812 19:24:02.988709 13564 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:02.948988 13858 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:02.991045 13858 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:02.992765 13894 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:02.839260 13859 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.002086 13859 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:03.003156 13153 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:03.004222 13153 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.006309  7594 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 6.
W20260812 19:24:03.008513  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 309050us
W20260812 19:24:02.969195  7551 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.002s	sys 0.009s
I20260812 19:24:02.936460 13863 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:02.934872  6342 rpcz_store.cc:276] 0812 19:24:00.710217 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.191318 (+481101us) service_pool.cc:227] Handling call
0812 19:24:01.191801 (+   483us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:01.224882 (+ 33081us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:24:01.468038 (+243156us) log.cc:842] Serialized 14 byte log entry
0812 19:24:01.757123 (+289085us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:01.784705 (+ 27582us) log.cc:842] Serialized 26 byte log entry
0812 19:24:01.784856 (+   151us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:01.784887 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:01.784954 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:02.891585 (+1106631us) raft_consensus.cc:1671] finished
0812 19:24:02.891727 (+   142us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:02.892271 (+   544us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":32483,"prepare.queue_time_us":276913,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":33161,"raft.run_cpu_time_us":441,"raft.run_wall_time_us":61900,"thread_start_us":469950,"threads_started":2,"wal-append.queue_time_us":397677}
I20260812 19:24:02.784979 13519 consensus_queue.cc:237] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:03.039156 13852 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:24:03.039786 13852 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:03.040259 13852 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:24:03.047626 13858 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:03.052688  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:03.054044  6344 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:03.055305 13682 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.057420  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1954) took 2389 ms. Trace:
I20260812 19:24:03.060815 13863 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:03.060883  6347 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2138) took 3286 ms (client timeout 2759 ms). Trace:
I20260812 19:24:03.055326 13808 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:03.063802  6354 raft_consensus.cc:3032] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:03.064363  6354 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:03.067020 13835 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:03.047884  7603 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 8. Current term is 9. Ops: []
I20260812 19:24:03.063804 13808 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:03.070259 13808 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:03.072304 13682 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:03.075063 13670 consensus_meta.cc:287] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.314s	user 0.009s	sys 0.013s
I20260812 19:24:03.066404 13581 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:03.078845  6172 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.003s	sys 0.007s
W20260812 19:24:03.079331  6172 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.004s	sys 0.008s
I20260812 19:24:03.078181 13581 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:03.080749 13505 consensus_meta.cc:287] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 1.297s	user 0.015s	sys 0.004s
I20260812 19:24:03.081911  7600 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:03.083914 13896 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:03.084416 13153 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:03.084957 13896 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:03.085695  7593 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:24:03.086994  6474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1899) took 3414 ms (client timeout 2711 ms). Trace:
W20260812 19:24:03.087584  6474 rpcz_store.cc:269] 0812 19:23:59.672105 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.961764 (+1289659us) service_pool.cc:227] Handling call
0812 19:24:03.082413 (+2120649us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b5400000d54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:03.086625 (+  4212us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":571024768}
W20260812 19:24:03.037297  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47124.7us
I20260812 19:24:03.106211  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:03.107400  7593 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
W20260812 19:24:03.061586  6347 rpcz_store.cc:269] 0812 19:23:59.774705 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:00.740594 (+965889us) service_pool.cc:227] Handling call
0812 19:24:03.060397 (+2319803us) spinlock_profiling.cc:243] Waited 6.62 ms on lock 0x7b5400028854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:03.060623 (+   226us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":15231872}
I20260812 19:24:03.083564 13581 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:03.108263  7593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 513) took 1308 ms. Trace:
I20260812 19:24:03.065963  6354 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.058032  6345 rpcz_store.cc:276] 0812 19:24:00.668210 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.160745 (+492535us) service_pool.cc:227] Handling call
0812 19:24:01.161151 (+   406us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:01.345237 (+184086us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.056593 (+1711356us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54001ccad4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:03.057140 (+   547us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":365921024}
I20260812 19:24:03.110111  6344 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:03.108369  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1969) took 1042 ms. Trace:
I20260812 19:24:03.106261  6474 raft_consensus.cc:1226] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:03.113739  6342 rpcz_store.cc:276] 0812 19:24:02.065638 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.099630 (+1033992us) service_pool.cc:227] Handling call
0812 19:24:03.108233 (+  8603us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.114427  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 587) took 3799 ms. Trace:
I20260812 19:24:03.114984  6474 rpcz_store.cc:276] 0812 19:23:59.315471 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.089010 (+3773539us) service_pool.cc:227] Handling call
0812 19:24:03.105895 (+ 16885us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.114025 (+  8130us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.114307 (+   282us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.116477  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:03.118126  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1960) took 1248 ms. Trace:
I20260812 19:24:03.118824  6342 rpcz_store.cc:276] 0812 19:24:01.869339 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.114992 (+1245653us) service_pool.cc:227] Handling call
0812 19:24:03.117999 (+  3007us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.119513  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1882) took 3706 ms. Trace:
I20260812 19:24:03.120080  6474 rpcz_store.cc:276] 0812 19:23:59.413391 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.117570 (+3704179us) service_pool.cc:227] Handling call
0812 19:24:03.118313 (+   743us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.118982 (+   669us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:03.119028 (+    46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:03.119117 (+    89us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:03.119167 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.119250 (+    83us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:03.119405 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.122885  6474 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260812 19:24:03.112342  7593 rpcz_store.cc:276] 0812 19:24:01.800213 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.800489 (+   276us) service_pool.cc:227] Handling call
0812 19:24:03.084433 (+1283944us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b54004c02a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f770640d 00007f98f76f4050 00007f98f7757aba 00007f98f776f3af 00007f98f7770b4e 00007f98f777c228 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1
0812 19:24:03.108137 (+ 23704us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":166350720}
I20260812 19:24:03.124092  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1883) took 3689 ms. Trace:
I20260812 19:24:03.124781  6474 rpcz_store.cc:276] 0812 19:23:59.435109 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.121398 (+3686289us) service_pool.cc:227] Handling call
0812 19:24:03.122119 (+   721us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.123629 (+  1510us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.124019 (+   390us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.128849  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:03.130053  6347 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:03.129959  6417 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:03.132997 12955 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:03.133868 12955 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:03.136019  6354 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:03.137101  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:03.138332 13670 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260812 19:24:03.141124  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.013s	sys 0.018s
W20260812 19:24:03.141697  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.013s	sys 0.019s
I20260812 19:24:03.153544  6344 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.156863  6344 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:03.157799 13771 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Stepping down as leader of term 11
W20260812 19:24:03.161567 13598 consensus_meta.cc:287] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.279s	user 0.018s	sys 0.007s
I20260812 19:24:03.162169 13598 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.165331 13598 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:03.158473 13771 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:03.196879  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:03.200863  6347 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:03.207135 13896 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:03.209873  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:03.209522 13771 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.210947  7593 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:03.211483 13771 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:24:03.212621  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 657199us
I20260812 19:24:03.214931  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:03.215499  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1877) took 3884 ms. Trace:
I20260812 19:24:03.204505  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1959) took 1332 ms. Trace:
I20260812 19:24:03.219345  6347 rpcz_store.cc:276] 0812 19:24:01.869055 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.128354 (+1259299us) service_pool.cc:227] Handling call
0812 19:24:03.201455 (+ 73101us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.221581  6342 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:03.222688  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1964) took 1344 ms. Trace:
W20260812 19:24:03.223265  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 86411.6us
I20260812 19:24:03.223536  6342 rpcz_store.cc:276] 0812 19:24:01.877982 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.179996 (+1302014us) service_pool.cc:227] Handling call
0812 19:24:03.222604 (+ 42608us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.222213  6417 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:03.214957  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:03.225258  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:03.218187 13453 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:03.215968  6477 rpcz_store.cc:276] 0812 19:23:59.307532 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.656923 (+2349391us) service_pool.cc:227] Handling call
0812 19:24:01.657312 (+   389us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:02.064132 (+406820us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:02.064182 (+    50us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:02.185550 (+121368us) log.cc:842] Serialized 52 byte log entry
0812 19:24:02.898381 (+712831us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:03.036014 (+137633us) log.cc:842] Serialized 14 byte log entry
0812 19:24:03.073616 (+ 37602us) log.cc:842] Serialized 14 byte log entry
0812 19:24:03.073948 (+   332us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.074172 (+   224us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:03.109580 (+ 35408us) raft_consensus.cc:1671] finished
0812 19:24:03.109608 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:03.191390 (+ 81782us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17596,"prepare.queue_time_us":180480,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":77,"raft.queue_time_us":37336,"raft.run_cpu_time_us":574,"raft.run_wall_time_us":44507,"thread_start_us":927068,"threads_started":3,"wal-append.queue_time_us":721905}
I20260812 19:24:03.218257 13682 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260812 19:24:03.232501  6238 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:03.224695 13896 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:03.232612 13606 consensus_queue.cc:1046] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260812 19:24:03.235095  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2144) took 1969 ms. Trace:
I20260812 19:24:03.238059  6354 rpcz_store.cc:276] 0812 19:24:01.265475 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.642827 (+377352us) service_pool.cc:227] Handling call
0812 19:24:01.643167 (+   340us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.063479 (+1420312us) spinlock_profiling.cc:243] Waited 9.96 ms on lock 0x7b54001b0e20. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7708730 00007f98f777a300 00007f98f777b371 00007f98f7777edf 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc
0812 19:24:03.230838 (+167359us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:03.230878 (+    40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:03.230924 (+    46us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:24:03.230958 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.234632 (+  3674us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:03.234999 (+   367us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1605,"spinlock_wait_cycles":22918400}
W20260812 19:24:03.239524 13446 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260812 19:24:03.232569 13807 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:03.240646 13611 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:03.240665  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 586) took 3929 ms. Trace:
I20260812 19:24:03.241242 13611 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:03.211565 12955 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:03.246797  6345 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:03.244887  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:03.247766 13598 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260812 19:24:03.248030  6483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2145) took 4380 ms (client timeout 1593 ms). Trace:
I20260812 19:24:03.248346  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:03.248553  6483 rpcz_store.cc:269] 0812 19:23:58.867260 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:58.933729 (+ 66469us) service_pool.cc:227] Handling call
0812 19:24:03.237069 (+4303340us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5400450e54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:03.247796 (+ 10727us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":483303296}
I20260812 19:24:03.252511  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:03.226747 13676 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.012s
I20260812 19:24:03.255579  6483 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:03.259598  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:53166 (request call id 289) took 3781 ms. Trace:
W20260812 19:24:03.259930  6179 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.796s (SENT) [suppressed 20 similar messages]
I20260812 19:24:03.260226 13657 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:03.260572  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:03.259040  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1900) took 3586 ms. Trace:
I20260812 19:24:03.260978  6242 rpcz_store.cc:276] 0812 19:23:59.454523 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:59.535857 (+ 81334us) service_pool.cc:227] Handling call
0812 19:24:03.233069 (+3697212us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400120cd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fdaf0 00007f98f7780f2a 00007f98fc6bdc6e 00007f98f5dc0807 00007f98f5dc0792 00007f98f5dc06c1 00007f98f5dc063c 00007f98f5dbf8f2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:03.235536 (+  2467us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2553927936}
I20260812 19:24:03.262269  6483 rpcz_store.cc:276] 0812 19:23:59.672557 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.249739 (+3577182us) service_pool.cc:227] Handling call
0812 19:24:03.250230 (+   491us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.257509 (+  7279us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.258554 (+  1045us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.267069 13657 raft_consensus.cc:686] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:03.268790  6347 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:03.257063 13807 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:03.272938  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1957) took 1401 ms. Trace:
I20260812 19:24:03.273342  6347 rpcz_store.cc:276] 0812 19:24:01.868423 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.225385 (+1356962us) service_pool.cc:227] Handling call
0812 19:24:03.253884 (+ 28499us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.269976 (+ 16092us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.270229 (+   253us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.275235 13219 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:03.280229  6474 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260812 19:24:03.280692  6474 pending_rounds.cc:76] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 5
I20260812 19:24:03.282032  6474 pending_rounds.cc:97] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260812 19:24:03.282348  6474 raft_consensus.cc:2866] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:03.269722 13657 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:03.286580 13748 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:03.287366 13748 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:03.282785 13719 consensus_meta.cc:287] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.395s	user 0.005s	sys 0.020s
I20260812 19:24:03.242584 13611 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:03.288009 13852 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:03.290562 13459 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:03.296446  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.297722  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1886) took 3845 ms. Trace:
W20260812 19:24:03.298844 13848 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260812 19:24:03.302053 13459 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.303879  6359 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:03.305244 13617 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:03.305090 13750 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:24:03.306202  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:24:03.307274  6475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2169) took 1755 ms (client timeout 2015 ms). Trace:
W20260812 19:24:03.307655  6475 rpcz_store.cc:269] 0812 19:24:01.551850 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.578443 (+ 26593us) service_pool.cc:227] Handling call
0812 19:24:03.306823 (+1728380us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400022e54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:03.307079 (+   256us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":472723200}
I20260812 19:24:03.311764  6470 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:03.312610  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2153) took 2247 ms. Trace:
I20260812 19:24:03.313014  6470 rpcz_store.cc:276] 0812 19:24:01.064877 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.310523 (+2245646us) service_pool.cc:227] Handling call
0812 19:24:03.311172 (+   649us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.312316 (+  1144us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.312542 (+   226us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:24:03.313542  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 61177.3us
W20260812 19:24:03.315425 13918 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260812 19:24:03.315642  6464 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:03.317777 13618 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:03.318048 13611 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:03.319509 13196 raft_consensus.cc:3032] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:24:03.319785 13620 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:03.319998 13196 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:03.306263  6481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2141) took 4488 ms (client timeout 2229 ms). Trace:
I20260812 19:24:03.300634  6474 rpcz_store.cc:276] 0812 19:23:59.451911 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.195760 (+3743849us) service_pool.cc:227] Handling call
0812 19:24:03.244154 (+ 48394us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.297363 (+ 53209us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.297619 (+   256us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.320668 13620 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.321305 13196 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.322477  6474 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:03.323137  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2157) took 2238 ms. Trace:
I20260812 19:24:03.323407 13667 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:03.300438  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.323612  6474 rpcz_store.cc:276] 0812 19:24:01.084781 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.321692 (+2236911us) service_pool.cc:227] Handling call
0812 19:24:03.322140 (+   448us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.322871 (+   731us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.323063 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:24:03.320995  6481 rpcz_store.cc:269] 0812 19:23:58.817722 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:59.994365 (+1176643us) service_pool.cc:227] Handling call
0812 19:24:03.305733 (+3311368us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b5400213ed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:03.305954 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11243264}
W20260812 19:24:03.327242  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 138050us
I20260812 19:24:03.328352  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:03.328990 13394 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:03.329937  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:03.331133 13682 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:24:03.333154 13439 raft_consensus.cc:3032] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:03.333662 13439 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:03.335829 13458 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:03.337632 13620 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:03.339396  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:03.342541  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:03.343434 13617 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:24:03.343662  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:03.344334 13394 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:03.351101 13394 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:03.351755  6465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2160) took 2181 ms (client timeout 1741 ms). Trace:
I20260812 19:24:03.352644 13394 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.353572 13748 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:03.320086  6475 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:24:03.355237  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:03.356168  7599 raft_consensus.cc:2379] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 11: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:03.355823 13439 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:03.301028  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 588) took 3677 ms. Trace:
I20260812 19:24:03.357163 13439 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:03.357021  6477 rpcz_store.cc:276] 0812 19:23:59.615255 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.245159 (+3629904us) service_pool.cc:227] Handling call
0812 19:24:03.272317 (+ 27158us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.280758 (+  8441us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:03.280784 (+    26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:03.283659 (+  2875us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:03.292230 (+  8571us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.292317 (+    87us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:03.292425 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:24:03.346176  6353 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2146) took 2072 ms (client timeout 1906 ms). Trace:
I20260812 19:24:03.358718  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 590) took 2441 ms. Trace:
I20260812 19:24:03.359416  6475 rpcz_store.cc:276] 0812 19:24:00.917484 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.308751 (+2391267us) service_pool.cc:227] Handling call
0812 19:24:03.309442 (+   691us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.354427 (+ 44985us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.358633 (+  4206us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.344642 13617 raft_consensus.cc:686] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:03.358752  6353 rpcz_store.cc:269] 0812 19:24:01.273519 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.393676 (+120157us) service_pool.cc:227] Handling call
0812 19:24:03.345805 (+1952129us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540036e054. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:03.346041 (+   236us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3251631488}
I20260812 19:24:03.362172 13617 consensus_queue.cc:237] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.363600  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:03.364778  7600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60760 (request call id 552) took 1627 ms (client timeout 1796 ms). Trace:
I20260812 19:24:03.365018  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:03.365229  7600 rpcz_store.cc:269] 0812 19:24:01.737442 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.737577 (+   135us) service_pool.cc:227] Handling call
0812 19:24:03.364566 (+1626989us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54004d21d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:03.364700 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3088497408}
I20260812 19:24:03.329932 13848 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:03.359843  6477 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:03.346642  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:03.353610  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 523) took 4054 ms. Trace:
I20260812 19:24:03.367415  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1958) took 1426 ms. Trace:
I20260812 19:24:03.366719  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1873) took 4061 ms. Trace:
W20260812 19:24:03.347488 13919 log.cc:924] Time spent T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260812 19:24:03.369675  6344 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260812 19:24:03.368782 13616 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260812 19:24:03.352330  6465 rpcz_store.cc:269] 0812 19:24:01.170450 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.229189 (+ 58739us) service_pool.cc:227] Handling call
0812 19:24:03.351155 (+2121966us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b5400213754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:03.351482 (+   327us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1044569472}
I20260812 19:24:03.371152  6464 rpcz_store.cc:276] 0812 19:23:59.305410 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.644164 (+2338754us) service_pool.cc:227] Handling call
0812 19:24:03.315028 (+1670864us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.316331 (+  1303us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.318553 (+  2222us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400022e50. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:03.366638 (+ 48085us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3828742912}
I20260812 19:24:03.350482 13459 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:03.361577  6475 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:03.370684  6236 rpcz_store.cc:276] 0812 19:23:59.298984 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:59.433733 (+134749us) service_pool.cc:227] Handling call
0812 19:23:59.453660 (+ 19927us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:00.700220 (+1246560us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.353046 (+2652826us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540013ea54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:03.353408 (+   362us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2820159232}
I20260812 19:24:03.374089  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2165) took 1943 ms. Trace:
I20260812 19:24:03.384299  6477 rpcz_store.cc:276] 0812 19:24:01.430808 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.359058 (+1928250us) service_pool.cc:227] Handling call
0812 19:24:03.359532 (+   474us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.373835 (+ 14303us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.374032 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.384985  6470 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260812 19:24:03.374677  6344 pending_rounds.cc:76] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 5
I20260812 19:24:03.370889  6342 rpcz_store.cc:276] 0812 19:24:01.868742 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.230581 (+1361839us) service_pool.cc:227] Handling call
0812 19:24:03.266397 (+ 35816us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.291103 (+ 24706us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:03.291125 (+    22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:03.294299 (+  3174us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:03.294356 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.294439 (+    83us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:03.294582 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.368829 13196 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:03.387291  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2166) took 1902 ms. Trace:
I20260812 19:24:03.344683 13453 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:03.389364  6483 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260812 19:24:03.391294  6344 pending_rounds.cc:97] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260812 19:24:03.389258  6475 rpcz_store.cc:276] 0812 19:24:01.485324 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.360862 (+1875538us) service_pool.cc:227] Handling call
0812 19:24:03.361314 (+   452us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.386957 (+ 25643us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.387224 (+   267us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.370455 13848 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:03.382812  6474 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260812 19:24:03.392359  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1901) took 3719 ms. Trace:
I20260812 19:24:03.392889  6483 rpcz_store.cc:276] 0812 19:23:59.673145 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.266759 (+3593614us) service_pool.cc:227] Handling call
0812 19:24:03.291122 (+ 24363us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.392133 (+101011us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.392315 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.393468  6344 raft_consensus.cc:2866] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:03.395033  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2164) took 2051 ms. Trace:
I20260812 19:24:03.395576  6474 rpcz_store.cc:276] 0812 19:24:01.343500 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.327456 (+1983956us) service_pool.cc:227] Handling call
0812 19:24:03.328001 (+   545us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:03.394643 (+ 66642us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.394962 (+   319us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:24:03.390679  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 130871us
I20260812 19:24:03.377758 13771 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:03.401692  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:03.411854 13667 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:24:03.412642 13667 raft_consensus.cc:686] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:03.416349 13851 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260812 19:24:03.416832  6359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1970) took 1309 ms (client timeout 1643 ms). Trace:
W20260812 19:24:03.417292  6359 rpcz_store.cc:269] 0812 19:24:02.107985 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:02.306386 (+198401us) service_pool.cc:227] Handling call
0812 19:24:03.416621 (+1110235us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b54004114d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:03.416769 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2290455936}
I20260812 19:24:03.418852 13628 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:03.423062 13708 consensus_queue.cc:1046] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:03.424316 13852 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:03.426483 13922 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260812 19:24:03.397090 13848 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:03.429800  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1947) took 4430 ms. Trace:
I20260812 19:24:03.435734  6347 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:03.424556 13708 raft_consensus.cc:3032] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:24:03.451838  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1967) took 1488 ms. Trace:
I20260812 19:24:03.452378  6347 rpcz_store.cc:276] 0812 19:24:01.955195 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.280554 (+1325359us) service_pool.cc:227] Handling call
0812 19:24:03.368237 (+ 87683us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.436277 (+ 68040us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.436532 (+   255us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.454061  6347 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 6. Current term is 7. Ops: []
I20260812 19:24:03.451609  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2145) took 2183 ms. Trace:
I20260812 19:24:03.430218  6349 rpcz_store.cc:276] 0812 19:23:58.999618 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:59.246555 (+246937us) service_pool.cc:227] Handling call
0812 19:24:01.029958 (+1783403us) spinlock_profiling.cc:243] Waited 908 us on lock 0x7b5800004598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824bce 000000000034aea9 00007f98fc644a30 00007f98fc70a7b4 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:24:03.066867 (+2036909us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:03.067963 (+  1096us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:24:03.068006 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:03.068774 (+   768us) log.cc:842] Serialized 26 byte log entry
0812 19:24:03.176800 (+108026us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:03.176859 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.177126 (+   267us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:03.317135 (+140009us) raft_consensus.cc:1671] finished
0812 19:24:03.317156 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:03.429464 (+112308us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b5400028850. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:03.429595 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2190,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":306,"spinlock_wait_cycles":4681743488,"thread_start_us":107369,"threads_started":1,"wal-append.queue_time_us":161245}
I20260812 19:24:03.460225  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 593) took 1664 ms. Trace:
I20260812 19:24:03.457942  6344 rpcz_store.cc:276] 0812 19:24:01.267813 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.697952 (+430139us) service_pool.cc:227] Handling call
0812 19:24:01.698324 (+   372us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.053655 (+1355331us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b5400195120. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7708730 00007f98f777a300 00007f98f777b371 00007f98f7777edf 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc
0812 19:24:03.402736 (+349081us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.451539 (+ 48803us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":171481472}
I20260812 19:24:03.464159  6345 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:03.460800  6475 rpcz_store.cc:276] 0812 19:24:01.796396 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.397807 (+1601411us) service_pool.cc:227] Handling call
0812 19:24:03.431161 (+ 33354us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.459909 (+ 28748us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:03.459938 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:03.459980 (+    42us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:03.460007 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.460064 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:03.460175 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.468150  6475 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260812 19:24:03.468304 13886 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.648s	user 0.003s	sys 0.001s
W20260812 19:24:03.469941  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 126425us
W20260812 19:24:03.438274  6179 leader_election.cc:334] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Timed out: RequestConsensusVote RPC to 127.3.253.4:35891 timed out after 1.803s (SENT)
I20260812 19:24:03.472941  6464 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:03.473644  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2172) took 1866 ms. Trace:
I20260812 19:24:03.474248  6349 raft_consensus.cc:3032] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:24:03.471871  6179 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:03.475049  6349 raft_consensus.cc:729] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:03.473955  6464 rpcz_store.cc:276] 0812 19:24:01.607687 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.391954 (+1784267us) service_pool.cc:227] Handling call
0812 19:24:03.472626 (+ 80672us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.473439 (+   813us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.473595 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.477293  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 1962) took 1595 ms. Trace:
I20260812 19:24:03.477802  6345 rpcz_store.cc:276] 0812 19:24:01.869991 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.192551 (+1322560us) service_pool.cc:227] Handling call
0812 19:24:03.464961 (+272410us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.479350  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:03.413897 13667 consensus_queue.cc:237] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:03.439364 13708 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:03.489966 13666 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:24:03.491808  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 528) took 2118 ms. Trace:
I20260812 19:24:03.492237  6228 rpcz_store.cc:276] 0812 19:24:01.373416 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.373901 (+   485us) service_pool.cc:227] Handling call
0812 19:24:01.432895 (+ 58994us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:01.482295 (+ 49400us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:01.482329 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:01.482374 (+    45us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:01.482412 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.487241 (+2004829us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b54002f9c54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:03.491446 (+  4205us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:03.491629 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":113085184}
I20260812 19:24:03.493573 13851 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:03.494299  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 594) took 1649 ms. Trace:
I20260812 19:24:03.494676  6483 rpcz_store.cc:276] 0812 19:24:01.844761 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.399104 (+1554343us) service_pool.cc:227] Handling call
0812 19:24:03.479160 (+ 80056us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.493938 (+ 14778us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:03.493969 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:03.494037 (+    68us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:03.494062 (+    25us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.494119 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:03.494241 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:03.496354  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 592) took 1766 ms. Trace:
W20260812 19:24:03.496461  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 131609us
I20260812 19:24:03.496728  6477 rpcz_store.cc:276] 0812 19:24:01.730504 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.385417 (+1654913us) service_pool.cc:227] Handling call
0812 19:24:03.437910 (+ 52493us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.496028 (+ 58118us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:03.496062 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:03.496103 (+    41us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:03.496134 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.496191 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:03.496303 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:24:03.503870  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 189320us
I20260812 19:24:03.502786 13708 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:03.505511  7594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60760 (request call id 555) took 1730 ms (client timeout 1803 ms). Trace:
W20260812 19:24:03.505977  7594 rpcz_store.cc:269] 0812 19:24:01.775059 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.786257 (+ 11198us) service_pool.cc:227] Handling call
0812 19:24:03.505289 (+1719032us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400229cd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:03.505448 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2801505152}
I20260812 19:24:03.508235  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:03.511059 13666 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:03.511268  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:03.512868  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1878) took 4204 ms. Trace:
I20260812 19:24:03.512923  7594 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260812 19:24:03.515267  6342 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:03.518383  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1968) took 1473 ms. Trace:
I20260812 19:24:03.513259  6482 rpcz_store.cc:276] 0812 19:23:59.307855 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.833217 (+2525362us) service_pool.cc:227] Handling call
0812 19:24:03.319204 (+1485987us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:03.333392 (+ 14188us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:24:03.333778 (+   386us) log.cc:842] Serialized 14 byte log entry
0812 19:24:03.406719 (+ 72941us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:03.415767 (+  9048us) log.cc:842] Serialized 26 byte log entry
0812 19:24:03.415898 (+   131us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:24:03.415926 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.415986 (+    60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:03.470427 (+ 54441us) raft_consensus.cc:1671] finished
0812 19:24:03.470439 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:03.512565 (+ 42126us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400213ed0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:03.512689 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28742,"prepare.queue_time_us":929,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":61,"raft.queue_time_us":31278,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":223,"spinlock_wait_cycles":3416343168,"thread_start_us":58768,"threads_started":1,"wal-append.queue_time_us":133095}
I20260812 19:24:03.516916  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1971) took 1370 ms. Trace:
I20260812 19:24:03.519723 13854 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:03.506047 13708 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:03.522643  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:03.523767  7594 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260812 19:24:03.525539 12972 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:24:03.526077  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:03.494204 13851 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.528270 13850 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:03.522511  6349 consensus_queue.cc:260] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:03.529929 13748 consensus_queue.cc:1046] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:03.481245 13808 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.521253  6359 rpcz_store.cc:276] 0812 19:24:02.146612 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.418185 (+1271573us) service_pool.cc:227] Handling call
0812 19:24:03.418639 (+   454us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.419009 (+   370us) raft_consensus.cc:1520] Early marking committed up to index 7
0812 19:24:03.435073 (+ 16064us) log.cc:842] Serialized 14 byte log entry
0812 19:24:03.516569 (+ 81496us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:03.516627 (+    58us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:03.516671 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.516751 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:03.516858 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27580,"prepare.queue_time_us":9300,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":40135,"spinlock_wait_cycles":2946432,"thread_start_us":41173,"threads_started":1}
I20260812 19:24:03.538751 13822 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:03.539444 13822 raft_consensus.cc:686] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:03.540786 13822 consensus_queue.cc:237] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.544533  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 530) took 1994 ms. Trace:
I20260812 19:24:03.520653  6353 rpcz_store.cc:276] 0812 19:24:02.044689 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.364954 (+1320265us) service_pool.cc:227] Handling call
0812 19:24:03.365369 (+   415us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.365693 (+   324us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:24:03.370454 (+  4761us) log.cc:842] Serialized 14 byte log entry
0812 19:24:03.501676 (+131222us) log.cc:842] Serialized 14 byte log entry
0812 19:24:03.517756 (+ 16080us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:03.517827 (+    71us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:03.517887 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.518012 (+   125us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:03.518331 (+   319us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14810,"prepare.queue_time_us":2449,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":21798,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":124,"thread_start_us":96806,"threads_started":1}
W20260812 19:24:03.546121  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 145406us
I20260812 19:24:03.545047  6224 rpcz_store.cc:276] 0812 19:24:01.549810 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.550207 (+   397us) service_pool.cc:227] Handling call
0812 19:24:01.550614 (+   407us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:02.978154 (+1427540us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.544168 (+566014us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400005354. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:03.544430 (+   262us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3279867648}
I20260812 19:24:03.553282 13852 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:03.557761  6345 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:03.557964 13893 raft_consensus.cc:3032] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:24:03.561455  6349 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:03.532816 13850 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:03.562556  6354 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:03.561177 13893 raft_consensus.cc:729] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:03.565589 13808 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:03.565387 13893 consensus_queue.cc:260] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:03.566267 12972 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:03.565899  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:03.568568 13611 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.003s
I20260812 19:24:03.573711 13835 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:03.568554 13658 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260812 19:24:03.575615  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2155) took 2495 ms. Trace:
I20260812 19:24:03.576087  6470 rpcz_store.cc:276] 0812 19:24:01.080659 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.314042 (+2233383us) service_pool.cc:227] Handling call
0812 19:24:03.367173 (+ 53131us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:03.385441 (+ 18268us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.575322 (+189881us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b54003ef3d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:03.575539 (+   217us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":40199936}
W20260812 19:24:03.629240  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 63433.4us
I20260812 19:24:03.633103  6465 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:24:03.568842 12972 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:03.635782  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:03.642767 13893 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:24:03.574507 13835 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.730954  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:03.731418  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 205477us
I20260812 19:24:03.731889 13835 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:03.732112  6470 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:03.637888 13657 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:03.732519  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:03.732877 13657 raft_consensus.cc:686] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:03.712694  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 77006.8us
I20260812 19:24:03.733860  6224 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:24:03.734078 13657 consensus_queue.cc:237] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.651721 13850 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.741389  6349 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260812 19:24:03.746374 13900 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:03.748932  7606 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260812 19:24:03.751327 13617 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:24:03.753422 13722 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:03.753803 13858 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:03.753940 13722 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:03.755412 13848 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.755967  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:03.757467 13858 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:03.758103 13858 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:03.758157  7599 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260812 19:24:03.755250 13722 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:03.764349  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 1e69ce57e6c74dea9e207b6ae03c43b2, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:03.764742  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 1e69ce57e6c74dea9e207b6ae03c43b2, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.766402 13858 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.749147 13430 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:03.241441  6473 rpcz_store.cc:276] 0812 19:23:59.311189 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.076405 (+3765216us) service_pool.cc:227] Handling call
0812 19:24:03.077179 (+   774us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.077751 (+   572us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:24:03.078315 (+   564us) log.cc:842] Serialized 14 byte log entry
0812 19:24:03.237193 (+158878us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:03.237286 (+    93us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:03.237335 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.237426 (+    91us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:03.237898 (+   472us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":28392,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":6894,"thread_start_us":151148,"threads_started":1}
I20260812 19:24:03.766641  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:03.774048  6352 raft_consensus.cc:595] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:03.774498  6352 raft_consensus.cc:603] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:03.769462 12906 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260812 19:24:03.775347 13801 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:03.775920 13801 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.771263  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 1963) took 1901 ms. Trace:
I20260812 19:24:03.776786  6354 rpcz_store.cc:276] 0812 19:24:01.870300 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.239313 (+1369013us) service_pool.cc:227] Handling call
0812 19:24:03.239782 (+   469us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.568753 (+328971us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.770936 (+202183us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b540025f654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:03.771159 (+   223us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":738276736}
I20260812 19:24:03.779428 13196 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:24:03.782053  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49464 (request call id 68) took 4329 ms. Trace:
I20260812 19:24:03.782612  6352 rpcz_store.cc:276] 0812 19:23:59.452573 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:59.452711 (+   138us) service_pool.cc:227] Handling call
0812 19:24:03.781808 (+4329097us) spinlock_profiling.cc:243] Waited 4.3 s on lock 0x7b54004092d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7772bc3 00007f98fc6bc81a 00007f98f5dbbd04 00007f98f5dbbc92 00007f98f5dbbbc1 00007f98f5dbbb3c 00007f98f5dbadf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:03.781966 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9892028672}
I20260812 19:24:03.788543  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:24:03.758208 13848 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:03.808485 13850 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:03.811401 13851 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:03.812659  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:03.813478  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:03.813871  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:03.814237  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:03.814330  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:03.815955  6475 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:24:03.827445  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 71753.4us
I20260812 19:24:03.828326 12972 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.828567 13472 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:03.830152 13933 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.267s	user 0.000s	sys 0.000s
I20260812 19:24:03.835692  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:03.836063  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:03.863669  6477 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:03.863881  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:03.864349  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:03.837347  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:03.865368  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:03.865720  6482 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:03.866878  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2158) took 2765 ms. Trace:
I20260812 19:24:03.850668 13852 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:03.867146  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:03.867851 13852 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:03.837625  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:03.837682  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:03.842381 13722 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:03.844460  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 591) took 2232 ms. Trace:
I20260812 19:24:03.873605  6465 rpcz_store.cc:276] 0812 19:24:01.612119 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.387524 (+1775405us) service_pool.cc:227] Handling call
0812 19:24:03.425411 (+ 37887us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.633665 (+208254us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.844095 (+210430us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54003a8c54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:03.844359 (+   264us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":477138688}
I20260812 19:24:03.845754 13801 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:03.854357  6474 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:24:03.875505  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:03.872392  6473 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:03.881282  7599 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260812 19:24:03.884963  6349 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:24:03.875103  6235 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:03.867580  6481 rpcz_store.cc:276] 0812 19:24:01.101302 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.325737 (+2224435us) service_pool.cc:227] Handling call
0812 19:24:03.326239 (+   502us) raft_consensus.cc:1457] Updating replica for 3 ops
0812 19:24:03.336279 (+ 10040us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:24:03.337766 (+  1487us) log.cc:842] Serialized 14 byte log entry
0812 19:24:03.397279 (+ 59513us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0812 19:24:03.412159 (+ 14880us) log.cc:842] Serialized 78 byte log entry
0812 19:24:03.412359 (+   200us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:24:03.413055 (+   696us) log.cc:842] Serialized 14 byte log entry
0812 19:24:03.413507 (+   452us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.413582 (+    75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:03.866583 (+453001us) raft_consensus.cc:1671] finished
0812 19:24:03.866613 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:03.866788 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17357,"prepare.queue_time_us":1057,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":29935,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":298,"thread_start_us":50940,"threads_started":1,"wal-append.queue_time_us":179784}
I20260812 19:24:03.905423 13616 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:03.906394 13572 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260812 19:24:03.908885  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 71445.2us
W20260812 19:24:03.910702 13939 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.159s	user 0.002s	sys 0.000s
I20260812 19:24:03.911355 13801 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:24:03.912762 13801 raft_consensus.cc:3032] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:03.913182 13801 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:03.914866 13735 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:03.914806 13801 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.915831 13735 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:03.916683  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:24:03.856320  6178 connection.cc:232] RPC call timeout handler was delayed by -1.6944747439119965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
I20260812 19:24:03.924777 13616 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:03.928316 13616 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:03.928706 13616 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:03.934974 13801 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:24:03.935485 13946 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.185s	user 0.004s	sys 0.000s
I20260812 19:24:03.939153  6353 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14. Ops: []
W20260812 19:24:03.931357  6178 connection.cc:232] RPC call timeout handler was delayed by -1.6323747439309955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260812 19:24:03.947105  6178 connection.cc:232] RPC call timeout handler was delayed by -1.5909747439436615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
W20260812 19:24:03.948422  6178 connection.cc:232] RPC call timeout handler was delayed by -1.5441747438162565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
I20260812 19:24:03.950596  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260812 19:24:03.962870  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 46384.2us
I20260812 19:24:03.898351 13472 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:03.989939  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:03.994740  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:03.977137 13854 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:03.998159  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:04.002671 13603 consensus_queue.cc:1046] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260812 19:24:04.005661 13472 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:04.006882 13446 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260812 19:24:04.009979  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2354747438803315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
I20260812 19:24:04.022399  6482 raft_consensus.cc:2396] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260812 19:24:04.018596 13851 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:04.031931  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:24:04.034590  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 55680.1us
I20260812 19:24:04.035845 13848 consensus_queue.cc:1046] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:04.039506  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:04.041074  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:03.986672 13900 consensus_queue.cc:1046] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260812 19:24:04.053184 13472 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:04.053800 13472 raft_consensus.cc:686] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:04.055244  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.055588  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.056068  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2151) took 2727 ms. Trace:
I20260812 19:24:04.054925 13472 consensus_queue.cc:237] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:04.056476  6350 rpcz_store.cc:276] 0812 19:24:01.324420 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.747275 (+422855us) service_pool.cc:227] Handling call
0812 19:24:01.747596 (+   321us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.773658 (+2026062us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:24:03.773709 (+    51us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:03.773761 (+    52us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:03.773808 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:04.049449 (+275641us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54004092d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:04.049516 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:04.051620 (+  2104us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":157214,"raft.queue_time_us":168276,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":148,"spinlock_wait_cycles":4187973888}
I20260812 19:24:04.068012  6474 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:04.074128 13848 raft_consensus.cc:3032] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:04.074640 13848 raft_consensus.cc:729] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:04.077203  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.078572  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.084146  6465 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:04.059511 13603 consensus_queue.cc:1225] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer bdfa5579d4534c618c00db6b4a841c81 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260812 19:24:04.091040 13629 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260812 19:24:04.021098 13854 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:04.059278 13827 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:04.115391  7603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 559) took 2178 ms. Trace:
I20260812 19:24:04.122057 13735 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:04.122776 12906 consensus_queue.cc:1046] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:04.127113 13848 consensus_queue.cc:260] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:04.128674 13848 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:24:04.133811 13947 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.382s	user 0.003s	sys 0.000s
I20260812 19:24:04.112272  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:04.115854  7603 rpcz_store.cc:276] 0812 19:24:01.936814 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:01.944673 (+  7859us) service_pool.cc:227] Handling call
0812 19:24:01.945047 (+   374us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:03.069335 (+1124288us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.911649 (+842314us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b54005ceca0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7708730 00007f98f777bb42 00007f98f7777f26 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:24:04.052658 (+141009us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b54005ceca0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f770dcbd 00007f98f777bb97 00007f98f7777f26 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:24:04.115055 (+ 62397us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54005ce254. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:04.115308 (+   253us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2701924480}
I20260812 19:24:04.143069  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.004583  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:04.058876 13458 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260812 19:24:04.152961  6235 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260812 19:24:04.155431  6482 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:04.147301  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:04.149832 13629 consensus_queue.cc:1225] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer bdfa5579d4534c618c00db6b4a841c81 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:24:04.175712 13789 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:04.176064 13854 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:04.176199 13789 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:04.177604 13789 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:04.149123 13446 raft_consensus.cc:3032] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:24:04.182204  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:04.170572  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 101349us
I20260812 19:24:04.160887 13851 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:04.165755 13504 consensus_queue.cc:1046] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260812 19:24:04.188374  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:04.190554  6473 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:04.189296  6055 catalog_manager.cc:5495] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:04.194063 13647 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:04.194581 13647 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:04.195000 13647 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:04.195076  6055 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:04.203225  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.181632 13446 raft_consensus.cc:729] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:04.213343  6482 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:04.216333  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:04.223796  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.225291  6473 raft_consensus.cc:2396] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260812 19:24:04.231722  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:04.237447  6465 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:04.239256  6055 catalog_manager.cc:5495] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:04.231470 13789 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:04.252496  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.246381  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:04.264110  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:04.268863  7593 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.041s	sys 0.117s
W20260812 19:24:04.269297  7593 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.041s	sys 0.117s
I20260812 19:24:04.273067  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.274217  6481 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:04.275334  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:04.253388 13808 raft_consensus.cc:3032] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:04.283876  6055 catalog_manager.cc:5495] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 10 to 12, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 12 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:04.297178  6235 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: [7.5-10.6]
W20260812 19:24:04.299431  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 44476.9us
I20260812 19:24:04.222637 13852 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:04.307351  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.310719  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:04.279211 13708 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260812 19:24:04.287144 13858 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.051s
I20260812 19:24:04.246394 13854 consensus_queue.cc:1046] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260812 19:24:04.319690  6228 raft_consensus.cc:2379] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 11: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:04.319943  6482 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:04.279671 13703 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:04.323410  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.325210  6236 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:04.327144  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:04.358556  6477 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:04.328168 13708 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:04.328611  6242 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:04.297782 13808 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:04.330991  6473 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:24:04.336743 13850 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.006s
I20260812 19:24:04.343830  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:04.347848 13430 consensus_queue.cc:1046] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:04.351146  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:04.361577  6353 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:04.286146 13446 consensus_queue.cc:260] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:04.366362  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:04.322430 13858 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.000s	sys 0.051s
I20260812 19:24:04.363445  6055 catalog_manager.cc:5495] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 7 to 8, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 8 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:04.376825  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.377709  6482 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:04.379405  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:04.380066  6464 raft_consensus.cc:2362] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11. Re-sending same reply.
I20260812 19:24:04.380756 13808 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:04.358003 13827 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:04.382958 13827 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:04.383421 13827 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:24:04.367570 13570 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.012s	sys 0.017s
W20260812 19:24:04.387979 13570 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.013s	sys 0.017s
I20260812 19:24:04.390586 13570 raft_consensus.cc:3032] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:04.391057 13570 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:04.391858  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.392177  6228 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:04.392648  6474 raft_consensus.cc:2362] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9. Re-sending same reply.
I20260812 19:24:04.392321 13570 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:04.393580 13570 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:04.394111  6474 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260812 19:24:04.371739  6475 raft_consensus.cc:2362] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10. Re-sending same reply.
I20260812 19:24:04.395023  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.399144  6481 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:04.400686  6464 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
W20260812 19:24:04.400816  6470 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.019s	sys 0.062s
I20260812 19:24:04.402134  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:04.402415  6470 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.019s	sys 0.062s
I20260812 19:24:04.382356 13808 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:04.366596 13708 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:04.406461  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:04.408474  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.368063 13616 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:04.418125  6055 catalog_manager.cc:5495] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:04.423127  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:04.427109  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:04.428623  6481 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:04.402624 13852 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:04.441457  6477 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260812 19:24:04.443856  6475 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:04.429076  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:04.447775  6465 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:04.368289 13703 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:04.414868 13504 consensus_queue.cc:1046] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260812 19:24:04.453979  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.462608  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:04.469914  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:04.476423 13504 raft_consensus.cc:3032] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:04.480832  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:04.490406  6054 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 239) took 20357 ms (client timeout 15000 ms). Trace:
I20260812 19:24:04.479620  6055 catalog_manager.cc:5495] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:04.495216  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:04.499023  7594 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.014s	sys 0.063s
W20260812 19:24:04.503937  7599 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.031s	sys 0.035s
W20260812 19:24:04.504868 13822 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.017s	sys 0.027s
I20260812 19:24:04.507164  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:04.508074  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:04.557363  6465 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
W20260812 19:24:04.564623  7599 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.032s	sys 0.036s
W20260812 19:24:04.564793  7594 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.015s	sys 0.063s
I20260812 19:24:04.559772  6477 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:04.559727  6055 catalog_manager.cc:5495] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 5 to 8, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 8 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:04.578498  6464 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:04.585616  6481 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:04.587191  6224 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 10: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:24:04.563833 13822 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.018s	sys 0.028s
I20260812 19:24:04.556507 13446 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:04.555850 13504 raft_consensus.cc:729] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:04.598410  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:04.624907  6481 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:04.557022 13722 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:04.505621 13647 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:04.625910  6055 catalog_manager.cc:5495] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:04.599733  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:04.731271  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:04.732262  6235 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:24:04.735823  6055 catalog_manager.cc:5495] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:04.738286  6055 catalog_manager.cc:5495] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 8 to 10, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 10 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:04.727995  6236 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:24:04.746556  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:04.805594  6464 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:24:04.747076 13953 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.167s	user 0.000s	sys 0.002s
I20260812 19:24:04.752068  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.714776 13722 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:04.752966  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:04.771602  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:04.780992 13703 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:04.734431 13822 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:24:04.768146 13611 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.013s	sys 0.032s
I20260812 19:24:04.769440 13572 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:04.762146 13616 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:04.793082  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:04.795161  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:04.796315  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:04.799453 13960 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260812 19:24:04.799563  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:04.800698  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 598) took 1052 ms. Trace:
I20260812 19:24:04.772909 13504 consensus_queue.cc:260] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:04.801368  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:04.798308  6230 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260812 19:24:04.825889  6350 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:24:04.826719  6477 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
W20260812 19:24:04.843972 13611 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.013s	sys 0.032s
I20260812 19:24:04.861420  6224 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:04.816211  6055 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 7 to 9, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 9 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:24:04.823827 12972 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.025s	sys 0.051s
I20260812 19:24:04.853993  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:04.867810  6354 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:04.840729 13848 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:04.866820  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:04.861397  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.024s	sys 0.037s
W20260812 19:24:04.873731  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.024s	sys 0.038s
I20260812 19:24:04.871183  6235 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
W20260812 19:24:04.874087  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 572641us
I20260812 19:24:04.853817  6470 rpcz_store.cc:276] 0812 19:24:03.748391 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.751148 (+  2757us) service_pool.cc:227] Handling call
0812 19:24:03.751564 (+   416us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:03.752029 (+   465us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:24:03.752059 (+    30us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:03.752652 (+   593us) log.cc:842] Serialized 52 byte log entry
0812 19:24:04.405137 (+652485us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:24:04.405184 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:04.405297 (+   113us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:04.800404 (+395107us) raft_consensus.cc:1671] finished
0812 19:24:04.800428 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:04.800612 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":924,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":123,"thread_start_us":651996,"threads_started":1,"wal-append.queue_time_us":955634}
I20260812 19:24:04.858193 13572 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:04.867446 12972 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.025s	sys 0.052s
W20260812 19:24:04.860328 13854 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.022s	sys 0.039s
W20260812 19:24:04.879060  6297 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.027s	sys 0.039s
I20260812 19:24:04.875937  6236 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
W20260812 19:24:04.888597  6297 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.027s	sys 0.040s
W20260812 19:24:04.867691 13472 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.011s	sys 0.051s
I20260812 19:24:04.874922 13616 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:04.885842  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:04.888969  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 586178us
I20260812 19:24:04.893597  6481 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
W20260812 19:24:04.884471 13827 consensus_meta.cc:287] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.000s
I20260812 19:24:04.902029  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:04.877611 13703 raft_consensus.cc:3032] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Stepping down as leader of term 10
W20260812 19:24:04.888036 13854 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.022s	sys 0.040s
W20260812 19:24:04.894768 13472 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.011s	sys 0.051s
I20260812 19:24:04.909984  6242 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:24:04.914485  7606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 519) took 1154 ms. Trace:
I20260812 19:24:04.854064 13822 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:04.898309 13852 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:04.865386  6055 catalog_manager.cc:5495] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 7 to 10, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 10 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:04.875626 13848 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:04.921568  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:04.928328  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:04.906306 12972 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:04.940398 12972 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:24:04.942121 13967 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260812 19:24:04.921571 13789 consensus_meta.cc:287] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.005s
I20260812 19:24:04.909080 13703 raft_consensus.cc:729] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:04.928647 13852 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:04.943671 13735 raft_consensus.cc:3032] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:04.944329 13735 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:04.943924 13703 consensus_queue.cc:260] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:04.945248 13703 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:24:04.556268  6054 rpcz_store.cc:269] 0812 19:23:43.970796 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:43.971000 (+   204us) service_pool.cc:227] Handling call
0812 19:24:04.299043 (+20328043us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:23:54.156973 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:23:54.163923 (+  6950us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:23:54.163991 (+    68us) write_op.cc:435] Acquired schema lock
0812 19:23:54.164007 (+    16us) tablet.cc:660] Decoding operations
0812 19:23:54.165212 (+  1205us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:23:54.165348 (+   136us) write_op.cc:641] Partition lock acquired for write op
0812 19:23:54.165393 (+    45us) tablet.cc:683] Acquiring locks for 12 operations
0812 19:23:54.312980 (+147587us) tablet.cc:699] Row locks acquired
0812 19:23:54.337899 (+ 24919us) write_op.cc:260] PREPARE: finished
0812 19:23:54.360207 (+ 22308us) write_op.cc:270] Start()
0812 19:23:54.385631 (+ 25424us) write_op.cc:276] Timestamp: P: 1786562634352449 usec, L: 0
0812 19:23:54.394057 (+  8426us) op_driver.cc:331] REPLICATION: starting
0812 19:23:54.493673 (+ 99616us) log.cc:842] Serialized 4728 byte log entry
0812 19:23:55.378995 (+885322us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b54002c1120. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7706771 00007f98f7711220 00007f98f77111c8 00007f98f7711148 00007f98f7711103 00007f98f771038c 00007f98fd781206 00007f98fd779808 00007f98f774d38b 00007f98f774fe80
0812 19:23:55.814876 (+435881us) op_driver.cc:444] REPLICATION: finished
0812 19:23:56.159944 (+345068us) write_op.cc:301] APPLY: starting
0812 19:23:56.225864 (+ 65920us) tablet.cc:1365] starting BulkCheckPresence
0812 19:23:58.022805 (+1796941us) tablet.cc:1368] finished BulkCheckPresence
0812 19:23:58.022871 (+    66us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:23:58.836643 (+813772us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:23:58.929180 (+ 92537us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0812 19:23:58.949180 (+ 20000us) write_op.cc:312] APPLY: finished
0812 19:23:59.002427 (+ 53247us) log.cc:842] Serialized 113 byte log entry
0812 19:23:59.002888 (+   461us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:59.003105 (+   217us) write_op.cc:454] Released schema lock
0812 19:23:59.003232 (+   127us) write_op.cc:341] FINISH: Updating metrics
0812 19:23:59.003645 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:23:59.003707 (+    62us) write_op.cc:454] Released schema lock
0812 19:24:00.968239 (+1964532us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b1800106a20. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c764 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
Metrics: {"mutex_wait_us":13768,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":325505,"apply.run_cpu_time_us":30888,"apply.run_wall_time_us":2844338,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54359,"num_ops":12,"prepare.queue_time_us":290159,"prepare.run_cpu_time_us":62889,"prepare.run_wall_time_us":660835,"raft.queue_time_us":336628,"raft.run_cpu_time_us":26183,"raft.run_wall_time_us":341371,"replication_time_us":1382194,"spinlock_wait_cycles":15450880,"thread_start_us":670076,"threads_started":4,"wal-append.queue_time_us":2222092,"wal-append.run_cpu_time_us":39317,"wal-append.run_wall_time_us":2971341}]]}
I20260812 19:24:04.914966  7606 rpcz_store.cc:276] 0812 19:24:03.753806 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.753935 (+   129us) service_pool.cc:227] Handling call
0812 19:24:03.754279 (+   344us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:03.754755 (+   476us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:03.754784 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:03.755388 (+   604us) log.cc:842] Serialized 26 byte log entry
0812 19:24:03.962171 (+206783us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:03.962231 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:03.962313 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:04.908438 (+946125us) raft_consensus.cc:1671] finished
0812 19:24:04.908460 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:04.908601 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1811,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":206224,"threads_started":1,"wal-append.queue_time_us":527301}
I20260812 19:24:04.931438  6354 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 12: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:24:04.932216 13964 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260812 19:24:04.932950 13965 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260812 19:24:04.924911 13572 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:04.939749 13848 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:04.949816  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 44802.4us
W20260812 19:24:04.929982 13828 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.016s	sys 0.028s
W20260812 19:24:04.957544 13828 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.017s	sys 0.028s
I20260812 19:24:04.917486 13722 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:04.900375 13616 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:04.959606  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.027s	sys 0.059s
I20260812 19:24:04.920095 13647 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:04.961683  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.027s	sys 0.059s
I20260812 19:24:04.945554 13852 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:04.972031  6236 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260812 19:24:04.976413 13956 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.257s	user 0.003s	sys 0.002s
I20260812 19:24:04.978075  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:04.916774 13827 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:04.993036  7593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 564) took 1256 ms. Trace:
I20260812 19:24:04.993680  7593 rpcz_store.cc:276] 0812 19:24:03.737398 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.745272 (+  7874us) service_pool.cc:227] Handling call
0812 19:24:03.745744 (+   472us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:03.757965 (+ 12221us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:03.758004 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:03.758633 (+   629us) log.cc:842] Serialized 26 byte log entry
0812 19:24:04.269674 (+511041us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:24:04.269712 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:04.269792 (+    80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:04.976037 (+706245us) spinlock_profiling.cc:243] Waited 7.74 ms on lock 0x7b240031b9f8. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f46b4cf4 00007f98f46b2dfb 00007f98f4741559 00007f98f47411e5 00007f98f474082d 00007f98f73e346e 00007f98f73fac0c 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551
0812 19:24:04.978297 (+  2260us) raft_consensus.cc:1671] finished
0812 19:24:04.978334 (+    37us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:04.992931 (+ 14597us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3910,"raft.queue_time_us":4897,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":17804160,"thread_start_us":510557,"threads_started":1,"wal-append.queue_time_us":751242}
W20260812 19:24:04.917963 13458 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.064s	sys 0.102s
I20260812 19:24:05.029608  7599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 524) took 1110 ms. Trace:
I20260812 19:24:05.008463  6055 catalog_manager.cc:5495] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:04.945499 13735 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.030300  7599 rpcz_store.cc:276] 0812 19:24:03.919530 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.919736 (+   206us) service_pool.cc:227] Handling call
0812 19:24:03.928566 (+  8830us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:03.949503 (+ 20937us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:03.949550 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:03.954520 (+  4970us) log.cc:842] Serialized 26 byte log entry
0812 19:24:04.567095 (+612575us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:04.567151 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:04.567254 (+   103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:04.941334 (+374080us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:05.029161 (+ 87827us) raft_consensus.cc:1671] finished
0812 19:24:05.029199 (+    38us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:05.029519 (+   320us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13252,"raft.queue_time_us":35947,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3925,"spinlock_wait_cycles":3919616,"thread_start_us":611953,"threads_started":1,"wal-append.queue_time_us":876935}
I20260812 19:24:05.037374  6238 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:04.991297 12972 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:05.029829 13458 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.065s	sys 0.103s
I20260812 19:24:05.002867 13789 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:05.056420  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:05.032913 13852 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:04.983507 13828 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
W20260812 19:24:05.063205  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 95797.6us
I20260812 19:24:05.037842 13848 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:05.066574  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:05.068552 13472 consensus_queue.cc:1046] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260812 19:24:05.070885  6229 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.021s	sys 0.040s
W20260812 19:24:05.071630 13966 log.cc:924] Time spent T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260812 19:24:05.072913 13722 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:05.092495  6229 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.021s	sys 0.041s
I20260812 19:24:05.101986  6354 raft_consensus.cc:2379] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:24:05.062634 13962 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
W20260812 19:24:05.129238  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 275442us
I20260812 19:24:05.065166 13854 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:05.145668  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:05.150947  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:05.152572 13893 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:05.153419  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:05.153232 13893 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.149871  6481 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
W20260812 19:24:05.139129 13708 consensus_meta.cc:287] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.005s
I20260812 19:24:05.161702  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:05.167008 13900 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:05.167919  6352 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:05.138758 13572 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:05.175320 13616 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.176937  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:05.184667  6464 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:05.191370  6224 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:05.192736  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:05.192891  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:05.195091  6349 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260812 19:24:05.196125  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:05.201102  6354 raft_consensus.cc:2379] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:05.140132 13735 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:05.209220 13572 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.213475 13827 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.207214  6359 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:05.214562 13572 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:05.214609  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:05.217422  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:05.218139  6349 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:05.210857  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:05.162880 12972 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:05.121740 13852 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.124189 13848 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.126418 13722 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.228410  6350 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: []
W20260812 19:24:05.242302  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 65426.8us
I20260812 19:24:05.269443  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:05.237668 13570 consensus_meta.cc:287] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.844s	user 0.016s	sys 0.000s
I20260812 19:24:05.264459  7594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 522) took 1388 ms. Trace:
I20260812 19:24:05.288599  6352 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:05.209731 13900 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.290319  7594 rpcz_store.cc:276] 0812 19:24:03.875867 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:03.876011 (+   144us) service_pool.cc:227] Handling call
0812 19:24:03.876350 (+   339us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:03.919110 (+ 42760us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:03.919145 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:03.930495 (+ 11350us) log.cc:842] Serialized 26 byte log entry
0812 19:24:04.589706 (+659211us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:04.589757 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:04.589853 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:05.264129 (+674276us) raft_consensus.cc:1671] finished
0812 19:24:05.264155 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:05.264374 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":21438,"raft.queue_time_us":32767,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3984,"thread_start_us":618538,"threads_started":1,"wal-append.queue_time_us":944103}
I20260812 19:24:05.299544  6344 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:24:05.310923  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.207108 13708 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:05.315913  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 162565us
I20260812 19:24:05.288149 12972 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260812 19:24:05.314072  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 162452us
I20260812 19:24:05.287062 13822 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:05.326486  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.326844  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:05.327885  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:05.329035  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:05.329782  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.332927  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:05.311827 13472 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:05.327453  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.235941 13972 consensus_queue.cc:1046] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.084s
I20260812 19:24:05.318682 12972 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:24:05.344491  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 183819us
I20260812 19:24:05.341940  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.335268  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:05.348848  6232 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:05.319105 13854 raft_consensus.cc:686] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:05.350346  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.358194  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:05.333246 13822 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:05.360565  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:05.358194  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:05.365454 13708 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:05.365785 13504 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:05.366902 13893 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:05.370738 13974 raft_consensus.cc:3032] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:05.371207 13974 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:05.346263 13430 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:05.349380 12972 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:05.387004  6238 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260812 19:24:05.388010  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:05.380102  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 224494us
I20260812 19:24:05.389873  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:05.392609  6344 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:05.390568  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:05.393814  6345 raft_consensus.cc:2396] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260812 19:24:05.355762 13458 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:05.405450  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:05.407487 13708 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:05.407958 13708 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:05.408252  6345 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260812 19:24:05.377122 13446 consensus_meta.cc:287] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.752s	user 0.013s	sys 0.001s
I20260812 19:24:05.408383 13708 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:24:05.416553 13971 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260812 19:24:05.417227 13981 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260812 19:24:05.418895  6232 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260812 19:24:05.399438 13808 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.994s	user 0.010s	sys 0.005s
I20260812 19:24:05.424528  6235 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:24:05.426390  6238 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260812 19:24:05.426625  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:05.366469 13822 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.428763  6345 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:05.437814  7591 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260812 19:24:05.439139  6344 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260812 19:24:05.439522  6344 pending_rounds.cc:76] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 5
I20260812 19:24:05.439817  6344 pending_rounds.cc:97] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260812 19:24:05.440061  6344 raft_consensus.cc:2866] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:05.441737  6354 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
W20260812 19:24:05.452025  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 157570us
I20260812 19:24:05.453071  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:05.453861  6235 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
W20260812 19:24:05.459764  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 133005us
I20260812 19:24:05.427337 14003 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260812 19:24:05.439469 13970 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260812 19:24:05.465004  6342 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
W20260812 19:24:05.440733 13982 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260812 19:24:05.465137  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 146235us
I20260812 19:24:05.466307  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:05.466566  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.467919  6347 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:05.472232  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:05.472721  6178 leader_election.cc:334] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.755s (SENT)
I20260812 19:24:05.418104 13458 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.452297 13603 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:05.481470  6238 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:24:05.483853  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:05.487468  7599 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:05.469120 13852 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.468884 14003 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:05.489117  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:05.489516  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:05.491006  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:05.489178  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:05.492960  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:05.496389  6349 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:24:05.506080  6242 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:05.507509  6359 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:24:05.479229 13848 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:05.486425 14006 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:05.509570  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:05.510743  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:05.533638  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:05.532212  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2156) took 1081 ms. Trace:
I20260812 19:24:05.534569  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:05.534983  6353 rpcz_store.cc:276] 0812 19:24:04.450700 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:04.450896 (+   196us) service_pool.cc:227] Handling call
0812 19:24:04.460518 (+  9622us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:04.461051 (+   533us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:04.461099 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:04.478676 (+ 17577us) log.cc:842] Serialized 26 byte log entry
0812 19:24:04.921663 (+442987us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:04.921718 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:04.921811 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:05.531976 (+610165us) raft_consensus.cc:1671] finished
0812 19:24:05.531995 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:05.532146 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1889,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":7305,"thread_start_us":430072,"threads_started":1,"wal-append.queue_time_us":602806}
I20260812 19:24:05.528457  6354 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:05.543325  6232 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260812 19:24:05.535939  6464 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:24:05.486501 13808 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:05.551067  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:05.502085 13900 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.547233 13504 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:24:05.489749 13722 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.507283 13616 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260812 19:24:05.563102  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 53606.8us
W20260812 19:24:05.566496  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 65560.6us
I20260812 19:24:05.571254  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:05.575860  6464 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:24:05.577607  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:05.511337 14002 consensus_queue.cc:1046] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.068s
I20260812 19:24:05.579900  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2159) took 1253 ms. Trace:
W20260812 19:24:05.580145  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 107454us
I20260812 19:24:05.580344  6229 rpcz_store.cc:276] 0812 19:24:04.326344 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:04.326591 (+   247us) service_pool.cc:227] Handling call
0812 19:24:04.327067 (+   476us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:04.368650 (+ 41583us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:04.368682 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:04.411158 (+ 42476us) log.cc:842] Serialized 26 byte log entry
0812 19:24:05.096259 (+685101us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:24:05.096312 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:05.096408 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:05.579694 (+483286us) raft_consensus.cc:1671] finished
0812 19:24:05.579714 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:05.579842 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":34898,"raft.queue_time_us":517041,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6441,"thread_start_us":623284,"threads_started":1,"wal-append.queue_time_us":761986}
I20260812 19:24:05.372225 13974 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.582854 13974 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
W20260812 19:24:05.583657  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Leader has not yet committed an operation in its own term
I20260812 19:24:05.561823 13446 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:24:05.586903 13446 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:05.587311 13446 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:05.587570 13822 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:05.590504 14019 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:05.591027 14019 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:05.591450 14019 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:05.577080 13616 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:05.594990 13616 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:05.595196 13822 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:05.573489 13504 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:05.595866 13822 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.596371 13504 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:24:05.598058 13822 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:05.572045  6345 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:05.472306 13854 consensus_queue.cc:237] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.507682 13893 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:05.579447 14008 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:05.624173  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2155) took 1241 ms. Trace:
I20260812 19:24:05.630707  6347 rpcz_store.cc:276] 0812 19:24:04.383331 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:04.404301 (+ 20970us) service_pool.cc:227] Handling call
0812 19:24:05.623934 (+1219633us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b5400410fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:05.624096 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2280894208}
I20260812 19:24:05.502318 14003 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:05.490703 13603 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.632953 13987 raft_consensus.cc:3032] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:05.641476 13972 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:05.623299 13789 consensus_meta.cc:287] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.003s
I20260812 19:24:05.647228  6235 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:24:05.574194 13848 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:05.493141 14017 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.138s
W20260812 19:24:05.658525  6178 leader_election.cc:334] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.853s (SENT)
I20260812 19:24:05.631699 13893 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:05.658551  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:05.659060  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:05.652102  6416 connection.cc:232] RPC call timeout handler was delayed by -2.5084094868507236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2404s for a response
I20260812 19:24:05.661936 13789 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:05.662726  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:05.663249 13848 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.664875 14017 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260812 19:24:05.665988  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 93caa3d3062a45cbad94ff4ba511f2e0, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.572400 13808 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.686496  6350 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
W20260812 19:24:05.675060  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 97539.6us
W20260812 19:24:05.683876  6416 connection.cc:232] RPC call timeout handler was delayed by -2.1889094868674874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2759s for a response
W20260812 19:24:05.689713  6416 connection.cc:232] RPC call timeout handler was delayed by -1.6204511218238622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260812 19:24:05.564224 14006 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:05.685668  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 93caa3d3062a45cbad94ff4ba511f2e0, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:05.690120  6416 connection.cc:232] RPC call timeout handler was delayed by -1.541251122020185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
I20260812 19:24:05.689296  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:05.696444  6416 connection.cc:232] RPC call timeout handler was delayed by -1.3693511218298227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260812 19:24:05.696985  6416 connection.cc:232] RPC call timeout handler was delayed by -1.2928511218633503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
I20260812 19:24:05.648870 13987 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:24:05.697788  6416 connection.cc:232] RPC call timeout handler was delayed by -1.1650511219631881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260812 19:24:05.698259  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0678511220030487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
I20260812 19:24:05.701018  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:05.679486 13893 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:05.687043 13472 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:05.712167 13616 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.714440 13616 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.716678 13708 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.718327  7594 raft_consensus.cc:2379] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 12: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
W20260812 19:24:05.719005  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 68575us
I20260812 19:24:05.720237 13708 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:05.720708  6178 connection.cc:232] RPC call timeout handler was delayed by -1.5178974729496986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2384s for a response
W20260812 19:24:05.721295  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2334974729456007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27s for a response
W20260812 19:24:05.721644  6178 connection.cc:232] RPC call timeout handler was delayed by -1.0039974728133529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29550000000000004s for a response
I20260812 19:24:05.721460  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:05.723042  6347 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:05.725919 13603 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.726679 13458 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.726846  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:05.729969  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 04c512eaceae43d2a378065361eb4854, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:05.730294  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 04c512eaceae43d2a378065361eb4854, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.685325 14017 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:05.728861  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:05.713917 13446 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.750375  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:05.751066  6477 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:05.752154 13446 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.752624 12972 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.753870  6352 raft_consensus.cc:2379] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:05.698304 14004 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:05.735059 14037 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:05.736421 13848 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.757081  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:05.760643 13789 raft_consensus.cc:3032] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:05.736567  7591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 525) took 1584 ms. Trace:
I20260812 19:24:05.689409 13972 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.761420  7591 rpcz_store.cc:276] 0812 19:24:04.154797 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:04.159173 (+  4376us) service_pool.cc:227] Handling call
0812 19:24:04.174571 (+ 15398us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:05.438278 (+1263707us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:05.736325 (+298047us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540048b554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:05.736511 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2867999488}
I20260812 19:24:05.755323 14004 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 15 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:05.763088 13972 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.737587 13504 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.763921 14004 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.765407 13504 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.759719  6477 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:05.738466  6235 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:24:05.755092  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:05.766736  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:05.767498  6475 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 12
I20260812 19:24:05.769479  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:05.770406  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:05.771008  6347 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:24:05.742007 13983 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:24:05.743660 14017 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:05.746445 13808 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.747155  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:05.747900  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.748356  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.785305  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:05.787318  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:05.788090  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:05.788271  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:05.788686  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:05.790086 13822 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:05.791607 12906 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election won for term 12
W20260812 19:24:05.792227 14047 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.002s
I20260812 19:24:05.792317 12906 raft_consensus.cc:686] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:05.793006  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:05.790233  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:05.794080  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:05.794530  6242 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:05.748904  6230 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:05.788688  6470 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 8
I20260812 19:24:05.795287  6465 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:05.788985  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:05.795549  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.794085  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.794324  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:05.756814  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet d1275ccc06f94fcdaa82a73420569651, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.794981  6350 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 7 FOLLOWER]: Advancing to term 8
I20260812 19:24:05.776768  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:05.756418  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.794020  6473 raft_consensus.cc:2396] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 13 because replica has last-logged OpId of term: 11 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260812 19:24:05.761019 13789 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:05.790990  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:05.796583  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet d1275ccc06f94fcdaa82a73420569651, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.799108  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:05.749679  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:05.754621 12972 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.796372  6235 raft_consensus.cc:2354] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15.
I20260812 19:24:05.787943  6347 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 10
I20260812 19:24:05.791290  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.796343  6482 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:05.797200  6477 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:24:05.805914  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:05.806440  6481 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:05.783514 13722 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:05.809109 13722 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.809557 13828 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:05.809945 14006 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.810060 13828 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.810509 14006 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:05.811244 13722 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:05.811120 14006 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.812152 13789 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.813136 13852 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:05.736588 13987 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.813560 13789 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:05.814276 13987 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:05.815666  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.804105  6229 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:05.774528 14002 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:05.815515  6232 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:24:05.816471  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.812395 13458 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 19:24:05.811358  6230 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:05.820003  6238 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:24:05.820936  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 89550.1us
I20260812 19:24:05.783100 14037 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:05.818048  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:05.818482  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:05.824249  6347 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:24:05.825832  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:05.836894  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:05.837893  6229 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:05.843040  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:05.812176 13828 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:05.822640 13703 consensus_meta.cc:287] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.872s	user 0.010s	sys 0.004s
I20260812 19:24:05.813160 14006 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:05.829088 14002 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:05.804625 13808 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:05.790460 14030 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260812 19:24:05.817514 13446 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:05.851912 13611 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:05.859016 13703 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:05.871042 13703 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.873253 13703 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:05.865829 13854 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260812 19:24:05.838632 13603 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:24:05.874799 13611 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:05.875196 13603 raft_consensus.cc:686] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:05.875272 13611 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:05.876164 13603 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.877308 14037 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.846895 14012 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:05.866147  6481 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:24:05.868461 13446 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:05.884043 13446 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:05.793414 12906 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.865468 14002 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:05.860742  6482 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
W20260812 19:24:05.891853  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 98930.8us
I20260812 19:24:05.834544 13972 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260812 19:24:05.898469  6350 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:24:05.893901  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:05.901242  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:05.905699  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 8b1f6c5d06f046a1818f453d9b609502, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.909606 14003 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:05.922472  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 8b1f6c5d06f046a1818f453d9b609502, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.925315  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:05.926136  6242 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:05.929297  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:05.932260 14050 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:24:05.933427 13988 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:24:05.934158 13988 raft_consensus.cc:686] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:05.942277  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:05.868991 13808 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.939622 13983 raft_consensus.cc:2741] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260812 19:24:05.945504  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 47172.1us
I20260812 19:24:05.946188 13808 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:05.947974  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:05.949630  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:05.941278  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:05.896706 14019 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:05.957237 13983 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:24:05.957959 13848 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:05.958108 14003 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.959349 13988 consensus_queue.cc:237] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.960569 13893 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:05.962031  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:05.966491  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:05.967772  6242 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:05.968858  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:24:05.955462 14042 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260812 19:24:05.976486 13647 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260812 19:24:05.969648 14049 log.cc:924] Time spent T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.051s	user 0.000s	sys 0.003s
I20260812 19:24:05.976378 14019 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:05.955137 13808 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election won for term 11
W20260812 19:24:05.993970  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 52781.1us
I20260812 19:24:06.017673  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:06.009614 13893 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:06.020488  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:06.021237  6350 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:06.025102  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:06.027477  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:06.029465  6350 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:24:06.030459 13611 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:06.008105 13446 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:06.030411 14002 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.029160 14027 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:06.042129 14002 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:06.043947  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:06.044275  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:06.045091  6228 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:06.045277  6350 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 14
I20260812 19:24:06.046422  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:06.046422  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:06.048025  6235 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:06.049309  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:06.042131 13446 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:06.051816 13446 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:06.053376 14003 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:06.055056 14003 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:24:06.055537  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 86735.6us
I20260812 19:24:06.056337  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:06.055972 14003 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.053944 13808 raft_consensus.cc:686] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:06.057621 13808 consensus_queue.cc:237] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.058710 14031 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:06.038055 13611 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:06.061839  6470 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:24:06.063642 13446 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:06.064546 13822 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:06.047799  6475 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:24:06.069991  6242 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:24:06.080762  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:06.082876  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:06.088909  7599 raft_consensus.cc:1226] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:06.072782  6235 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:24:06.095664  6350 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:06.096966  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:06.106242  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:06.115168  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:06.073895 13647 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:06.118131  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:06.120280  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 102980us
I20260812 19:24:06.092504 13789 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:06.082805 14002 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:24:06.120988 13603 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:06.117102 13822 raft_consensus.cc:2741] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260812 19:24:06.125842  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:06.116647  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:06.119287 13848 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:06.132545 13603 raft_consensus.cc:686] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:06.124258 13789 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:06.134603 13789 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:06.123153 13893 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:06.142385  6228 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:06.117900 14019 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260812 19:24:06.147312  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 71913.8us
I20260812 19:24:06.141551 13848 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:06.144351 14008 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:24:06.144510 13893 raft_consensus.cc:686] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:06.142135 14002 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:06.122895 14046 consensus_queue.cc:1046] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260812 19:24:06.162040  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:06.166569  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:06.171977  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:06.173066 14019 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:06.173712  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:06.140530 13446 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:06.190946 13848 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.191843 14008 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:06.193060 14031 raft_consensus.cc:3032] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:06.193468 14031 raft_consensus.cc:729] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:06.194414 14031 consensus_queue.cc:260] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:06.195914 14031 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:06.196516  6345 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:06.197989  6352 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:06.178181  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:06.179669 14003 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:06.188529 14017 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.172566 14002 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:06.188872 13893 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:06.174247 14006 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:06.215662 14002 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:06.219337  6178 leader_election.cc:334] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.619s (SENT)
I20260812 19:24:06.220299  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:06.210856  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:06.205181  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:06.222916  6352 raft_consensus.cc:2396] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260812 19:24:06.223908  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:06.226723  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:06.227205  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:06.230249  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:06.231801  6470 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260812 19:24:06.234822  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:06.236215  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:06.233379  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:06.203958 13458 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:24:06.246765  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:06.249123  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:06.250065  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:06.250201  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 96118.4us
I20260812 19:24:06.209839 14019 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:06.210765 14003 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:06.252339  6236 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:06.253571  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:06.259406  6224 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:06.213385 14006 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:06.264508  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:06.255592  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:06.261315  6473 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:06.254714  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:06.262059  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:06.252206  6470 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:06.256376  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:06.255302  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:06.212525 14043 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260812 19:24:06.278959  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46246.7us
I20260812 19:24:06.281284  6228 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:06.266386  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:06.282811  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:06.252103  6475 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:06.287088 14019 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.247153 13828 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:06.253597 14050 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:06.300148  6224 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:06.282673  6482 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:24:06.250715 13458 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:06.253741 13972 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:24:06.300166  6229 raft_consensus.cc:2396] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260812 19:24:06.175091 13603 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:06.265887 14006 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:06.305938  6475 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:24:06.306305  6297 leader_election.cc:398] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15.
I20260812 19:24:06.254135 14046 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
W20260812 19:24:06.325318  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 70542.3us
I20260812 19:24:06.303186 14044 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:24:06.332006  6470 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:06.294462 14043 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:06.305836 13458 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:06.333385  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:06.335256 13647 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:06.336421  6352 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260812 19:24:06.343787  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 132861us
W20260812 19:24:06.349176  6178 leader_election.cc:334] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.682s (SENT)
I20260812 19:24:06.328287 14050 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:24:06.354841  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 64312.4us
I20260812 19:24:06.354342  6228 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:06.357297  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:06.361651  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:06.353349 14044 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:06.343359 13822 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260812 19:24:06.368333  6228 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260812 19:24:06.369606  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:06.363325 12972 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:06.353067 13446 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
W20260812 19:24:06.380264  6178 leader_election.cc:334] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.751s (SENT)
I20260812 19:24:06.380730  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:06.334770 14003 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.375734 13611 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260812 19:24:06.378898 14057 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260812 19:24:06.367473 14044 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:06.389261  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:06.350026  6475 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:24:06.369061 14017 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:06.395879  6475 raft_consensus.cc:595] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:06.372743 14037 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:06.399438  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:06.400413 14081 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260812 19:24:06.397454 13504 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:06.417549 14037 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:06.418069 14037 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:06.397935 12972 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260812 19:24:06.403214 14063 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.150s	user 0.000s	sys 0.002s
I20260812 19:24:06.396562 14044 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:06.407035  6470 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260812 19:24:06.395594 13808 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:06.395295 14050 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.397604 13987 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:24:06.415685  6352 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260812 19:24:06.399631 14003 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:06.434427 14043 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:06.446133  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:06.462219  6483 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:24:06.464522  6236 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
W20260812 19:24:06.467305  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 76576.7us
I20260812 19:24:06.435462 13504 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:06.451958 12972 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:06.490471 13722 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:06.490236  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:06.483290 13893 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260812 19:24:06.493803 13848 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:06.495841  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:06.496061 13848 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:06.497062  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:06.497347 13848 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.387843 13789 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.499207  6345 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:06.499444  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:06.499706  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:06.500134 13789 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:06.500393  6483 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:06.500236  6236 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:06.500873 13789 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:06.501467 13789 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:06.502015 13808 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:24:06.502701 13808 raft_consensus.cc:686] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:06.503808 13808 consensus_queue.cc:237] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.508332  6470 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260812 19:24:06.512374  6470 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:24:06.512991  6470 raft_consensus.cc:595] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:06.513358  6470 raft_consensus.cc:603] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:06.506285  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:06.514937 14019 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:06.515704  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:06.517356 14002 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:06.517465  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:06.518250 14002 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:24:06.520252 14043 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:24:06.521343  6236 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:06.522303  6483 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:06.528152  6345 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260812 19:24:06.563678  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:06.633579  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 233163us
I20260812 19:24:06.635489  6353 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:06.585402 13647 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:06.530510 12972 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:06.544236 14046 raft_consensus.cc:2741] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260812 19:24:06.585644 14037 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.542259  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:06.544456 14031 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
W20260812 19:24:06.597162  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 75586.5us
I20260812 19:24:06.605387 13458 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:06.526235 13893 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:06.502353 13789 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.600666 14006 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:06.572722  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 82610.6us
I20260812 19:24:06.525292 13504 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:06.530560  6482 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260812 19:24:06.544248  6464 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:24:06.700374  6464 raft_consensus.cc:595] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:06.700857  6464 raft_consensus.cc:603] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:06.674376  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:06.687618  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:06.702279  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:06.702281  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:06.696698  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:06.707188  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:06.708459 14008 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:06.709282 14008 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:06.709748 14008 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:06.727913  6347 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
W20260812 19:24:06.730108  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 90878.9us
I20260812 19:24:06.686630 13722 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260812 19:24:06.710171 14008 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:06.713757 13972 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:06.712189 14050 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:24:06.735167  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:06.734234  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:06.737195  6345 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260812 19:24:06.718793 13808 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:06.725909 14046 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:06.745054  6473 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:24:06.685837 13647 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.749024 13848 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 19:24:06.727439 14009 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260812 19:24:06.727624 13822 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260812 19:24:06.750816 13647 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:06.752686 13983 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:06.753386 13983 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:06.754418 13983 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.737908 14050 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:06.796132  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:06.797132 14019 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:06.800467 14050 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:06.800601 14019 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.803660 14019 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:06.807538 14044 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:06.811352  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 46779.4us
I20260812 19:24:06.812194 13603 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:06.812727 13603 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:06.813174 13603 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
W20260812 19:24:06.762148 14118 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260812 19:24:06.820008  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 112932us
I20260812 19:24:06.757653 14046 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:06.764104 13647 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:06.832868 13987 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:24:06.835069 14037 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:06.814081 13808 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:06.843240 13808 raft_consensus.cc:686] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:06.843663  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:06.844322  6470 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:06.844261 13808 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.796204 13504 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260812 19:24:06.834872 13987 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:24:06.810532 14044 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:06.861280  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:06.862210  6483 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:06.864010  6236 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260812 19:24:06.853344  6232 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:06.830251 14046 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:06.870500  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:06.871377  6241 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:06.868201  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:06.865491  6232 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:06.873961  6229 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260812 19:24:06.825171 13446 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260812 19:24:06.877986  6477 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260812 19:24:06.882984  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:06.873008  6470 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:06.883847  6224 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:06.884003  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:06.883306  6482 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:06.882184  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:06.888724  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 172814us
I20260812 19:24:06.892030  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:06.893536  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:06.895160  6347 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260812 19:24:06.896034  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:06.888226  6232 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.901118  6474 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260812 19:24:06.903548  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:06.896274  6241 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:06.851683 13647 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.911368  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:06.913203  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 83882.4us
I20260812 19:24:06.894089 13972 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:06.914623  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:06.915890  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:06.917071  6230 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:06.919643  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:06.895843 13458 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:06.914197  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:06.897630 14019 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:06.896864 14002 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:06.878556 14050 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.923182  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:06.924938  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:06.925328  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:06.903687 14006 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:06.943754  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47809.5us
W20260812 19:24:06.951057 14111 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260812 19:24:06.938890 14108 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260812 19:24:06.901487 13848 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260812 19:24:06.954308  6352 raft_consensus.cc:2396] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260812 19:24:06.939363 14019 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.957404  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:06.969884  6232 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:06.954672  6230 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260812 19:24:06.990434  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 176945us
I20260812 19:24:06.993273  6241 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260812 19:24:06.994958  6230 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260812 19:24:07.004369  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 89817.6us
I20260812 19:24:07.013118  6230 raft_consensus.cc:1226] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:07.024489  6347 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260812 19:24:07.032095  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:07.036149  6230 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:06.963323 14050 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:06.958483 14009 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:06.952327 14140 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:07.038878  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:06.997268 14105 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260812 19:24:06.972095 14127 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:06.963851 13647 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:07.042145  6235 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260812 19:24:07.044451  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 58387.8us
I20260812 19:24:06.944164 13972 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.939563 14002 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:06.998629 13789 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:07.061213  6230 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:07.093245  6242 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260812 19:24:07.113456  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 48374.2us
I20260812 19:24:07.115356  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:07.062592 14140 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:07.023578 14006 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.067s
I20260812 19:24:06.982605 14008 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:07.136915  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0474836851935834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
I20260812 19:24:07.028988 14003 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
W20260812 19:24:07.141331  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0150836850516498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260812 19:24:07.032778 13808 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260812 19:24:07.145895  6350 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260812 19:24:07.146531  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:07.115530 13647 raft_consensus.cc:2741] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260812 19:24:07.090854 14133 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:07.152694  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:07.153390  6470 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:24:07.154847  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 125935us
I20260812 19:24:07.063566 13893 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.078s
I20260812 19:24:07.162405  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:07.119843 14130 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:07.167392  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:07.168252  6474 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:07.163091  6482 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:07.059819 14009 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:07.136124 14140 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:07.138931 14027 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:07.184748  6229 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260812 19:24:07.186940  6481 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260812 19:24:07.093510 14127 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.190006  6229 pending_rounds.cc:76] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 6
I20260812 19:24:07.192466  6229 pending_rounds.cc:97] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260812 19:24:07.192725  6229 raft_consensus.cc:2866] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:24:07.193197  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 51184.1us
I20260812 19:24:07.189675  6477 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:07.201611  6470 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:24:07.206115  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:07.215126  6482 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:07.192036 14138 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:07.227535  6474 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:24:07.188275 14144 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:07.187772 14153 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260812 19:24:07.164745 14133 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:07.219744 14136 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260812 19:24:07.219738 14145 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260812 19:24:07.242288 14133 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:07.219094 14135 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260812 19:24:07.271934  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:07.273501  6224 raft_consensus.cc:3032] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:07.273947  6224 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:07.275748  6224 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.276944  6224 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:07.281388  6474 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260812 19:24:07.249941 14148 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260812 19:24:07.192943 14130 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.228901 14030 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260812 19:24:07.290746  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 84721.8us
I20260812 19:24:07.293538  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:07.257249 14138 raft_consensus.cc:686] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:07.318122  6224 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260812 19:24:07.319003  6470 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:07.323534 14002 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:07.321019  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:07.324229 14002 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 19:24:07.324448  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:07.325009  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:07.325573 14153 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:24:07.326146 14153 raft_consensus.cc:686] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:07.326392 14131 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:07.327136 14131 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:07.327011 14153 consensus_queue.cc:237] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.204002 14027 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.329550 14027 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:07.330291 13616 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:24:07.332520  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:07.342212  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:07.287549 14019 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:07.343650  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:24:07.344388  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 149133us
W20260812 19:24:07.368225  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 255450us
I20260812 19:24:07.372565  6232 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:07.217288 14150 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260812 19:24:07.374141  6350 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260812 19:24:07.384021  6470 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260812 19:24:07.385193  6350 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
W20260812 19:24:07.386869  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 54485.5us
I20260812 19:24:07.388953  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:07.390760  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:07.256887 14046 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.375228 14144 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:07.395514  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:07.372458 13616 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:07.381575 14027 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:07.381947 14003 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 19:24:07.404717  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:07.371024 13789 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:07.407210  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:07.424722  6178 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.130s (SENT)
I20260812 19:24:07.424867  6350 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:07.426221  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:07.428158  6473 raft_consensus.cc:595] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:07.428645  6473 raft_consensus.cc:603] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:07.427178  6350 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:24:07.435281  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:07.436108  6350 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:07.439522  6344 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
W20260812 19:24:07.440399  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 49742.3us
I20260812 19:24:07.386065 14139 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
W20260812 19:24:07.457345  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 49031.1us
I20260812 19:24:07.403187 13972 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:07.427567 14031 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:24:07.386778 14129 consensus_queue.cc:1046] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260812 19:24:07.422444 14008 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:07.406137 12906 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260812 19:24:07.489260  6350 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:07.445744 13616 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:24:07.481624  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 71457us
W20260812 19:24:07.504920  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 59835.5us
I20260812 19:24:07.465413 14019 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260812 19:24:07.540706  6178 leader_election.cc:334] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.475s (SENT)
I20260812 19:24:07.547178  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:07.442217 13983 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260812 19:24:07.467767 14127 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:07.514232 14109 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260812 19:24:07.576541  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 126477us
I20260812 19:24:07.550622  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:07.602445  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:07.603470  6349 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:07.562090 14129 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:07.546811 14019 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:07.508519 14044 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260812 19:24:07.458698 14138 consensus_queue.cc:237] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.463115 14171 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.150s
I20260812 19:24:07.543402 14031 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.076s
W20260812 19:24:07.629355 14152 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.399s	user 0.000s	sys 0.002s
I20260812 19:24:07.616647 13972 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:07.544520 14027 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
I20260812 19:24:07.543567 14030 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260812 19:24:07.585956 14009 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:07.671831  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 105751us
W20260812 19:24:07.675307  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 164066us
I20260812 19:24:07.646353 14019 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:07.629056 14129 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:24:07.723464  6178 leader_election.cc:334] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.781s (SENT)
I20260812 19:24:07.583611 14127 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260812 19:24:07.586632 13789 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.656291 14130 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:07.721156  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 103797us
I20260812 19:24:07.723954  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:07.725767 14103 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260812 19:24:07.645532 14157 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.339s
I20260812 19:24:07.663123 14191 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260812 19:24:07.730175 14190 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
W20260812 19:24:07.734578  7649 heartbeater.cc:644] Failed to heartbeat to 127.3.253.62:46555 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.3.253.62:46555 timed out after 15.000s (SENT)
I20260812 19:24:07.736892 14165 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:07.560984 14144 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.702540 14163 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260812 19:24:07.702157 14003 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:07.796329 14003 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:24:07.797233  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 76565.6us
I20260812 19:24:07.702987 14162 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:07.799005 14162 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:07.777088 14140 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.571s	user 0.012s	sys 0.000s
I20260812 19:24:07.751292 14037 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:07.800297 14140 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.801436 14162 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:07.801688 14176 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
W20260812 19:24:07.774015 13603 consensus_meta.cc:287] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.944s	user 0.009s	sys 0.002s
I20260812 19:24:07.723585 14174 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:07.718534 13616 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.800382 14037 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.802448 14129 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.740353 14046 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:07.791869  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:07.784096 12972 consensus_meta.cc:287] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.093s	user 0.011s	sys 0.004s
I20260812 19:24:07.803536  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:07.805991  6242 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260812 19:24:07.809038  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:07.762239  6349 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:07.819953  6238 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260812 19:24:07.719523  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 169018us
I20260812 19:24:07.829259  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:07.830492  6235 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:24:07.832659  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:07.833124  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:07.833853  6235 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:24:07.802943  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:07.775941 14157 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:07.834888  6229 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:07.775178 14168 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:07.848552  6238 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260812 19:24:07.802618 14140 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:07.862669  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 53708.7us
I20260812 19:24:07.775043 14190 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260812 19:24:07.846031 14157 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:24:07.907646  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 74618.2us
I20260812 19:24:07.907831  6465 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260812 19:24:07.803064 13722 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260812 19:24:07.785820 14019 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.915911  6464 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:24:07.803427 13603 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:07.903083 13988 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.000s	sys 0.022s
I20260812 19:24:07.867250 13972 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:24:07.895782 14129 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:07.846302 12972 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.902541 14131 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:07.907394 14155 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:07.846208 13987 consensus_queue.cc:1046] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260812 19:24:07.815948 14165 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.917349 14150 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:24:07.962790  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 128717us
W20260812 19:24:07.943768 13988 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.001s	sys 0.023s
I20260812 19:24:07.968403  7591 raft_consensus.cc:2354] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14.
I20260812 19:24:07.969197  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:07.970345  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 86773.4us
I20260812 19:24:07.831548 14174 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:07.983932  6344 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260812 19:24:07.982364  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:07.982769  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:07.989076  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:07.989785  6229 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:07.990995  6464 raft_consensus.cc:2396] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 13 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260812 19:24:07.968979 14140 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:07.895169 14168 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:08.017611  6352 raft_consensus.cc:1261] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260812 19:24:08.043726  6349 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10. Ops: []
I20260812 19:24:07.960590 14139 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.040s
I20260812 19:24:07.977196 14202 raft_consensus.cc:2741] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260812 19:24:08.060410  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:07.994483 14031 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:08.063364  6464 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:24:08.071033  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 102196us
W20260812 19:24:08.075366  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 122751us
I20260812 19:24:08.084862  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:08.017795 14027 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260812 19:24:07.979072 14155 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:08.062883 14150 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260812 19:24:08.091404 14043 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:24:08.134394  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:08.117841 14187 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260812 19:24:08.043147 14140 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:08.139623  6464 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:08.142999  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:08.120095 14037 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:08.070066 14031 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:08.153852 14131 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:08.130703 14027 consensus_queue.cc:1225] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260812 19:24:08.158277  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 175164us
W20260812 19:24:08.159475  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 74054.2us
I20260812 19:24:08.163100 13987 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:07.989343 14157 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:08.163165  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:08.181622 13987 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:08.181807  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:08.182782  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:08.183919 13987 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:08.183934  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:08.185220  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:08.185879  6464 raft_consensus.cc:2354] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10.
I20260812 19:24:08.186560  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:08.163175 14188 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260812 19:24:08.134776 14043 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:08.215587  6477 raft_consensus.cc:2354] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13.
I20260812 19:24:08.197826  6464 raft_consensus.cc:2379] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:08.225343  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:08.192729 14173 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
W20260812 19:24:08.231324 14179 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.276s	user 0.000s	sys 0.002s
I20260812 19:24:08.241888  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:08.242146  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:08.122023 14202 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.100s
I20260812 19:24:08.200189 14139 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:08.240293 14030 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:08.222277 14043 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:08.211699 14037 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260812 19:24:08.256451  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:08.258401  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:08.190877 14019 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:08.232772 12972 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:08.237289 14009 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:08.313416  6228 raft_consensus.cc:3032] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:24:08.356079  6228 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:08.227319 14027 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:08.246587 13603 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:08.164418 14192 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.302s
W20260812 19:24:08.246439  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 266661us
W20260812 19:24:08.311578 14186 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260812 19:24:08.310751 14165 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:08.353609  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:08.343719 14003 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.018s	sys 0.018s
W20260812 19:24:08.369511 14003 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.023s	sys 0.019s
I20260812 19:24:08.365329  6228 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:08.354463  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 346596us
I20260812 19:24:08.340855  6242 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:24:08.198673 14196 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.348s
W20260812 19:24:08.360793 14262 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260812 19:24:08.357853 14009 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:08.384060 14009 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 4, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:08.384542  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:08.385349  6235 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:08.385459 14009 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:08.387149 14196 consensus_queue.cc:1225] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:24:08.387650 14019 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:08.388192 14019 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:08.360358 14209 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.149s
I20260812 19:24:08.361207 14259 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:08.362250 14131 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:08.369906 14164 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.030s
I20260812 19:24:08.361863 14140 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:08.387179 14031 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:08.390352 14259 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:08.342319 14030 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:08.396750 14259 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:08.398605 14030 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:08.403083  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2236) took 1125 ms. Trace:
I20260812 19:24:08.373487  6228 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:08.377573  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:08.372327 14163 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260812 19:24:08.379684 14037 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:08.376230 14168 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:08.380337 14233 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260812 19:24:08.381217 14260 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:08.433111 14260 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:08.435513 14260 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:08.381950 14218 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260812 19:24:08.396649  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:08.403559  6483 rpcz_store.cc:276] 0812 19:24:07.277390 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:07.277569 (+   179us) service_pool.cc:227] Handling call
0812 19:24:07.277968 (+   399us) raft_consensus.cc:1457] Updating replica for 3 ops
0812 19:24:07.330475 (+ 52507us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:07.330511 (+    36us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0812 19:24:07.331213 (+   702us) log.cc:842] Serialized 78 byte log entry
0812 19:24:07.407987 (+ 76774us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:07.450027 (+ 42040us) log.cc:842] Serialized 14 byte log entry
0812 19:24:07.450243 (+   216us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:08.232692 (+782449us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b54001310d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:08.232744 (+    52us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:08.402736 (+169992us) raft_consensus.cc:1671] finished
0812 19:24:08.402843 (+   107us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:08.403013 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1569,"prepare.queue_time_us":63061,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":7296,"raft.queue_time_us":12001,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":22483,"spinlock_wait_cycles":119713024,"thread_start_us":76320,"threads_started":1,"wal-append.queue_time_us":577182}
I20260812 19:24:08.451452  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:08.452987  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:08.386334  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:08.375031  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.914s (SENT) [suppressed 14 similar messages]
I20260812 19:24:08.416671  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:08.422839  6354 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:24:08.423868  6229 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:08.456161  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:08.457038  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:08.457343  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:08.457990  6224 raft_consensus.cc:2396] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260812 19:24:08.458014  6464 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:08.458726  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:08.459060  6224 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:08.459380  6230 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:08.390478 14019 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:08.466220  6464 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
W20260812 19:24:08.468089 14204 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260812 19:24:08.469297  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2181) took 1065 ms. Trace:
I20260812 19:24:08.469667  6359 rpcz_store.cc:276] 0812 19:24:07.404319 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:07.405232 (+   913us) service_pool.cc:227] Handling call
0812 19:24:07.431160 (+ 25928us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:07.431383 (+   223us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:07.431406 (+    23us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:07.450769 (+ 19363us) log.cc:842] Serialized 26 byte log entry
0812 19:24:07.905452 (+454683us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:24:07.905508 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:07.905832 (+   324us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:08.469067 (+563235us) raft_consensus.cc:1671] finished
0812 19:24:08.469089 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:08.469235 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":361075,"threads_started":1,"wal-append.queue_time_us":934034}
I20260812 19:24:08.471899  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:08.473148  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:08.473489 14155 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:08.474321  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:08.474874  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:08.448964  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:08.367309 14027 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:08.336858 14139 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:08.475988  6242 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:24:08.480206  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 105380us
I20260812 19:24:08.476730  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:08.477690  6228 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:24:08.479449  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:08.487021  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:08.487507 14251 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:08.489478 14027 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:08.490881  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:08.492677  6229 raft_consensus.cc:2396] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260812 19:24:08.484234  6483 raft_consensus.cc:2362] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12. Re-sending same reply.
I20260812 19:24:08.486034  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:08.496261  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:08.492494 14259 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:08.547545  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:08.550347  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 54515.5us
I20260812 19:24:08.487685  6464 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 14
I20260812 19:24:08.551712  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:08.552898  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:08.553579  6483 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:08.554392  6224 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260812 19:24:08.538822  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 62161.4us
I20260812 19:24:08.564136  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:08.551349  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:08.569350  6465 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:08.570634  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:08.584895  6470 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 5. (term mismatch)
I20260812 19:24:08.591349  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:08.546360 14268 log.cc:924] Time spent T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260812 19:24:08.585414  6470 pending_rounds.cc:76] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 4
I20260812 19:24:08.645931  6470 pending_rounds.cc:97] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260812 19:24:08.448720 14174 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:08.646212  6470 raft_consensus.cc:2866] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:24:08.635243  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 83940.1us
I20260812 19:24:08.437229 14043 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:08.701414  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 130846us
I20260812 19:24:08.719762  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:08.716181  6483 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:24:08.724289  6483 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260812 19:24:08.649438  6417 leader_election.cc:398] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14.
I20260812 19:24:08.731011  6417 leader_election.cc:401] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:24:08.754063  6464 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:08.717057  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:08.757648  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.016s	sys 0.019s
W20260812 19:24:08.597747 14218 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.104s	user 0.000s	sys 0.002s
I20260812 19:24:08.566171 14239 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:24:08.760207  6224 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: [8.4-11.5]
I20260812 19:24:08.596674  6242 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
W20260812 19:24:08.762439  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 179137us
I20260812 19:24:08.763216  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:08.766880  6178 leader_election.cc:334] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.678s (SENT)
I20260812 19:24:08.570026 13603 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:08.597692 14131 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260812 19:24:08.770334  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.017s	sys 0.019s
I20260812 19:24:08.773027  6465 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 9. Current term is 10. Ops: []
I20260812 19:24:08.774231  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:08.866030  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 624181us
I20260812 19:24:08.757651 14260 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:24:08.762776 14174 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:08.648582 14231 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election won for term 12
W20260812 19:24:08.862196  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 81305.3us
W20260812 19:24:08.824433 14141 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260812 19:24:08.815661  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:08.866019  6352 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:08.786520 14239 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:08.941211  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:08.939349  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 121794us
I20260812 19:24:08.857132 14241 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:08.956784  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:08.918411 14030 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:08.825605 13603 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:08.983175  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:08.918068 14017 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:08.933380 14239 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:08.923393 14249 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:24:09.016747  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 249886us
I20260812 19:24:09.016980  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:09.017554  6178 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.686s (SENT)
I20260812 19:24:09.018000  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:08.823797 14269 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.477s
I20260812 19:24:09.017916  6349 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:08.931633 14031 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
W20260812 19:24:09.012467 14129 consensus_meta.cc:287] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.044s	user 0.013s	sys 0.000s
I20260812 19:24:08.984833 14138 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:08.984608 14202 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:24:09.056222 14278 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260812 19:24:08.831888 14261 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.258s
I20260812 19:24:09.019989 13808 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:09.070148  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:08.951032 14174 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:09.031196 14144 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:09.041234 14139 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:09.047348 14168 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:09.012301 14017 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:08.973665 14241 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:09.115549  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:09.118750  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 101216us
W20260812 19:24:09.141417  6178 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.763s (SENT)
I20260812 19:24:09.141970  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:09.143839  6349 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
W20260812 19:24:09.151161  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 201920us
I20260812 19:24:09.080827 14259 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:09.093205 14189 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:09.172560  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:09.120836 14009 consensus_meta.cc:287] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.735s	user 0.009s	sys 0.007s
I20260812 19:24:09.118583 12972 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:09.184159  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:09.185153  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 43786.5us
W20260812 19:24:09.193747  6178 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.796s (SENT)
I20260812 19:24:09.194360  6178 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:09.197959  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:09.198932  6349 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:09.199632  6470 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 8. Current term is 9. Ops: []
I20260812 19:24:09.086371 14267 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14.
I20260812 19:24:09.120249 14043 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:09.211051  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:09.150580 14168 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:09.029690 14249 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:09.068645 14202 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:09.182309 14140 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:09.081643 13808 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:09.234030  6178 leader_election.cc:334] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.801s (SENT)
I20260812 19:24:09.087399 14144 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:09.193988 14259 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:09.207932 14231 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:24:09.220598 14235 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.593s	user 0.001s	sys 0.000s
I20260812 19:24:09.178022 14205 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.093s
I20260812 19:24:09.251617 14174 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:09.252128 14249 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:09.252971  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 639) took 1452 ms. Trace:
I20260812 19:24:09.252786 14231 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:09.253304  6475 rpcz_store.cc:276] 0812 19:24:07.800404 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:07.801399 (+   995us) service_pool.cc:227] Handling call
0812 19:24:07.801790 (+   391us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:07.802208 (+   418us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:07.802238 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:07.802842 (+   604us) log.cc:842] Serialized 26 byte log entry
0812 19:24:07.918671 (+115829us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:07.918728 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:07.918804 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:09.252735 (+1333931us) raft_consensus.cc:1671] finished
0812 19:24:09.252758 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:09.252905 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4321,"spinlock_wait_cycles":10237696,"thread_start_us":115464,"threads_started":1,"wal-append.queue_time_us":433367}
I20260812 19:24:09.236515  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:09.229146 14043 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:09.255059 14043 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:09.254117 14006 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260812 19:24:09.250860 14290 log.cc:924] Time spent T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.192s	user 0.001s	sys 0.001s
I20260812 19:24:09.255672  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:09.237422 14009 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260812 19:24:09.250711 14306 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260812 19:24:09.219481 14189 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:09.231926 14139 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:09.230510 13987 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260812 19:24:09.268101 14277 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
W20260812 19:24:09.290603  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 83101.7us
W20260812 19:24:09.267274  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 71015.2us
W20260812 19:24:09.303949  6178 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.838s (SENT)
I20260812 19:24:09.299569 14189 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:09.305922 14312 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260812 19:24:09.306872 14189 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:09.307423  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 671) took 2164 ms. Trace:
I20260812 19:24:09.307762 14133 raft_consensus.cc:3032] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:09.301910 14139 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:09.308276 14133 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:09.308005  6347 rpcz_store.cc:276] 0812 19:24:07.143029 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:07.143174 (+   145us) service_pool.cc:227] Handling call
0812 19:24:07.143512 (+   338us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:08.785080 (+1641568us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b18003c9c40. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f4859155 00007f98f77703d0 00007f98f7770f6b 00007f98f777b78b
0812 19:24:08.861235 (+ 76155us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:08.861270 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:08.871845 (+ 10575us) log.cc:842] Serialized 26 byte log entry
0812 19:24:09.018472 (+146627us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:24:09.018532 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:09.018599 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:09.307006 (+288407us) raft_consensus.cc:1671] finished
0812 19:24:09.307033 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:09.307359 (+   326us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6359,"raft.queue_time_us":115136,"spinlock_wait_cycles":51045888,"thread_start_us":203343,"threads_started":2,"wal-append.queue_time_us":156893}
I20260812 19:24:09.309576  6352 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:09.309909 14139 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:09.310160  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:09.304759  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:09.313652  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:09.232008 14255 consensus_queue.cc:1046] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.073s
I20260812 19:24:09.268258 14006 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:09.320075  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:09.289892 14009 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:24:09.311462 14292 log.cc:924] Time spent T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260812 19:24:09.323588  6352 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: []
W20260812 19:24:09.328361 14295 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260812 19:24:09.329067  6349 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260812 19:24:09.315500 14323 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260812 19:24:09.329896  6178 leader_election.cc:334] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.963s (SENT)
I20260812 19:24:09.348352  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:09.348635  6483 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260812 19:24:09.256104 14140 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:09.252180 14259 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:09.346637  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:09.346673  6349 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:09.360342  6477 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:09.332335 14017 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:09.309409 14133 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:09.358772  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:09.365881  6483 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 11: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:09.324980 14006 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:09.364099  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:09.322666 14129 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:09.362432  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:09.327005 14009 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:09.369230  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1937) took 1255 ms. Trace:
I20260812 19:24:09.376418  6477 rpcz_store.cc:276] 0812 19:24:08.106622 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:08.484662 (+378040us) service_pool.cc:227] Handling call
0812 19:24:09.361852 (+877190us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:09.345419 13504 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:09.391495  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:09.364377 14030 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:09.367120  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:09.350713 14307 log.cc:924] Time spent T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260812 19:24:09.333984 13603 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:09.395310  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:09.395310  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:09.376463 14255 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:09.403187  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:09.417883  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 87977.7us
I20260812 19:24:09.372810  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:09.412714  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:09.388069 14133 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:24:09.421612  6178 leader_election.cc:334] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.711s (SENT)
I20260812 19:24:09.441900  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:09.346014 14336 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
W20260812 19:24:09.421018 14293 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.404s	user 0.000s	sys 0.002s
W20260812 19:24:09.450912  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 78177.8us
I20260812 19:24:09.451056  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:09.415688 12972 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:24:09.437469 14143 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.217s	user 0.026s	sys 0.009s
I20260812 19:24:09.406994 14138 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:09.452842  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:09.467877  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:09.475066  6464 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:09.474972  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2243) took 1675 ms. Trace:
I20260812 19:24:09.487818 14202 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:09.490010 14299 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260812 19:24:09.492274 14320 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260812 19:24:09.426941 14255 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:09.499203  6483 raft_consensus.cc:2396] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260812 19:24:09.504667 14138 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:09.505720 14325 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:09.409292 14030 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:09.507869  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2211) took 1042 ms. Trace:
I20260812 19:24:09.508054 14030 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:09.508323  6235 rpcz_store.cc:276] 0812 19:24:08.465467 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:08.465953 (+   486us) service_pool.cc:227] Handling call
0812 19:24:08.466269 (+   316us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:08.466607 (+   338us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:08.466635 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:08.467098 (+   463us) log.cc:842] Serialized 26 byte log entry
0812 19:24:08.828243 (+361145us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:24:08.828284 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:08.828369 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:09.507651 (+679282us) raft_consensus.cc:1671] finished
0812 19:24:09.507670 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:09.507808 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2693,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":360780,"threads_started":1,"wal-append.queue_time_us":764478}
I20260812 19:24:09.509359 14140 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:09.510911 14259 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:09.511045  6475 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:09.511193 14280 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:09.401160 13504 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:09.511984 14280 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:09.514088 13504 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:09.472436 14258 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:09.515468 14258 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:09.515909 14258 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:09.488237  6474 rpcz_store.cc:276] 0812 19:24:07.799843 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:07.818626 (+ 18783us) service_pool.cc:227] Handling call
0812 19:24:07.844508 (+ 25882us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:07.850200 (+  5692us) raft_consensus.cc:1520] Early marking committed up to index 7
0812 19:24:08.179711 (+329511us) log.cc:842] Serialized 14 byte log entry
0812 19:24:08.483407 (+303696us) log.cc:842] Serialized 14 byte log entry
0812 19:24:08.487562 (+  4155us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:08.488118 (+   556us) log.cc:842] Serialized 26 byte log entry
0812 19:24:08.488278 (+   160us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:08.488321 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:08.488416 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:09.474629 (+986213us) raft_consensus.cc:1671] finished
0812 19:24:09.474669 (+    40us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:09.474893 (+   224us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":445870,"prepare.queue_time_us":982789,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":90,"raft.queue_time_us":163899,"raft.run_cpu_time_us":569,"raft.run_wall_time_us":48309,"thread_start_us":250124,"threads_started":2,"wal-append.queue_time_us":591626}
W20260812 19:24:09.517392 14143 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.275s	user 0.027s	sys 0.009s
I20260812 19:24:09.535449  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2210) took 1070 ms. Trace:
I20260812 19:24:09.452369 14301 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:09.462996 14241 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:09.516551 14352 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:09.539244  6230 rpcz_store.cc:276] 0812 19:24:08.465101 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:08.476045 (+ 10944us) service_pool.cc:227] Handling call
0812 19:24:08.476345 (+   300us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:08.481349 (+  5004us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:08.481379 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:08.495654 (+ 14275us) log.cc:842] Serialized 26 byte log entry
0812 19:24:08.771718 (+276064us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:09.203635 (+431917us) log.cc:842] Serialized 14 byte log entry
0812 19:24:09.203921 (+   286us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:09.204064 (+   143us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:09.535236 (+331172us) raft_consensus.cc:1671] finished
0812 19:24:09.535258 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:09.535394 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":66777,"prepare.queue_time_us":303615,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":4757,"raft.run_cpu_time_us":394,"raft.run_wall_time_us":27436,"thread_start_us":419643,"threads_started":2,"wal-append.queue_time_us":441705}
I20260812 19:24:09.531841 14189 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:09.566401  6230 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: [8.4-10.5]
I20260812 19:24:09.567173  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2221) took 1098 ms. Trace:
I20260812 19:24:09.567528  6230 rpcz_store.cc:276] 0812 19:24:08.468368 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.565688 (+1097320us) service_pool.cc:227] Handling call
0812 19:24:09.566107 (+   419us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:09.566882 (+   775us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:09.567113 (+   231us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:24:09.568188  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 212482us
I20260812 19:24:09.572302  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2218) took 1104 ms. Trace:
I20260812 19:24:09.572947  6228 rpcz_store.cc:276] 0812 19:24:08.467451 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.315272 (+847821us) service_pool.cc:227] Handling call
0812 19:24:09.377786 (+ 62514us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:09.393278 (+ 15492us) raft_consensus.cc:1520] Early marking committed up to index 6
0812 19:24:09.409178 (+ 15900us) log.cc:842] Serialized 14 byte log entry
0812 19:24:09.571856 (+162678us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:09.571921 (+    65us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:09.571988 (+    67us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:09.572082 (+    94us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:09.572225 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17023,"prepare.queue_time_us":22969,"prepare.run_cpu_time_us":1330,"prepare.run_wall_time_us":3059,"thread_start_us":145094,"threads_started":1}
I20260812 19:24:09.590523  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:09.590811  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:09.592175  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:09.543058 14144 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:09.543311 14043 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:09.543504 14301 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:09.532269 14044 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260812 19:24:09.591753  6228 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:09.575068 14030 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:09.638751  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:09.640759  6352 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:09.601205 14189 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:09.613660 14202 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:09.542449 14322 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260812 19:24:09.606202 14285 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:09.611651 14276 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:09.618613 14280 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:09.620108 14301 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:24:09.667675  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 255692us
I20260812 19:24:09.698184  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:09.648102 14342 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260812 19:24:09.699138  6228 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:24:09.700475  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:09.631438 14129 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:09.635921 14209 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:09.696398 14270 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.262s	user 0.001s	sys 0.001s
I20260812 19:24:09.718622  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:09.572113 14352 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:09.606401 12972 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:09.702553 14202 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:09.703070 14310 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:09.733338  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:09.651394 14030 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:09.734599  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:09.742448 14280 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:09.743134 14280 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:09.744269 14280 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:09.745123  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2244) took 1944 ms. Trace:
I20260812 19:24:09.747067  6465 raft_consensus.cc:1203] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 9.5->[11.6-11.6]   Dedup: 11.6->[]
W20260812 19:24:09.747278 14321 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260812 19:24:09.747611  6465 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260812 19:24:09.748797  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2216) took 1281 ms. Trace:
I20260812 19:24:09.745568  6481 rpcz_store.cc:276] 0812 19:24:07.801234 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:07.806545 (+  5311us) service_pool.cc:227] Handling call
0812 19:24:07.837000 (+ 30455us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:07.850463 (+ 13463us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:07.850507 (+    44us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:07.851226 (+   719us) log.cc:842] Serialized 52 byte log entry
0812 19:24:08.156733 (+305507us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:08.156792 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:08.156903 (+   111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:09.744863 (+1587960us) raft_consensus.cc:1671] finished
0812 19:24:09.744888 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:09.745059 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":38613,"raft.queue_time_us":98,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":12181,"thread_start_us":232110,"threads_started":1,"wal-append.queue_time_us":1172995}
I20260812 19:24:09.749178  6242 rpcz_store.cc:276] 0812 19:24:08.466886 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:08.818795 (+351909us) service_pool.cc:227] Handling call
0812 19:24:08.857452 (+ 38657us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:08.857737 (+   285us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:08.857769 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:08.858272 (+   503us) log.cc:842] Serialized 26 byte log entry
0812 19:24:09.054938 (+196666us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:09.054994 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:09.055095 (+   101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:09.748566 (+693471us) raft_consensus.cc:1671] finished
0812 19:24:09.748592 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:09.748738 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":101876,"threads_started":1,"wal-append.queue_time_us":239634}
I20260812 19:24:09.660111 14189 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:09.726675 14314 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:09.764761  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:09.772017 14355 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:09.753844 14043 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:09.773499  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:09.766629  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:09.777180  6477 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:24:09.671548 14276 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:09.753412 14206 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:09.785941 14206 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:09.786374 14206 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:09.781731 14314 raft_consensus.cc:686] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:09.787705 14314 consensus_queue.cc:237] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:09.772634 14355 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:09.782999  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:09.709916 14129 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:09.770313 14327 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260812 19:24:09.772923 14043 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:09.715801 14209 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:09.737968 14202 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:09.793502  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:09.811512  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:09.812757  6242 raft_consensus.cc:2396] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260812 19:24:09.814865  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:09.703480 14285 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:09.817392  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:09.817909 14129 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:09.812893  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:09.831934  6481 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260812 19:24:09.835765  6230 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260812 19:24:09.858564  6242 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:09.753053 14310 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:09.818590 14209 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:09.890591 14358 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260812 19:24:09.908567  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2215) took 1442 ms. Trace:
I20260812 19:24:09.918543  6224 rpcz_store.cc:276] 0812 19:24:08.466559 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:08.821231 (+354672us) service_pool.cc:227] Handling call
0812 19:24:08.864931 (+ 43700us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:08.933378 (+ 68447us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:08.933422 (+    44us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:08.947516 (+ 14094us) log.cc:842] Serialized 52 byte log entry
0812 19:24:09.261531 (+314015us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:09.261829 (+   298us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:09.262200 (+   371us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:09.908330 (+646130us) raft_consensus.cc:1671] finished
0812 19:24:09.908350 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:09.908506 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12090,"raft.queue_time_us":24647,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":16866,"thread_start_us":226609,"threads_started":1,"wal-append.queue_time_us":373314}
W20260812 19:24:09.893980 14239 consensus_meta.cc:287] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.853s	user 0.012s	sys 0.001s
I20260812 19:24:09.891167 14189 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:09.938129 14350 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260812 19:24:09.957610 14381 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260812 19:24:09.962260  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:09.908393 14352 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:09.974612 14255 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:09.990875 14370 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260812 19:24:09.993352 13504 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:09.994050 13504 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:09.994072 14363 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260812 19:24:09.939293 14239 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:09.984324 14264 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 1.146s	user 0.001s	sys 0.001s
W20260812 19:24:10.004377 14246 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.074s	user 0.000s	sys 0.002s
I20260812 19:24:10.009052  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.010993  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:09.876983  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:10.017366  6224 pending_rounds.cc:76] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 4
I20260812 19:24:10.017763  6224 pending_rounds.cc:97] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260812 19:24:10.018088  6224 raft_consensus.cc:2866] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:09.879479 14009 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.028829  6229 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 9. Ops: []
I20260812 19:24:10.017192 14285 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:10.039623 14009 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:10.033686 14310 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:10.056041 14239 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:10.061368  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:10.042423 14030 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:10.110321 13616 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.014s	sys 0.010s
W20260812 19:24:10.111188 13616 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.015s	sys 0.010s
I20260812 19:24:10.117722 14276 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:10.139753  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2183) took 2734 ms. Trace:
I20260812 19:24:10.140426  6342 rpcz_store.cc:276] 0812 19:24:07.405011 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:07.405117 (+   106us) service_pool.cc:227] Handling call
0812 19:24:07.440765 (+ 35648us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:07.441269 (+   504us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:24:07.847750 (+406481us) log.cc:842] Serialized 14 byte log entry
0812 19:24:08.009241 (+161491us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:08.041059 (+ 31818us) log.cc:842] Serialized 26 byte log entry
0812 19:24:08.041300 (+   241us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:24:08.041351 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:08.041463 (+   112us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:09.996015 (+1954552us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:10.139321 (+143306us) raft_consensus.cc:1671] finished
0812 19:24:10.139468 (+   147us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:10.139671 (+   203us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":31215,"prepare.queue_time_us":102763,"prepare.run_cpu_time_us":1223,"prepare.run_wall_time_us":11122,"raft.queue_time_us":125308,"raft.run_cpu_time_us":428,"raft.run_wall_time_us":22918,"spinlock_wait_cycles":12580096,"thread_start_us":455781,"threads_started":2,"wal-append.queue_time_us":689610}
I20260812 19:24:10.117863 14355 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:10.143915 14228 raft_consensus.cc:3032] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:10.144058 13504 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:10.144428 14228 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:10.089636 14202 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:10.115677 14043 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:10.167435  6345 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.004s	sys 0.024s
W20260812 19:24:10.170722  6345 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.005s	sys 0.024s
W20260812 19:24:10.184181  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.016s	sys 0.011s
I20260812 19:24:10.178448 14343 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:24:10.186010  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.016s	sys 0.012s
W20260812 19:24:10.188081  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.011s	sys 0.033s
W20260812 19:24:10.188414  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 596211us
I20260812 19:24:10.189620  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:10.188454  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.011s	sys 0.033s
W20260812 19:24:10.202139  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 432115us
W20260812 19:24:10.162966 14017 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.005s	sys 0.030s
W20260812 19:24:10.187968 14006 consensus_meta.cc:287] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.800s	user 0.013s	sys 0.005s
W20260812 19:24:10.188187 14133 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.750s	user 0.016s	sys 0.010s
I20260812 19:24:10.225901  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.220767 14030 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260812 19:24:10.182523 14206 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:10.220897 14138 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:10.229671 14375 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:10.229873 14206 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:10.230108 14138 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:10.230538 14044 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:24:10.230368 14375 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.231432 14044 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:10.231838 14044 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:10.232420 14138 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:10.232733 14375 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:10.201146 14202 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:10.236644  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.232671 14044 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.221261 13983 consensus_queue.cc:1046] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260812 19:24:10.233675  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.239095  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:10.239993  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 469045us
W20260812 19:24:10.204248 14322 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.009s	sys 0.016s
I20260812 19:24:10.241542  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:10.222733 14017 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.006s	sys 0.031s
I20260812 19:24:10.222616 14355 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:10.240453 14129 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:10.246517  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:10.254289  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:10.260128  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:10.260387 13983 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:10.260773 14133 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260812 19:24:10.245903 14359 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.027s	sys 0.026s
I20260812 19:24:10.262712  6178 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:10.263737 14255 consensus_queue.cc:1046] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:24:10.264819 14196 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:24:10.245289 14189 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:10.243878 14375 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:10.322886 14244 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:10.249292 14030 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:10.335577 14244 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.335783 14030 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.337834 14244 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:10.321710 14044 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:10.338129 14030 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:10.245069 14209 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:10.339053 14209 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:10.339874 14301 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.642s	user 0.021s	sys 0.007s
I20260812 19:24:10.340317 14301 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.341933 14209 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:10.345044  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:10.346762  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:10.239666 14325 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:10.252242  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2240) took 2955 ms. Trace:
I20260812 19:24:10.260193  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:10.234720 14006 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.179927 14228 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.201259 14343 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:10.347388  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 84797.6us
I20260812 19:24:10.347779  6352 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:10.342391 14301 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:10.375025 14133 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:24:10.392639  7606 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:10.393579 14228 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:10.322706 13983 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.296761 14286 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:10.398083 14286 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:10.398958 14407 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260812 19:24:10.373361  6482 rpcz_store.cc:276] 0812 19:24:07.292777 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:07.294116 (+  1339us) service_pool.cc:227] Handling call
0812 19:24:07.323680 (+ 29564us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:07.373033 (+ 49353us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:07.373063 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:07.382037 (+  8974us) log.cc:842] Serialized 26 byte log entry
0812 19:24:07.479838 (+ 97801us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:07.479885 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.243399 (+2763514us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b54003a8254. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:10.243467 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:10.243539 (+    72us) raft_consensus.cc:1671] finished
0812 19:24:10.243554 (+    15us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:10.248288 (+  4734us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28285,"raft.queue_time_us":32937,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":2548,"spinlock_wait_cycles":47133952,"thread_start_us":97513,"threads_started":1,"wal-append.queue_time_us":475031,"wal-append.run_cpu_time_us":8470,"wal-append.run_wall_time_us":1475334}
I20260812 19:24:10.403383  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:10.404872  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:10.406174  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:10.326241 14359 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.032s	sys 0.028s
I20260812 19:24:10.411442  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 1970) took 1039 ms. Trace:
I20260812 19:24:10.411994  6483 rpcz_store.cc:276] 0812 19:24:09.372101 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.402600 (+ 30499us) service_pool.cc:227] Handling call
0812 19:24:10.411188 (+1008588us) spinlock_profiling.cc:243] Waited 81.6 ms on lock 0x7b54004452d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:10.411369 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":187775872}
I20260812 19:24:10.413393  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:10.387763  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.299472  7597 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:24:10.416322 14333 raft_consensus.cc:3032] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:10.416940 14333 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:10.327168 14196 consensus_queue.cc:1225] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer bdfa5579d4534c618c00db6b4a841c81 log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:24:10.433204  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.397413 14280 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:10.441987  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 54310.2us
I20260812 19:24:10.430267 14030 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:10.401360  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.443392  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:10.270612 14355 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.447985  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.455672  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.456022  6342 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 13: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:10.457310  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:59812 (request call id 18) took 3701 ms. Trace:
I20260812 19:24:10.460093  6473 rpcz_store.cc:276] 0812 19:24:06.744651 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:06.744923 (+   272us) service_pool.cc:227] Handling call
0812 19:24:10.446129 (+3701206us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b54000735d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7772bc3 00007f98fc6bc81a 00007f98f5dbbd04 00007f98f5dbbc92 00007f98f5dbbbc1 00007f98f5dbbb3c 00007f98f5dbadf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:10.446261 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1567141760}
I20260812 19:24:10.461750 14401 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:10.462498 14401 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:10.301045 14009 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.133s
W20260812 19:24:10.445137 14258 consensus_meta.cc:287] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.929s	user 0.012s	sys 0.015s
I20260812 19:24:10.431195 14325 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:10.488312  6482 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 12. Ops: []
I20260812 19:24:10.490711  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:10.491827  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1969) took 1120 ms. Trace:
I20260812 19:24:10.492236  6482 rpcz_store.cc:276] 0812 19:24:09.371819 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:10.452877 (+1081058us) service_pool.cc:227] Handling call
0812 19:24:10.485499 (+ 32622us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:10.491509 (+  6010us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.491764 (+   255us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:10.493119  6347 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 12. Ops: []
I20260812 19:24:10.494709  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260812 19:24:10.373162 14189 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.497607  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:10.449605 14133 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:10.458271 14276 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:10.499491  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.502045  6350 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:10.498953 14009 consensus_queue.cc:1225] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer 54f83319db6b49929cc8f18a66a66975 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260812 19:24:10.503352 14399 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:10.503268  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:10.517830 14399 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.521294 14399 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:10.504082  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:10.501629 12972 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:10.506385 14232 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:10.507205 13983 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:10.508947 14355 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:10.525048  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.527312 14405 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:10.418085 14333 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:10.528308 14397 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260812 19:24:10.507244 14413 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:10.494167 13808 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:10.535987  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.537371 14413 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:10.539209 14389 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260812 19:24:10.539469  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 84895.9us
I20260812 19:24:10.540383  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.541646 14189 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:10.543437 14401 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:10.543332 14196 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:24:10.542332  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.545464 14286 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:10.545890 13808 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:10.546113 14286 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:10.546716 13808 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:24:10.490171 14258 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.547516 14006 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:10.543258  6474 raft_consensus.cc:3032] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:10.466073 14030 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.466260 14280 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.551821  6474 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:10.592703  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.593591  6349 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:10.534600  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:10.592996  7599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 551) took 1193 ms. Trace:
I20260812 19:24:10.596174  7599 rpcz_store.cc:276] 0812 19:24:09.399166 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.399882 (+   716us) service_pool.cc:227] Handling call
0812 19:24:09.417489 (+ 17607us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:09.520323 (+102834us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:09.520368 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:09.520424 (+    56us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:09.520467 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.553263 (+1032796us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54002c5954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:10.553335 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:10.592919 (+ 39584us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":235748096}
I20260812 19:24:10.595394  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:10.568531  6474 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:10.605420  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 343726us
I20260812 19:24:10.606602  6474 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:10.607230  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:10.550594 14355 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:10.524255 14133 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.549940 14027 raft_consensus.cc:3032] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:24:10.638391  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.639906  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2003) took 3247 ms. Trace:
I20260812 19:24:10.623401  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.557106 14153 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:10.551072 14286 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:10.636265  6350 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:10.604398 14399 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:10.631763  6417 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:10.622080 14189 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:10.640405  6345 rpcz_store.cc:276] 0812 19:24:07.392632 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:07.392892 (+   260us) service_pool.cc:227] Handling call
0812 19:24:07.393242 (+   350us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:07.543869 (+150627us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:07.543898 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:09.305965 (+1762067us) spinlock_profiling.cc:243] Waited 9.17 ms on lock 0x7b2c00012928. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:24:09.306371 (+   406us) log.cc:842] Serialized 26 byte log entry
0812 19:24:10.178243 (+871872us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:10.178295 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.180527 (+  2232us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:10.626912 (+446385us) raft_consensus.cc:1671] finished
0812 19:24:10.626940 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:10.639817 (+ 12877us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":70179,"raft.queue_time_us":142351,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":18788,"spinlock_wait_cycles":21084928,"thread_start_us":951466,"threads_started":2,"wal-append.queue_time_us":963313}
I20260812 19:24:10.657362  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:10.531066 12972 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:10.623878 14206 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:10.655453  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.680348  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.681962 14209 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 19:24:10.654245 14153 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.684907 14153 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:10.652259 14286 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:10.686196 14286 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:10.535668 14232 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.644914 14027 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:10.651537  6474 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260812 19:24:10.688727  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.696178  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.704046  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2260) took 1349 ms. Trace:
I20260812 19:24:10.704191  6345 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:24:10.704421  6474 rpcz_store.cc:276] 0812 19:24:09.354410 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.523099 (+168689us) service_pool.cc:227] Handling call
0812 19:24:09.541095 (+ 17996us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:10.543086 (+1001991us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54000c3da0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7708730 00007f98f777a300 00007f98f777b371 00007f98f7777edf 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc
0812 19:24:10.703789 (+160703us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.703992 (+   203us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1673824512}
I20260812 19:24:10.705147  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.705289  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.706195  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:10.653582 14129 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:24:10.656231 14355 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:10.659736 14189 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:10.676994 14206 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:10.609259 14325 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
W20260812 19:24:10.720826 14418 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260812 19:24:10.699397  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 195169us
I20260812 19:24:10.760877  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2274) took 1130 ms. Trace:
I20260812 19:24:10.720422 14244 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 19:24:10.706352  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:10.722457 14031 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260812 19:24:10.724773 14189 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:10.701944 14140 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:10.761344  6474 rpcz_store.cc:276] 0812 19:24:09.630414 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:10.723120 (+1092706us) service_pool.cc:227] Handling call
0812 19:24:10.760344 (+ 37224us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:10.760551 (+   207us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:10.760575 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:10.760622 (+    47us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:10.760651 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.760701 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:10.760814 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:10.762986  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.763602 14426 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:10.723099 14401 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:10.767356 14044 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:10.771337 14425 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260812 19:24:10.796577  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2277) took 1036 ms. Trace:
I20260812 19:24:10.778328  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:24:10.797991  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.798851  6349 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:24:10.797103  6474 rpcz_store.cc:276] 0812 19:24:09.760584 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:10.786845 (+1026261us) service_pool.cc:227] Handling call
0812 19:24:10.795913 (+  9068us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:10.796145 (+   232us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:10.796180 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:10.796245 (+    65us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:10.796289 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.796377 (+    88us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:10.796507 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:10.780789 12972 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:10.780910  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.804019  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:10.805624 14409 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.544s	user 0.000s	sys 0.002s
I20260812 19:24:10.726111  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.797668 14044 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.776722  6298 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.730232 14206 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:10.791980 14401 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:10.727967 14258 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:10.720948 14209 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260812 19:24:10.805851  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:10.807703  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.814703 14209 consensus_queue.cc:1225] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260812 19:24:10.812145 14413 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:10.824254  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:10.781764 14030 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:10.789958 14027 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.827024 14027 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:10.818452 14325 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:10.810928 14280 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:10.812039 14133 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:10.822329 12972 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:10.830389 12972 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:10.830816 12972 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:10.809478 14232 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:10.811259 14401 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:10.831826  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.832403  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1959) took 2432 ms. Trace:
I20260812 19:24:10.832661  6481 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260812 19:24:10.832787  6470 rpcz_store.cc:276] 0812 19:24:08.399680 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.101554 (+701874us) service_pool.cc:227] Handling call
0812 19:24:09.101870 (+   316us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:09.200200 (+ 98330us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.832152 (+1631952us) spinlock_profiling.cc:243] Waited 97.5 ms on lock 0x7b54004448d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:10.832344 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":224355584}
I20260812 19:24:10.834923  7594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 550) took 1443 ms. Trace:
I20260812 19:24:10.835497  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.833187  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.835824  7594 rpcz_store.cc:276] 0812 19:24:09.391351 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.391524 (+   173us) service_pool.cc:227] Handling call
0812 19:24:09.404783 (+ 13259us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:09.828096 (+423313us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:09.828130 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:09.828173 (+    43us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:09.828203 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.830542 (+1002339us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b5400229cd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:10.830591 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:10.834863 (+  4272us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":972982016}
I20260812 19:24:10.838470  6345 raft_consensus.cc:2379] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:10.828475 14325 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:10.839184  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:10.844254  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.808727 14044 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:10.845937  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2220) took 2377 ms. Trace:
I20260812 19:24:10.860591  6235 rpcz_store.cc:276] 0812 19:24:08.468075 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.510098 (+1042023us) service_pool.cc:227] Handling call
0812 19:24:09.510476 (+   378us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:09.529099 (+ 18623us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:24:09.529131 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:09.552965 (+ 23834us) log.cc:842] Serialized 26 byte log entry
0812 19:24:10.421022 (+868057us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b18003cf4c0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:24:10.713270 (+292248us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:10.713431 (+   161us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.713829 (+   398us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:10.844862 (+131033us) raft_consensus.cc:1671] finished
0812 19:24:10.844890 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:10.845846 (+   956us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1211282,"raft.queue_time_us":103124,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":1220426,"spinlock_wait_cycles":20372736,"thread_start_us":291772,"threads_started":1,"wal-append.queue_time_us":1218639}
I20260812 19:24:10.864650  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.864785  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:10.865664  6349 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:10.867139  6345 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:10.870203  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:10.871620  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 251413us
W20260812 19:24:10.872514  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 240838us
I20260812 19:24:10.883704  6350 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260812 19:24:10.872612  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.888482  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:10.793943  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 258034us
I20260812 19:24:10.891980  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.898356  6349 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260812 19:24:10.901121 14155 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:24:10.911868  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2244) took 1206 ms. Trace:
I20260812 19:24:10.898967  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.912278  6224 rpcz_store.cc:276] 0812 19:24:09.705331 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.978824 (+273493us) service_pool.cc:227] Handling call
0812 19:24:10.017126 (+ 38302us) raft_consensus.cc:1457] Updating replica for 3 ops
0812 19:24:10.028922 (+ 11796us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:10.028958 (+    36us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0812 19:24:10.029845 (+   887us) log.cc:842] Serialized 78 byte log entry
0812 19:24:10.454741 (+424896us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:10.454782 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.454848 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:10.911615 (+456767us) raft_consensus.cc:1671] finished
0812 19:24:10.911634 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:10.911801 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":836197,"raft.queue_time_us":2171,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":847542,"thread_start_us":414067,"threads_started":1,"wal-append.queue_time_us":508660}
I20260812 19:24:10.913790 14155 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:10.914127  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:10.906697  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:10.791199 14140 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:10.911108 14325 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:10.903847  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2186) took 3396 ms. Trace:
I20260812 19:24:10.917735  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:10.918118  6345 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: [10.5-12.6]
I20260812 19:24:10.910202 14189 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:10.918850  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:10.921509  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:10.952778  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2271) took 1405 ms. Trace:
I20260812 19:24:10.957647  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:10.960394  6345 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260812 19:24:10.958105  6482 rpcz_store.cc:276] 0812 19:24:09.547678 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:10.500242 (+952564us) service_pool.cc:227] Handling call
0812 19:24:10.525542 (+ 25300us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:10.525911 (+   369us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:24:10.728539 (+202628us) log.cc:842] Serialized 14 byte log entry
0812 19:24:10.952085 (+223546us) log.cc:842] Serialized 14 byte log entry
0812 19:24:10.952343 (+   258us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:10.952404 (+    61us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:10.952464 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.952544 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:10.952703 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":383540,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":202,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":94,"spinlock_wait_cycles":3223296,"thread_start_us":424548,"threads_started":2}
W20260812 19:24:10.906831 14228 consensus_meta.cc:287] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.003s
W20260812 19:24:10.975538  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 54112.4us
I20260812 19:24:10.963681  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:10.958637  6224 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:10.959233  6353 rpcz_store.cc:276] 0812 19:24:07.507535 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:07.507686 (+   151us) service_pool.cc:227] Handling call
0812 19:24:07.508110 (+   424us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:07.543450 (+ 35340us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:07.543488 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:10.552702 (+3009214us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b2c00012928. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:24:10.553107 (+   405us) log.cc:842] Serialized 26 byte log entry
0812 19:24:10.699264 (+146157us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:10.699637 (+   373us) log.cc:842] Serialized 14 byte log entry
0812 19:24:10.699859 (+   222us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.699956 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:10.903468 (+203512us) raft_consensus.cc:1671] finished
0812 19:24:10.903600 (+   132us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:10.903763 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":58465,"prepare.queue_time_us":643,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":68585,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":30066,"spinlock_wait_cycles":7478528,"thread_start_us":61407,"threads_started":1,"wal-append.queue_time_us":186863}
I20260812 19:24:10.973559 14298 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:10.922791 13987 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:10.911083 14373 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:10.982916  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:10.921868 13647 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:10.974068  6349 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260812 19:24:10.951104 13616 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:10.993132  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:10.986250 14121 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.973s	user 0.010s	sys 0.014s
I20260812 19:24:10.995152  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:10.996764  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:10.904472 14405 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:11.001677  6235 raft_consensus.cc:2396] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260812 19:24:10.997538 13987 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:24:11.006996 14121 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.995s	user 0.011s	sys 0.014s
I20260812 19:24:11.054296  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:10.997865 14447 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:10.998008 14373 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:11.002205 14228 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260812 19:24:11.057016  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 43980.9us
I20260812 19:24:11.057910  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 586) took 3265 ms. Trace:
I20260812 19:24:11.058950  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:11.069527  6224 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:11.070402  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:11.071128  6224 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:11.060956  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:11.005688 14298 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:11.058985 13987 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:11.013248 14334 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:11.013892 14467 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260812 19:24:11.068575  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:11.073524  6482 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:11.059717  6235 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:11.084828  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:11.079681  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 584) took 3683 ms. Trace:
I20260812 19:24:11.062772 14044 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:11.085912  6232 rpcz_store.cc:276] 0812 19:24:07.396009 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:07.397950 (+  1941us) service_pool.cc:227] Handling call
0812 19:24:10.324454 (+2926504us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b5800001898. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824bce 000000000034aea9 00007f98fc644a30 00007f98fc70a7b4 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:24:10.324666 (+   212us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:10.324935 (+   269us) raft_consensus.cc:1520] Early marking committed up to index 13
0812 19:24:10.710927 (+385992us) log.cc:842] Serialized 14 byte log entry
0812 19:24:11.008010 (+297083us) log.cc:842] Serialized 14 byte log entry
0812 19:24:11.078959 (+ 70949us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:11.079019 (+    60us) raft_consensus.cc:1631] Marking committed up to 13
0812 19:24:11.079065 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.079132 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:11.079612 (+   480us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":70336,"prepare.queue_time_us":523349,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":73935,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":10611456,"thread_start_us":617058,"threads_started":2}
I20260812 19:24:11.088901  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:11.078955  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:11.068859 14228 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:11.089757  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:11.072150  6241 rpcz_store.cc:276] 0812 19:24:07.792424 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:07.793044 (+   620us) service_pool.cc:227] Handling call
0812 19:24:07.793420 (+   376us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:07.793802 (+   382us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:07.793831 (+    29us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:10.545471 (+2751640us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b2c0006c608. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:24:10.546033 (+   562us) log.cc:842] Serialized 52 byte log entry
0812 19:24:10.729796 (+183763us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:24:11.010793 (+280997us) log.cc:842] Serialized 14 byte log entry
0812 19:24:11.011352 (+   559us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.011727 (+   375us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:11.011783 (+    56us) raft_consensus.cc:1671] finished
0812 19:24:11.057608 (+ 45825us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:11.057830 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2713,"prepare.queue_time_us":118307,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":12736,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":41688,"spinlock_wait_cycles":35675904,"thread_start_us":422937,"threads_started":2,"wal-append.queue_time_us":417206}
I20260812 19:24:11.102706  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:11.105165  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:11.067188 14373 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:11.064054 14261 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260812 19:24:11.116425  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:11.081248 14325 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:11.122706  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:11.124236  6241 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:11.131896  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:11.091033 14433 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:11.136356  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:11.139526  6241 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:11.108557 14228 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:11.144922  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:11.160267  6477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2272) took 1562 ms (client timeout 1524 ms). Trace:
W20260812 19:24:11.160770  6477 rpcz_store.cc:269] 0812 19:24:09.598188 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.712024 (+113836us) service_pool.cc:227] Handling call
0812 19:24:11.160045 (+1448021us) spinlock_profiling.cc:243] Waited 57.6 ms on lock 0x7b54001315d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:11.160183 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":132461440}
I20260812 19:24:11.161819  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1958) took 2762 ms. Trace:
I20260812 19:24:11.161991  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:11.164491 14202 raft_consensus.cc:3032] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:24:11.165143 14202 raft_consensus.cc:729] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:11.167590  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2217) took 2700 ms. Trace:
I20260812 19:24:11.166623 14202 consensus_queue.cc:260] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:11.167999  6229 rpcz_store.cc:276] 0812 19:24:08.467142 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.248071 (+780929us) service_pool.cc:227] Handling call
0812 19:24:09.301188 (+ 53117us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:10.035018 (+733830us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.167315 (+1132297us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54001649d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:11.167524 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1664807680}
I20260812 19:24:11.168467 14202 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:11.169337  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:11.169864 14285 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:11.170222  6229 raft_consensus.cc:2396] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260812 19:24:11.170370 14285 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:11.172600 14285 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:11.162431  6465 rpcz_store.cc:276] 0812 19:24:08.399253 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:08.939171 (+539918us) service_pool.cc:227] Handling call
0812 19:24:09.746913 (+807742us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:09.748002 (+  1089us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.161491 (+1413489us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54002d2150. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:11.161737 (+   246us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":934388096}
I20260812 19:24:11.151144 14433 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:11.178772  6465 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260812 19:24:11.120211 14261 consensus_queue.cc:1225] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer 54f83319db6b49929cc8f18a66a66975 log is divergent from this leader: its last log entry 10.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260812 19:24:11.188546  6477 raft_consensus.cc:2396] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 14 because replica has last-logged OpId of term: 11 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260812 19:24:11.146181  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:11.165053 14471 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260812 19:24:11.152029  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:11.191432  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:11.190713  6224 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:24:11.077804 12972 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:11.105132 14044 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:11.201550  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2248) took 1450 ms. Trace:
I20260812 19:24:11.202056  6477 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260812 19:24:11.186335 14397 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260812 19:24:11.202006  6224 rpcz_store.cc:276] 0812 19:24:09.751444 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.200747 (+1449303us) service_pool.cc:227] Handling call
0812 19:24:11.201070 (+   323us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:11.201235 (+   165us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:11.201261 (+    26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:11.201303 (+    42us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:11.201345 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.201394 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:11.201494 (+   100us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:11.206202  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2247) took 1466 ms. Trace:
W20260812 19:24:11.076895 14162 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 3.056s	user 0.008s	sys 0.014s
I20260812 19:24:11.206365  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:11.207772  6241 rpcz_store.cc:276] 0812 19:24:09.740212 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.202598 (+1462386us) service_pool.cc:227] Handling call
0812 19:24:11.205552 (+  2954us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:11.205784 (+   232us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:11.205821 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:11.205878 (+    57us) raft_consensus.cc:1631] Marking committed up to 13
0812 19:24:11.205932 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.206004 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:11.206129 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:11.190989 14189 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:11.092018 14334 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:11.226632  6477 raft_consensus.cc:1203] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 7.4->[9.5-14.7]   Dedup: 9.5->[12.6-14.7]
I20260812 19:24:11.225255  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2251) took 1456 ms. Trace:
W20260812 19:24:11.204484 14440 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.091s	user 0.000s	sys 0.002s
W20260812 19:24:11.237301  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 161793us
I20260812 19:24:11.237962  6241 rpcz_store.cc:276] 0812 19:24:09.768433 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.224257 (+1455824us) service_pool.cc:227] Handling call
0812 19:24:11.224654 (+   397us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:11.224863 (+   209us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:11.224899 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:11.224954 (+    55us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:11.224997 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.225062 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:11.225184 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:11.239969  6477 pending_rounds.cc:76] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 5
I20260812 19:24:11.240453  6477 pending_rounds.cc:97] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260812 19:24:11.240839  6477 raft_consensus.cc:2866] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:11.155186 14401 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:11.222424 14162 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.217s	user 0.008s	sys 0.015s
I20260812 19:24:11.243695 14298 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260812 19:24:11.244004  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 112240us
I20260812 19:24:11.289703  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:11.280730  6241 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:24:11.280580  6229 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260812 19:24:11.328128  6241 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:11.328704  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2250) took 1568 ms. Trace:
I20260812 19:24:11.395916  6229 rpcz_store.cc:276] 0812 19:24:09.760468 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.223748 (+1463280us) service_pool.cc:227] Handling call
0812 19:24:11.280233 (+ 56485us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:11.328381 (+ 48148us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.328641 (+   260us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:11.397877  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2254) took 1609 ms. Trace:
I20260812 19:24:11.275983 12972 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:11.400697  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 681) took 2814 ms. Trace:
I20260812 19:24:11.404817 14239 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:11.405601 14239 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:11.408600 14239 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:11.410240 14239 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:11.243000 14206 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:11.416384 14401 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:11.282337 14405 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:11.452281  6345 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: [10.5-12.6]
W20260812 19:24:11.428846 14361 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.717s	user 0.002s	sys 0.000s
I20260812 19:24:11.464773  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:11.398298  6229 rpcz_store.cc:276] 0812 19:24:09.788929 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.396916 (+1607987us) service_pool.cc:227] Handling call
0812 19:24:11.397311 (+   395us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:11.397522 (+   211us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:11.397549 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:11.397592 (+    43us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:11.397625 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.397677 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:11.397816 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:11.571172  6229 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260812 19:24:11.401258  6344 rpcz_store.cc:276] 0812 19:24:08.586250 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:08.645198 (+ 58948us) service_pool.cc:227] Handling call
0812 19:24:08.762718 (+117520us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:08.763086 (+   368us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:08.763121 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:10.426936 (+1663815us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b2c00012928. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:24:10.442673 (+ 15737us) log.cc:842] Serialized 26 byte log entry
0812 19:24:10.949763 (+507090us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:10.949805 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.949888 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:11.166373 (+216485us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:11.400441 (+234068us) raft_consensus.cc:1671] finished
0812 19:24:11.400465 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:11.400624 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":92930,"raft.queue_time_us":7680,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":9353,"spinlock_wait_cycles":21502464,"thread_start_us":448485,"threads_started":1,"wal-append.queue_time_us":598063}
W20260812 19:24:11.489931  6350 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.047s	sys 0.058s
W20260812 19:24:11.572933  6350 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.047s	sys 0.058s
I20260812 19:24:11.588925  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2257) took 1684 ms. Trace:
I20260812 19:24:11.589627  6229 rpcz_store.cc:276] 0812 19:24:09.904839 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.570319 (+1665480us) service_pool.cc:227] Handling call
0812 19:24:11.570748 (+   429us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:11.571805 (+  1057us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.588849 (+ 17044us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:11.547351  6241 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:11.593535  6241 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
W20260812 19:24:11.598908  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.056s	sys 0.097s
W20260812 19:24:11.599689  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.056s	sys 0.097s
I20260812 19:24:11.266113 14044 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:11.606137  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 591112us
I20260812 19:24:11.613674  6344 pending_rounds.cc:76] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 3
I20260812 19:24:11.614017  6344 pending_rounds.cc:97] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 10.4
I20260812 19:24:11.614301  6344 raft_consensus.cc:2866] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:11.622925  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:11.624084  6349 raft_consensus.cc:2379] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:11.561142 14298 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:11.642194  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 648) took 1295 ms. Trace:
I20260812 19:24:11.641090  6241 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260812 19:24:11.645655  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2253) took 1864 ms. Trace:
I20260812 19:24:11.651888  6241 rpcz_store.cc:276] 0812 19:24:09.783309 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.239346 (+1456037us) service_pool.cc:227] Handling call
0812 19:24:11.239730 (+   384us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:11.645310 (+405580us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.645587 (+   277us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:11.644390  6474 rpcz_store.cc:276] 0812 19:24:10.346560 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:10.800657 (+454097us) service_pool.cc:227] Handling call
0812 19:24:10.806361 (+  5704us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:10.806620 (+   259us) raft_consensus.cc:1520] Early marking committed up to index 11
0812 19:24:11.104081 (+297461us) log.cc:842] Serialized 14 byte log entry
0812 19:24:11.641736 (+537655us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:11.641818 (+    82us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:24:11.641878 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.641955 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:11.642117 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12448,"prepare.queue_time_us":92207,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":40399,"thread_start_us":781558,"threads_started":2}
W20260812 19:24:11.610867 13983 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.010s	sys 0.040s
I20260812 19:24:11.588091 14261 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:11.612919 14433 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:11.660825 13983 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.010s	sys 0.041s
I20260812 19:24:11.567760 14239 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:11.588567 14405 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:11.660176 14361 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260812 19:24:11.671116  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:11.661013 14430 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.020s	sys 0.045s
I20260812 19:24:11.611888 14129 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260812 19:24:11.676714 14373 consensus_meta.cc:287] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.000s
W20260812 19:24:11.686357 14121 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.025s	sys 0.043s
W20260812 19:24:11.696041 14430 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.020s	sys 0.045s
W20260812 19:24:11.702235 14121 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.026s	sys 0.043s
I20260812 19:24:11.668233 14261 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:11.698468 14373 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:11.716574 14373 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:11.717731  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2015) took 2772 ms. Trace:
I20260812 19:24:11.718048 14405 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:11.723096  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:11.719525  6235 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:11.718194  6347 rpcz_store.cc:276] 0812 19:24:08.945168 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.319838 (+374670us) service_pool.cc:227] Handling call
0812 19:24:09.322103 (+  2265us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:10.493569 (+1171466us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.717470 (+1223901us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54002d0fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:11.717665 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2692515072}
I20260812 19:24:11.721158  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 683) took 2963 ms. Trace:
I20260812 19:24:11.730898  6474 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260812 19:24:11.730052  6359 rpcz_store.cc:276] 0812 19:24:08.758251 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:08.758460 (+   209us) service_pool.cc:227] Handling call
0812 19:24:09.339485 (+581025us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:09.390419 (+ 50934us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:09.390463 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:09.401171 (+ 10708us) log.cc:842] Serialized 26 byte log entry
0812 19:24:09.708427 (+307256us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:24:09.708468 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.720731 (+2012263us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b540009e7d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:11.720794 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:11.720838 (+    44us) raft_consensus.cc:1671] finished
0812 19:24:11.720847 (+     9us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:11.721094 (+   247us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":124608,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":136,"spinlock_wait_cycles":116059904,"thread_start_us":287973,"threads_started":1,"wal-append.queue_time_us":397778,"wal-append.run_cpu_time_us":3650,"wal-append.run_wall_time_us":1179469}
W20260812 19:24:11.733135  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 443500us
W20260812 19:24:11.725759 14228 consensus_meta.cc:287] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.538s	user 0.012s	sys 0.000s
W20260812 19:24:11.724879 13987 consensus_meta.cc:287] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.000s
I20260812 19:24:11.719378 14206 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:11.755694  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:11.744256 14467 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:11.744179 14373 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:11.742061 14259 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260812 19:24:11.761032  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:11.769560 14336 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:11.745693 14228 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:11.750305 13987 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:11.778615 14387 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:11.787966 14336 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:11.812929  6232 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:11.786284 14369 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:11.773231 14467 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:11.779843 14259 consensus_queue.cc:1225] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer bdfa5579d4534c618c00db6b4a841c81 log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:24:11.818455  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:11.819360 14495 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260812 19:24:11.821170  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:11.823194 14121 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:24:11.824649 14228 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:11.824553  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:11.827741 14261 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:11.836011  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:11.849761  6359 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:11.806324 14239 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:11.814433 14336 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:11.775591 14373 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:11.807853 14162 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260812 19:24:11.829787 14369 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:11.813906 14387 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:11.887131  6474 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:11.888387  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:11.889549  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:11.903496  6474 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260812 19:24:11.908545 14482 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260812 19:24:11.908912 14506 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260812 19:24:11.910849  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2215) took 1254 ms. Trace:
I20260812 19:24:11.911778 14373 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:11.912248 14121 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260812 19:24:11.912508 14411 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.412s	user 0.008s	sys 0.000s
W20260812 19:24:11.913610 14493 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260812 19:24:11.914489  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2243) took 2209 ms. Trace:
I20260812 19:24:11.914911  6242 rpcz_store.cc:276] 0812 19:24:09.705056 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.889348 (+184292us) service_pool.cc:227] Handling call
0812 19:24:09.898931 (+  9583us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:09.899403 (+   472us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:09.899434 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:09.901209 (+  1775us) log.cc:842] Serialized 26 byte log entry
0812 19:24:10.221160 (+319951us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:10.221199 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.221277 (+    78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:11.838037 (+1616760us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:11.914179 (+ 76142us) raft_consensus.cc:1671] finished
0812 19:24:11.914201 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:11.914423 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":964825,"raft.queue_time_us":132,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":967563,"spinlock_wait_cycles":6767488,"thread_start_us":319516,"threads_started":1,"wal-append.queue_time_us":476203}
I20260812 19:24:11.917081  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:11.906177 14515 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260812 19:24:11.918949  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2249) took 2164 ms. Trace:
I20260812 19:24:11.865899 14369 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:11.943053 14387 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:11.945497 14467 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:11.911255  6350 rpcz_store.cc:276] 0812 19:24:10.656146 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:10.885249 (+229103us) service_pool.cc:227] Handling call
0812 19:24:10.885823 (+   574us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:10.886627 (+   804us) raft_consensus.cc:1520] Early marking committed up to index 5
0812 19:24:10.887030 (+   403us) log.cc:842] Serialized 14 byte log entry
0812 19:24:11.809236 (+922206us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:11.833589 (+ 24353us) log.cc:842] Serialized 26 byte log entry
0812 19:24:11.833797 (+   208us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:24:11.833846 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.833934 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:11.910478 (+ 76544us) raft_consensus.cc:1671] finished
0812 19:24:11.910529 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:11.910775 (+   246us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":196,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":145552,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":219,"thread_start_us":921751,"threads_started":2,"wal-append.queue_time_us":823903}
I20260812 19:24:11.948823 13983 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:11.953485  7603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 552) took 1609 ms. Trace:
I20260812 19:24:11.953994  7603 rpcz_store.cc:276] 0812 19:24:10.344259 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:10.375224 (+ 30965us) service_pool.cc:227] Handling call
0812 19:24:10.434774 (+ 59550us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:10.435041 (+   267us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:10.435077 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:10.435134 (+    57us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:10.435177 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.435251 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:11.953192 (+1517941us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b540058e150. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:11.953403 (+   211us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":74799872}
I20260812 19:24:11.919305  6224 rpcz_store.cc:276] 0812 19:24:09.754294 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.205352 (+1451058us) service_pool.cc:227] Handling call
0812 19:24:11.205667 (+   315us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:11.206120 (+   453us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:11.206150 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:11.232699 (+ 26549us) log.cc:842] Serialized 26 byte log entry
0812 19:24:11.805077 (+572378us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:24:11.805137 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.805230 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:11.918731 (+113501us) raft_consensus.cc:1671] finished
0812 19:24:11.918753 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:11.918890 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11002,"raft.queue_time_us":113,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":20463,"thread_start_us":206947,"threads_started":1,"wal-append.queue_time_us":324897}
I20260812 19:24:11.958276 14239 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:11.959206 14239 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:11.960914  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2269) took 2522 ms. Trace:
I20260812 19:24:11.961370  6473 rpcz_store.cc:276] 0812 19:24:09.438830 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:10.489271 (+1050441us) service_pool.cc:227] Handling call
0812 19:24:10.489640 (+   369us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:10.535496 (+ 45856us) raft_consensus.cc:1520] Early marking committed up to index 6
0812 19:24:10.920252 (+384756us) log.cc:842] Serialized 14 byte log entry
0812 19:24:11.113815 (+193563us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:11.113872 (+    57us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:11.113920 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.959972 (+846052us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b18004b1660. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9
0812 19:24:11.960633 (+   661us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b5400073fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:11.960691 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:11.960840 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":372439,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":85,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":15214,"spinlock_wait_cycles":115054208,"thread_start_us":519379,"threads_started":2,"wal-append.queue_time_us":323075}
I20260812 19:24:11.964198  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:11.966830  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2009) took 3959 ms. Trace:
I20260812 19:24:11.967326  6354 rpcz_store.cc:276] 0812 19:24:08.007377 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:08.008376 (+   999us) service_pool.cc:227] Handling call
0812 19:24:08.058319 (+ 49943us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:08.454839 (+396520us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.966544 (+3511705us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54001b8354. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:11.966745 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":837759232}
I20260812 19:24:11.910867  6482 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:11.970144 13987 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:11.921126  6242 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:11.949724 13983 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:11.976078  6342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2205) took 1748 ms (client timeout 2029 ms). Trace:
W20260812 19:24:11.976682  6342 rpcz_store.cc:269] 0812 19:24:10.227361 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:10.233299 (+  5938us) service_pool.cc:227] Handling call
0812 19:24:11.975845 (+1742546us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54001bfdd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:11.976005 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":478823680}
I20260812 19:24:11.983001  6179 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:11.986609 13987 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:11.988476  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:11.989791  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:11.991490  6359 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:11.970455 14286 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
W20260812 19:24:12.004149  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 179634us
I20260812 19:24:12.018985  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:12.002532  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:11.983768 14129 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:11.997429 14008 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:11.995213 14131 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:11.997742 14239 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:12.047717  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2259) took 2142 ms. Trace:
I20260812 19:24:12.049974  6241 rpcz_store.cc:276] 0812 19:24:10.006530 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.664546 (+1658016us) service_pool.cc:227] Handling call
0812 19:24:11.664898 (+   352us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:11.665817 (+   919us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:24:11.877751 (+211934us) log.cc:842] Serialized 14 byte log entry
0812 19:24:12.047185 (+169434us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:12.047269 (+    84us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:12.047347 (+    78us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:12.047458 (+   111us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:12.047635 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15218,"prepare.queue_time_us":357645,"thread_start_us":349964,"threads_started":2}
I20260812 19:24:12.057564  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:12.043537 14008 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:12.059677 14467 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:12.060510 14467 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:12.066434  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2287) took 1052 ms. Trace:
I20260812 19:24:12.067166  6477 rpcz_store.cc:276] 0812 19:24:11.014502 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.209234 (+194732us) service_pool.cc:227] Handling call
0812 19:24:11.226200 (+ 16966us) raft_consensus.cc:1457] Updating replica for 3 ops
0812 19:24:11.245083 (+ 18883us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:24:11.245131 (+    48us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:11.245821 (+   690us) log.cc:842] Serialized 52 byte log entry
0812 19:24:11.997686 (+751865us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:11.997726 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.997797 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:12.066148 (+ 68351us) raft_consensus.cc:1671] finished
0812 19:24:12.066172 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:12.066361 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":45175,"raft.queue_time_us":3398,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":153759,"thread_start_us":358133,"threads_started":1,"wal-append.queue_time_us":493809}
I20260812 19:24:12.072578  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:12.073120  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 188515us
I20260812 19:24:12.028757 14258 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:12.079131 14258 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:12.081511 14130 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:12.052186 14239 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:12.083397 14239 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:12.025805 14129 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:12.088740 13983 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:12.089349 14129 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:12.062088 14467 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:12.091566 14157 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:12.100109  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:12.107331  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:12.108580  6241 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:24:12.110172  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:12.111121  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:12.112111  6347 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:12.114184  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:12.082320 14130 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:12.114696  6349 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260812 19:24:12.101234  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:12.119158  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:12.045696 14131 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:12.123229  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:12.123623  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:12.104910 14408 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.843s	user 0.001s	sys 0.010s
I20260812 19:24:12.127036  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:12.128407  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:12.129093  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:12.124302  6241 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:24:12.136252  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:12.146121  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:12.149612  6354 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: [10.5-12.6]
W20260812 19:24:12.152474  6178 leader_election.cc:334] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.540s (SENT)
I20260812 19:24:12.154495  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:12.128010 13852 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:12.135499 14430 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:12.150956 14346 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:12.158839 14539 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:12.160889  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:12.155524 14239 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:12.132524 14336 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:12.172538  6241 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260812 19:24:12.168645  6235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2228) took 1732 ms (client timeout 2029 ms). Trace:
I20260812 19:24:12.162073 14043 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:12.160817 14258 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:12.166376 14359 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:12.169682 14346 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:12.162983 14131 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:12.180420  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:12.183732  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:12.188407  6235 rpcz_store.cc:269] 0812 19:24:10.436540 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.084447 (+647907us) service_pool.cc:227] Handling call
0812 19:24:12.168420 (+1083973us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b5400179154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:12.168534 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1457792768}
I20260812 19:24:12.190578  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:12.154608 13458 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:12.195604  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:12.186440 14202 consensus_meta.cc:287] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.017s	user 0.010s	sys 0.008s
W20260812 19:24:12.202178  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 156555us
I20260812 19:24:12.202620  6344 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:12.192613  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2266) took 1756 ms. Trace:
I20260812 19:24:12.203761  6241 rpcz_store.cc:276] 0812 19:24:10.435867 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.134332 (+1698465us) service_pool.cc:227] Handling call
0812 19:24:12.172098 (+ 37766us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:12.191752 (+ 19654us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:12.192490 (+   738us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:12.200464  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:12.160429 14008 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:12.206220  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2233) took 1763 ms. Trace:
I20260812 19:24:12.208806  6235 rpcz_store.cc:276] 0812 19:24:10.442818 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.205588 (+1762770us) service_pool.cc:227] Handling call
0812 19:24:12.205891 (+   303us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:12.206018 (+   127us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:12.206032 (+    14us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:12.206059 (+    27us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:12.206078 (+    19us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:12.206109 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:12.206177 (+    68us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:12.208213  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:12.209700 14539 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260812 19:24:12.214373  6241 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260812 19:24:12.215667  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:12.216514  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2230) took 1779 ms. Trace:
I20260812 19:24:12.210638 14261 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:12.217478 13458 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:24:12.216979  6241 rpcz_store.cc:276] 0812 19:24:10.441824 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.204605 (+1762781us) service_pool.cc:227] Handling call
0812 19:24:12.214058 (+  9453us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:12.216194 (+  2136us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:12.216454 (+   260us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:12.200654 14239 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:12.220269  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2236) took 1751 ms. Trace:
I20260812 19:24:12.222867  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:12.226688  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:12.224833  6235 rpcz_store.cc:276] 0812 19:24:10.469239 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.211415 (+1742176us) service_pool.cc:227] Handling call
0812 19:24:12.216951 (+  5536us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:12.217115 (+   164us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:12.217143 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:12.217185 (+    42us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:12.217219 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:12.220047 (+  2828us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:12.220186 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:12.199965 13987 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260812 19:24:12.231750  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:12.232187  6241 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10. Ops: []
I20260812 19:24:12.215130 14530 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:12.235605  6477 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260812 19:24:12.245870  6477 pending_rounds.cc:76] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 4
I20260812 19:24:12.246199  6477 pending_rounds.cc:97] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260812 19:24:12.246541  6477 raft_consensus.cc:2866] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:12.199079 14043 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:12.246590  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2238) took 1625 ms. Trace:
I20260812 19:24:12.248377  6241 rpcz_store.cc:276] 0812 19:24:10.623256 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.219863 (+1596607us) service_pool.cc:227] Handling call
0812 19:24:12.232025 (+ 12162us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:12.246280 (+ 14255us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:12.246526 (+   246us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:12.249707  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2243) took 1469 ms. Trace:
I20260812 19:24:12.249939  6241 rpcz_store.cc:276] 0812 19:24:10.780239 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.249160 (+1468921us) service_pool.cc:227] Handling call
0812 19:24:12.249409 (+   249us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:12.249517 (+   108us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:12.249531 (+    14us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:12.249556 (+    25us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:12.249573 (+    17us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:12.249604 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:12.249669 (+    65us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:12.226457 14239 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:12.253679  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:12.230728 14371 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:24:12.234015 14538 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:12.256665  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2270) took 1248 ms. Trace:
I20260812 19:24:12.269457  6241 rpcz_store.cc:276] 0812 19:24:11.008245 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.255903 (+1247658us) service_pool.cc:227] Handling call
0812 19:24:12.256215 (+   312us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:12.256387 (+   172us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:12.256409 (+    22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:12.256449 (+    40us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:12.256474 (+    25us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:12.256525 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:12.256616 (+    91us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:12.266068  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:12.265501  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:12.220291 14369 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:12.277331 13828 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:12.281190  6359 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:12.281895 14369 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:12.282289  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2265) took 2078 ms. Trace:
I20260812 19:24:12.282851  6242 rpcz_store.cc:276] 0812 19:24:10.203824 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.971439 (+1767615us) service_pool.cc:227] Handling call
0812 19:24:11.971855 (+   416us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:11.972297 (+   442us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:11.972328 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:11.972873 (+   545us) log.cc:842] Serialized 26 byte log entry
0812 19:24:12.126174 (+153301us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:12.126231 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:12.126324 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:12.281998 (+155674us) raft_consensus.cc:1671] finished
0812 19:24:12.282020 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:12.282216 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1506,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"thread_start_us":152941,"threads_started":1,"wal-append.queue_time_us":237355}
I20260812 19:24:12.251816 14228 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:12.285624  6242 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260812 19:24:12.300316  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2273) took 1238 ms. Trace:
I20260812 19:24:12.301956  6242 rpcz_store.cc:276] 0812 19:24:11.062264 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.284725 (+1222461us) service_pool.cc:227] Handling call
0812 19:24:12.285190 (+   465us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:12.299991 (+ 14801us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:12.300248 (+   257us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:12.301435  6241 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:12.267426 14371 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:12.322202 14371 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:12.325534 14043 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:12.223421 14525 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260812 19:24:12.292140 14387 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260812 19:24:12.267614 14239 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:12.250834 14489 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:24:12.328708 14489 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:12.329319 14489 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:24:12.237468 14174 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260812 19:24:12.237622 14196 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260812 19:24:12.296435 14538 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:24:12.332258 14551 log.cc:924] Time spent T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260812 19:24:12.247092 14346 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:12.289767 14385 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.043s
I20260812 19:24:12.302995 14515 consensus_queue.cc:1046] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260812 19:24:12.332190 14538 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
W20260812 19:24:12.347577  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 51214.5us
I20260812 19:24:12.370095  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2271) took 1361 ms. Trace:
I20260812 19:24:12.370551  6241 rpcz_store.cc:276] 0812 19:24:11.009047 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.300878 (+1291831us) service_pool.cc:227] Handling call
0812 19:24:12.301286 (+   408us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:12.369710 (+ 68424us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:12.369759 (+    49us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:12.369800 (+    41us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:12.369826 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:12.369904 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:12.370038 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12886}
W20260812 19:24:12.389675  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 143100us
I20260812 19:24:12.389981  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:12.391299  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:12.391065  6242 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
W20260812 19:24:12.411602 14478 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.248s	user 0.008s	sys 0.001s
I20260812 19:24:12.413440  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2270) took 2885 ms. Trace:
W20260812 19:24:12.414911 14520 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.348s	user 0.002s	sys 0.000s
I20260812 19:24:12.413915  6483 rpcz_store.cc:276] 0812 19:24:09.528086 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:10.495477 (+967391us) service_pool.cc:227] Handling call
0812 19:24:10.496025 (+   548us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:10.712497 (+216472us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:10.712546 (+    49us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:10.724056 (+ 11510us) log.cc:842] Serialized 52 byte log entry
0812 19:24:11.060926 (+336870us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:11.060963 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.061033 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:12.410703 (+1349670us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:12.413087 (+  2384us) raft_consensus.cc:1671] finished
0812 19:24:12.413109 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:12.413372 (+   263us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":453,"raft.queue_time_us":16278,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":8761,"spinlock_wait_cycles":38599040,"thread_start_us":492319,"threads_started":2,"wal-append.queue_time_us":372534}
I20260812 19:24:12.415930  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:12.416337  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2258) took 2511 ms. Trace:
I20260812 19:24:12.417102  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:12.419996  6483 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260812 19:24:12.432898 14258 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:12.433658 14258 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:12.436395 14258 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:12.416715  6229 rpcz_store.cc:276] 0812 19:24:09.905204 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.591468 (+1686264us) service_pool.cc:227] Handling call
0812 19:24:11.592213 (+   745us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:11.616484 (+ 24271us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:11.616555 (+    71us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:11.631014 (+ 14459us) log.cc:842] Serialized 26 byte log entry
0812 19:24:11.848962 (+217948us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:11.849002 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.849076 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:12.414189 (+565113us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:12.416026 (+  1837us) raft_consensus.cc:1671] finished
0812 19:24:12.416048 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:12.416277 (+   229us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16830,"raft.queue_time_us":17253,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":116,"spinlock_wait_cycles":9086336,"thread_start_us":185249,"threads_started":1,"wal-append.queue_time_us":383505}
I20260812 19:24:12.424970  6242 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
W20260812 19:24:12.633297  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 265882us
I20260812 19:24:12.290520 14430 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260812 19:24:12.369059 14228 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:12.380357 14336 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:12.820626  6242 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260812 19:24:12.856614  6475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2259) took 3503 ms (client timeout 1886 ms). Trace:
W20260812 19:24:12.857489  6475 rpcz_store.cc:269] 0812 19:24:09.354048 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.362114 (+  8066us) service_pool.cc:227] Handling call
0812 19:24:12.856266 (+3494152us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400271354. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:12.856490 (+   224us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":306768128}
I20260812 19:24:12.631804 13722 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:12.861979  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:12.867988  6178 leader_election.cc:334] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.914s (SENT)
I20260812 19:24:12.872278  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:12.879308  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2239) took 2220 ms. Trace:
I20260812 19:24:12.879787  6235 rpcz_store.cc:276] 0812 19:24:10.659038 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.232726 (+1573688us) service_pool.cc:227] Handling call
0812 19:24:12.270230 (+ 37504us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:12.270513 (+   283us) raft_consensus.cc:1520] Early marking committed up to index 6
0812 19:24:12.311308 (+ 40795us) log.cc:842] Serialized 14 byte log entry
0812 19:24:12.878904 (+567596us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:12.878967 (+    63us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:12.879015 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:12.879100 (+    85us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:12.879245 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":201379,"prepare.queue_time_us":40983,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":98,"thread_start_us":365783,"threads_started":1}
I20260812 19:24:12.808106 14258 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:12.870433 14359 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.019s	sys 0.007s
I20260812 19:24:12.873746  6475 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
W20260812 19:24:12.901333  6241 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.014s	sys 0.071s
W20260812 19:24:12.901775  6241 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.014s	sys 0.071s
I20260812 19:24:12.858553 14286 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:12.663594 14387 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.223s
I20260812 19:24:12.915962 14525 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:24:12.901130 14359 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.020s	sys 0.007s
I20260812 19:24:12.917095 13987 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:12.935257 13987 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:12.889400 14261 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:24:12.925469  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:12.938943  6482 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:12.777282 14228 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:12.945231 14228 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:12.948900  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:12.950464 13987 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:12.889657 13647 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:12.958065  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 1957) took 4590 ms. Trace:
I20260812 19:24:12.958635  6464 rpcz_store.cc:276] 0812 19:24:08.367876 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:08.774131 (+406255us) service_pool.cc:227] Handling call
0812 19:24:09.474859 (+700728us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:09.487742 (+ 12883us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:12.957790 (+3470048us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b5400213ed0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:12.957983 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1610644224}
I20260812 19:24:12.972359  7603 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14. Ops: []
W20260812 19:24:12.972208 14414 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 2.692s	user 0.002s	sys 0.007s
I20260812 19:24:12.900445 14258 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:12.932118 14286 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:12.953649 14525 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:12.972242 13647 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:12.996858 14467 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:12.988026 14174 consensus_queue.cc:1046] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260812 19:24:13.018189 14258 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:13.018961 14258 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:13.019479 14258 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:13.020464 14467 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.027546 14002 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:13.028281 14002 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:13.026901  7552 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.032s	sys 0.081s
W20260812 19:24:13.033219  7552 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.033s	sys 0.082s
I20260812 19:24:13.036443  6482 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:13.022620 14467 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.024526 14258 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:13.067780 14157 consensus_meta.cc:287] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.975s	user 0.007s	sys 0.011s
I20260812 19:24:13.064141 14249 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:13.067284 13987 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:24:13.091785  6483 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.010s	sys 0.025s
W20260812 19:24:13.092353  6483 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.010s	sys 0.025s
W20260812 19:24:13.091343  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 254243us
I20260812 19:24:13.072181 14467 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:13.072842 14578 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:13.081365 14241 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:13.116473  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:13.119424  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2277) took 2034 ms. Trace:
W20260812 19:24:13.126164 14489 consensus_meta.cc:287] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.796s	user 0.004s	sys 0.008s
I20260812 19:24:13.124730  6241 rpcz_store.cc:276] 0812 19:24:11.085396 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.371753 (+1286357us) service_pool.cc:227] Handling call
0812 19:24:12.372146 (+   393us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:12.372358 (+   212us) raft_consensus.cc:1520] Early marking committed up to index 7
0812 19:24:12.388425 (+ 16067us) log.cc:842] Serialized 14 byte log entry
0812 19:24:13.113894 (+725469us) log.cc:842] Serialized 14 byte log entry
0812 19:24:13.114398 (+   504us) log.cc:842] Serialized 14 byte log entry
0812 19:24:13.118932 (+  4534us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:13.119005 (+    73us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:13.119072 (+    67us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:13.119168 (+    96us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:13.119347 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4257,"prepare.queue_time_us":21133,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":87,"raft.queue_time_us":25543,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"spinlock_wait_cycles":2135808,"thread_start_us":724613,"threads_started":3,"wal-append.queue_time_us":619971}
W20260812 19:24:13.138934  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 742594us
I20260812 19:24:13.092831 14249 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.109997 14346 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:13.146881  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.094754 13987 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.138268 14369 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:24:13.138067 14286 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.109503 14467 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.108752 14578 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.147338 13647 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:13.166625  7594 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:13.153518 14019 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:13.117491 14241 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.173444  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 649) took 2799 ms. Trace:
I20260812 19:24:13.155040 14582 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260812 19:24:13.159204 14346 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.173857  6470 rpcz_store.cc:276] 0812 19:24:10.373746 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:10.833833 (+460087us) service_pool.cc:227] Handling call
0812 19:24:11.162757 (+328924us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:11.163002 (+   245us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:24:11.163359 (+   357us) log.cc:842] Serialized 14 byte log entry
0812 19:24:11.650345 (+486986us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:11.650415 (+    70us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:11.650478 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.650564 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:13.173254 (+1522690us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54001315d0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:13.173375 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":626,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":155,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":9748,"spinlock_wait_cycles":755739392,"thread_start_us":486560,"threads_started":1,"wal-append.queue_time_us":561109,"wal-append.run_cpu_time_us":1317,"wal-append.run_wall_time_us":1001354}
I20260812 19:24:13.175571 14019 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.151033 14525 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.126612 14489 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:13.172358 14343 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.172647 14333 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:13.188539 14130 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.189692 14130 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:13.171687  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:13.162441 14369 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:13.183239 14002 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:13.187340 13987 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.176466 14346 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.169482 14558 consensus_queue.cc:1046] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260812 19:24:13.196825  7603 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: []
W20260812 19:24:13.190793 14469 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 2.016s	user 0.006s	sys 0.016s
I20260812 19:24:13.190590 14019 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.194193 14369 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:13.206542 14489 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:13.210175 14239 consensus_meta.cc:287] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.882s	user 0.010s	sys 0.004s
I20260812 19:24:13.206893 14467 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.210626 14239 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.207609 14249 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.208170 14578 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.208182 14241 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:13.212149 14538 consensus_meta.cc:287] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.839s	user 0.013s	sys 0.000s
I20260812 19:24:13.222470 14538 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.225196 14140 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:13.223371 14144 raft_consensus.cc:3032] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:13.225770 14144 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:13.226791 14144 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.227911 14144 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:13.231724 14008 raft_consensus.cc:3032] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:13.232203 14008 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:13.233196 14008 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:13.217383 14239 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.234627 14008 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:13.240633 14538 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:13.242431 14455 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 2.178s	user 0.001s	sys 0.024s
W20260812 19:24:13.249292 14371 consensus_meta.cc:287] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.926s	user 0.007s	sys 0.008s
I20260812 19:24:13.250027 14371 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:13.251008 14527 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.183s	user 0.011s	sys 0.000s
I20260812 19:24:13.253283 14371 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.256652 14369 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.257110 14251 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:13.257915 14251 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.259224 14369 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:13.261565 14422 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 2.754s	user 0.023s	sys 0.049s
I20260812 19:24:13.263566 14251 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:13.265753 14334 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:13.267771 14196 raft_consensus.cc:3032] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:13.268224 14196 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:13.269066 14196 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.270478 14196 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:10.798282  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260812 19:24:13.324019  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 297850us
I20260812 19:24:13.328128  6228 raft_consensus.cc:2396] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260812 19:24:13.149945  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2204) took 3501 ms. Trace:
I20260812 19:24:13.329986  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2246) took 3603 ms. Trace:
I20260812 19:24:13.330096  6352 rpcz_store.cc:276] 0812 19:24:09.648287 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.659184 (+ 10897us) service_pool.cc:227] Handling call
0812 19:24:09.669368 (+ 10184us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:10.387599 (+718231us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:13.149706 (+2762107us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b5400410fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:13.149885 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1559661824}
I20260812 19:24:13.330549  6230 rpcz_store.cc:276] 0812 19:24:09.726072 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:10.080957 (+354885us) service_pool.cc:227] Handling call
0812 19:24:10.081325 (+   368us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:10.086762 (+  5437us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:24:10.086805 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:10.134018 (+ 47213us) log.cc:842] Serialized 26 byte log entry
0812 19:24:10.347367 (+213349us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:10.347407 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.347480 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:13.260829 (+2913349us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:13.329297 (+ 68468us) raft_consensus.cc:1671] finished
0812 19:24:13.329359 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:13.329763 (+   404us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":776668,"raft.queue_time_us":5436,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":765777,"spinlock_wait_cycles":8323456,"thread_start_us":163797,"threads_started":1,"wal-append.queue_time_us":344048}
I20260812 19:24:13.329350  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 588) took 5521 ms. Trace:
I20260812 19:24:13.333791  6236 rpcz_store.cc:276] 0812 19:24:07.807328 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:07.807496 (+   168us) service_pool.cc:227] Handling call
0812 19:24:07.836313 (+ 28817us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:07.849686 (+ 13373us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:07.849716 (+    30us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:10.543768 (+2694052us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b2c0006c608. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:24:10.544428 (+   660us) log.cc:842] Serialized 52 byte log entry
0812 19:24:10.871900 (+327472us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:10.921053 (+ 49153us) log.cc:842] Serialized 14 byte log entry
0812 19:24:10.921361 (+   308us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:10.921465 (+   104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:11.963488 (+1042023us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b180000b020. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:24:13.241859 (+1278371us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:13.328434 (+ 86575us) raft_consensus.cc:1671] finished
0812 19:24:13.328536 (+   102us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:13.329047 (+   511us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":48923,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":25674,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":28925,"spinlock_wait_cycles":146577664,"thread_start_us":327065,"threads_started":1,"wal-append.queue_time_us":455728}
I20260812 19:24:13.338729  6465 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260812 19:24:13.339468  6465 pending_rounds.cc:76] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 4
I20260812 19:24:13.338153  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:13.339915  6465 pending_rounds.cc:97] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260812 19:24:13.340549  6465 raft_consensus.cc:2866] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:13.340549  6236 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:13.353180  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:13.359849  6236 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:13.363372  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:13.370345  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2284) took 1033 ms. Trace:
I20260812 19:24:13.370783  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2285) took 1033 ms. Trace:
I20260812 19:24:13.372287  7591 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10. Ops: []
I20260812 19:24:13.374171  6241 rpcz_store.cc:276] 0812 19:24:12.337779 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:13.127419 (+789640us) service_pool.cc:227] Handling call
0812 19:24:13.127868 (+   449us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:13.128298 (+   430us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:13.128329 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:13.328550 (+200221us) log.cc:842] Serialized 26 byte log entry
0812 19:24:13.367407 (+ 38857us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:13.367498 (+    91us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:13.367606 (+   108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:13.370286 (+  2680us) raft_consensus.cc:1671] finished
0812 19:24:13.370315 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:13.370524 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":117,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6592,"thread_start_us":38079,"threads_started":1,"wal-append.queue_time_us":38734}
I20260812 19:24:13.389479  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2231) took 5432 ms. Trace:
I20260812 19:24:13.376879  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:13.384861  6228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2226) took 3686 ms (client timeout 1971 ms). Trace:
I20260812 19:24:13.386441  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2261) took 3311 ms. Trace:
I20260812 19:24:13.387842  6229 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260812 19:24:13.392153  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2295) took 1508 ms. Trace:
I20260812 19:24:13.400425 13848 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:24:13.402238  6232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2267) took 2965 ms (client timeout 2063 ms). Trace:
I20260812 19:24:13.403132 14002 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:13.404168 14002 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.389955  6238 rpcz_store.cc:276] 0812 19:24:07.957463 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:07.958296 (+   833us) service_pool.cc:227] Handling call
0812 19:24:07.958765 (+   469us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:08.062223 (+103458us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:08.062255 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:08.065850 (+  3595us) log.cc:842] Serialized 26 byte log entry
0812 19:24:08.164781 (+ 98931us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:08.164823 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:11.910180 (+3745357us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b18002eb580. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9
0812 19:24:13.388840 (+1478660us) spinlock_profiling.cc:243] Waited 86.4 ms on lock 0x7b54000f50d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:13.388924 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:13.389013 (+    89us) raft_consensus.cc:1671] finished
0812 19:24:13.389027 (+    14us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:13.389275 (+   248us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16630,"raft.queue_time_us":95283,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":18553,"spinlock_wait_cycles":211411072,"thread_start_us":80477,"threads_started":1,"wal-append.queue_time_us":256941,"wal-append.run_cpu_time_us":19393,"wal-append.run_wall_time_us":1620156}
I20260812 19:24:13.394796  6465 rpcz_store.cc:276] 0812 19:24:11.884202 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.894801 (+ 10599us) service_pool.cc:227] Handling call
0812 19:24:11.895168 (+   367us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:13.341545 (+1446377us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:13.391834 (+ 50289us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54001040d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:13.392082 (+   248us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3316688256}
W20260812 19:24:13.392779  6228 rpcz_store.cc:269] 0812 19:24:09.698458 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.700145 (+  1687us) service_pool.cc:227] Handling call
0812 19:24:13.384453 (+3684308us) spinlock_profiling.cc:243] Waited 3.62 s on lock 0x7b54002f8854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:13.384716 (+   263us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8337426816}
I20260812 19:24:13.373761  6242 rpcz_store.cc:276] 0812 19:24:12.337260 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:13.095949 (+758689us) service_pool.cc:227] Handling call
0812 19:24:13.097865 (+  1916us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:13.098423 (+   558us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:13.098466 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:13.334197 (+235731us) log.cc:842] Serialized 26 byte log entry
0812 19:24:13.365056 (+ 30859us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:13.365122 (+    66us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:13.365278 (+   156us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:13.369820 (+  4542us) raft_consensus.cc:1671] finished
0812 19:24:13.369848 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:13.370080 (+   232us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":5499,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":14367,"thread_start_us":30071,"threads_started":1,"wal-append.queue_time_us":30978}
I20260812 19:24:13.417563 14468 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:13.418915 14468 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:13.422847 14244 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:13.392897  6224 rpcz_store.cc:276] 0812 19:24:10.075329 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.957744 (+1882415us) service_pool.cc:227] Handling call
0812 19:24:11.958226 (+   482us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:11.963443 (+  5217us) raft_consensus.cc:1520] Early marking committed up to index 7
0812 19:24:12.114957 (+151514us) log.cc:842] Serialized 14 byte log entry
0812 19:24:12.201767 (+ 86810us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:12.201835 (+    68us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:12.201899 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:13.385936 (+1184037us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b540013ef54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:13.386015 (+    79us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:13.386259 (+   244us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11419,"prepare.queue_time_us":101118,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":357,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":7529,"spinlock_wait_cycles":11333504,"thread_start_us":237235,"threads_started":2,"wal-append.queue_time_us":137428}
I20260812 19:24:13.427206 14371 consensus_queue.cc:1046] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:13.429738 14318 raft_consensus.cc:3032] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:13.430334 14318 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:24:13.402832  6232 rpcz_store.cc:269] 0812 19:24:10.436228 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:11.088449 (+652221us) service_pool.cc:227] Handling call
0812 19:24:13.401648 (+2313199us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b54002f9754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:13.401969 (+   321us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1652456320}
I20260812 19:24:13.401690 13848 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.432232 14318 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:13.423929 14244 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.435211  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2308) took 1179 ms. Trace:
I20260812 19:24:13.435890 14002 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.436525 14244 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.435640  6473 rpcz_store.cc:276] 0812 19:24:12.255374 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.309270 (+ 53896us) service_pool.cc:227] Handling call
0812 19:24:12.309599 (+   329us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:12.335196 (+ 25597us) raft_consensus.cc:1520] Early marking committed up to index 7
0812 19:24:12.373618 (+ 38422us) log.cc:842] Serialized 14 byte log entry
0812 19:24:13.345890 (+972272us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b18004b1ea0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff57b
0812 19:24:13.433455 (+ 87565us) log.cc:842] Serialized 14 byte log entry
0812 19:24:13.434076 (+   621us) log.cc:842] Serialized 14 byte log entry
0812 19:24:13.434305 (+   229us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:13.434387 (+    82us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:13.434502 (+   115us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:13.434629 (+   127us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:13.435012 (+   383us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":129433,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":1403,"raft.queue_time_us":56935,"raft.run_cpu_time_us":435,"raft.run_wall_time_us":442,"spinlock_wait_cycles":83425152,"thread_start_us":280235,"threads_started":1,"wal-append.queue_time_us":497180}
I20260812 19:24:13.441598  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:13.443285  6475 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:13.443742 13616 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:13.453022  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:13.467867  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2265) took 4103 ms. Trace:
I20260812 19:24:13.468443  6481 rpcz_store.cc:276] 0812 19:24:09.367960 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:09.832940 (+464980us) service_pool.cc:227] Handling call
0812 19:24:10.832333 (+999393us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:10.833150 (+   817us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:13.467335 (+2634185us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54004448d0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:13.467619 (+   284us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2295247232}
I20260812 19:24:13.473177  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.474321  6475 raft_consensus.cc:2354] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11.
I20260812 19:24:13.479455  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:13.481292 13852 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:24:13.484598 14483 raft_consensus.cc:3032] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:13.466318  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:51762 (request call id 0) took 3034 ms. Trace:
I20260812 19:24:13.478889  6465 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260812 19:24:13.488647  6228 rpcz_store.cc:276] 0812 19:24:10.431751 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:13.464072 (+3032321us) service_pool.cc:227] Handling call
0812 19:24:13.466181 (+  2109us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:13.487481 14483 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:13.474421  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:13.495443 14129 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:13.496348  6474 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:13.496222 14483 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.497864  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.498893  6470 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:13.458787 14468 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:13.504212  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.510751  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.500324 14318 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:24:13.515699  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica a1541d11be514114966dc1e92a345298 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:13.523108 13848 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.527016  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:13.512255 14483 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:13.533519 14244 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:13.534190 14244 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.534425  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:13.536566 14244 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.496308 14129 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.544852 14129 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.547904  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:13.555605  6475 raft_consensus.cc:2396] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260812 19:24:13.564985  6359 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260812 19:24:13.567507  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:13.568579  6353 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
W20260812 19:24:13.569904  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 87924.2us
I20260812 19:24:13.571739  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:13.572642  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.573027 14620 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:13.573973 14468 consensus_queue.cc:1046] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:13.574404  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:13.575557 14468 raft_consensus.cc:3032] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:13.576047 14468 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:13.577351 14468 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:13.578899  7591 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:13.579280 14468 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:13.579432  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:13.581331  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:13.585021 14009 consensus_queue.cc:1046] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:13.586571 14009 raft_consensus.cc:3032] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:24:13.587013 14009 raft_consensus.cc:729] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:13.588129 14009 consensus_queue.cc:260] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:13.589598 14009 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:13.593343  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:13.594995  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.060s (SENT) [suppressed 6 similar messages]
I20260812 19:24:13.595388  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2279) took 1361 ms. Trace:
I20260812 19:24:13.595991  6229 rpcz_store.cc:276] 0812 19:24:12.234057 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.456258 (+222201us) service_pool.cc:227] Handling call
0812 19:24:13.387132 (+930874us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:13.393314 (+  6182us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:13.595124 (+201810us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54002f8850. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:13.595305 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2139430656}
W20260812 19:24:13.598272  6178 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.214s (SENT)
I20260812 19:24:13.607069 14620 raft_consensus.cc:686] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:13.609505 14620 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:13.610574  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:13.611130  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.611776  6342 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:13.613142  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 706) took 1506 ms. Trace:
I20260812 19:24:13.614042  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.618306  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.620214  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.621455  6482 raft_consensus.cc:2396] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260812 19:24:13.613245  6483 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260812 19:24:13.594498  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:13.623544  6483 pending_rounds.cc:76] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 7
I20260812 19:24:13.626919  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:13.613660  6344 rpcz_store.cc:276] 0812 19:24:12.107005 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.107576 (+   571us) service_pool.cc:227] Handling call
0812 19:24:12.127564 (+ 19988us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:12.203195 (+ 75631us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:13.612615 (+1409420us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b5400061154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:13.612914 (+   299us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":172145536}
I20260812 19:24:13.632880  6483 pending_rounds.cc:97] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260812 19:24:13.633440  6483 raft_consensus.cc:2866] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:13.631366  6470 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:24:13.648041  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.650830 14587 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:13.651678 14587 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:13.654071 14587 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:13.654771 13611 raft_consensus.cc:3032] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:13.655050  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:13.655298 13611 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:13.660440  6298 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:13.661082  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.662472  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:13.663800 14615 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:13.664247  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:13.665145  6344 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:24:13.666493  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.667986  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:13.668975  6470 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:13.669960  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.662573  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.663823  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.693262  6353 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: [10.5-12.6]
W20260812 19:24:13.700253  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 102080us
I20260812 19:24:13.703117  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.715412 14615 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260812 19:24:13.729878  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.732465  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:13.732697  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:13.734179  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.734118 14587 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:13.735423  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.736573  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.737651  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.738147  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:13.738477  6473 raft_consensus.cc:2396] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260812 19:24:13.740635  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:13.738279  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:13.740936  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.741314  6359 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:24:13.741449  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 08db676d084c41abaa2e196e5c2653b5, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.739215  6232 raft_consensus.cc:2396] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260812 19:24:13.741852  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 08db676d084c41abaa2e196e5c2653b5, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.739559  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.742087  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.740113  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:13.742849  6483 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9.
I20260812 19:24:13.743010  6350 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:13.740212 14369 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:13.743868 14467 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:13.744158 14369 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.744705 14467 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.745234  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:13.745352  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.740360  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:13.746932  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.747304  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:13.747980  6353 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:13.748214  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.746951  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:13.749493  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.749929  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.750134  6470 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:13.750542  6482 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:13.752239 14190 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:13.753074  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.752830 14190 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:13.751497  6178 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.725s (SENT)
I20260812 19:24:13.751456  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.760293  6475 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:24:13.754387  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:13.746148  6483 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:13.764014  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.765630  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.766566  6482 raft_consensus.cc:2396] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 12 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
W20260812 19:24:13.767486  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 7230832bbf3743e0a33e68f405d6b124, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:13.767905  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 7230832bbf3743e0a33e68f405d6b124, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.767797 14190 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.767495  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.779511  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:13.779820  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.783481  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:13.785723  6482 raft_consensus.cc:2396] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260812 19:24:13.792608  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:13.793922  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.797889  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:13.798794  6470 raft_consensus.cc:2362] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 9. Re-sending same reply.
I20260812 19:24:13.769999 14620 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:13.803153  6359 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:13.772862 14587 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:13.814644  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.815866  6470 raft_consensus.cc:2396] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260812 19:24:13.817258 13611 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:13.819166 13611 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:13.826529  6344 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260812 19:24:13.829718  6481 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260812 19:24:13.831033 14206 consensus_queue.cc:1046] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:13.817970  6232 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:13.800086 14129 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:13.805145 14467 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:13.807474 14244 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:13.839959  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:13.846746  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.851379  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.855945  6482 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:13.856644  6481 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:13.856393  6482 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:13.858875  6242 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:24:13.862143  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 110688us
I20260812 19:24:13.862613 14244 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:13.848757 14129 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:13.848078 14620 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:13.873891  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.875182  6481 raft_consensus.cc:2396] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260812 19:24:13.855509 14587 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:13.878237  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:13.879653  6236 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:13.868328 14244 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:13.895957  6055 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 119) took 21356 ms (client timeout 15000 ms). Trace:
I20260812 19:24:13.905498  6482 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:13.928767  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:13.931238  6232 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:13.933813  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:13.935600  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:13.928303  6235 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.022s	sys 0.016s
W20260812 19:24:13.960886  6235 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.023s	sys 0.016s
I20260812 19:24:13.963757  6359 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:13.980217  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:13.993006  6482 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:14.003364  6236 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:24:13.896653  6055 rpcz_store.cc:269] 0812 19:23:52.539580 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:52.539951 (+   371us) service_pool.cc:227] Handling call
0812 19:24:13.895600 (+21355649us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:24:05.373687 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:24:05.558112 (+184425us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:24:05.573523 (+ 15411us) write_op.cc:435] Acquired schema lock
0812 19:24:05.573562 (+    39us) tablet.cc:660] Decoding operations
0812 19:24:05.592267 (+ 18705us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:24:05.592395 (+   128us) write_op.cc:641] Partition lock acquired for write op
0812 19:24:05.592441 (+    46us) tablet.cc:683] Acquiring locks for 14 operations
0812 19:24:05.593749 (+  1308us) tablet.cc:699] Row locks acquired
0812 19:24:05.593784 (+    35us) write_op.cc:260] PREPARE: finished
0812 19:24:05.594004 (+   220us) write_op.cc:270] Start()
0812 19:24:05.594172 (+   168us) write_op.cc:276] Timestamp: P: 1786562645593935 usec, L: 0
0812 19:24:05.594228 (+    56us) op_driver.cc:331] REPLICATION: starting
0812 19:24:05.665582 (+ 71354us) log.cc:842] Serialized 5432 byte log entry
0812 19:24:06.287926 (+622344us) op_driver.cc:444] REPLICATION: finished
0812 19:24:06.630764 (+342838us) write_op.cc:301] APPLY: starting
0812 19:24:06.630957 (+   193us) tablet.cc:1365] starting BulkCheckPresence
0812 19:24:07.727177 (+1096220us) spinlock_profiling.cc:243] Waited 8.75 ms on lock 0x7b180003e2c0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f75430dc 00007f98f7545ade 00007f98f7546820 00007f98fb1a7f9b 00007f98fb1a8312 00007f98fb1ecd33 00007f98fb0a1593 00007f98fb0a0e5b 00007f98fb0a2487
0812 19:24:07.732526 (+  5349us) tablet.cc:1368] finished BulkCheckPresence
0812 19:24:07.732568 (+    42us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:24:08.385743 (+653175us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:24:08.386095 (+   352us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0812 19:24:08.422629 (+ 36534us) write_op.cc:312] APPLY: finished
0812 19:24:08.428582 (+  5953us) log.cc:842] Serialized 129 byte log entry
0812 19:24:08.794842 (+366260us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:24:08.857902 (+ 63060us) write_op.cc:454] Released schema lock
0812 19:24:08.924435 (+ 66533us) write_op.cc:341] FINISH: Updating metrics
0812 19:24:09.003535 (+ 79100us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:24:09.011358 (+  7823us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":337576,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":342346,"apply.run_cpu_time_us":62431,"apply.run_wall_time_us":2411183,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62731,"num_ops":14,"prepare.queue_time_us":264603,"prepare.run_cpu_time_us":13008,"prepare.run_wall_time_us":325216,"raft.queue_time_us":494165,"raft.run_cpu_time_us":14949,"raft.run_wall_time_us":100451,"replication_time_us":693590,"spinlock_wait_cycles":20119424,"thread_start_us":905397,"threads_started":5,"wal-append.queue_time_us":1140177,"wal-append.run_cpu_time_us":48464,"wal-append.run_wall_time_us":2498601}]]}
I20260812 19:24:14.010085 14190 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 19:24:14.048756  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:14.049737  6475 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:24:14.050817  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 184832us
I20260812 19:24:14.059531  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2282) took 1728 ms. Trace:
I20260812 19:24:14.052378 14129 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:14.053232 14641 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260812 19:24:14.093026 14369 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:14.093952 14244 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:14.098275  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:24:14.111752  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:14.070501 14620 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:14.073093  6235 rpcz_store.cc:276] 0812 19:24:12.331500 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.881003 (+549503us) service_pool.cc:227] Handling call
0812 19:24:12.910512 (+ 29509us) raft_consensus.cc:1457] Updating replica for 3 ops
0812 19:24:12.927461 (+ 16949us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:12.927497 (+    36us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0812 19:24:12.956988 (+ 29491us) log.cc:842] Serialized 78 byte log entry
0812 19:24:14.009753 (+1052765us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:24:14.019920 (+ 10167us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:14.042992 (+ 23072us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:14.043120 (+   128us) raft_consensus.cc:1671] finished
0812 19:24:14.043136 (+    16us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:14.059452 (+ 16316us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16276,"raft.queue_time_us":19091,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":22846,"thread_start_us":971968,"threads_started":1,"wal-append.queue_time_us":208022}
W20260812 19:24:14.135440  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 63175.4us
I20260812 19:24:14.134310  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:14.144158 14615 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:14.161029  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:14.161294 14615 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:14.162016  6359 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:14.163587 14615 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:14.164156  6298 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:14.164960 13458 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:14.165578 13458 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:14.167696 13458 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:14.169466  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:14.171350  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:14.173681 14127 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:14.174139 14127 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:14.174387  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:14.174571 14127 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:14.178383 14620 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:14.180585 14620 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:14.181008 14620 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:14.119447 14587 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:14.190022  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:14.190852  6464 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:24:14.178695  6242 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:24:14.197628  6242 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260812 19:24:14.199036  6241 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:14.198953 14127 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:14.199674 14371 raft_consensus.cc:3032] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:14.200227 14371 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:24:14.201284 14644 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.415s	user 0.005s	sys 0.001s
I20260812 19:24:14.201396 14371 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:14.203318 14371 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:14.203393  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:14.204227  6481 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:14.205054  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:14.205317  6481 raft_consensus.cc:3032] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:14.205657  6481 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:14.172338  7603 raft_consensus.cc:2379] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 7: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:14.172242  6475 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
W20260812 19:24:14.210641  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 5bf9c8ef81414ede8e942ee03b95a816, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:14.216990  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 5bf9c8ef81414ede8e942ee03b95a816, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:14.217152  6232 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:14.206617  6481 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:14.220342  6236 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:24:14.225152  6482 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260812 19:24:14.225621  6482 pending_rounds.cc:76] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 6
I20260812 19:24:14.225903  6482 pending_rounds.cc:97] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260812 19:24:14.226212  6482 raft_consensus.cc:2866] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:14.179812 14369 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:14.229391  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:14.231035  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:14.231638  6353 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:24:14.248543  6481 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:14.249883  6228 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
W20260812 19:24:14.247622 14647 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260812 19:24:14.260496 14646 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.217s	user 0.000s	sys 0.002s
I20260812 19:24:14.263765  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:14.271814  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:14.240597 14369 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:14.245434 14009 consensus_queue.cc:1046] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260812 19:24:14.282930  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:14.285056 13616 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:14.254092 14206 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260812 19:24:14.290505  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:24:14.288256  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 229901us
I20260812 19:24:14.299772 14265 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election won for term 13
W20260812 19:24:14.297833  6178 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.684s (SENT)
I20260812 19:24:14.309796  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:14.314334  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:14.316299  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:14.319629  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:14.321455  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:14.325189  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:14.325285 14620 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:14.327179  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2305) took 2092 ms. Trace:
I20260812 19:24:14.327711  6477 rpcz_store.cc:276] 0812 19:24:12.234803 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:12.245175 (+ 10372us) service_pool.cc:227] Handling call
0812 19:24:12.245644 (+   469us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:12.247354 (+  1710us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:12.247382 (+    28us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:12.247921 (+   539us) log.cc:842] Serialized 52 byte log entry
0812 19:24:13.671852 (+1423931us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b18004b1ae0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:24:13.848106 (+176254us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:24:13.848155 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:13.855343 (+  7188us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:14.313406 (+458063us) raft_consensus.cc:1671] finished
0812 19:24:14.313429 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:14.326957 (+ 13528us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":13566,"spinlock_wait_cycles":8946048,"thread_start_us":123502,"threads_started":1,"wal-append.queue_time_us":1717235}
I20260812 19:24:14.335073  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:14.340229  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:14.351402 14244 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:14.367128 14519 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:14.372430 14519 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:14.372959 14519 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:14.374745 14009 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:14.370353 13458 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260812 19:24:14.376121 13603 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:24:14.376803 13603 raft_consensus.cc:686] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:14.377727 13603 consensus_queue.cc:237] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:14.377960  6058 catalog_manager.cc:5495] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:14.379043 13789 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:14.379799 13789 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:14.382238 13789 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:14.424350  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 54337.7us
W20260812 19:24:14.425704  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 132345us
I20260812 19:24:14.425366 14127 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:14.380541  6058 catalog_manager.cc:5495] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:24:14.436193  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:14.441107  6058 catalog_manager.cc:5495] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 9 to 10, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 10 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:24:14.460173 14620 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:14.444053 14129 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:14.463613 14129 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:14.442420 14244 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:14.450130 14369 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:14.469117 13789 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:14.494046 14129 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:14.494967  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:14.499528  7598 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:14.501724  6481 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260812 19:24:14.501982  7603 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: []
I20260812 19:24:14.502575  6481 pending_rounds.cc:76] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 7
I20260812 19:24:14.503193  6481 pending_rounds.cc:97] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260812 19:24:14.504964  6481 raft_consensus.cc:2866] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:14.500243  6058 catalog_manager.cc:5495] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 7 to 8, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 8 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } }
I20260812 19:24:14.472137 14244 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:14.511310  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:14.513361  7599 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:14.499612 14129 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:14.517405 14129 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:14.518191 14468 raft_consensus.cc:3032] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 19:24:14.518738 14468 raft_consensus.cc:729] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:14.524335 14129 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:14.526154  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:14.527439  6058 catalog_manager.cc:5495] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 8 to 10, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 10 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:24:14.536870 13789 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260812 19:24:14.537263 14369 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:14.559221  7598 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:14.561043  7607 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260812 19:24:14.563198  6298 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:14.561460 14369 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:14.589953  6179 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:14.591122  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:14.536211 14468 consensus_queue.cc:260] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:14.583083 14127 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election won for term 16
W20260812 19:24:14.599406  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 83737.7us
I20260812 19:24:14.592394 14511 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260812 19:24:14.591216 14369 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:14.602742  6058 catalog_manager.cc:5495] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 7 to 8, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 8 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:24:14.608474 14006 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:14.608989 14006 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:14.612344  6058 catalog_manager.cc:5495] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 8 to 9, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 9 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:24:14.604166 14127 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:14.617408 14006 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:14.653712 14244 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:14.614879 14129 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260812 19:24:14.679638 14017 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260812 19:24:14.680823  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:14.654592 14244 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:14.712597  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:14.717981 14017 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:14.718597 14017 raft_consensus.cc:686] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:14.708595 14244 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:14.730893  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:14.732807  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:14.736811 14017 consensus_queue.cc:237] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:14.600309 14009 consensus_queue.cc:1159] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f4ef77b3328a44e8a21dd902b370e25a" responder_term: 7 status { last_received { term: 6 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:24:14.749539 14468 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:24:14.724336 14244 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:14.772450 14622 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:14.772982 14622 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:14.773401 14622 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:14.760946 14587 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260812 19:24:14.776399  6229 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.015s	sys 0.023s
W20260812 19:24:14.778754  6229 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.015s	sys 0.023s
I20260812 19:24:14.775460 14620 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:24:14.765187 14519 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:14.767587  6058 catalog_manager.cc:5495] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 8 to 10, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 10 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:24:14.784703 14620 raft_consensus.cc:686] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:14.792191  7594 raft_consensus.cc:2379] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 12: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:14.764319 14127 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:14.820148  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 495010us
W20260812 19:24:14.828401  6482 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.030s	sys 0.020s
W20260812 19:24:14.838110  6482 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.030s	sys 0.020s
I20260812 19:24:14.839368  6058 catalog_manager.cc:5495] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 8 to 9, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 9 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:24:14.893465 14671 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:14.894343 14671 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:14.849764 14265 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.017s	sys 0.038s
W20260812 19:24:14.900280 14265 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.017s	sys 0.038s
W20260812 19:24:14.899636 14662 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.080s	user 0.001s	sys 0.001s
I20260812 19:24:14.903393  6058 catalog_manager.cc:5495] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 6 to 7, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 7 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:24:14.912941  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:14.922832  6353 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:14.900739 14265 raft_consensus.cc:686] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:14.911787 14519 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:14.919063  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 399346us
W20260812 19:24:14.931634  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 156129us
I20260812 19:24:14.884168 14620 consensus_queue.cc:237] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:14.924525 13789 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:14.938872  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:14.933068 13603 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:14.966221  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:14.949183 13789 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:14.972292  6470 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:14.979321  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:14.964406  6058 catalog_manager.cc:5495] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 10 to 12, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 12 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:24:14.985090  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:14.952234 14671 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:14.988289  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:14.986243  6058 catalog_manager.cc:5495] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 10 to 11, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 11 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:24:14.965415 13603 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:14.990314  6058 catalog_manager.cc:5495] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 4 to 6, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 6 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:24:14.991791 13603 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:14.992030 14679 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:14.987676  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:14.986464  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:14.992547 14679 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:14.995564  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:14.995914  6230 raft_consensus.cc:2396] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260812 19:24:14.996973 14679 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:15.000593 14244 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:15.004010  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.008615  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:15.009306  6236 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:15.011091  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.011695 14129 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:15.012270 14129 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:14.952122 14006 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:15.019986  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:15.029505  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.031266  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:15.020714  6475 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:15.032015  6242 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 16
I20260812 19:24:15.030471  6232 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:15.038151  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:15.039805  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:15.013936 14265 consensus_queue.cc:237] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:15.041885  6477 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260812 19:24:15.045576  6353 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:24:15.050205  6475 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:15.071877  6236 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:15.037609 14244 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:15.043963 14006 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:15.096568  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:15.059155 14587 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:15.097795  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:15.100095  7594 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:15.100525  6242 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:15.078750 13789 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:15.104904  6470 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:24:15.110709  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.082942 14691 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:15.119124  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:15.090875 14620 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:15.121654  7598 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:15.099680 14318 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:15.123200  6179 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:15.100260 14129 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:15.125247  6236 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260812 19:24:15.135102 13722 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:15.105114 14587 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:15.135676 13722 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:15.135880 14691 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:15.138054 14691 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:15.138322 14587 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:15.125401  6241 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:15.171205  6470 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260812 19:24:15.173545  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 208149us
W20260812 19:24:15.190107  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46597.8us
W20260812 19:24:15.125190 14369 consensus_meta.cc:287] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.002s
I20260812 19:24:15.170548 14318 raft_consensus.cc:686] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:15.125360 14620 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:15.195012 14190 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:15.195927  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:15.196795  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:15.208616  7598 raft_consensus.cc:2379] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:15.213043  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:15.170289 14244 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260812 19:24:15.252002  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 246752us
I20260812 19:24:15.140527 14622 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:15.261549 14530 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:15.262295 14530 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:15.262764 14530 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
W20260812 19:24:15.264421 14700 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260812 19:24:15.267484 14695 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260812 19:24:15.234668 14711 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:15.223987 14369 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:15.227979  7594 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
W20260812 19:24:15.303488  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 129142us
I20260812 19:24:15.245533 13611 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260812 19:24:15.304932  6179 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:15.284086 14318 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:15.305133 13722 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:15.337091  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:15.337967 14244 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:15.338253 14127 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:15.338515 14244 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:15.338339 14620 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:15.340080  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:15.342022 14127 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260812 19:24:15.344480  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 83521.4us
I20260812 19:24:15.347157  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2345) took 1074 ms. Trace:
I20260812 19:24:15.347534  6483 rpcz_store.cc:276] 0812 19:24:14.272599 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:14.272808 (+   209us) service_pool.cc:227] Handling call
0812 19:24:14.286091 (+ 13283us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:14.300784 (+ 14693us) raft_consensus.cc:1520] Early marking committed up to index 7
0812 19:24:14.790960 (+490176us) log.cc:842] Serialized 14 byte log entry
0812 19:24:15.295137 (+504177us) log.cc:842] Serialized 14 byte log entry
0812 19:24:15.346815 (+ 51678us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:15.346870 (+    55us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:15.346915 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:15.346985 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:15.347100 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":148530,"prepare.queue_time_us":523565,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":100,"raft.queue_time_us":268476,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":11327,"thread_start_us":956629,"threads_started":3,"wal-append.queue_time_us":280562}
I20260812 19:24:15.352010 14265 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:15.352567 14265 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:15.355638 14705 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260812 19:24:15.358541 14698 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260812 19:24:15.322049 14129 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:15.365933  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:15.317354 14017 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:15.381208  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:15.388387  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 52555.7us
I20260812 19:24:15.316082 14679 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:15.383944 14713 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260812 19:24:15.382822 14129 raft_consensus.cc:686] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:15.399241  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2340) took 1196 ms. Trace:
I20260812 19:24:15.395697 13616 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:15.398373 14671 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:15.409739  6474 rpcz_store.cc:276] 0812 19:24:14.201997 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:14.202907 (+   910us) service_pool.cc:227] Handling call
0812 19:24:14.203276 (+   369us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:14.203548 (+   272us) raft_consensus.cc:1520] Early marking committed up to index 6
0812 19:24:14.656234 (+452686us) log.cc:842] Serialized 14 byte log entry
0812 19:24:14.964474 (+308240us) log.cc:842] Serialized 14 byte log entry
0812 19:24:14.976360 (+ 11886us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b18004b2560. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:24:15.138051 (+161691us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b18004b2560. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c764 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:24:15.203713 (+ 65662us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b18004b2560. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f47d34ca 00007f98fdea8f99 00007f98f4697990 00007f98f4859864 00007f98f4859155 00007f98f77703d0 00007f98f7782576 00007f98f77930d7 00007f98f7793058
0812 19:24:15.342639 (+138926us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b18004b2560. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f47d34ca 00007f98fdea8f99 00007f98fb620bcf 00007f98f485c7b6 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d
0812 19:24:15.395678 (+ 53039us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:15.395796 (+   118us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:15.395874 (+    78us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:15.396019 (+   145us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:15.398097 (+  2078us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":215705,"prepare.queue_time_us":591605,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":297901,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":12837,"spinlock_wait_cycles":33720576,"thread_start_us":876886,"threads_started":3,"wal-append.queue_time_us":284436}
I20260812 19:24:15.432888 14671 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:15.447775  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:15.440460 14622 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:15.407960 14017 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:15.452335  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:15.445791 14671 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:15.456007  6224 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260812 19:24:15.456678  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.457480  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:15.459928 14714 log.cc:924] Time spent T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260812 19:24:15.462925 14129 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:15.468520 14679 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:15.440240 14265 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:15.490422  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.493556  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:15.490602  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.451272 13789 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:15.498665  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:15.497337  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 108267us
I20260812 19:24:15.499396  6241 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:15.497279  6228 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:15.498736  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:15.500257  6236 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:15.498888  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:15.498978  6235 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:15.502796  6238 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260812 19:24:15.503911  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.504323  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.502247  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:15.475029 14369 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:15.445071 13616 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260812 19:24:15.508595  6232 raft_consensus.cc:2396] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260812 19:24:15.491261 14622 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:15.511400  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.501871 14715 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260812 19:24:15.518028  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 302178us
I20260812 19:24:15.511478 13789 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:15.524713  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:15.527650  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.529592  6359 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:24:15.534161  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.517428 14715 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:15.537442  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.531149  6473 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:24:15.539790  6229 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:15.530989  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:15.512684 14731 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260812 19:24:15.554956  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.506935 14530 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:15.523313 13789 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:15.572278 13789 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:15.570900 14711 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:15.571758 14530 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:15.563920  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:24:15.575400  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 66720us
I20260812 19:24:15.586854  6236 raft_consensus.cc:2396] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260812 19:24:15.575145  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 44251.7us
I20260812 19:24:15.544272 14715 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:15.576606 14711 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:15.591429 14017 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:15.594767 14318 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:15.595606 13789 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:15.596782  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.597358  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.598093  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.598920  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.599192  6350 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:15.601950  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.604182  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:15.612272  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.613116  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:15.613708  6353 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 15
I20260812 19:24:15.613904  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:15.614928  6232 raft_consensus.cc:2396] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260812 19:24:15.615417  6474 raft_consensus.cc:3032] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:15.615787  6474 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:15.611312  6473 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:15.616603  6474 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:15.617530  6474 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:15.605410 14711 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:15.618685 13789 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:15.613125  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:15.619330  6236 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:15.623553  6353 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:24:15.673448  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.621315  6483 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:15.675510  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:15.622175  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:15.676178  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:15.680249  6477 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:15.682420  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:15.683447  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.684257  6235 raft_consensus.cc:2379] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 10: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:15.686987  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:15.687760  7594 raft_consensus.cc:2354] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12.
I20260812 19:24:15.694478  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:15.606146 14318 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:15.708887  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:15.712280  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:15.712321  6359 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 8. Current term is 10. Ops: []
I20260812 19:24:15.715416  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:15.717269  6465 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:15.719161  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:15.720001  6353 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 12. Ops: []
I20260812 19:24:15.722450  6470 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:15.718237 14620 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:15.726816 14763 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:15.727252 14763 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:15.727571 14763 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:15.729931  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.730296  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.731130  6352 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 13: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:15.730976  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.731231  6344 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:15.732136  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.732405  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.732999  6349 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:24:15.787165  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.742750 14733 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:15.710549 14318 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:15.788705  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:15.792672  6353 raft_consensus.cc:2396] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260812 19:24:15.792528  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 73472.3us
W20260812 19:24:15.795787  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 173686us
I20260812 19:24:15.797346  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:15.787031  6416 connection.cc:232] RPC call timeout handler was delayed by -4.1430794449988753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260812 19:24:15.805961  6416 connection.cc:232] RPC call timeout handler was delayed by -3.74813766987063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260812 19:24:15.806344  6416 connection.cc:232] RPC call timeout handler was delayed by -3.6302376699168235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
I20260812 19:24:15.734122 13458 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260812 19:24:15.811718  6416 connection.cc:232] RPC call timeout handler was delayed by -3.5177376698702574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260812 19:24:15.820156  6416 connection.cc:232] RPC call timeout handler was delayed by -3.4637376698665321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
I20260812 19:24:15.821545 14468 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:15.822991 14468 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:15.825163 14468 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:15.826018  6416 connection.cc:232] RPC call timeout handler was delayed by -3.379137669922784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
I20260812 19:24:15.822235  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260812 19:24:15.827867 14753 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.263s	user 0.004s	sys 0.004s
I20260812 19:24:15.828097  6298 leader_election.cc:398] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12.
I20260812 19:24:15.828446  6298 leader_election.cc:401] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:24:15.830006  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.826972  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.830705 14620 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 12
I20260812 19:24:15.831252  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.831197  6235 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:15.833184  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:15.833738  6235 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 13
I20260812 19:24:15.831380  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.836678  6224 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260812 19:24:15.800361 14761 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.096s	user 0.004s	sys 0.000s
I20260812 19:24:15.821750 14747 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:15.832494  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:15.858064  6344 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
W20260812 19:24:15.841825  6416 connection.cc:232] RPC call timeout handler was delayed by -3.3627046060282737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260812 19:24:15.843881  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:15.866520  6416 connection.cc:232] RPC call timeout handler was delayed by -3.3530376700218767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
W20260812 19:24:15.867690  6416 connection.cc:232] RPC call timeout handler was delayed by -3.2835046059917659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
W20260812 19:24:15.868204  6416 connection.cc:232] RPC call timeout handler was delayed by -3.2673046060372144s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260812 19:24:15.868664  6416 connection.cc:232] RPC call timeout handler was delayed by -3.128704606089741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
I20260812 19:24:15.869792  6236 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 11: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:15.870512  6354 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 12: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:24:15.869100  6416 connection.cc:232] RPC call timeout handler was delayed by -2.611437669955194s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28530000000000005s for a response
I20260812 19:24:15.871073  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:15.871938  6416 connection.cc:232] RPC call timeout handler was delayed by -1.84620460588485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32230000000000003s for a response
I20260812 19:24:15.855945  6477 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:15.877696  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:15.798794 14127 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:15.887996  6352 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:15.888406  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.893113  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.892532  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:15.899144  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.899293  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:15.900328  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:15.903462  6342 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:15.904249 14764 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:15.911504  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.912434  6354 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:15.893069 14530 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:15.920285  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 126029us
I20260812 19:24:15.915997 14764 raft_consensus.cc:686] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:15.926723  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:15.924310  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:15.803406 14244 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:15.929948  6352 raft_consensus.cc:2379] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:15.908715 13603 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:15.811693 14733 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:15.946677  6474 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260812 19:24:15.948063  6228 raft_consensus.cc:2379] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 15: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:15.979676  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2347) took 1011 ms. Trace:
I20260812 19:24:15.876276 14747 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:15.980180  6464 rpcz_store.cc:276] 0812 19:24:14.968496 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:14.968749 (+   253us) service_pool.cc:227] Handling call
0812 19:24:14.969166 (+   417us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:15.327143 (+357977us) raft_consensus.cc:1520] Early marking committed up to index 3
0812 19:24:15.327196 (+    53us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:15.327827 (+   631us) log.cc:842] Serialized 26 byte log entry
0812 19:24:15.505972 (+178145us) raft_consensus.cc:1631] Marking committed up to 3
0812 19:24:15.506030 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:15.506115 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:15.799616 (+293501us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:15.940153 (+140537us) raft_consensus.cc:1671] finished
0812 19:24:15.940184 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:15.979582 (+ 39398us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":234733,"raft.queue_time_us":373347,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":32783744,"thread_start_us":203007,"threads_started":2,"wal-append.queue_time_us":182989}
I20260812 19:24:15.916008 14671 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:15.939218 14511 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:15.982633 13603 raft_consensus.cc:686] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 15 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:24:16.009182  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 113023us
W20260812 19:24:16.009743  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 94204.6us
I20260812 19:24:15.933074 14530 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:16.044401  6230 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 11: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:16.010699 14741 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:24:16.062916  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 165281us
I20260812 19:24:16.019603 14511 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:16.070128  6352 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260812 19:24:16.070884  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:16.069391 14750 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.183s	user 0.006s	sys 0.004s
W20260812 19:24:16.082314  6178 connection.cc:232] RPC call timeout handler was delayed by -1.3186329151503742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2891s for a response
W20260812 19:24:16.082996  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1028877280186862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
I20260812 19:24:16.009471 14711 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.073290  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:16.104280  6238 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 12: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:16.099342  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:16.111987  6345 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:16.123477 14511 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:16.125903 14774 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260812 19:24:16.075449 14715 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.131686  6465 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
W20260812 19:24:16.146382  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 199554us
W20260812 19:24:16.146564  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica a1541d11be514114966dc1e92a345298 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:16.153798  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:16.155296  6359 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:16.163646 14786 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260812 19:24:16.163964 14777 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260812 19:24:16.165158 14782 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260812 19:24:16.172129 14715 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:16.173539  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 9e38bc4707784979b4d00b45879a8f0b, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:16.178128  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 9e38bc4707784979b4d00b45879a8f0b, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.139657 14244 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:16.187781  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:16.022971 14764 consensus_queue.cc:237] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:16.180806  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 68669.5us
W20260812 19:24:16.193671 14773 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.129s	user 0.001s	sys 0.001s
I20260812 19:24:16.201476 13616 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:16.201975 13616 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:16.202409 13616 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:16.204286  6235 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:16.117285 13603 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:16.181087 14772 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260812 19:24:16.209585  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:16.209642  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 5bf9c8ef81414ede8e942ee03b95a816, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:16.264402  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 5bf9c8ef81414ede8e942ee03b95a816, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.084765 14741 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.170475 14318 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:16.208534 14778 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260812 19:24:16.243371  7594 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:16.184765 14733 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:16.250743  6464 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260812 19:24:16.208864 14530 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:16.252063  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:16.222442 14781 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260812 19:24:16.225694  7598 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260812 19:24:16.220768 14671 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:16.276285  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 66776.6us
W20260812 19:24:16.276993  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 206195us
I20260812 19:24:16.211546 14747 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:16.211450 14757 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260812 19:24:16.278193 14622 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:16.285759  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:16.287597  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:16.283638  6483 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 7.
I20260812 19:24:16.252501 14711 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:16.289213  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 3bc485edcf4e4bbc84bff9c14c471284, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:16.297690  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 3bc485edcf4e4bbc84bff9c14c471284, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.292151  6235 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 6.
I20260812 19:24:16.282449 14620 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12.
I20260812 19:24:16.304307  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:16.311973  7598 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 7.
I20260812 19:24:16.312356  6344 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
W20260812 19:24:16.314173 14771 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.382s	user 0.001s	sys 0.001s
I20260812 19:24:16.315769 14790 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.107s
I20260812 19:24:16.320339 14741 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:16.300694 14798 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:16.281916 14244 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260812 19:24:16.313480  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:16.296414 14671 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260812 19:24:16.331094  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:16.331955  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:16.311841 13789 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260812 19:24:16.340543  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:16.352648  6238 raft_consensus.cc:1261] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260812 19:24:16.328007 14798 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:16.367146  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:16.367437  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:16.367842  6474 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 14
I20260812 19:24:16.368202  6235 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 14
I20260812 19:24:16.367208  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:16.373054  6465 raft_consensus.cc:1261] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260812 19:24:16.344539 14763 consensus_meta.cc:287] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.617s	user 0.013s	sys 0.000s
I20260812 19:24:16.375384  6228 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260812 19:24:16.377503  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:16.362767 14511 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:16.382593  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:16.344743 14816 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 19:24:16.370719 14798 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:16.364358 14757 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:16.362478 14741 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:16.400538  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:16.397431  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 86451.7us
I20260812 19:24:16.380663 14711 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:24:16.419456  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:16.398393 14816 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:16.426774 14369 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:16.428408  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:16.405265 14127 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260812 19:24:16.433033  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 89839.7us
I20260812 19:24:16.404495 14511 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:16.407986 14741 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:16.415443 14731 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:16.414450 14711 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:16.446524  7594 raft_consensus.cc:595] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 15 LEADER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:16.417867 14318 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:16.449179  6235 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:16.381873 14763 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:16.434487 14821 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260812 19:24:16.432729 14816 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:24:16.472795  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44202.5us
I20260812 19:24:16.461849  6474 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:16.434762 14127 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:16.451221 14741 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
W20260812 19:24:16.493489  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 71528.1us
I20260812 19:24:16.495532  6241 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 14. Current term is 15. Ops: []
W20260812 19:24:16.473125 14813 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260812 19:24:16.462860 13603 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260812 19:24:16.500654  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:16.507275  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:16.526468  6477 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:16.439121 14779 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260812 19:24:16.459009 14711 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:16.525163  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:16.457737 14757 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:16.458118 14715 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260812 19:24:16.496981 14127 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
W20260812 19:24:16.536706  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 93caa3d3062a45cbad94ff4ba511f2e0, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:16.540449  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 93caa3d3062a45cbad94ff4ba511f2e0, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.525840 14671 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:16.541366 14671 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.536669  7594 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:16.546319 14671 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:16.553973  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:16.555356  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:16.528800 14808 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:16.531075 14757 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:16.557650  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 121081us
I20260812 19:24:16.536326 14244 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:16.674409  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:16.546977 14671 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:16.559070 14666 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:16.679569  7594 raft_consensus.cc:595] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:16.685133  6477 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:16.560039 14757 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:24:16.694954  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 146069us
W20260812 19:24:16.686465  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 125097us
I20260812 19:24:16.696209  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:16.697988 14369 raft_consensus.cc:686] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:16.679998 14244 raft_consensus.cc:2741] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260812 19:24:16.702390 14369 consensus_queue.cc:237] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.712055 14834 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:16.712821 14834 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.715674  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:16.716745 14765 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:16.718907 14715 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:16.719501 14715 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:16.720525 14715 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.695535 14666 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:16.735284  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 280889us
I20260812 19:24:16.558722 14511 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:16.739075  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 64853.3us
I20260812 19:24:16.733683 14666 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:16.700129 14671 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.764923 14671 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:16.765683  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:16.767028 14747 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:16.767519  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:16.770200  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:16.770893 14808 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:16.772858  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:16.781960  6477 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 12
I20260812 19:24:16.738090 14468 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:16.767635 14747 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:16.787477  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 52673.5us
I20260812 19:24:16.789397  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:16.786159 14468 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:16.793853 14468 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:16.795125  6417 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:16.799381 14265 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:16.755983 14763 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:16.787652 14747 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:16.812083 14757 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.802356 14741 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.815688  6483 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
W20260812 19:24:16.815773  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 73854.1us
W20260812 19:24:16.835327  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 65236.8us
I20260812 19:24:16.834039 14757 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:16.761968 14816 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:16.860579 14741 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:16.902869  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 72442.6us
I20260812 19:24:16.916199  6242 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:16.917013  6477 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
W20260812 19:24:16.941642 14832 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.183s	user 0.003s	sys 0.000s
I20260812 19:24:16.835465 14620 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260812 19:24:16.836437 13603 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:16.835916 14808 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260812 19:24:16.915084 14798 consensus_meta.cc:287] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.500s	user 0.014s	sys 0.007s
I20260812 19:24:16.964056  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:16.953779 13603 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:16.959197 14808 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:16.967228 13603 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:16.967770 14808 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 7 FOLLOWER]: Advancing to term 8
W20260812 19:24:16.950585 13616 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.748s	user 0.013s	sys 0.005s
I20260812 19:24:16.941969 14127 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.987357  7594 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:16.953382 14468 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:16.976266 14834 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:16.963287 14798 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:17.020012 14816 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:17.047521  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 230743us
I20260812 19:24:16.984373  6229 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260812 19:24:17.066690 14764 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.010s	sys 0.066s
I20260812 19:24:16.976104  7607 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260812 19:24:16.985245 14745 consensus_queue.cc:1046] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260812 19:24:17.081396  7594 raft_consensus.cc:595] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
W20260812 19:24:17.087806  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 117925us
W20260812 19:24:17.074833  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 378767us
I20260812 19:24:17.092495  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:17.099169  6228 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 6 FOLLOWER]: Advancing to term 8
I20260812 19:24:17.099680 14834 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:17.082075 14741 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:17.097898  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:17.089454 14711 consensus_meta.cc:287] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.006s
I20260812 19:24:17.083922 14671 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:24:17.106087  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 179742us
I20260812 19:24:17.100968  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:17.097262 14764 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.011s	sys 0.066s
I20260812 19:24:17.113412  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:17.116397  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:17.113080  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:17.100291 14834 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:17.120709  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:17.122558  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:17.123195  6354 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:17.124220 14798 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:17.108978 14836 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:17.127642 14836 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:17.129056 14468 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:17.129809 14836 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:17.130589  6347 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260812 19:24:17.131589 14834 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:17.111085 14711 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:17.134639 14711 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:17.136132 14127 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:17.136883  6475 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:24:17.144053  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:17.105073 14741 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:17.149027 14790 raft_consensus.cc:3032] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:17.149395 14790 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:17.150940 14815 raft_consensus.cc:2741] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260812 19:24:17.151326 14511 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:17.092748 13616 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:17.164750  6238 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 9. Current term is 10. Ops: []
I20260812 19:24:17.097076 14747 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:17.162083  6483 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:17.165658  6483 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:17.175005  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:17.177155  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:17.181349  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:17.182206  6242 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 15
I20260812 19:24:17.181512 14835 consensus_queue.cc:1046] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260812 19:24:17.190876 14006 raft_consensus.cc:3032] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:17.191339 14006 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:17.192171 14006 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:17.193627 14006 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:17.193894  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:17.194484  6470 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:17.204428  6482 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:17.213470  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:17.211331  6229 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:17.143216 14765 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:17.152920 14808 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:17.092671 14666 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:17.227813  6242 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:17.228257 14666 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:17.219085  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:17.229043  6481 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:17.147349 14763 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:17.154299 14741 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:17.153522 14511 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:17.225934  6224 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260812 19:24:17.226328  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 61170.6us
I20260812 19:24:17.232628  6354 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:24:17.224520  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:17.233747  6475 raft_consensus.cc:595] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:17.247330  6475 raft_consensus.cc:603] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:17.164893 14745 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election won for term 12
W20260812 19:24:17.254148  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 136112us
I20260812 19:24:17.250584  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:17.252830  6465 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:17.261054  6229 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 15: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:17.253626  6483 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:17.154778 14127 consensus_queue.cc:1046] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260812 19:24:17.272697  6470 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:17.150244 14790 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:17.320159  6483 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:17.224516 14671 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:17.323935  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:17.321614  6481 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:17.330577  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:17.404865  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260812 19:24:17.405344  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 82499.1us
I20260812 19:24:17.406111  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:17.407100  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:24:17.407421  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:17.407965 14671 raft_consensus.cc:2741] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260812 19:24:17.409260  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:17.326161 14745 raft_consensus.cc:686] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:17.232384 14765 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:17.438241  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 105895us
W20260812 19:24:17.419735 14778 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.147s	user 0.000s	sys 0.004s
I20260812 19:24:17.518239 14836 raft_consensus.cc:3032] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:17.518857 14836 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:17.519840 14836 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:17.521275 14836 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:17.416042 14711 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:17.320758 14845 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.127s
I20260812 19:24:17.419361 14764 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:17.428719 14691 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:24:17.530253 14862 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260812 19:24:17.430040 14802 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:17.594466  6235 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260812 19:24:17.599522  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 190320us
I20260812 19:24:17.535472 14790 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:17.604622  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:17.620364  6481 raft_consensus.cc:2379] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 8: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:17.558866 14708 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
W20260812 19:24:17.616079  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 48232us
I20260812 19:24:17.628505  6465 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:17.543946 14779 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:24:17.672303  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 71801us
I20260812 19:24:17.688545  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:17.446297 14511 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:17.719669  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 84535.2us
I20260812 19:24:17.704128  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:17.586786 14691 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:17.592495 14802 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:17.741973 14866 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.406s	user 0.000s	sys 0.001s
I20260812 19:24:17.731241 13616 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:17.746482 14808 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:17.664749 14779 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:17.776024 14747 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:17.783245 14764 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260812 19:24:17.796430 14842 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260812 19:24:17.817492 14318 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:17.753113 14841 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
W20260812 19:24:17.828362  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 160963us
I20260812 19:24:17.835508  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:17.663757 14745 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:17.839450  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 165840us
I20260812 19:24:17.841830 13611 raft_consensus.cc:979] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower 54f83319db6b49929cc8f18a66a66975 to start an election
W20260812 19:24:17.844319  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica a1541d11be514114966dc1e92a345298 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:17.844511 14837 raft_consensus.cc:979] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:17.823009 14757 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:17.846766 14755 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:17.851785 13603 raft_consensus.cc:979] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower 54f83319db6b49929cc8f18a66a66975 to start an election
I20260812 19:24:17.870359  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:17.876107  6228 consensus_meta.cc:287] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.776s	user 0.010s	sys 0.000s
I20260812 19:24:17.876565  6228 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 8.
I20260812 19:24:17.879670  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:17.885932  6483 consensus_meta.cc:287] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.559s	user 0.013s	sys 0.001s
I20260812 19:24:17.887526 14837 raft_consensus.cc:1067] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Signalling peer 54f83319db6b49929cc8f18a66a66975 to start an election
I20260812 19:24:17.888602 13616 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:17.890264  6483 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:17.892033  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:17.876452 14519 raft_consensus.cc:1067] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 15 LEADER]: Signalling peer 54f83319db6b49929cc8f18a66a66975 to start an election
I20260812 19:24:17.879051 14816 raft_consensus.cc:1067] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:17.838774 14318 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:17.878417 14765 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:17.889782 14764 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:17.889607 14666 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260812 19:24:17.905761 14884 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260812 19:24:17.901456 14127 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260812 19:24:17.906425 14870 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.113s	user 0.001s	sys 0.001s
W20260812 19:24:17.910961  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 545108632fab48129db7f032619a1e55, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:17.911339  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 545108632fab48129db7f032619a1e55, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:17.876739 14715 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260812 19:24:17.912827  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 52549.4us
I20260812 19:24:17.898033 14845 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:17.921573  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:17.923506  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 4995e2d6140a4fa3a2dadad444b9a924, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:17.923834  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 4995e2d6140a4fa3a2dadad444b9a924, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:17.929430  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:17.938853 14878 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.199s	user 0.003s	sys 0.000s
W20260812 19:24:17.940680  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 04c512eaceae43d2a378065361eb4854, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:17.941030  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 04c512eaceae43d2a378065361eb4854, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:17.912779 14764 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:17.914276 14691 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:17.895843 14757 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:17.950030  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:17.952852  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:17.954164  6354 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:24:17.955010  6178 connection.cc:232] RPC call timeout handler was delayed by -2.0220403491985053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2218s for a response
W20260812 19:24:17.942564 14872 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260812 19:24:17.960105  6178 connection.cc:232] RPC call timeout handler was delayed by -1.9273722080979496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
I20260812 19:24:17.962262  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:17.963291  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:17.942986 14849 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Stepping down as leader of term 9
W20260812 19:24:17.970093  6178 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.743s (SENT)
I20260812 19:24:17.969962  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:17.982892  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:17.983382  6344 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260812 19:24:17.984664  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:17.985641  7594 raft_consensus.cc:2379] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:17.925283 14671 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260812 19:24:17.990578  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:17.993433  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:17.963842 14845 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:18.001168  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:17.971818 14849 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:18.007256  6232 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:56292
I20260812 19:24:18.007805  6232 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:18.008153  6232 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:24:18.008268  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:18.008615  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:18.002844  6354 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:17.972012  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:17.996320  6342 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:35822
I20260812 19:24:18.010435  6342 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:18.010825  6342 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:17.997282  6347 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:35822
I20260812 19:24:18.011615  6347 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:18.012070  6347 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:18.015870  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:18.016691  6481 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:18.017393  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:18.020551  6483 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:18.020709  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:17.960803 14764 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:18.022635  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:18.023321  6228 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:17.996181 14666 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:18.024379  6464 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260812 19:24:18.024923  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:18.028460  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.030069  6482 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:18.006666 14808 raft_consensus.cc:2741] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260812 19:24:18.039207  6230 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260812 19:24:18.039139  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:18.037712  6236 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:24:18.054059  6481 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:18.009323 14779 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:18.059474  6483 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260812 19:24:18.061138  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.053659  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:18.049878  6232 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:18.067060  6228 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
W20260812 19:24:18.068321  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 67211.1us
W20260812 19:24:18.070055 14883 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260812 19:24:18.071378  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:18.029438 14666 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:18.100749  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:18.101025 14666 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:18.101492  6354 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:24:18.070938 14819 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Leader election won for term 8
I20260812 19:24:18.106828 14845 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:18.096742  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 58448.7us
I20260812 19:24:18.109386 14808 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:18.112686  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:18.114784 14691 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:18.115309 14757 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:18.072948 14747 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:18.117522 14834 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 19:24:18.071676 14849 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:18.118845 14836 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:18.119252 14836 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:18.077780  6353 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:18.079670  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:18.122303  7594 raft_consensus.cc:3032] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:18.122725  7594 raft_consensus.cc:729] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:24:18.082019 14891 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260812 19:24:18.085664  6342 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:18.088294 14764 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:18.057989 14318 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:18.093693  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:18.134905  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:18.135514 14836 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:18.136767 14836 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:24:18.087073  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 126285us
I20260812 19:24:17.999060 14890 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260812 19:24:18.007069 14815 consensus_queue.cc:1046] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260812 19:24:18.141779  6342 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:18.107631 14819 raft_consensus.cc:686] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:18.143942  6345 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
W20260812 19:24:18.128437  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 57135.9us
I20260812 19:24:18.130470  7594 consensus_queue.cc:260] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:18.132249  6354 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:18.131481  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:18.139036  6178 leader_election.cc:334] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.748s (SENT)
I20260812 19:24:18.150385  7594 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:18.154495  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:18.129146 14889 consensus_queue.cc:1159] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdfa5579d4534c618c00db6b4a841c81" responder_term: 9 status { last_received { term: 9 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 9 index: 7 } }
I20260812 19:24:18.162495  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:18.163285  7591 raft_consensus.cc:3032] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:18.163565  7591 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:18.164336  7591 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:18.165524  7591 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:18.160141 14841 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:18.167222 14841 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:18.167622 14841 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:18.168551 14849 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:18.160211 14715 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:18.173919 14898 raft_consensus.cc:3032] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:18.174381 14898 raft_consensus.cc:729] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:18.175416 14898 consensus_queue.cc:260] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:18.178704 14898 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:24:18.174454 14741 consensus_meta.cc:287] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.910s	user 0.013s	sys 0.001s
W20260812 19:24:18.176920 14790 consensus_meta.cc:287] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.004s
I20260812 19:24:18.188822  7598 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:18.189503 14819 consensus_queue.cc:237] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:18.174482  7591 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:18.078289  6232 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:18.187397  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 48393.4us
W20260812 19:24:18.192473  6178 leader_election.cc:334] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.808s (SENT)
I20260812 19:24:18.192987  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:18.187901 14890 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:18.200011  6298 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:18.191592  6347 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:18.203666  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:18.204411  7594 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:18.160099 14802 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:18.208294  6347 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:18.185097 14894 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:18.211814  6179 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:18.213323  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:18.215237  7594 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:18.215564  7594 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:18.217095  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.217033  7594 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:18.217641  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.218466  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.219089  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.219671  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.219997  7594 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:18.219373  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.220256  6482 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:18.220773  6481 raft_consensus.cc:2354] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 7. Current term is 8.
I20260812 19:24:18.221827  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.223745  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.221189 14901 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:18.207779 14765 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:18.229249 14671 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:18.229826 14671 raft_consensus.cc:686] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:18.230129  7594 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:18.230742 14671 consensus_queue.cc:237] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:18.206476 14779 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260812 19:24:18.233072 14779 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:18.233422 14779 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:18.233968 14765 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:18.234953  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.235728  6470 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:18.235249 14765 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:18.236563  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.237668  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:18.238322  6470 raft_consensus.cc:2354] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 14.
I20260812 19:24:18.238933  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:18.239775  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.240909  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.241600  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.208927 14715 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:18.246534  6298 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:18.263574  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.267462  6465 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
W20260812 19:24:18.269344  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 76916.4us
W20260812 19:24:18.269934  6178 connection.cc:232] RPC call timeout handler was delayed by -1.8985722081270069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
I20260812 19:24:18.194125 14741 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:18.274296  7598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 607) took 1019 ms. Trace:
I20260812 19:24:18.276357  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:18.278714  7598 rpcz_store.cc:276] 0812 19:24:17.255073 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:17.255261 (+   188us) service_pool.cc:227] Handling call
0812 19:24:18.274048 (+1018787us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54005ae6d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:18.274218 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1977788160}
I20260812 19:24:18.280754  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.281850  6470 raft_consensus.cc:2354] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12.
I20260812 19:24:18.203567 14890 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:18.295441  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:18.297024  6482 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14. Ops: [13.5-13.5]
I20260812 19:24:18.298237  6481 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260812 19:24:18.298453  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:18.298987  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:18.299268  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:18.299391  6482 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:18.299762  6465 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:18.300578  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.301815  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.263825 14849 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260812 19:24:18.303059  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.234189 14779 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:18.304414 14779 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:18.305616 14666 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:18.306768  6475 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:18.307039  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.307740  6474 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:18.309572 14666 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:18.311084  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:18.272526 14802 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260812 19:24:18.320206  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:18.323143  6232 raft_consensus.cc:2396] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260812 19:24:18.325704  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:18.326476  6232 raft_consensus.cc:2379] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:18.328068 14741 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:18.328819  6477 raft_consensus.cc:1226] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:18.329885  6232 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:18.278316 13616 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:18.332113  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:18.332690 14897 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.171s	user 0.002s	sys 0.001s
I20260812 19:24:18.335798  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:18.336139  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 54172.1us
I20260812 19:24:18.338404  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:18.342208  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 713) took 1268 ms. Trace:
I20260812 19:24:18.338581  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:18.286194  6298 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:18.341373  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:18.342635  6477 rpcz_store.cc:276] 0812 19:24:17.074159 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:17.074372 (+   213us) service_pool.cc:227] Handling call
0812 19:24:17.077185 (+  2813us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:18.329252 (+1252067us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:18.341975 (+ 12723us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540003bbd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:18.342147 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2878020992}
I20260812 19:24:18.343781  6242 raft_consensus.cc:2379] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 8: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:18.334621  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:18.352299  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:24:18.367682  6416 connection.cc:232] RPC call timeout handler was delayed by -1.5439460270572454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260812 19:24:18.368243  6416 connection.cc:232] RPC call timeout handler was delayed by -1.3810460271779448s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260812 19:24:18.368585  6416 connection.cc:232] RPC call timeout handler was delayed by -1.2964460272341967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260812 19:24:18.368851  6416 connection.cc:232] RPC call timeout handler was delayed by -1.2775460272096097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
W20260812 19:24:18.369143  6416 connection.cc:232] RPC call timeout handler was delayed by -1.2721460270695388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260812 19:24:18.369428  6416 connection.cc:232] RPC call timeout handler was delayed by -1.2559460271149874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
I20260812 19:24:18.369343  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:18.369859  6416 connection.cc:232] RPC call timeout handler was delayed by -1.1218460272066295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260812 19:24:18.370127  6416 connection.cc:232] RPC call timeout handler was delayed by -1.070546027040109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
I20260812 19:24:18.372119 13616 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:18.373622 13616 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:18.378297  6482 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:18.378753  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:18.379907  6354 raft_consensus.cc:1261] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260812 19:24:18.380268  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:18.382117  6342 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:18.382351  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:18.383118 14889 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:18.383306  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:18.383579 14889 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:18.383960 14889 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:18.384661  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:18.387204  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:18.388023  6349 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:18.388677 14587 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:18.389178  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:18.390121 14587 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:18.390700 14127 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:18.391165  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:18.377327  6475 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:18.393535 14369 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:18.394016 14369 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:18.394172  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:18.395185 14587 raft_consensus.cc:686] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:18.396478 14587 consensus_queue.cc:237] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:18.394539 14369 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:18.407964  6344 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
W20260812 19:24:18.347045 14903 log.cc:924] Time spent T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260812 19:24:18.415267  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47449.9us
I20260812 19:24:18.334582 14715 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:24:18.423755  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 53041.7us
I20260812 19:24:18.424716  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:18.338920 14691 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260812 19:24:18.444005  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:18.345806 14798 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
W20260812 19:24:18.453397  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 167327us
I20260812 19:24:18.432826 14898 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260812 19:24:18.457958  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 76644.5us
I20260812 19:24:18.420552 14745 consensus_queue.cc:1046] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
W20260812 19:24:18.462478  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 191937us
I20260812 19:24:18.463986  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:18.465487  6178 leader_election.cc:334] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.965s (SENT)
I20260812 19:24:18.453744 14747 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:18.477298  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:18.485808  6470 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260812 19:24:18.486049 14519 raft_consensus.cc:3032] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:18.486533 14519 raft_consensus.cc:729] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:18.487430 14519 consensus_queue.cc:260] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:18.493602 14910 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260812 19:24:18.495054  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:18.495723  6230 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:18.502275  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:18.498454  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:18.507759  6229 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
W20260812 19:24:18.508109  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 44211.3us
I20260812 19:24:18.523989  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:18.724967  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 207638us
I20260812 19:24:18.553812 14715 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:18.472586 14898 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:18.788043  6232 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:18.788446  6232 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:18.791306  6345 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260812 19:24:18.774812  6475 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:18.554792 14894 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:18.778049  6230 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:18.780078  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:18.507499 14765 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
W20260812 19:24:18.785272  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 319774us
I20260812 19:24:18.789193  6232 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:18.786583 14815 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:18.793767 14666 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:18.795406 14890 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:18.797559  6229 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
W20260812 19:24:18.809469  6178 connection.cc:232] RPC call timeout handler was delayed by -1.851772207999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
I20260812 19:24:18.809557  6232 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
W20260812 19:24:18.795639 14912 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.327s	user 0.006s	sys 0.004s
I20260812 19:24:18.817938  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:18.859604  6232 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260812 19:24:18.814198 14747 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260812 19:24:18.873680  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 93665.2us
I20260812 19:24:18.806195 14889 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:18.888134  7598 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260812 19:24:18.888540 14915 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.289s	user 0.008s	sys 0.002s
I20260812 19:24:18.805807 14369 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:18.819494 14666 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:18.814400 14815 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:18.906996  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:18.881477 14671 raft_consensus.cc:2741] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260812 19:24:18.935668  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 116523us
I20260812 19:24:18.937462  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:18.944133 14898 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:18.967159  6483 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260812 19:24:18.978400  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260812 19:24:19.040784  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 73062.3us
I20260812 19:24:18.886210 14318 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260812 19:24:18.908114 14747 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:18.975020 14943 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260812 19:24:19.053612  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 159112us
I20260812 19:24:19.061255  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:24:18.975029 14916 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.200s	user 0.001s	sys 0.001s
W20260812 19:24:19.045886 14884 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260812 19:24:19.118724  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 59991.8us
I20260812 19:24:19.120249  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2402) took 1096 ms. Trace:
I20260812 19:24:19.120672  6238 rpcz_store.cc:276] 0812 19:24:18.023991 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:18.024097 (+   106us) service_pool.cc:227] Handling call
0812 19:24:18.037283 (+ 13186us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:18.213932 (+176649us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:18.213965 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:18.225666 (+ 11701us) log.cc:842] Serialized 26 byte log entry
0812 19:24:18.349916 (+124250us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:18.349958 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:18.350041 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:19.120024 (+769983us) raft_consensus.cc:1671] finished
0812 19:24:19.120044 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:19.120185 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":78357,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":295439,"threads_started":2,"wal-append.queue_time_us":217768}
I20260812 19:24:18.963642 14798 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.115s
I20260812 19:24:19.049259 14904 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:19.112258 14898 raft_consensus.cc:2741] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
W20260812 19:24:19.147087  6298 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.013s	sys 0.022s
W20260812 19:24:19.135123 14922 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260812 19:24:19.135562 14951 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260812 19:24:19.136186 14947 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260812 19:24:19.138720 14530 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:19.073552 14747 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:19.148095  6298 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.013s	sys 0.022s
W20260812 19:24:19.124604  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 63465.1us
I20260812 19:24:19.164928  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:19.144510 14792 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:19.154598 14836 consensus_meta.cc:287] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.017s	user 0.006s	sys 0.016s
W20260812 19:24:19.155205 14841 consensus_meta.cc:287] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.987s	user 0.014s	sys 0.009s
W20260812 19:24:19.161832 14779 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.853s	user 0.012s	sys 0.007s
I20260812 19:24:19.155055 14951 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:19.207513 14889 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:19.208411 14849 raft_consensus.cc:3032] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:19.208642 14666 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:19.209177 14747 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:19.146538 14904 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:19.209805 14815 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:19.210268 14369 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:19.210861 14955 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:19.167553 14530 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:19.186128 14841 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:19.221994  6354 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
W20260812 19:24:19.229090  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 65800.4us
I20260812 19:24:19.259537  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:19.182086 14792 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:19.237061 14894 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:19.237633 14978 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:19.215214 14898 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:19.227551 14951 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:24:19.241084  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 418392us
I20260812 19:24:19.283649  7607 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:19.284093  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:19.234459 14849 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:19.263993  6350 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:19.279088  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:19.296563  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:19.276620 14815 raft_consensus.cc:2741] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260812 19:24:19.299120  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 318839us
I20260812 19:24:19.299449  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:19.277289 14894 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:19.300043 14969 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:19.327364  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:19.327888  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 159325us
I20260812 19:24:19.301954 14898 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:19.340322  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:19.342900  6232 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:19.345268  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:19.362844  6481 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260812 19:24:19.364305  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:19.364966  7598 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:19.365909  7598 raft_consensus.cc:595] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:19.366340  7598 raft_consensus.cc:603] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:19.365020  6235 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
W20260812 19:24:19.376680  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 49404.5us
I20260812 19:24:19.378374  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:19.379843  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:19.381026  6242 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 15: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:24:19.381641 14970 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260812 19:24:19.380149 14986 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:24:19.397935  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:19.302232 14666 consensus_queue.cc:1046] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.052s
I20260812 19:24:19.403180  7591 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:19.319725 14815 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:19.403927  7591 raft_consensus.cc:595] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:19.351063 14927 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:19.293314 14978 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:19.419337  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 122864us
I20260812 19:24:19.336050 14969 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:19.413771 14747 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:19.433501  6477 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:19.436722  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:19.415132  7594 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
W20260812 19:24:19.396325 14965 log.cc:924] Time spent T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.160s	user 0.002s	sys 0.000s
W20260812 19:24:19.455046  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 76792.7us
I20260812 19:24:19.460271  6483 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260812 19:24:19.456015  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:19.465348  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:19.468014  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:19.459141  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:19.416577 14927 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:24:19.528438  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 65200.2us
I20260812 19:24:19.318349 14849 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:19.425990 14969 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:19.423460 14981 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:19.526917 14898 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:19.601029  7594 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:19.601914  7594 raft_consensus.cc:595] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:19.602321  7594 raft_consensus.cc:603] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:19.608738  6470 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:19.589676 14841 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:19.567971 14892 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260812 19:24:19.601328 14849 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:19.601295 14530 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:19.610728 14904 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:19.668852  6483 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:59812
I20260812 19:24:19.670868  6483 raft_consensus.cc:595] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:19.671458  6483 raft_consensus.cc:603] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:19.612550 14792 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:19.674832 14904 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:19.675786 14989 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260812 19:24:19.675462 14904 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:19.677654 14904 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:19.674402 14992 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260812 19:24:19.683377 14998 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260812 19:24:19.699323 14894 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:19.701725 14978 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:19.720556  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260812 19:24:19.721045  6229 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:19.721621  6229 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:24:19.728253  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 360907us
I20260812 19:24:19.632324 14666 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:19.744777  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:19.745532  6470 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:19.753409  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:19.742548  6229 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:19.759975  6229 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:19.759431  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:19.768522  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 332304us
I20260812 19:24:19.771210  6298 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:19.776773  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:19.778697  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:19.779774  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:19.780642  6229 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260812 19:24:19.762447 14745 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:19.773284 14849 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:19.626543 14927 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:19.812750  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:19.814985  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:19.763832 14987 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260812 19:24:19.799576 14978 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:19.777102 14666 consensus_queue.cc:1046] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260812 19:24:19.817564  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.558s (SENT) [suppressed 17 similar messages]
I20260812 19:24:19.817178  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:19.794937 14849 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:19.830747  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:19.822733  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:19.822330 14849 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
W20260812 19:24:19.834010 14951 consensus_meta.cc:287] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.002s
I20260812 19:24:19.831542  6349 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:19.789786 14745 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:19.841272 15004 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:19.836923  6354 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:19.841365  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:19.842885  6359 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:19.842015 14931 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:19.855682 14931 raft_consensus.cc:686] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:19.856698 14931 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:19.834956 14978 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:19.847502 14666 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:24:19.863720  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 46193.7us
I20260812 19:24:19.837095 13616 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260812 19:24:19.867043  6178 leader_election.cc:334] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.070s (SENT)
W20260812 19:24:19.912349  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 125940us
I20260812 19:24:19.965549  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:19.862540 15004 raft_consensus.cc:686] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:19.983281  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:19.986838  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 521541us
I20260812 19:24:20.005739  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:20.006951 14898 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:24:19.842506 14999 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.180s
I20260812 19:24:20.009223 14849 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:19.983227 14815 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.013357 14745 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:20.013063 14815 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.015661 14894 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.016067 15008 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.016388 14894 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.016770 15008 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.018990  6350 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:20.019042 14894 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:20.010495 14671 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260812 19:24:20.011327  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 144296us
W20260812 19:24:20.020884  6178 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.109s (SENT)
I20260812 19:24:20.021371  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:20.021893  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:20.019299 14849 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:20.022734  6228 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
W20260812 19:24:20.023160  6178 leader_election.cc:334] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.193s (SENT)
I20260812 19:24:20.023700  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:20.025074  6178 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.218s (SENT)
I20260812 19:24:20.025534  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:20.011929 14960 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.026744 14978 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.027096 14960 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.029706  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:19.960821 14622 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:19.846266 14951 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:20.070431  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45380.6us
W20260812 19:24:20.088810  6178 leader_election.cc:334] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.231s (SENT)
I20260812 19:24:20.076484 14969 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.093041 14960 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:20.057322 14671 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:24:20.095815 14969 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:20.015719 14815 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:20.097360 14815 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:20.098111 14815 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:20.098717 14815 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:20.104760 14951 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:20.070783 14894 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:20.078732 14622 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:20.095151 15008 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:20.057650 14999 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:20.115321 14765 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:20.115869 14765 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:20.116263 14765 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:20.117859 14622 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:20.119668  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:20.120015 15004 consensus_queue.cc:237] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.121407 14960 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:19.874078 14666 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:20.112963 15007 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260812 19:24:20.128648  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:20.058118 14745 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:20.132431  7607 raft_consensus.cc:2379] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 12: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:20.141072 14745 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:20.145561 14745 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:20.153348  6178 connection.cc:232] RPC call timeout handler was delayed by -1.3694867498707026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28900000000000003s for a response
W20260812 19:24:20.155764  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2254867497831583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.305s for a response
W20260812 19:24:20.155844  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 64176.3us
W20260812 19:24:20.157061  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1525867499876767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3131s for a response
I20260812 19:24:20.056964 14898 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:19.984043 14994 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.147s
I20260812 19:24:20.183612  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:20.167798 14999 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.173602 14894 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.201676  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:20.178815 15008 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.187227 14960 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:20.187337 14904 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:20.219724  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 214037us
I20260812 19:24:20.223795  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:20.227777 14993 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:24:20.228873  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:20.231256  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:20.232530  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:20.238986  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:20.250445  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:20.252904  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:20.253643  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:20.256029  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:20.257855  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:20.258803  6353 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:20.221714 15008 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:20.261232  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:20.262144  6229 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:20.271991  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:20.264282  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:20.276652  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:20.278632  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:20.279579  6241 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:20.278064  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:20.270330  6178 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.059s (SENT)
I20260812 19:24:20.272147 15014 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:20.283387  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:20.223230 14666 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:20.287483  6242 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:20.309108 14747 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.265475 14993 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:20.323755  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:24:20.186709 14898 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.283603  6229 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:20.221325 14894 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.273231 14969 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.272408 15027 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:20.223074 14960 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.224788 14999 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.287565 14802 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:20.280260 15029 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:20.227006 14904 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.325205 14671 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260812 19:24:20.373505  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 103177us
W20260812 19:24:20.374593  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 391380us
I20260812 19:24:20.336863 15014 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:20.377665  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:20.288954 14815 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.382092  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:20.382287  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:20.384019  6354 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:20.390512  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:20.402457  6230 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:20.374833 15027 raft_consensus.cc:686] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:20.414757  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:20.380033 15029 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:20.420506  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:20.422909  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:20.344514 14969 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.389798 15004 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:20.372969 14802 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.418633 14519 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:20.434898 14802 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:20.424089  6241 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260812 19:24:20.442332 14802 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:20.442972 14894 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:20.444847 14904 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:20.446112  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2430) took 1099 ms. Trace:
I20260812 19:24:20.409202 14666 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.428036 14834 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:20.447158 14815 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:20.447305 14666 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.448084 14815 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:20.449739 14666 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:20.449879 15026 log.cc:924] Time spent T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260812 19:24:20.447203 14834 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:20.448765 14815 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:20.453951 14834 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:20.454799 15003 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.756s	user 0.005s	sys 0.011s
I20260812 19:24:20.446538  6236 rpcz_store.cc:276] 0812 19:24:19.346923 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:19.347072 (+   149us) service_pool.cc:227] Handling call
0812 19:24:19.347475 (+   403us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:19.454349 (+106874us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:24:19.454379 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:19.525366 (+ 70987us) log.cc:842] Serialized 26 byte log entry
0812 19:24:19.817075 (+291709us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:19.817115 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:20.445730 (+628615us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b540001d954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:20.445778 (+    48us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:20.445826 (+    48us) raft_consensus.cc:1671] finished
0812 19:24:20.445838 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:20.446045 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":55035,"raft.queue_time_us":217408,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7812,"spinlock_wait_cycles":131362176,"thread_start_us":222500,"threads_started":1,"wal-append.queue_time_us":259060}
I20260812 19:24:20.459964  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 773) took 1152 ms. Trace:
I20260812 19:24:20.460513  6345 rpcz_store.cc:276] 0812 19:24:19.307713 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:19.307917 (+   204us) service_pool.cc:227] Handling call
0812 19:24:19.323864 (+ 15947us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:19.324325 (+   461us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:19.324365 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:19.359458 (+ 35093us) log.cc:842] Serialized 26 byte log entry
0812 19:24:19.647163 (+287705us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:19.647220 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:19.647339 (+   119us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:20.454174 (+806835us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:20.456368 (+  2194us) raft_consensus.cc:1671] finished
0812 19:24:20.456389 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:20.459878 (+  3489us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23331,"raft.queue_time_us":6026,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":15168,"spinlock_wait_cycles":26223488,"thread_start_us":192365,"threads_started":1,"wal-append.queue_time_us":252406}
W20260812 19:24:20.475302  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 84849.5us
I20260812 19:24:20.476437  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:20.426862 14981 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.018s	sys 0.029s
I20260812 19:24:20.345925 14747 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.430136 15029 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.432310  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2453) took 1002 ms. Trace:
I20260812 19:24:20.432667 14986 raft_consensus.cc:3032] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:20.414759 14671 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:20.511587  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:20.499791 14981 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.018s	sys 0.029s
I20260812 19:24:20.510077  6481 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:20.507462 14815 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:20.511296  6475 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260812 19:24:20.508251  6470 rpcz_store.cc:276] 0812 19:24:19.429878 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:19.430015 (+   137us) service_pool.cc:227] Handling call
0812 19:24:20.432090 (+1002075us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400364a54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:20.432217 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":310735744}
I20260812 19:24:20.498618  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:20.513837  6345 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:24:20.505962  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 330452us
W20260812 19:24:20.515501  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 74210.4us
I20260812 19:24:20.516249  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:20.518306  6465 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:20.531150  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:20.419299 14845 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260812 19:24:20.514061  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:20.500115 15004 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:20.455567 15014 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.555667  7594 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:20.555871  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:20.508343 15020 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260812 19:24:20.536916  6464 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:20.544822  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:20.545843  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:20.554467  6465 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260812 19:24:20.525305  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:20.561554  6464 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:20.561524  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:20.563862  6483 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:20.565943  6229 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260812 19:24:20.566567  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:20.567524  6475 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:20.511883 14986 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:20.570266  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:20.571275  6481 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:20.575506  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:20.577478  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:20.537919 14936 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:20.583891  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:20.524489 14904 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.557447 14953 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:20.586172  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:20.591032  6229 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:20.559222 14815 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.571312 15053 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.569661 14666 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:20.624527  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:20.630478  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:20.563159 14671 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260812 19:24:20.631376  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:20.587343 14898 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:20.588963 14988 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:20.584805 14999 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:20.642900  6179 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:20.632773 15008 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:20.589664 14904 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:20.699527 15051 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260812 19:24:20.628531 15053 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.654896 14988 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:20.662055 15035 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.033s
I20260812 19:24:20.663379 14986 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:20.696705 14745 consensus_meta.cc:287] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.551s	user 0.014s	sys 0.000s
I20260812 19:24:20.578447 15027 consensus_queue.cc:237] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.641710 14779 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:20.701118  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45581.2us
I20260812 19:24:20.701932  6229 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
W20260812 19:24:20.740257  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:24:20.691382 15045 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260812 19:24:20.650220 14960 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:20.639530 14666 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:20.626976 14815 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:20.660782 15004 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:20.754715  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:20.661101 14845 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:20.738227  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:20.745622  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:20.747802  6232 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260812 19:24:20.590270 14936 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:20.758924  6229 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:24:20.597596 14953 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:20.755460  6483 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 9.
I20260812 19:24:20.766121  6475 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:20.744983 14969 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:20.785006 15034 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
W20260812 19:24:20.785640 15054 log.cc:924] Time spent T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260812 19:24:20.761350 14986 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:20.763235 14747 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:20.749528 14745 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:20.750574 14779 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:20.819078 15051 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260812 19:24:20.832062 14988 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:20.832669 14953 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:20.832890 15050 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.184s	user 0.000s	sys 0.002s
I20260812 19:24:20.834812 14745 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:20.835413 14904 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:20.836349 15081 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.067s	user 0.003s	sys 0.000s
W20260812 19:24:20.836686 14765 consensus_meta.cc:287] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.720s	user 0.009s	sys 0.004s
I20260812 19:24:20.837113 14765 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.837564 14829 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:20.838110 14829 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:20.838869  6352 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 12. Ops: []
I20260812 19:24:20.840253 14779 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:20.840397 14936 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:20.820137 14898 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:20.813223 15000 raft_consensus.cc:3032] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:20.842844 15000 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:20.843811 15000 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:20.764575 14845 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.848057 15053 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:20.869400  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 289609us
W20260812 19:24:20.873593  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 9444dc5105264169a510f4261e7a1f40, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:20.874096  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 9444dc5105264169a510f4261e7a1f40, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.879729  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:20.881002  6349 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260812 19:24:20.879729  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:20.890519  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:24:20.891067  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:20.842535 14898 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:20.848788 14829 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:20.883744 14978 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.009s	sys 0.006s
W20260812 19:24:20.905267  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 135040us
W20260812 19:24:20.904058 14978 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.010s	sys 0.006s
I20260812 19:24:20.935527  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:20.936404  6236 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:20.937100 14845 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:20.936453 14747 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.937827 14747 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.940264 14747 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:20.932811 15053 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.955174 15053 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:20.956055 14898 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:20.956723 14898 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:20.933615  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:20.961872  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:20.962285  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:20.963129  6236 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:20.905894 14904 consensus_queue.cc:1046] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260812 19:24:20.968500  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:20.977253  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:20.977604  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:20.978394  6241 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:24:20.981225  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:20.935482 14765 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:20.957300 15053 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:20.989181  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:20.957260 14898 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:20.981897 15003 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260812 19:24:21.109660 14898 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:21.110340 15085 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
I20260812 19:24:20.973187 14671 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.131s
I20260812 19:24:20.991066  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:21.035542  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 49513.6us
I20260812 19:24:21.112675  6483 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
W20260812 19:24:21.115403 15098 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260812 19:24:21.115742 14622 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:21.120324  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:21.122187  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:21.123059  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.123667 14622 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:21.124413  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:20.983026 14936 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:20.932894 15035 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260812 19:24:21.103293  6236 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:24:21.005822 15060 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:20.988758 14978 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:21.125331  6477 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:21.126240  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:21.151881  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 162837us
I20260812 19:24:21.152980 14960 raft_consensus.cc:3032] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:21.153821 14904 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:21.157548  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 51847.4us
I20260812 19:24:21.168869  6349 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: []
W20260812 19:24:21.173692  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 50675.6us
I20260812 19:24:21.174530  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.179162  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.180060  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.203222  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.209576  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.209896  6474 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:21.211303  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.210233  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:21.221114 15073 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.347s	user 0.003s	sys 0.007s
I20260812 19:24:21.220997 14904 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:21.223374 15091 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260812 19:24:21.224879 14904 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:21.208598  6465 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:21.225885  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.226374  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:21.227150  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.227160  6465 raft_consensus.cc:2362] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12. Re-sending same reply.
I20260812 19:24:21.227818  6483 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:21.228507  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.228765  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.229947  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:21.230048  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.231276  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.231571  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:21.231251  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.232192  6474 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:21.232826  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:21.204711 15060 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:21.234836 14985 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:24:21.235328 15060 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:21.236505 15080 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.247s	user 0.004s	sys 0.007s
I20260812 19:24:21.232868  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.219151 14936 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:21.238082 14936 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:21.238441 14936 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:21.243021 15053 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:21.243534  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:21.244390 15053 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:21.247702  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:21.248586 15014 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 19:24:21.252192  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:21.253021 15014 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:21.254474  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:21.255303 15014 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:21.256688  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:21.258400 15029 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:21.258858 15029 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:21.259318 15029 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:21.151471 14691 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.113s
I20260812 19:24:21.268615  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.269392  6482 raft_consensus.cc:2354] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12.
W20260812 19:24:21.270392  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47189.4us
I20260812 19:24:21.272918  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:24:21.273155  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 49876us
I20260812 19:24:21.208281 14978 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:21.274103  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:21.275143  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:21.271091 15029 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:21.282466  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:21.283432  6235 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:24:21.286391 14955 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 19:24:21.291018  6474 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 10.
I20260812 19:24:21.292811 14898 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:24:21.293622 14898 consensus_queue.cc:1225] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:24:21.293979 14978 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:21.294207 14898 raft_consensus.cc:3032] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:21.294587 14898 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:21.295477 14898 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:21.211052 14960 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:24:21.292325 15109 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260812 19:24:21.308732  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:21.310067  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:21.312175  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:21.313748  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:21.314458  6236 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:21.316128 14622 raft_consensus.cc:686] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:21.316646  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:21.317288  6236 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:21.317173 14622 consensus_queue.cc:237] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:21.319489 15119 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:24:21.319625  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:21.320434  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:21.321645 15119 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:21.319613 14745 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:21.322340 14955 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:21.322830 15004 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:21.322280  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:21.322531 14745 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:21.324011 15004 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:21.320475  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:21.325227 14745 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:21.325291  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:21.326089  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:21.326988 14953 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:21.327361 14953 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:21.327692 14953 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:21.328272  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:21.329290 14982 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:21.329725 14982 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:21.330040 14982 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:21.331452 14985 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:21.332096 14985 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:21.333277  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:21.332988 14985 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:21.334374 15008 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:21.334808 15008 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:21.335193 15008 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:21.335016 14955 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 19:24:21.337893  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:21.340418  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:21.340842  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:21.299628 15095 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260812 19:24:21.342097  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:21.342551  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:21.343204  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:21.369141  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:21.370277  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:21.371274  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:21.371423  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:21.344799  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:21.338537 14898 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:21.352809 14981 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:21.375130 14981 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:21.376014 14981 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:21.377506 14981 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:21.351123  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:21.379498  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:21.379930 13611 raft_consensus.cc:979] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower 54f83319db6b49929cc8f18a66a66975 to start an election
I20260812 19:24:21.352699 14802 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:21.352407  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:21.349540 14815 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:21.360539  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:21.381233  6349 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 13: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:21.362129  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:21.299530 14960 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:21.388178 14960 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:21.298621 15113 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:21.365116  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:21.393656  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 55842.8us
I20260812 19:24:21.305727 15027 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:21.395967  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.396826  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:21.372650  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:21.398499  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:21.373219 14904 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:21.370867 15004 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:21.402889  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.403550  6474 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:21.401175  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:21.404440  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:21.406170  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:21.406443  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:21.406955  6236 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:21.407202  6474 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:21.406443  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:21.394733  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:21.395117  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:21.400332  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:21.412839  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:21.413990  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:21.414086  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:21.365753 15029 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:21.411484  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.426311  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:21.433631  6232 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260812 19:24:21.435423  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:21.368495 14999 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:21.440227  6465 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:21.446894  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:21.425179  6474 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:21.436146  6242 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
W20260812 19:24:21.445477  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 48789.6us
I20260812 19:24:21.450165  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:21.460886  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:21.463783  6344 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260812 19:24:21.401535 14519 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:21.402321 14955 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:21.472748  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:21.423044 15053 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:21.366734 14982 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:21.482128  6178 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:21.436834 15072 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260812 19:24:21.396039 14978 consensus_queue.cc:1159] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdfa5579d4534c618c00db6b4a841c81" responder_term: 13 status { last_received { term: 12 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:24:21.446288 14969 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:21.447825 15029 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:21.495152  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.467599 14904 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:21.467149 14835 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:21.454913 15113 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:21.487394 14815 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:21.495213  6236 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:21.504750  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:21.509621  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:21.510303 14982 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:21.510535  7598 raft_consensus.cc:2354] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12.
I20260812 19:24:21.511927  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:21.512660  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:21.512004 14955 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:24:21.478991 14519 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:21.516312  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:21.519901  6483 raft_consensus.cc:2379] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:21.505898 15072 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:21.502458  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:21.486115 14993 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:21.525029 15029 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:21.528267  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:21.518905  6417 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:21.513069  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:21.511474 14904 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:21.527701  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:21.529094 15053 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:21.537919 15072 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:21.546790 14885 raft_consensus.cc:1067] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Signalling peer 54f83319db6b49929cc8f18a66a66975 to start an election
I20260812 19:24:21.546285 14936 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:21.537041 14845 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:21.573812  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47948.8us
I20260812 19:24:21.578238  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:21.583657  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 55463.6us
I20260812 19:24:21.589262  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:21.590644  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:21.592384  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:21.594046  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:21.570294  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 67955.2us
I20260812 19:24:21.537467 14519 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:21.538561 14993 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:21.601703 14993 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:21.581789 14511 consensus_queue.cc:1046] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260812 19:24:21.604039  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:21.606503  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:21.575139 14904 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:21.529982 14815 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:21.603858 15081 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260812 19:24:21.625072  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:21.627739  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 108955us
I20260812 19:24:21.587042 14671 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:21.630394 15141 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:21.642117  6465 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260812 19:24:21.612411 14894 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:21.634747 15148 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:21.635170  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:21.634755  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:21.636025  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:21.647254  6482 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:21.647411  6229 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 12
I20260812 19:24:21.636319 15027 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:21.650125 15027 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:21.650748 15129 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260812 19:24:21.651481 14815 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:21.652223 14815 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:21.652585 14815 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:21.652757 15084 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:21.653264 15084 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:21.653666 15084 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:21.653879 14995 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:21.655053 14953 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:21.657508 14953 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:21.603688 13616 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:21.658349 13616 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:21.658741 15047 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:21.659895 14936 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:21.660046 15006 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:21.617805 15029 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:21.608214 14845 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:21.658806 13616 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:21.628268 15144 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:21.582875 15053 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:21.642107 15141 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:21.686331  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 51675.4us
I20260812 19:24:21.692564  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:21.653047 14815 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:21.708112 14894 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:24:21.712733  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 86230.6us
I20260812 19:24:21.713964  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:21.694933  6178 leader_election.cc:398] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12.
W20260812 19:24:21.687384  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 80972us
I20260812 19:24:21.720503  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:21.722118  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:21.700881  6229 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:24:21.690301 15141 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:21.686053 15148 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:21.723636  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:21.727497  6482 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:24:21.693550 14969 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:21.737743  6342 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:35822
I20260812 19:24:21.738431  6342 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:21.738890  6342 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
W20260812 19:24:21.742565  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 139032us
I20260812 19:24:21.726028  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:21.736029  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:21.744436  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:21.745409  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:21.748018  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:21.751009  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:21.752182 14889 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:21.752722 14889 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:21.753715 14889 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:21.727799 15144 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:21.766831  6229 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:21.728993 15029 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:21.762476  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:21.764736  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:21.773339  6342 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:21.775619  6342 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:21.737495 15060 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:21.781313  6350 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:21.748689 15148 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:24:21.757138 14894 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:24:21.768857 14885 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:21.786161  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:21.756983 15139 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:21.623147 15113 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:21.800217 15060 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:21.805886  6342 raft_consensus.cc:3032] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:21.806403  6342 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:21.806846  7607 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:21.807418  6342 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:21.810701  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:21.811632  7607 raft_consensus.cc:3032] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:21.812016  7607 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:21.813601  7607 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:21.783720 15144 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:21.782596 14802 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:21.837957  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:21.846899  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 82720.4us
I20260812 19:24:21.857214  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:21.858065  6347 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:21.857954  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:21.863284  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:21.864055  6470 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:21.875821 15053 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:21.876140 15055 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:21.876647 15055 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:21.877022 15055 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:21.871519 14622 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260812 19:24:21.849234 14511 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:21.884193  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:21.884974  6482 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:21.882956 14511 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:21.892002 15132 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:21.891839  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:21.893374 14511 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:21.848839 14894 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:21.894595 14894 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:21.888688 15053 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:21.896600 15053 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:21.899257 15053 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:21.900537 15072 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:21.901424 15004 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:21.904361 14927 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:21.836181 14885 raft_consensus.cc:686] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:21.904410  6470 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:21.918177  6416 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:21.924984  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:21.925735  6482 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:21.883342 14802 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:24:21.934514  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 51636.2us
I20260812 19:24:21.882263 14815 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:21.936129  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:21.935339  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:21.950764  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 92914.7us
I20260812 19:24:21.953137  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:21.928823 15072 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:21.928321 15139 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260812 19:24:21.948414 15008 consensus_meta.cc:287] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.000s
I20260812 19:24:21.933027 14898 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:21.911249 14519 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:21.980450  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45193.5us
I20260812 19:24:21.933565 15029 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260812 19:24:22.020658 13616 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:22.021849 15088 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:22.022037 15084 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:22.024078  7594 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:21.974783 14845 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.026049  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:22.034376  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 56631.6us
W20260812 19:24:22.029362 14981 consensus_meta.cc:287] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.651s	user 0.015s	sys 0.000s
W20260812 19:24:22.049224  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 113563us
I20260812 19:24:21.999152 15008 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.025995 14898 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:21.953986 15144 consensus_queue.cc:1046] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260812 19:24:22.055140  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:22.056316  6353 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260812 19:24:22.077400  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:22.057184  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:22.057514 15184 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:24:22.059165  7591 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:22.061592 14835 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:22.082335 14835 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:22.084141  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:22.043823 15004 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:22.063447 13616 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:22.085052 15004 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.067642 14519 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:22.008155 14885 consensus_queue.cc:237] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:22.022536 15088 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.088819  6241 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:22.084187  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:22.092468  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:22.092087 15185 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:22.094383 15139 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260812 19:24:22.103034 14995 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:22.111629 15008 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.111878 15184 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:22.112339 15184 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:22.112643 15000 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:22.117856  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:22.078989 14815 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:22.088826 15053 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:22.147166  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:22.152355  6344 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:22.147251  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:22.147593  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 57542.1us
I20260812 19:24:22.151805  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:22.157302  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:22.105480 14981 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:22.167439  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:22.113269 15184 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.169531 15184 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:22.169889  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:22.170907 15190 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:22.171590 15190 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.173988 15190 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.176009 15004 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.176344  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:22.153309 15055 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:22.177244 14993 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260812 19:24:22.177718  6349 raft_consensus.cc:2354] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15.
I20260812 19:24:22.178678 15055 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.181255  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:22.080834 14898 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.193192  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:22.194420  6228 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:22.205451  6483 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:24:22.207253  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 53597.7us
I20260812 19:24:22.146289 14955 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:22.160233 14815 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:22.105291 14802 consensus_queue.cc:1046] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260812 19:24:22.219267  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:22.192283 15004 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260812 19:24:22.223116 14999 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.754s	user 0.012s	sys 0.000s
I20260812 19:24:22.245086  6228 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:22.247859  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:22.177655 14993 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.252403  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:22.253353  6228 raft_consensus.cc:2396] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260812 19:24:22.231559 15141 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:22.262727 14960 consensus_meta.cc:287] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.874s	user 0.014s	sys 0.001s
I20260812 19:24:22.262991 15067 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260812 19:24:22.265120 15067 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:22.265480 15067 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:24:22.267241 15173 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260812 19:24:22.267925 15084 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.269732  6236 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:22.271692 14898 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:22.249313 14999 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:22.272871  6235 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:22.272966  6236 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260812 19:24:22.277056 14993 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.257579 15153 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:22.259688 15088 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.279922  6236 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:22.281939  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:22.218382 14955 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.267192 15141 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:22.257066  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:22.280041 14904 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.643s	user 0.007s	sys 0.004s
I20260812 19:24:22.283491  6179 leader_election.cc:398] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12.
I20260812 19:24:22.288610  6483 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:22.288702  6179 leader_election.cc:401] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:24:22.291379  6224 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:22.292279 14904 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.294739 14955 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.295054  6230 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:22.296689  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2258) took 2044 ms. Trace:
I20260812 19:24:22.297015  6352 rpcz_store.cc:276] 0812 19:24:20.252644 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:20.264742 (+ 12098us) service_pool.cc:227] Handling call
0812 19:24:20.265069 (+   327us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:20.839268 (+574199us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:22.296458 (+1457190us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b540009f6d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:22.296610 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1319152384}
I20260812 19:24:22.301119  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:22.303392  6483 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:22.305953  6228 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260812 19:24:22.306195  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 64533.5us
I20260812 19:24:22.307567  6352 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:22.311724  7598 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:22.313802  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:22.317050  7598 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260812 19:24:22.294551 14904 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.274353 14835 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.305500 14999 raft_consensus.cc:465] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Not starting pre-election -- already a leader
I20260812 19:24:22.313139 14955 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12.
I20260812 19:24:22.347334  6353 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:22.348654 14835 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.348549 15053 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:22.349382 15047 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:22.350073 15047 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:22.350121  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:22.351214 14829 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:22.351737 14829 raft_consensus.cc:686] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:22.324080  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:22.352752 14829 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:22.353665  6178 leader_election.cc:398] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15.
I20260812 19:24:22.353991  6178 leader_election.cc:401] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:24:22.326593  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:22.346395 15000 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:22.355266 15000 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.355582  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:22.331534  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:22.355379 14999 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:22.357059 14889 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:22.357450 15000 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:22.357648 14889 raft_consensus.cc:686] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:22.358052 14999 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 15
I20260812 19:24:22.335035  6342 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:22.324002  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:22.337937 15166 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260812 19:24:22.367779 15027 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:22.362385 15162 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260812 19:24:22.368402 15027 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.343386 15084 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:24:22.350044 15053 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:22.358588 14889 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:22.344435 14815 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:22.348330  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 100631us
I20260812 19:24:22.266279 15067 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:22.372994  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:22.360447  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:38134 (request call id 570) took 1467 ms. Trace:
I20260812 19:24:22.378762  6483 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:22.374866  6359 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:22.378924  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:22.387293  6235 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:22.355530 15037 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:22.387259  6464 rpcz_store.cc:276] 0812 19:24:20.893507 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:20.893642 (+   135us) service_pool.cc:227] Handling call
0812 19:24:22.359975 (+1466333us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54000735d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fdaf0 00007f98f7780f2a 00007f98fc6bdc6e 00007f98f5dc0807 00007f98f5dc0792 00007f98f5dc06c1 00007f98f5dc063c 00007f98f5dbf8f2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:22.360354 (+   379us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":543218048}
I20260812 19:24:22.394584  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:22.392372  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:22.378870  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:22.396461  6242 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:22.405138  6236 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260812 19:24:22.412261  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:22.413614  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:22.416600  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:22.419018  6342 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260812 19:24:22.419534  6342 pending_rounds.cc:76] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 13
I20260812 19:24:22.419929  6342 pending_rounds.cc:97] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260812 19:24:22.420270  6342 raft_consensus.cc:2866] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:22.388765 15035 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:22.428345  6464 raft_consensus.cc:3032] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:22.428772  6464 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:22.427208  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:22.431056  6464 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.432204  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:22.414294 15037 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:22.437677  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:22.405529 14904 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260812 19:24:22.438443  6230 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:22.442621 15124 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:22.443753 14587 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:22.444258 14587 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:22.444485 15124 raft_consensus.cc:3032] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:22.445111 15124 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:22.446782  6464 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:22.448472 15037 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:22.430027 15035 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.451225 15053 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.403092 14815 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.457808  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:22.444690 14587 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:22.446266 15027 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:22.466940  6228 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:22.469327  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:22.474054  6232 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260812 19:24:22.475905  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:22.429111 15119 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260812 19:24:22.478142  6230 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:22.480952  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:22.483204  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:22.446235 15124 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.485056  6232 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:22.485526 15124 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:22.487277 14836 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:22.487751 14836 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:22.487888  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:22.488173 14836 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:22.497589 14836 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.500473 14836 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.500605 14834 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:22.502737 14834 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:22.503242 14834 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:22.508287 14999 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15.
I20260812 19:24:22.517266 14715 raft_consensus.cc:3032] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:22.517841 14715 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:22.521327 14715 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:20.327230  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:22.528316  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2284) took 1221 ms. Trace:
I20260812 19:24:22.528549 14815 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:22.528775  6224 rpcz_store.cc:276] 0812 19:24:21.306761 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:21.306948 (+   187us) service_pool.cc:227] Handling call
0812 19:24:22.528087 (+1221139us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b5400120cd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:22.528209 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2137670016}
I20260812 19:24:22.530254  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:22.530923  6475 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:22.530844  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:22.531626  6465 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
W20260812 19:24:22.550055  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 155928us
I20260812 19:24:22.554177 14715 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:22.562129  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:22.563876  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:22.566603  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:22.568200  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:22.568583  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:22.574622  6475 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:22.578999 15194 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:22.575294 15141 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:22.587821 15161 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:22.563730 14815 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260812 19:24:22.596338  6464 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260812 19:24:22.613517 15218 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:24:22.578469 14587 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.622886 14587 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.566352 14765 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260812 19:24:22.633975 15150 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.759s	user 0.000s	sys 0.003s
I20260812 19:24:22.648799  7607 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:22.649271  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2489) took 1220 ms. Trace:
I20260812 19:24:22.616122 15047 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:22.663942  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 86929.8us
I20260812 19:24:22.654313  6477 rpcz_store.cc:276] 0812 19:24:21.429126 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:21.429255 (+   129us) service_pool.cc:227] Handling call
0812 19:24:21.429599 (+   344us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:21.624110 (+194511us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:21.624143 (+    33us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:21.640927 (+ 16784us) log.cc:842] Serialized 52 byte log entry
0812 19:24:21.780527 (+139600us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:21.795367 (+ 14840us) log.cc:842] Serialized 14 byte log entry
0812 19:24:21.828994 (+ 33627us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:21.829070 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:22.367498 (+538428us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b4800110358. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fc61f7f1 00007f98fc6168e7 00007f98fc61677a 00007f98fc70a95f 00007f98fc70a627 00007f98fc71eb2c 00007f98fc71ead8 00007f98fc71ea58 00007f98fc71ea13 00007f98fc71dcbc 00007f98fb69fbe6
0812 19:24:22.642893 (+275395us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b18003d0600. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:24:22.648979 (+  6086us) raft_consensus.cc:1671] finished
0812 19:24:22.649004 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:22.649189 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33313,"prepare.queue_time_us":15285,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":12566,"raft.queue_time_us":58946,"raft.run_cpu_time_us":2739,"raft.run_wall_time_us":540395,"spinlock_wait_cycles":23593728,"thread_start_us":333139,"threads_started":2,"wal-append.queue_time_us":230096}
I20260812 19:24:22.676043 15122 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:22.683418  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:22.677596 14945 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:22.656414 15035 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.699040  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:22.700858  6238 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:22.708449  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:22.704612  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:22.709213  6242 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:22.710799  6354 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:22.711859  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:22.712129  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:22.712860  6230 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:22.716157  6232 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:22.716815 14834 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.719765  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:22.721060 14836 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:22.720875 15158 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260812 19:24:22.721558 14836 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:22.721989 14836 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:22.727982 14834 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.729514 15047 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:22.706518 14815 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:22.712354 15053 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:22.733793 14622 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:22.671280 15141 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260812 19:24:22.703595 15124 consensus_queue.cc:1046] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260812 19:24:22.738363 15124 raft_consensus.cc:3032] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:22.738799 15124 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:22.738906 14836 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.739898 15124 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.741128 14836 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.699265 14945 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:22.744012 14945 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.748881  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:22.751063  7591 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260812 19:24:22.703918 15161 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:22.765123  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:22.766081  6236 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:22.766505  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:22.768432  6241 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
W20260812 19:24:22.750483 15148 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.013s	sys 0.011s
I20260812 19:24:22.772655  6477 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:22.776407  6232 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260812 19:24:22.782143 14927 raft_consensus.cc:3032] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:22.782611 14927 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:22.783474 14927 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.786207  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:22.754393 15141 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:22.800374  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:22.804953  6344 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260812 19:24:22.806330  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:22.774221 15148 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.014s	sys 0.012s
I20260812 19:24:22.802915  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:22.813850  6342 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:22.810869  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:22.818984  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:22.820749  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:22.829656  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:22.835579  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:22.844053  6224 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:22.844128  6477 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:22.845114  6242 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:22.846369  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:22.847441  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:22.852941  6342 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260812 19:24:22.845506 14964 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260812 19:24:22.860033  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:22.789887 14836 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260812 19:24:22.840986  6236 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:22.813520 14927 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:22.812254 15161 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:22.833768 15141 raft_consensus.cc:686] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:22.829200 14978 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:24:22.788621 15035 consensus_queue.cc:1046] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260812 19:24:22.846508  6464 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:22.834982 15004 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:22.844597  6232 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:22.796491 14985 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260812 19:24:22.846033 15190 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:22.866674  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:22.877467  6224 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260812 19:24:22.874624  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:22.879499  6241 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:22.880766  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:22.870680 15161 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:22.884455 15161 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:22.885435 14836 raft_consensus.cc:3032] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:22.875270 15006 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:22.885643  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:22.886842  7591 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:22.886549 15006 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.887828  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:22.888484  6417 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:22.889649  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:22.890854 15037 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:22.891388 15037 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:22.892122 14622 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:22.892711 14622 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:22.893420 14987 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:24:22.893713 14835 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:22.893590 14622 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.894264 14835 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:22.892220 15037 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.874712 15114 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260812 19:24:22.895136 14835 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.879202 15158 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:22.900502  6232 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260812 19:24:22.906970  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:22.906869  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2483) took 1106 ms. Trace:
I20260812 19:24:22.909595  6229 rpcz_store.cc:276] 0812 19:24:21.801667 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:21.802108 (+   441us) service_pool.cc:227] Handling call
0812 19:24:22.906640 (+1104532us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b540035eb54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:22.906808 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":887980288}
I20260812 19:24:22.910957  6230 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260812 19:24:22.915990  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:22.860106 14671 consensus_queue.cc:1046] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260812 19:24:22.885910 14836 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:22.903319 15161 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:22.912509 15158 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:22.874948 15047 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260812 19:24:22.933552  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:22.934305  6347 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:22.938868 15053 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:22.939073 15006 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:22.940618  6475 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:22.940114 15141 consensus_queue.cc:237] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.943415  6470 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:22.944420  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:22.939081  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:22.940167  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:22.940457  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:22.949247  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet ff48be70624f412e9bf485b5e489adf3, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:22.949755  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet ff48be70624f412e9bf485b5e489adf3, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.950328 15118 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:24:22.925382 14815 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:22.932960 15161 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:22.952677 15161 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:22.952019 15118 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:22.953315 15118 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:22.879361 14747 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260812 19:24:22.957245  6347 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:22.950273  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:22.961305  6483 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:22.954207 15118 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.963418  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:22.964238 14951 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:22.964747 14951 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:22.964601 14715 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 19:24:22.965610 14951 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:22.968111  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:22.970177  6481 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260812 19:24:22.992967  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:23.001807  6481 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260812 19:24:23.024827  7607 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:22.967317 15190 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:22.972815 14691 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260812 19:24:23.044015  7607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 625) took 1216 ms (client timeout 1618 ms). Trace:
W20260812 19:24:23.044627  7607 rpcz_store.cc:269] 0812 19:24:21.809922 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:21.810287 (+   365us) service_pool.cc:227] Handling call
0812 19:24:22.646613 (+836326us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b58006266b0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f76f3f63 00007f98f7757aba 00007f98f776f3af 00007f98f7770b4e 00007f98f777c228 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c
0812 19:24:23.025342 (+378729us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1513822976}
I20260812 19:24:22.970733 14931 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:22.976838 14815 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:23.063679  6481 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260812 19:24:23.068360  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 529ed979cd2842acb5bc24debb151b93, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:23.068866  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 529ed979cd2842acb5bc24debb151b93, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.031378 15118 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:22.994158 14671 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:23.076573  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 83451.9us
I20260812 19:24:23.005714 15158 consensus_queue.cc:1046] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260812 19:24:22.991465 15000 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260812 19:24:23.064615 14815 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:23.007143 15027 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260812 19:24:23.057891 14666 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:23.139586 13611 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260812 19:24:23.140439 15240 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260812 19:24:23.064914 14931 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:23.049193 15190 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.006990 14836 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.057606 14318 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260812 19:24:23.195894  6055 catalog_manager.cc:5495] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 10 to 13, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 13 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:23.193094 15158 raft_consensus.cc:3032] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:23.201929 14931 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:23.201648 14666 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:23.080845 14671 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.206696 15246 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:23.249032  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 172393us
I20260812 19:24:23.241122 15158 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:23.261245  7607 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260812 19:24:23.250542 15249 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:23.278867  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:23.254850 14666 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:23.286695  6417 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:23.254505 15246 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:23.303556  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 220764us
I20260812 19:24:23.293643 15141 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:23.277607 15114 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260812 19:24:23.317812  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:23.306548 15006 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:23.306280 14904 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:23.273176 15249 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:23.325829 15250 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260812 19:24:23.328264 14511 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:23.330096  6224 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:23.339620 14671 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:23.340284  6055 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 10 to 11, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 11 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:24:23.352792  6230 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260812 19:24:23.282810 15158 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.369453  7591 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260812 19:24:23.350235 15190 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:23.324251 15193 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260812 19:24:23.359591 15141 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:23.341363 15006 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.408776 15006 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:23.390168 14511 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:23.391494 14747 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260812 19:24:23.397290 15245 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260812 19:24:23.398887 15249 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:23.399956  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 480723us
W20260812 19:24:23.394493 15224 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.719s	user 0.003s	sys 0.000s
I20260812 19:24:23.400952 14666 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:23.401559  6359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2254) took 3162 ms (client timeout 2064 ms). Trace:
I20260812 19:24:23.344437 14904 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.373395 15158 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
W20260812 19:24:23.412009  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 43826us
W20260812 19:24:23.424863  6359 rpcz_store.cc:269] 0812 19:24:20.238952 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:20.248717 (+  9765us) service_pool.cc:227] Handling call
0812 19:24:23.401328 (+3152611us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b540025ec54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:23.401446 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4729543936}
W20260812 19:24:23.411770  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 94035.4us
I20260812 19:24:23.432070  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:23.434993  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:23.442425  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:23.443156  6482 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:23.444411 15188 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:24:23.445381 15188 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:23.445745 15188 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:23.435041 15196 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:23.424461 14798 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:23.411525 15261 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260812 19:24:23.448902 14798 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:23.446982 15253 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260812 19:24:23.448534 14904 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:23.409705 15141 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.451350 15246 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:23.457062  6465 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:23.458179  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:23.460131  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:23.447715 15196 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.481415  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:23.498154  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 56166.3us
W20260812 19:24:23.502151  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 71261.3us
I20260812 19:24:23.504099  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:23.505609  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:23.506389  6470 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:23.509444  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:23.508021  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:23.505489  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:23.510439  6345 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:23.499469  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:23.512701  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:23.516542  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:23.521840  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:23.527132  7594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 623) took 2015 ms. Trace:
I20260812 19:24:23.527559  7594 rpcz_store.cc:276] 0812 19:24:21.507469 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:21.510162 (+  2693us) service_pool.cc:227] Handling call
0812 19:24:21.510471 (+   309us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:22.024657 (+514186us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:23.522277 (+1497620us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54005ae6d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:23.522460 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1180520320}
I20260812 19:24:23.529059  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:23.529089  6242 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260812 19:24:23.450261 14931 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.514804 14904 consensus_queue.cc:1046] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260812 19:24:23.446619 15188 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:23.533949 15188 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:23.534088 14931 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:23.511740 15246 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:23.539233 15246 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:23.521698 14666 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:23.541322 15246 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:23.515614 15006 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:23.542237 15006 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:23.542577 14671 consensus_queue.cc:1159] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "54f83319db6b49929cc8f18a66a66975" responder_term: 11 status { last_received { term: 11 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:24:23.544340 15006 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:23.544898 15006 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260812 19:24:23.544932 15161 consensus_meta.cc:287] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.578s	user 0.016s	sys 0.003s
I20260812 19:24:23.545377 15006 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:23.545840 15006 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:23.545562 15161 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:23.549189  6470 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260812 19:24:23.552433  6477 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260812 19:24:23.553371  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:23.554860  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:23.546540  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:23.562382  6236 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:23.569928 15141 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:23.565717 15161 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:23.588567  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:23.589243  7607 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:23.591219  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:23.595820  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 63477us
I20260812 19:24:23.617518  7607 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:23.586148 13616 consensus_queue.cc:1046] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260812 19:24:23.602065 14798 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:23.620258  6477 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:23.620460 15067 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:23.566213 15256 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
W20260812 19:24:23.631466 15230 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.779s	user 0.003s	sys 0.000s
I20260812 19:24:23.609124 15196 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:23.650372 15233 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.753s	user 0.003s	sys 0.000s
W20260812 19:24:23.699827  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 183149us
I20260812 19:24:23.709721  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:23.714638  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:23.722373  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:23.731206  6224 raft_consensus.cc:2396] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260812 19:24:23.731161  6242 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 12: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:23.748597  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:23.749660  6242 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:23.762967  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:23.764631  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:23.765237  6228 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260812 19:24:23.765759  6228 pending_rounds.cc:76] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 7
I20260812 19:24:23.766057  6228 pending_rounds.cc:97] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260812 19:24:23.769500  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:23.769806  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:23.770619  6347 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:23.776805  6353 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260812 19:24:23.766467  6228 raft_consensus.cc:2866] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:23.799559 15161 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:23.776109  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:23.771482  6352 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:23.771709  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:23.816836 14127 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:24:23.818315 14930 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.002s	sys 0.010s
I20260812 19:24:23.818960 14127 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:23.824795 15297 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260812 19:24:23.826275 15284 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:23.826941 15284 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:23.827497 15284 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:23.829285 15004 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:23.774267  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:23.836032 15161 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:23.838456  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 64574.3us
I20260812 19:24:23.839686 15272 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:23.843756 15188 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:23.844668 15188 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.848747 15188 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:23.818979 14930 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.002s	sys 0.010s
W20260812 19:24:23.849953  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 140319us
I20260812 19:24:23.863209  6417 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:23.871395  6481 raft_consensus.cc:2396] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260812 19:24:23.882930 15196 consensus_queue.cc:1046] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:23.884946  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2093) took 1316 ms. Trace:
I20260812 19:24:23.885526  6474 rpcz_store.cc:276] 0812 19:24:22.568187 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:22.568315 (+   128us) service_pool.cc:227] Handling call
0812 19:24:22.578728 (+ 10413us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:22.664131 (+ 85403us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:22.664180 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:22.664663 (+   483us) log.cc:842] Serialized 26 byte log entry
0812 19:24:23.469245 (+804582us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b18003ea820. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:24:23.834031 (+364786us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:23.835686 (+  1655us) log.cc:842] Serialized 14 byte log entry
0812 19:24:23.836057 (+   371us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:23.836191 (+   134us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:23.884299 (+ 48108us) raft_consensus.cc:1671] finished
0812 19:24:23.884459 (+   160us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:23.884684 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":84926,"prepare.queue_time_us":1247,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":86837,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":3675,"spinlock_wait_cycles":17748224,"thread_start_us":364187,"threads_started":1,"wal-append.queue_time_us":977198}
I20260812 19:24:23.888129 15141 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:23.889148 15141 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.894589 14898 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:23.895170 14898 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:23.896701 14898 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.826283 15158 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260812 19:24:23.898175 14898 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:23.899926 14945 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:23.900998  6477 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:23.903568 14978 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:23.904698 14978 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:23.913278 15039 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:23.913954 15039 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:23.886293 14815 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.918941 15148 raft_consensus.cc:3032] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:23.919551 15148 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:23.920508 15141 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:23.922041 15185 raft_consensus.cc:3032] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:23.922734 15185 raft_consensus.cc:729] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:23.924537 15185 consensus_queue.cc:260] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.926906 14930 raft_consensus.cc:3032] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:23.927377 14930 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:23.928586 14930 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:23.930148 14930 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:23.936074 15148 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.937790 15161 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:23.937878 15229 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.079s	user 0.002s	sys 0.000s
W20260812 19:24:23.939960 15296 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260812 19:24:23.940197 14127 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:23.830272 15004 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.941023  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:23.941491  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 701) took 1469 ms. Trace:
I20260812 19:24:23.941941  6235 rpcz_store.cc:276] 0812 19:24:22.471614 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:22.477944 (+  6330us) service_pool.cc:227] Handling call
0812 19:24:22.478359 (+   415us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:22.478836 (+   477us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:22.478867 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:22.479697 (+   830us) log.cc:842] Serialized 26 byte log entry
0812 19:24:22.683156 (+203459us) raft_consensus.cc:1631] Marking committed up to 13
0812 19:24:22.683214 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:22.683311 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:23.936963 (+1253652us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:23.940929 (+  3966us) raft_consensus.cc:1671] finished
0812 19:24:23.940955 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:23.941260 (+   305us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":137,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3930,"spinlock_wait_cycles":185256320,"thread_start_us":171126,"threads_started":1,"wal-append.queue_time_us":290626}
I20260812 19:24:23.943339  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:23.943712 15172 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:23.944640 15004 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:23.946378  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 83620.8us
I20260812 19:24:23.947446 15132 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:23.948072 15132 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:23.949617 15132 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:23.953454 15143 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260812 19:24:23.926555 15185 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:23.953464  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 808) took 1117 ms. Trace:
W20260812 19:24:23.954577  6238 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2502) took 1539 ms (client timeout 1756 ms). Trace:
I20260812 19:24:23.953600 15055 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:24:23.961889  6238 rpcz_store.cc:269] 0812 19:24:22.415420 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:22.415603 (+   183us) service_pool.cc:227] Handling call
0812 19:24:23.946443 (+1530840us) spinlock_profiling.cc:243] Waited 78.8 ms on lock 0x7b54002fd854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:23.954333 (+  7890us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":181262592}
I20260812 19:24:23.961210  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:23.959195 13611 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:23.963827 15237 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.090s	user 0.000s	sys 0.004s
I20260812 19:24:23.964052  6353 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:23.964414 13611 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:23.955682 15039 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:23.962524 15055 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:23.966478 15161 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:23.967519 15161 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:23.954059 15265 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:23.959195  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:23.960819  6342 rpcz_store.cc:276] 0812 19:24:22.835806 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:22.836005 (+   199us) service_pool.cc:227] Handling call
0812 19:24:22.836326 (+   321us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:22.853534 (+ 17208us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:23.952878 (+1099344us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b5400061154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:23.953230 (+   352us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":37237120}
I20260812 19:24:23.959730 15219 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:23.970053  6345 raft_consensus.cc:2396] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260812 19:24:23.970886 15219 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:23.972316  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:23.973325  7607 raft_consensus.cc:2379] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:23.973676 15219 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:23.974964 13611 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:23.976387 15055 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:23.980652 14978 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:23.984117 14836 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:23.984658 15307 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:23.975653 15161 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:23.987035 15219 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:23.991029 15219 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:23.964771 15006 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:24.002679 15238 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.100s	user 0.002s	sys 0.002s
I20260812 19:24:23.995765  6238 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260812 19:24:23.996500  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2262) took 2641 ms. Trace:
I20260812 19:24:24.021955  6350 rpcz_store.cc:276] 0812 19:24:21.354518 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:21.361361 (+  6843us) service_pool.cc:227] Handling call
0812 19:24:21.361705 (+   344us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:21.782130 (+420425us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:23.995933 (+2213803us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b540036e054. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:23.996292 (+   359us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":964577152}
I20260812 19:24:24.022593  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 805) took 1383 ms. Trace:
I20260812 19:24:24.004483 15006 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:23.986474  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:24.005617  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2528) took 1168 ms. Trace:
I20260812 19:24:24.023453  6241 rpcz_store.cc:276] 0812 19:24:22.836517 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:22.880425 (+ 43908us) service_pool.cc:227] Handling call
0812 19:24:22.880816 (+   391us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:22.884200 (+  3384us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:22.884235 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:22.884280 (+    45us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:22.884316 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:24.004945 (+1120629us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b5400179154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:24.005034 (+    89us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:24.005277 (+   243us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7332736}
I20260812 19:24:24.023012  6349 rpcz_store.cc:276] 0812 19:24:22.639024 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:22.643794 (+  4770us) service_pool.cc:227] Handling call
0812 19:24:22.644188 (+   394us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:22.644600 (+   412us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:22.644628 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:22.645064 (+   436us) log.cc:842] Serialized 26 byte log entry
0812 19:24:22.821601 (+176537us) raft_consensus.cc:1631] Marking committed up to 13
0812 19:24:22.821662 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:22.821994 (+   332us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:24.001546 (+1179552us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:24.022111 (+ 20565us) raft_consensus.cc:1671] finished
0812 19:24:24.022134 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:24.022390 (+   256us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":693,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":91,"spinlock_wait_cycles":95006848,"thread_start_us":176158,"threads_started":1,"wal-append.queue_time_us":257143}
I20260812 19:24:24.027417 15006 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:24.028203  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2286) took 1637 ms. Trace:
I20260812 19:24:24.028710  6352 rpcz_store.cc:276] 0812 19:24:22.391071 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:22.391210 (+   139us) service_pool.cc:227] Handling call
0812 19:24:23.401948 (+1010738us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:23.816124 (+414176us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:24.027187 (+211063us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b540025ec54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:24.027961 (+   774us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540025ec50. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:24.028119 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3171748992}
I20260812 19:24:24.041329 15047 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:24.041855 15047 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:24.012701 15265 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.043586 15265 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.016981 15288 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:24.045560 15288 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:23.987054 15295 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.330s	user 0.000s	sys 0.002s
W20260812 19:24:24.048372 15232 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.180s	user 0.000s	sys 0.003s
I20260812 19:24:24.043263 15047 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.052806 15047 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:24.056620 14815 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:24.059516 15307 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.062390 15307 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.063673  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2505) took 1678 ms. Trace:
I20260812 19:24:24.064107  6473 rpcz_store.cc:276] 0812 19:24:22.384782 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:22.384992 (+   210us) service_pool.cc:227] Handling call
0812 19:24:22.413793 (+ 28801us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:22.454490 (+ 40697us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:22.454533 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:22.454573 (+    40us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:22.454608 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:24.063150 (+1608542us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b54001310d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:24.063216 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:24.063437 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":93114752}
I20260812 19:24:24.064689 15261 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:24.065637 15261 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.070336 15039 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:24.083460 15043 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.084304 15043 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:24.005438  6055 catalog_manager.cc:5495] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260812 19:24:24.116024  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 129752us
I20260812 19:24:24.116247 15288 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:24.118072  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.117496  6055 catalog_manager.cc:5495] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:24.121428  6055 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 9 to 10, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 10 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:24.124365  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.125111  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.125733  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.125914  6350 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:24.127097 15307 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.123929  6055 catalog_manager.cc:5495] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:24.094790 15219 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:24.102589 15148 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:24.134936  6347 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:24.139180  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:24.141521  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:24.141441 15161 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:24:24.142975 15143 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:24.143447 15143 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:24.143805 15143 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:24.159037 15043 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:24.159196  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:24.159379  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:24.159927  6477 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:24.156140  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:24.168269 14845 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.173487 15288 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.174149 15288 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.175858 15177 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:24.176335 15288 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.176906 15185 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:24.176543 14845 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.177390  6349 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260812 19:24:24.177562 15185 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:24.186582  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.187558  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.188902  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:24.191443  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:24.198398  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:24.183684 15261 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:24.201601 14978 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.212235  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:24.212332 14978 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.214798  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:24.215616  6475 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 8.
I20260812 19:24:24.223380  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:24.224107  6230 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:24:24.208273 15265 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:24.229576 15190 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.234872 15190 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:24.237602 15190 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:24.238198 15190 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.230522  6055 catalog_manager.cc:5495] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:24.238857  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:24.176616 15177 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.246455 15177 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:24.247479  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.248172  6350 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:24.249327  6344 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:24.251535  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2296) took 1294 ms. Trace:
I20260812 19:24:24.251884  6344 rpcz_store.cc:276] 0812 19:24:22.956845 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:22.956987 (+   142us) service_pool.cc:227] Handling call
0812 19:24:22.957280 (+   293us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:24.249705 (+1292425us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:24.251237 (+  1532us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540009ddd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:24.251473 (+   236us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2969771648}
I20260812 19:24:24.241925  7607 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
W20260812 19:24:24.254873  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 400845us
I20260812 19:24:24.214586 14978 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.255510  6179 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:24.256372 15124 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:24.257123 14845 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.257915 14978 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:24.258556 14978 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.259055 14978 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:24.262753  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:24.223847 15284 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.265046  6235 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:24.265513 15284 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.275957  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:24.278384  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:24.279913  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:24.281452 15307 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:24.281870 15307 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:24.254951 15067 consensus_meta.cc:287] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.014s
I20260812 19:24:24.282259 15307 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:24.282689 13611 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.283278 13611 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:24.286813  6238 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:24.287621 13611 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:24.287132  6055 catalog_manager.cc:5495] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:24.288488  7607 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:24.291206  6179 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:24.242295 15190 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.292918 15288 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:24.293133  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:24.293804 15288 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:24.294305  6238 raft_consensus.cc:2396] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260812 19:24:24.294263 15288 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:24.255607 15185 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:24.301947  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:24.308723  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 129395us
I20260812 19:24:24.310686  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:24.315291 14845 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.315697  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.315886 14845 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.316385  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.316628  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.317454  6349 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 13: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:24.289677  6055 catalog_manager.cc:5495] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 6 to 9, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 9 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:24.322345 15219 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:24:24.323390  7607 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260812 19:24:24.324126  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:24.324781  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:24.326433  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.327819  7591 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260812 19:24:24.328629 14845 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.318778 15288 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:24.335099  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:24.334758  6477 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:24.366622 15004 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:24.367324 15004 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.369514 15004 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.369750  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:24.360131  6352 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:24.372105  6354 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:24.286535 15148 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:24.382390  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.383324  6345 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:24:24.383890  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:24.384862  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.385286 15190 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.385468 15148 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.346479  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.386063 15148 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.387760  6235 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:24:24.388157 15148 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.389436 15143 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.391181 14889 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.397432  6344 raft_consensus.cc:2396] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260812 19:24:24.364457  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:24.400933  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.407485  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:24.348409 15284 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:24.397096  6055 catalog_manager.cc:5495] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 12 to 15, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 15 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:24.417934  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.411314  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.416260  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:24.406284  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 43682.3us
I20260812 19:24:24.425413  6349 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:24.437227  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:24.442472  6354 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:24.448268  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:24.434541  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:24.451968 15272 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:24.468405 15265 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:24.469043 15265 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.469508 15265 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:24.470994 15161 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:24.471647 15161 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:24.472015 15161 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:24.416620 14889 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.476117 14889 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.470890 15272 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.479054 15272 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.479260 15307 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.481202 15272 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:24.481123 15177 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.481714 15158 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.482043 15177 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.482357 15158 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.484123 15177 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:24.484341 15158 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:24.486495 15161 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.488629 15161 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:24.489434  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:24.495223 15288 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:24.496141 15288 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.498193  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:24.439769  6055 catalog_manager.cc:5495] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:24.426687 15284 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:24:24.505857  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.015s	sys 0.027s
W20260812 19:24:24.514613  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.016s	sys 0.027s
W20260812 19:24:24.521648  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 94597.1us
I20260812 19:24:24.522874  6178 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:24.527539  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:24.515105  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 736168us
I20260812 19:24:24.540475  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:24.444814 15188 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.539110  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:24.550169  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.560828 14981 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:24:24.561462 14981 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:24.561861  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:24.568588  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:24.569813 15190 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:24.545822 14898 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:24.516825 15284 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:24.439028 15132 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.531309 14889 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.579526  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:24.581207  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:24:24.583541  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44506.3us
I20260812 19:24:24.524869 15148 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:24.573764  6345 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:24.586483  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:24.603928  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.511847 15261 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260812 19:24:24.525254 15185 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.506292 15288 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:24.612955  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 47139.3us
I20260812 19:24:24.561905 14981 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:24.621850 14930 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:24.631582  6359 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:24.631691 14930 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:24.594460 15006 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:24.633904  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.632189 14930 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:24.542011 14978 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:24.638736 15006 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:24.660697  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 43514.5us
I20260812 19:24:24.643188  7591 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:24.581897 15265 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.573293 15188 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.628515 15148 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:24.689216  6179 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:24.648558 14898 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:24.714378  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2297) took 1222 ms. Trace:
I20260812 19:24:24.714804 14845 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.714884  6359 rpcz_store.cc:276] 0812 19:24:23.492306 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:23.492767 (+   461us) service_pool.cc:227] Handling call
0812 19:24:23.493155 (+   388us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:24.632138 (+1138983us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:24.714090 (+ 81952us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002d05d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:24.714308 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2597944576}
I20260812 19:24:24.715631 14845 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.716614  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:24.717994 14845 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.718712 14997 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:24.719204 14927 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:24.723935 14978 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:24.724709  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 143621us
I20260812 19:24:24.725531  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:24.726387 15261 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:24.727291  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:24.728392 15039 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:24.729044 15039 raft_consensus.cc:686] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:24.730990 15004 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:24.730336 15039 consensus_queue.cc:237] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.731535 15004 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:24.611193 14889 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.732788 15004 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:24.638110 15132 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.734915 14889 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.629241 15185 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.736723 15132 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:24.737147 15185 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.692881 15148 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:24.741959 15148 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:24.738808 15181 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:24.740391 14898 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.743880  6238 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 17: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:24.673251 15006 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:24.675115 15219 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:24.691504 15307 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.760527  6344 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:24.719250 15317 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:24.747182 15143 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:24.776005  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:24.779595  6350 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 13: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:24.779441  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.764995 14898 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:24.768811 15132 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.794960  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.791554  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:24.804000  6344 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260812 19:24:24.810469  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:24.805907 15047 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.753s	user 0.019s	sys 0.003s
I20260812 19:24:24.794481 15261 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.847560  6470 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:24.813488 15272 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.813689 15161 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.808992 15132 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.842675 15284 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.839483 15158 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.884655  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:24.889604  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:24.880131 15288 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.893615  6475 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:24.893622  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:24.894464  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:24.899793  6473 raft_consensus.cc:2354] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 15. Current term is 16.
I20260812 19:24:24.871964 15177 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.848249 15047 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:24.908980 14745 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.086s	sys 0.176s
I20260812 19:24:24.926770  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.870208 15261 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.874583 15272 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.906487 15141 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:24.931963  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:24.947657  6465 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
W20260812 19:24:24.932438  6058 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38512 (request call id 232) took 30907 ms (client timeout 15000 ms). Trace:
I20260812 19:24:24.932792  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:24.933774 15332 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260812 19:24:24.944525 15261 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:24.950675  6464 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
W20260812 19:24:24.925056 14745 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.086s	sys 0.177s
I20260812 19:24:24.951458  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:24.921159 15265 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:24.924944 15307 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.910230 15161 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.912040 15177 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.956296 15188 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.985272  6473 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260812 19:24:24.985776  6473 pending_rounds.cc:76] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 7
I20260812 19:24:24.986027  6473 pending_rounds.cc:97] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260812 19:24:24.986266  6473 raft_consensus.cc:2866] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:24.986548 15272 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:24.987073 15284 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.978137 15307 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.988168  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:24.989148  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:24.989419 15307 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:24.989814  6344 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:24.990245  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:24.988250  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:24.991760  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:24.992085  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:24.992403  6465 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:24.993752  6470 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260812 19:24:24.994089  6470 pending_rounds.cc:76] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 6
I20260812 19:24:24.994324  6470 pending_rounds.cc:97] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260812 19:24:24.994551  6470 raft_consensus.cc:2866] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:24.987438  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:24.997449  6344 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:24.953118 14836 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.998530  6344 raft_consensus.cc:595] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:24.999250  6344 raft_consensus.cc:603] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:24.999065 14836 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:24.996125  6473 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:25.000397  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:25.010838 15272 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:24.928110 15158 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.011938  6342 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:24.929944 15047 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.001468 15124 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:24.956434 14815 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260812 19:24:25.011580 15272 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:24.958987 15141 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.026742  6475 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:25.021938  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:25.027453  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:25.032773  6354 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:25.034413  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:25.030699 14930 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.040489  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:25.041730 15265 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:25.042265 15265 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:25.042711 15265 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:25.048095  6473 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: [14.7-15.8]
I20260812 19:24:25.049687  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:25.031575 15272 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:25.027796 15219 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:25.082504  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:25.064718 15261 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:25.090198  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "545108632fab48129db7f032619a1e55"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:25.115569  6347 raft_consensus.cc:595] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:25.093600  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:25.117628  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:25.072188 15132 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.080286 15219 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:25.096285 14945 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:25.094271 14889 consensus_queue.cc:1046] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260812 19:24:25.103008 14836 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:25.102305 15265 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.028416 15124 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.076853 15141 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.120915  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:24:25.134588  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.005s	sys 0.024s
W20260812 19:24:25.122622  6352 consensus_meta.cc:287] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.003s
W20260812 19:24:25.135061  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.005s	sys 0.024s
I20260812 19:24:25.135313  6352 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
W20260812 19:24:25.135423  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 519125us
I20260812 19:24:25.123289 14898 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.075971 15143 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:25.132398  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 492545us
I20260812 19:24:25.115375 15261 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:25.143457  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:25.126995 15181 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:25.128783 15132 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:25.144629  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:25.152858  6481 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:25.159008  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:25.159317  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 470202us
I20260812 19:24:25.164265  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:24:24.948376  6058 rpcz_store.cc:269] 0812 19:23:53.902095 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:23:53.902588 (+   493us) service_pool.cc:227] Handling call
0812 19:24:24.802791 (+30900203us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:24:15.462381 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:24:15.463164 (+   783us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:24:15.463220 (+    56us) write_op.cc:435] Acquired schema lock
0812 19:24:15.463239 (+    19us) tablet.cc:660] Decoding operations
0812 19:24:15.464633 (+  1394us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:24:15.464804 (+   171us) write_op.cc:641] Partition lock acquired for write op
0812 19:24:15.464850 (+    46us) tablet.cc:683] Acquiring locks for 13 operations
0812 19:24:15.466136 (+  1286us) tablet.cc:699] Row locks acquired
0812 19:24:15.466176 (+    40us) write_op.cc:260] PREPARE: finished
0812 19:24:15.466381 (+   205us) write_op.cc:270] Start()
0812 19:24:15.466525 (+   144us) write_op.cc:276] Timestamp: P: 1786562655466309 usec, L: 0
0812 19:24:15.466564 (+    39us) op_driver.cc:331] REPLICATION: starting
0812 19:24:15.520633 (+ 54069us) log.cc:842] Serialized 5106 byte log entry
0812 19:24:15.813247 (+292614us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b18000769c0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:24:16.679674 (+866427us) op_driver.cc:444] REPLICATION: finished
0812 19:24:17.454166 (+774492us) write_op.cc:301] APPLY: starting
0812 19:24:17.566141 (+111975us) tablet.cc:1365] starting BulkCheckPresence
0812 19:24:18.105347 (+539206us) tablet.cc:1368] finished BulkCheckPresence
0812 19:24:18.105406 (+    59us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:24:19.201041 (+1095635us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:24:19.201374 (+   333us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0812 19:24:19.201436 (+    62us) write_op.cc:312] APPLY: finished
0812 19:24:19.201855 (+   419us) log.cc:842] Serialized 121 byte log entry
0812 19:24:19.361581 (+159726us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:24:19.412005 (+ 50424us) write_op.cc:454] Released schema lock
0812 19:24:19.451995 (+ 39990us) write_op.cc:341] FINISH: Updating metrics
0812 19:24:19.587073 (+135078us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:24:19.590998 (+  3925us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":130679,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":700785,"apply.run_cpu_time_us":49252,"apply.run_wall_time_us":2191712,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58545,"num_ops":13,"prepare.queue_time_us":124922,"prepare.run_cpu_time_us":8544,"prepare.run_wall_time_us":120877,"raft.queue_time_us":235679,"raft.run_cpu_time_us":21746,"raft.run_wall_time_us":530981,"replication_time_us":1207055,"spinlock_wait_cycles":24428160,"thread_start_us":652891,"threads_started":5,"wal-append.queue_time_us":276820,"wal-append.run_cpu_time_us":89273,"wal-append.run_wall_time_us":2859716}]]}
I20260812 19:24:25.172384  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:25.147938 15261 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:25.179369  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:24:25.165038  6175 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.014s	sys 0.016s
I20260812 19:24:25.183840  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:25.184211  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:25.153586 15284 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:25.190032 15047 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.163203 15067 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:25.190703  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:25.191979  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:25.192621  6354 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:25.189834  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:25.164392 15143 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.194164 15158 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.195380 15143 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.157244 15141 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:25.195887 14951 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:25.196316 14951 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:25.196820 14951 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:25.198385 15161 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.198969 14318 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:25.190625 15047 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:25.173449 15132 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:25.164739 14815 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:25.196285 15141 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.189821 14622 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:24:25.188151  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:25.184443  6175 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.014s	sys 0.016s
I20260812 19:24:25.211583 15141 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:25.239799  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60543us
I20260812 19:24:25.240787  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:25.246847 15177 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.228355  6347 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:25.206514 15265 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.209100 15132 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:25.248142 14898 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.270224  6178 leader_election.cc:398] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 15. Current term is 16.
I20260812 19:24:25.202601 15124 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:25.250732 15148 consensus_meta.cc:287] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.004s
I20260812 19:24:25.205685 15006 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:25.281962  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:25.283002  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:25.248762 15284 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:25.206981 15047 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.287431 14745 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:25.209216 14815 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.218146 15261 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:25.284828  6055 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.017s	sys 0.031s
W20260812 19:24:25.297816  6055 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.018s	sys 0.031s
W20260812 19:24:25.287554 15320 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260812 19:24:25.301028 15288 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:25.320947  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:25.303679 15188 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:25.285292 15148 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.316521 14978 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:25.314131 15307 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:25.328811 15185 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:25.354936 15337 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:25.355571 15337 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.356423 15190 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:25.356979 15190 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.357618 15337 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:25.358126 15337 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:25.348989 15348 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.203s	user 0.004s	sys 0.000s
I20260812 19:24:25.353487 15047 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.347014 15307 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.346760 14978 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.358546 15337 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.359790 15185 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:25.349707 15284 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:25.376622 15039 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.019s	sys 0.037s
I20260812 19:24:25.369511 15340 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:25.381031 15006 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:25.389704 15261 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.393064 14815 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.419013  7598 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260812 19:24:25.398336 15339 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:25.402837 15190 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:25.411006 14927 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:25.409313 15006 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:25.429479 15329 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.400s	user 0.003s	sys 0.000s
I20260812 19:24:25.415601 15148 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:25.408473 15039 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.019s	sys 0.038s
W20260812 19:24:25.464211  6359 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.012s	sys 0.034s
W20260812 19:24:25.507864  6359 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.012s	sys 0.034s
I20260812 19:24:25.390498 15340 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.465474  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2323) took 1300 ms. Trace:
I20260812 19:24:25.512092  6241 rpcz_store.cc:276] 0812 19:24:24.165002 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:24.173842 (+  8840us) service_pool.cc:227] Handling call
0812 19:24:24.174228 (+   386us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:24.174618 (+   390us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:24.174645 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:24.175208 (+   563us) log.cc:842] Serialized 26 byte log entry
0812 19:24:24.406773 (+231565us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:24.406848 (+    75us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:24.406925 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:25.323465 (+916540us) spinlock_profiling.cc:243] Waited 6.68 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:25.430609 (+107144us) raft_consensus.cc:1671] finished
0812 19:24:25.430640 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:25.465396 (+ 34756us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":163,"spinlock_wait_cycles":15353088,"thread_start_us":228335,"threads_started":1,"wal-append.queue_time_us":749569}
I20260812 19:24:25.426548 14951 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.463951 15006 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.522163 15337 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:25.524504 14930 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:25.566448  6350 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:24:25.573945  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.020s	sys 0.015s
I20260812 19:24:25.431849 14927 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:25.534453 14836 raft_consensus.cc:3032] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:25.532111 15345 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260812 19:24:25.575704 15333 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.394s	user 0.005s	sys 0.000s
I20260812 19:24:25.524533 15272 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.580183 14836 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:25.585101 14978 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:25.592643  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:25.584792 14815 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:25.596962  6482 raft_consensus.cc:2354] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15.
W20260812 19:24:25.598858  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 436281us
I20260812 19:24:25.595103 15185 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:25.626181  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:25.646216 15124 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:25.647078 15124 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:25.647552 15124 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
W20260812 19:24:25.648348  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:25.634554  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:25.592314 15261 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260812 19:24:25.659370  6475 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260812 19:24:25.662322  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:25.661525  6465 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.002s	sys 0.018s
W20260812 19:24:25.676055  6465 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.002s	sys 0.019s
I20260812 19:24:25.676292 14511 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260812 19:24:25.676914 15141 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:25.677647 15141 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.678303 15039 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:25.678812 15132 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:25.679558 15039 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:25.679373 15132 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.679942 15039 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:25.680373 15141 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.681139 15141 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:25.681447 15132 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.680891 15039 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.641927 15047 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:25.608188 14815 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.700686  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:25.703014  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:25.705674  6470 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.056s	sys 0.068s
I20260812 19:24:25.706168  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:25.707892  6470 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.056s	sys 0.068s
I20260812 19:24:25.699818  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:25.710101  6475 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:25.712774  6241 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:25.713080  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:25.713357  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:25.714190  6465 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:25.629963 15219 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:25.718086  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:25.719013  6481 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:25.719480  6473 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:25.729310  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:25.733987  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:25.730244  6350 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:25.737697  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:25.692359 14951 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:25.684333 14898 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:25.743974  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:25.745579  6241 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:25.749639  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:25.755357  7598 raft_consensus.cc:2379] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:25.767010  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:25.714600 15143 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:25.717741 14978 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:25.790285 14978 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.791139  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:25.792045  7599 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:25.792615 14978 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:25.793404  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:25.794001  6347 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:24:25.796065 14981 consensus_meta.cc:287] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.142s	user 0.008s	sys 0.008s
I20260812 19:24:25.796607 14981 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:25.757069 14898 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.799494 15272 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.799624 15339 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:25.800160 15339 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.801625 14898 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.722117 15047 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.802826 15337 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:25.803455 15004 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:25.803525 15337 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:25.804061 15004 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.774917 14927 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:25.805742 15337 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:25.779230 15143 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:25.770995 14951 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260812 19:24:25.752810 15039 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
W20260812 19:24:25.787418 15349 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260812 19:24:25.740087 15006 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:25.753517 15340 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:25.788453 15288 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:25.788686 14815 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.798959  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:25.799079  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:25.802909 15374 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:25.804327 15047 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.806012 15004 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:25.806547 15148 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:25.811077  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:25.811564  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:25.812140  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:25.812901 15346 log.cc:924] Time spent T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
W20260812 19:24:25.773252 15350 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260812 19:24:25.776964  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 529ed979cd2842acb5bc24debb151b93, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.814751  7607 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:25.880843  6473 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:25.819139  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:25.820430  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:25.705212 15141 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.775386  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:25.754508 15268 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:25.835783  6228 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
W20260812 19:24:25.880343  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 529ed979cd2842acb5bc24debb151b93, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.834115  6347 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:24:25.836447  6465 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:25.742971 15188 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:25.837005  6298 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:25.802359 15339 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:25.756206 15185 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:25.855432  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:25.868547  6235 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
W20260812 19:24:25.868726  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 69718.2us
I20260812 19:24:25.953751  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:25.869269  6349 raft_consensus.cc:2354] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14.
I20260812 19:24:25.878257  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:25.775815 15219 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:25.881599  6475 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:25.956969  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:25.882701  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:25.884492  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:25.891570  6470 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:25.958978  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:25.959854 15340 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:24:25.960016 15143 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:25.960574 15340 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:25.961098 15340 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:25.961133 15188 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.892393 15124 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.963093  6474 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:25.958213  6350 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:25.897228 15268 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:25.880566 15148 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:25.897713 15004 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:25.938715  6483 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:25.791080 14836 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.875262 15288 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260812 19:24:25.956117  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 66872.2us
I20260812 19:24:25.966862  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:25.967830  6230 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:25.971386  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:25.887287 14981 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:25.955817 15047 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:25.986550  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:25.987368  6465 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 13
I20260812 19:24:25.992091  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:25.972070 15268 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
W20260812 19:24:25.994699  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet d1275ccc06f94fcdaa82a73420569651, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:25.997377  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet d1275ccc06f94fcdaa82a73420569651, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.997249  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:25.978750 15364 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:26.001641  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:25.998195  6464 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:25.874871 15374 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:25.978807 15288 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:26.005712  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:26.011998  6464 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
W20260812 19:24:26.014995 15382 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.002s
I20260812 19:24:26.015913 15004 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:26.016489 15004 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:26.019644  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:26.010938  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:26.019871  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:25.989926 15181 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:25.963281 15185 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:26.035943  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:26.043396  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:26.043883  6178 leader_election.cc:398] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15.
I20260812 19:24:26.044221  6178 leader_election.cc:401] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:24:26.009200 15364 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:26.026082 15288 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:26.049412  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:26.050199  6350 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:26.029655 14836 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:26.054450  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:26.054868  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:26.037767 15181 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:26.062780  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:25.992343 15047 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:26.028753 15004 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:26.032768 15284 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:26.057451  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:26.086690  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:26.087075  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:26.087724  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:26.087905  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:26.088343  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:26.088894  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:26.089085  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:26.089425  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:26.090271  6347 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: []
W20260812 19:24:26.058490  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 7230832bbf3743e0a33e68f405d6b124, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:26.091351  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 7230832bbf3743e0a33e68f405d6b124, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:26.054402  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2317) took 1217 ms. Trace:
I20260812 19:24:26.094172  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:26.087905  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:26.095444  6353 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:26.096822  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:26.100276  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:26.101368  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:25.962256 15340 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:26.106240  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:26.109964  6350 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:26.061219  6465 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
W20260812 19:24:26.045315  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 208385us
I20260812 19:24:26.072649 15372 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:26.072834  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:26.057281 14978 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 15
I20260812 19:24:26.077708 15124 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:26.078579  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:26.082118 15181 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:26.046028 14930 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:26.082834 14981 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:26.083405 14745 consensus_meta.cc:287] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.784s	user 0.009s	sys 0.005s
I20260812 19:24:26.048343 15364 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:26.185590  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:26.185824  6475 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260812 19:24:26.110147  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:26.090210  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:26.138283  6354 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:26.156767  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:26.190229  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 207791us
I20260812 19:24:26.048593 15337 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:26.164809  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:26.166674  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:26.101269  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:26.093544  6359 rpcz_store.cc:276] 0812 19:24:24.837137 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:24.837311 (+   174us) service_pool.cc:227] Handling call
0812 19:24:24.850097 (+ 12786us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:24.850537 (+   440us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:24.850576 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:24.884103 (+ 33527us) log.cc:842] Serialized 26 byte log entry
0812 19:24:24.942165 (+ 58062us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b18004cde60. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:24:25.508377 (+566212us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:25.517913 (+  9536us) log.cc:842] Serialized 14 byte log entry
0812 19:24:25.518153 (+   240us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:25.518269 (+   116us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:26.046604 (+528335us) raft_consensus.cc:1671] finished
0812 19:24:26.050760 (+  4156us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:26.054342 (+  3582us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":9346,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":2271,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":21279,"spinlock_wait_cycles":3643136,"thread_start_us":566010,"threads_started":1,"wal-append.queue_time_us":739408}
I20260812 19:24:26.194466  6229 raft_consensus.cc:2396] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260812 19:24:26.197551  6465 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:26.063771 15141 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:26.175221  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:26.200450  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:26.220364  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:26.226058  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 61342us
I20260812 19:24:26.241457  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:26.243567  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 71386.7us
I20260812 19:24:26.259132  6228 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:26.159382 14815 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:24:26.305095  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet d3d1eb75377449c8b2ea3ee9e6622404, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:26.263314  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:26.179316 15372 raft_consensus.cc:686] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:26.296401  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:26.197333 15337 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:26.354409 15337 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
W20260812 19:24:26.359702  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 55301.1us
I20260812 19:24:26.285477  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:26.305703  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet d3d1eb75377449c8b2ea3ee9e6622404, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:26.254395  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:26.393807  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:26.221664 15132 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:26.281388 15357 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:26.264456 14745 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:26.196549 14981 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:26.439564  6229 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260812 19:24:26.453585  6345 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:26.458359  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:26.465703  6228 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260812 19:24:26.284896 14930 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:26.410475 15284 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:26.417369 15357 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:26.525695  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:26.528800 15357 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:26.520319 15284 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:26.486814  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:26.491868  6232 raft_consensus.cc:1261] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
W20260812 19:24:26.502678 15377 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.115s	user 0.001s	sys 0.001s
I20260812 19:24:26.444947 15132 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:26.542586  6232 pending_rounds.cc:76] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 5
I20260812 19:24:26.315131 14815 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:26.512962 15370 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:26.519503  6236 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:26.572677 14981 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:26.579674  6232 pending_rounds.cc:97] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260812 19:24:26.583011 15370 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:26.588706 15370 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:26.590034 15372 consensus_queue.cc:237] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:26.604849 14836 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.009s
I20260812 19:24:26.547437 15284 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:26.583930  6232 raft_consensus.cc:2866] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:26.537098 15067 consensus_queue.cc:1046] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
W20260812 19:24:26.659502 15268 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.014s
I20260812 19:24:26.648046 15047 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:26.714013  6353 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.618s	user 0.025s	sys 0.000s
I20260812 19:24:26.727059  6353 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
W20260812 19:24:26.720638 15412 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.000s	sys 0.013s
I20260812 19:24:26.672545 14815 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:26.749508  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:26.732939  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:26.778256  7598 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
W20260812 19:24:26.766466 15412 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.000s	sys 0.015s
W20260812 19:24:26.821250  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 558728us
I20260812 19:24:26.863978  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:26.748431 14951 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:26.908236  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:26.948455  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:26.723351 15268 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:27.059747  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:27.035799  6178 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:26.978376  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:27.082259  6238 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:27.120343  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:27.105120  6232 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:27.148597  6229 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:26.936712 15190 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:26.971776 15339 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:27.159968  6344 raft_consensus.cc:2354] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13.
I20260812 19:24:27.025842 15373 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:27.213811  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:27.218506 15339 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:27.086757 15426 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:24:27.323223 15420 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.726s	user 0.000s	sys 0.010s
I20260812 19:24:27.324407 15190 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:24:27.289806 14930 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:27.309262  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:27.311455  7551 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.010s	sys 0.043s
I20260812 19:24:27.312494 15132 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:27.335748  7551 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.012s	sys 0.045s
I20260812 19:24:27.309005  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:27.180207 15039 consensus_meta.cc:287] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.330s	user 0.029s	sys 0.004s
I20260812 19:24:27.338400  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:27.136904 15188 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:27.378682  6232 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:27.398305  6352 raft_consensus.cc:595] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
W20260812 19:24:27.399433  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.013s	sys 0.070s
I20260812 19:24:27.356989  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2571) took 1266 ms. Trace:
I20260812 19:24:27.404134  6352 raft_consensus.cc:603] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260812 19:24:27.410488  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.015s	sys 0.072s
I20260812 19:24:27.118275 14951 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:27.445634  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:27.519531  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 696233us
W20260812 19:24:27.394248 15421 log.cc:924] Time spent T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.283s	user 0.005s	sys 0.001s
I20260812 19:24:27.378754 15339 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:27.462723 15188 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:24:27.430964 14927 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.043s	sys 0.077s
I20260812 19:24:27.534629  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:27.575740 14927 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.047s	sys 0.077s
I20260812 19:24:27.577112  6229 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:27.077842 15429 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.431s
I20260812 19:24:27.589159  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2602) took 1523 ms. Trace:
I20260812 19:24:27.300989 15373 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:27.562952 14836 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:27.413692  6235 rpcz_store.cc:276] 0812 19:24:26.090485 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:26.091709 (+  1224us) service_pool.cc:227] Handling call
0812 19:24:26.092038 (+   329us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:26.092381 (+   343us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:26.092409 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:26.092843 (+   434us) log.cc:842] Serialized 26 byte log entry
0812 19:24:26.404859 (+312016us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:26.404905 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:26.404974 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:27.354270 (+949296us) raft_consensus.cc:1671] finished
0812 19:24:27.354452 (+   182us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:27.356511 (+  2059us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":542,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":311622,"threads_started":1,"wal-append.queue_time_us":501878}
I20260812 19:24:27.433722 15416 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:27.612138  6474 rpcz_store.cc:276] 0812 19:24:26.064991 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:26.065131 (+   140us) service_pool.cc:227] Handling call
0812 19:24:26.167425 (+102294us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:26.167777 (+   352us) raft_consensus.cc:1520] Early marking committed up to index 4
0812 19:24:26.167812 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:26.185114 (+ 17302us) log.cc:842] Serialized 26 byte log entry
0812 19:24:26.415957 (+230843us) raft_consensus.cc:1631] Marking committed up to 4
0812 19:24:26.415993 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:26.416192 (+   199us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:27.586856 (+1170664us) raft_consensus.cc:1671] finished
0812 19:24:27.587009 (+   153us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:27.588584 (+  1575us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":98900,"threads_started":1,"wal-append.queue_time_us":524896}
I20260812 19:24:27.429160 15426 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:27.755892  6172 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.019s	sys 0.072s
W20260812 19:24:27.759042  6172 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.024s	sys 0.072s
I20260812 19:24:27.781505  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:27.748525  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:27.635797 15268 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:27.814496  6229 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:27.782263 15423 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:27.776894 14951 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:27.823485  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.013s	sys 0.057s
W20260812 19:24:27.841483  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.014s	sys 0.057s
I20260812 19:24:27.564992 15188 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:27.851985  7607 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:27.789949 15039 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:27.845470  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.005s	sys 0.042s
W20260812 19:24:27.838922 15434 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.275s	user 0.005s	sys 0.002s
I20260812 19:24:27.889151  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:27.895291  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:27.893201  6298 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.012s	sys 0.005s
W20260812 19:24:27.902621  6298 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.015s	sys 0.005s
W20260812 19:24:27.881830  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.007s	sys 0.043s
W20260812 19:24:27.850721 15407 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.011s
W20260812 19:24:27.917881  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 966480us
W20260812 19:24:27.845046  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 860673us
W20260812 19:24:27.927605  7551 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.010s	sys 0.018s
W20260812 19:24:27.935783  7551 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.011s	sys 0.019s
I20260812 19:24:27.692459 14836 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:27.883826 15430 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.091s	user 0.000s	sys 0.005s
I20260812 19:24:27.919915  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:27.859895 15428 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:27.979594  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:24:27.938357 15124 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.020s	sys 0.052s
W20260812 19:24:27.930868 15407 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.001s	sys 0.015s
I20260812 19:24:27.982555 15446 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:27.738606 15416 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:27.992595 15288 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.922s	user 0.041s	sys 0.015s
W20260812 19:24:28.034363  6295 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.001s	sys 0.017s
I20260812 19:24:27.901525 15039 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:28.011900 15439 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:28.044129 15440 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:27.985476 15429 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:28.005244 15124 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.024s	sys 0.052s
I20260812 19:24:27.853286 15423 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:28.002383 15428 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:28.057000 15429 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:28.066520  7552 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.000s	sys 0.026s
I20260812 19:24:28.079697 15288 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:28.019972 15373 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:28.123680 14951 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:28.134831  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2555) took 2367 ms. Trace:
W20260812 19:24:28.037925  6295 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.001s	sys 0.020s
W20260812 19:24:28.186443  7552 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.000s	sys 0.029s
I20260812 19:24:28.129983 15416 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:28.058488  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:28.290403  6238 rpcz_store.cc:276] 0812 19:24:25.766266 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:25.766394 (+   128us) service_pool.cc:227] Handling call
0812 19:24:25.784084 (+ 17690us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:27.139788 (+1355704us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:28.093197 (+953409us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002f9754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:28.133778 (+ 40581us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2980006272}
W20260812 19:24:28.281364 15370 consensus_meta.cc:287] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.692s	user 0.070s	sys 0.004s
I20260812 19:24:27.947644  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:28.200320  6242 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:28.378006  6235 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
W20260812 19:24:28.338920  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.013s	sys 0.028s
W20260812 19:24:28.385347  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.015s	sys 0.029s
W20260812 19:24:28.399339  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 760309us
W20260812 19:24:28.338265 14927 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.017s	sys 0.027s
W20260812 19:24:28.430173  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 440681us
I20260812 19:24:28.085541 15006 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Stepping down as leader of term 11
W20260812 19:24:28.388067 15181 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 2.118s	user 0.056s	sys 0.019s
W20260812 19:24:28.379161 15364 consensus_meta.cc:287] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 2.109s	user 0.044s	sys 0.019s
I20260812 19:24:28.304900 15307 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:28.147790 15423 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:28.260967 15288 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:28.137943 15428 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:28.420326 15284 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.704s	user 0.049s	sys 0.018s
W20260812 19:24:28.519120  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.026s	sys 0.042s
I20260812 19:24:28.194553 15429 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:28.535828  7594 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260812 19:24:28.114334 15039 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:28.064350 15441 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:28.529481 14836 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:28.436903 14927 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.020s	sys 0.027s
I20260812 19:24:28.406026 15317 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:28.042372 15439 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:28.528206  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.010s	sys 0.030s
I20260812 19:24:28.168318 15446 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:28.532953  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.027s	sys 0.042s
W20260812 19:24:28.506839 15337 consensus_meta.cc:287] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 2.148s	user 0.065s	sys 0.012s
W20260812 19:24:28.591583  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 50547.5us
I20260812 19:24:28.075695 15426 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:28.472105 15006 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:28.388978 15370 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:28.509130 15364 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:28.621119 15456 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:28.498174  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:28.526854 15307 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election won for term 13
W20260812 19:24:28.538264 14978 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 2.355s	user 0.065s	sys 0.004s
I20260812 19:24:28.685873 14978 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15.
I20260812 19:24:28.690882  6228 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:28.509166 15188 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:28.703572 15307 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:28.526343 15423 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:28.199004 15440 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:28.573938  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.011s	sys 0.030s
I20260812 19:24:28.289511 14951 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:28.606709 15442 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:28.507277 15181 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:28.577658 15317 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:28.616410 15337 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:28.612602  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:28.577623 15357 consensus_meta.cc:287] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 2.000s	user 0.076s	sys 0.002s
I20260812 19:24:28.572808 15441 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:28.552393  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 112904us
I20260812 19:24:28.769575  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:28.531395 15284 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:28.720932  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 741892us
I20260812 19:24:28.665136 15370 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:28.771373  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:28.563259 15437 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:28.782279  6349 raft_consensus.cc:2354] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14.
I20260812 19:24:28.777456  6235 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:28.706240 15288 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:28.764156 15442 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:28.792368 14951 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:28.795079 15446 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:28.797392 15374 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:28.822984  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2561) took 2851 ms. Trace:
I20260812 19:24:28.705650 15188 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:28.662374 15006 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:28.844038 15006 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:28.844352 15439 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:28.820598 15458 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:28.845486 15458 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:28.712952 15423 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:28.651763 15456 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:28.846666 15317 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:28.849718 15423 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:28.849857 15456 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:28.853408 15337 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:28.852880 15373 consensus_queue.cc:1159] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f4ef77b3328a44e8a21dd902b370e25a" responder_term: 12 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: [11.11-11.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:24:28.855233 15442 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:28.846746 15458 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:28.852922 15181 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:28.858286  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:28.860364  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:28.861022 15364 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:28.865638 15441 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:28.712915 15428 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:28.799386  6230 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:28.837954  6350 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260812 19:24:28.838913  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:28.900835  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49464 (request call id 71) took 2814 ms. Trace:
I20260812 19:24:28.839558  6241 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:28.840161  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:28.841459  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:28.904363  6359 raft_consensus.cc:2354] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17.
I20260812 19:24:28.842762 15188 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:28.906066 15375 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 2.906s	user 0.023s	sys 0.014s
I20260812 19:24:28.907673 15188 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:28.869341 15339 consensus_meta.cc:287] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.305s	user 0.042s	sys 0.008s
I20260812 19:24:28.835400  6224 rpcz_store.cc:276] 0812 19:24:25.971562 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:25.971772 (+   210us) service_pool.cc:227] Handling call
0812 19:24:25.990179 (+ 18407us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:26.046950 (+ 56771us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:26.046996 (+    46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:26.047053 (+    57us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:26.047097 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:28.822118 (+2775021us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b54000ff0d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:28.822209 (+    91us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:28.822811 (+   602us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":129974656}
I20260812 19:24:28.911442 15339 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:28.807976  6232 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.264s	user 0.056s	sys 0.000s
I20260812 19:24:28.945022  6232 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
W20260812 19:24:28.947815  6232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2337) took 1670 ms (client timeout 1835 ms). Trace:
I20260812 19:24:28.950744 15284 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:28.901351  6352 rpcz_store.cc:276] 0812 19:24:26.086154 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:26.089284 (+  3130us) service_pool.cc:227] Handling call
0812 19:24:28.900553 (+2811269us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54002d0ad4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7772bc3 00007f98fc6bc81a 00007f98f5dbbd04 00007f98f5dbbc92 00007f98f5dbbbc1 00007f98f5dbbb3c 00007f98f5dbadf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:28.900703 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3008068480}
I20260812 19:24:28.967504  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2182) took 2590 ms. Trace:
I20260812 19:24:28.873399 15307 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:28.774844 15357 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:28.922293  6344 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2332) took 2965 ms (client timeout 2242 ms). Trace:
I20260812 19:24:28.795264 15437 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:28.896937 15428 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:28.821115 15288 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:28.914392  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:28.931989  6236 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2568) took 2842 ms (client timeout 2670 ms). Trace:
W20260812 19:24:28.999718  6236 rpcz_store.cc:269] 0812 19:24:26.089485 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:26.096051 (+  6566us) service_pool.cc:227] Handling call
0812 19:24:28.931499 (+2835448us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54000064d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:28.931727 (+   228us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":970162432}
I20260812 19:24:28.996589  6224 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:29.016353  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:29.027580 15188 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:29.043043  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2614) took 2266 ms. Trace:
W20260812 19:24:29.037814  7607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 591) took 2247 ms (client timeout 1511 ms). Trace:
I20260812 19:24:29.059980  6235 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
W20260812 19:24:28.949831  6232 rpcz_store.cc:269] 0812 19:24:27.278548 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:27.443304 (+164756us) service_pool.cc:227] Handling call
0812 19:24:28.947712 (+1504408us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:29.020681  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
W20260812 19:24:28.975577  6344 rpcz_store.cc:269] 0812 19:24:25.956961 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:25.958701 (+  1740us) service_pool.cc:227] Handling call
0812 19:24:28.921764 (+2963063us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400180954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:28.922075 (+   311us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2753732352}
I20260812 19:24:29.061444  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:29.078977  7607 rpcz_store.cc:269] 0812 19:24:26.789651 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:26.842364 (+ 52713us) service_pool.cc:227] Handling call
0812 19:24:29.036333 (+2193969us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b540048b554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:29.037103 (+   770us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1649925888}
I20260812 19:24:29.067678  6224 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:24:29.106487  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2343) took 1437 ms. Trace:
I20260812 19:24:29.040227  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:29.103775  6464 rpcz_store.cc:276] 0812 19:24:26.776879 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:26.799115 (+ 22236us) service_pool.cc:227] Handling call
0812 19:24:29.017478 (+2218363us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:24:29.027162 (+  9684us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:29.028817 (+  1655us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:29.028939 (+   122us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:29.029018 (+    79us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:29.029058 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:29.029555 (+   497us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:29.042157 (+ 12602us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9854336}
I20260812 19:24:29.089570  6359 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:29.116386  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:28.969969  6347 rpcz_store.cc:276] 0812 19:24:26.377104 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:26.377248 (+   144us) service_pool.cc:227] Handling call
0812 19:24:26.417739 (+ 40491us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:26.559542 (+141803us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:26.559586 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:26.559629 (+    43us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:24:26.559669 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:28.938239 (+2378570us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54001b8854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:28.938356 (+   117us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:28.967314 (+ 28958us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":325165440}
I20260812 19:24:29.123550  6232 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:29.126432  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2350) took 1067 ms. Trace:
I20260812 19:24:29.127684  6232 rpcz_store.cc:276] 0812 19:24:28.059794 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:29.115021 (+1055227us) service_pool.cc:227] Handling call
0812 19:24:29.126231 (+ 11210us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:29.083422  6352 raft_consensus.cc:595] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:29.133014  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:29.111333  6224 rpcz_store.cc:276] 0812 19:24:27.669979 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:29.013323 (+1343344us) service_pool.cc:227] Handling call
0812 19:24:29.106238 (+ 92915us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:29.136098  6353 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:29.141212  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:29.113833  6236 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:29.159587  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2349) took 1182 ms. Trace:
I20260812 19:24:29.161533  6236 rpcz_store.cc:276] 0812 19:24:27.978456 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:29.038182 (+1059726us) service_pool.cc:227] Handling call
0812 19:24:29.159393 (+121211us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:29.150942  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:29.165201  6350 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:29.174793  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:29.185027  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:29.229175  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:29.245482  6236 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:29.294526  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:29.300655  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:29.187386 15284 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:29.096410 15188 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:29.307420  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:29.313443 15437 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:29.317085 15288 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:29.324819  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2344) took 1599 ms. Trace:
I20260812 19:24:29.315467  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:29.362514  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:29.267220 15339 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:29.368296  7594 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:29.345423  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:29.342844  6359 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 14
I20260812 19:24:29.353294 15439 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:29.354960  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:29.295346 15441 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:29.310030  6350 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:24:29.365499  6232 rpcz_store.cc:276] 0812 19:24:27.726529 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:29.292590 (+1566061us) service_pool.cc:227] Handling call
0812 19:24:29.324289 (+ 31699us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:29.268563 15428 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:29.157347 15268 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.163s
I20260812 19:24:29.387133  6352 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:29.379756  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:29.345577 15337 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:29.424410  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:29.436928  6232 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:29.441147  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2356) took 1263 ms. Trace:
I20260812 19:24:29.454950  6232 rpcz_store.cc:276] 0812 19:24:28.178854 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:29.423000 (+1244146us) service_pool.cc:227] Handling call
0812 19:24:29.440851 (+ 17851us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:29.463573  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:29.468111  6232 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:29.470373  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2351) took 1408 ms. Trace:
I20260812 19:24:29.447504 15357 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:29.478340  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2359) took 1224 ms. Trace:
I20260812 19:24:29.478349  6236 rpcz_store.cc:276] 0812 19:24:28.062200 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:29.323461 (+1261261us) service_pool.cc:227] Handling call
0812 19:24:29.470069 (+146608us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:29.503928  6232 rpcz_store.cc:276] 0812 19:24:28.254418 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:29.461342 (+1206924us) service_pool.cc:227] Handling call
0812 19:24:29.478139 (+ 16797us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:29.397603 14745 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:29.521471  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:29.544219  6232 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:29.547902  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2360) took 1026 ms. Trace:
I20260812 19:24:29.550994  6232 rpcz_store.cc:276] 0812 19:24:28.521593 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:29.516019 (+994426us) service_pool.cc:227] Handling call
0812 19:24:29.547567 (+ 31548us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:29.481253 15339 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:29.558318 15473 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.114s	user 0.004s	sys 0.000s
W20260812 19:24:29.439553  6178 connection.cc:232] RPC call timeout handler was delayed by -1.3024667541030794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260812 19:24:29.568369  6178 connection.cc:232] RPC call timeout handler was delayed by -1.3024667541030794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260812 19:24:29.425279 15439 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:29.571952  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:29.447103 15337 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:29.571952 15339 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:29.575784 14745 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:29.564603  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:29.577931  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 3.32361e+06us
I20260812 19:24:29.578202  6236 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:29.349177 15284 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:29.578668  6241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2575) took 3241 ms (client timeout 1714 ms). Trace:
I20260812 19:24:29.578972  6416 leader_election.cc:398] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14.
I20260812 19:24:29.579321  6416 leader_election.cc:401] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260812 19:24:29.579124  6241 rpcz_store.cc:269] 0812 19:24:26.337021 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:26.410042 (+ 73021us) service_pool.cc:227] Handling call
0812 19:24:29.578353 (+3168311us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b540027c4d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:29.578533 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5459462400}
W20260812 19:24:29.570218  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2502667540684342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
I20260812 19:24:29.560323  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:29.582643  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2286667539738119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260812 19:24:29.582567  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:29.583156  6178 connection.cc:232] RPC call timeout handler was delayed by -1.2286667539738119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
W20260812 19:24:29.583537  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1944667540956289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260812 19:24:29.584116  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1944667540956289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260812 19:24:29.585390  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1863667541183531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
I20260812 19:24:29.583555  7591 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
W20260812 19:24:29.585862  6178 connection.cc:232] RPC call timeout handler was delayed by -1.1665667539928108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260812 19:24:29.616096  6178 connection.cc:232] RPC call timeout handler was delayed by -1.0171667539980263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260812 19:24:29.561702 15474 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.112s	user 0.004s	sys 0.000s
I20260812 19:24:29.556056  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:29.618945  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:29.619699  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:29.616864 15143 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:29.624989 15143 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:29.434341 15441 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:29.547449 15188 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:29.470938 15428 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:29.631023  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:29.630906  7594 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:29.613792 15339 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:29.586436 15357 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:29.587838 15132 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:29.586789 15047 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:29.634567  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:29.632668  7594 raft_consensus.cc:595] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:29.635607  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:29.616721 14745 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:29.681635  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:29.682749  6232 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 17
I20260812 19:24:29.639513  6298 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:29.640964  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:29.639374  7599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 632) took 1130 ms. Trace:
W20260812 19:24:29.683821  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 44452.2us
I20260812 19:24:29.684522  7599 rpcz_store.cc:276] 0812 19:24:28.504181 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:28.520313 (+ 16132us) service_pool.cc:227] Handling call
0812 19:24:29.630458 (+1110145us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b5800005498. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:24:29.633714 (+  3256us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:29.633976 (+   262us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:29.634013 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:29.634071 (+    58us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:24:29.634108 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:29.634169 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:29.634291 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2606336}
I20260812 19:24:29.688187  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:29.688226  6353 raft_consensus.cc:2396] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260812 19:24:29.689124  7603 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:29.633422 15337 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:29.636034 15428 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:29.695860  6242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2567) took 3606 ms (client timeout 2218 ms). Trace:
I20260812 19:24:29.696039  6298 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:24:29.696369  6242 rpcz_store.cc:269] 0812 19:24:26.089153 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:26.093894 (+  4741us) service_pool.cc:227] Handling call
0812 19:24:29.695641 (+3601747us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b540017a554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:29.695781 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4837519232}
I20260812 19:24:29.697322 14622 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:29.697715 14622 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:29.697849  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:29.697559  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:29.698146 14622 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:29.653436 15047 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:29.702785  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:29.693286 15268 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:29.694628 15288 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:29.708842  6242 raft_consensus.cc:2396] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260812 19:24:29.701128  7597 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:29.699216 15284 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:29.712340  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:29.712487  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:29.716207 15148 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:29.707945 15268 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:29.719254 15143 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:29.722210  6297 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.1:46707 timed out after 1.714s (SENT) [suppressed 9 similar messages]
I20260812 19:24:29.652832 15357 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:29.735587  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:29.736367  6242 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:24:29.734680 15268 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:29.724653  6229 raft_consensus.cc:2354] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14.
I20260812 19:24:29.724924  6224 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:24:29.739984  6224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2345) took 1993 ms (client timeout 2548 ms). Trace:
W20260812 19:24:29.740536  6224 rpcz_store.cc:269] 0812 19:24:27.764771 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:29.712155 (+1947384us) service_pool.cc:227] Handling call
0812 19:24:29.739919 (+ 27764us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:24:29.741061  6229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2353) took 1654 ms (client timeout 1659 ms). Trace:
I20260812 19:24:29.710147 15439 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:29.704533 15047 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:29.686232 15132 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:29.741569  6229 rpcz_store.cc:269] 0812 19:24:28.123224 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:29.712017 (+1588793us) service_pool.cc:227] Handling call
0812 19:24:29.740981 (+ 28964us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:29.733831  6232 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:29.744253  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:29.752763  6242 raft_consensus.cc:2396] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260812 19:24:29.754392 15428 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:29.750360  6359 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:29.765889  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2338) took 2455 ms. Trace:
I20260812 19:24:29.766445  6232 rpcz_store.cc:276] 0812 19:24:27.311715 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:29.765035 (+2453320us) service_pool.cc:227] Handling call
0812 19:24:29.765393 (+   358us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:29.765579 (+   186us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:29.765609 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:29.765647 (+    38us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:29.765673 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:29.765721 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:29.765833 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:29.771266  6229 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260812 19:24:29.772161  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2586) took 2999 ms. Trace:
I20260812 19:24:29.772565  6229 rpcz_store.cc:276] 0812 19:24:26.772389 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:29.751858 (+2979469us) service_pool.cc:227] Handling call
0812 19:24:29.765944 (+ 14086us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:29.771854 (+  5910us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:29.772096 (+   242us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:29.775493  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2584) took 3009 ms. Trace:
I20260812 19:24:29.743093 15143 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14.
I20260812 19:24:29.778255  6224 rpcz_store.cc:276] 0812 19:24:26.765699 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:29.742877 (+2977178us) service_pool.cc:227] Handling call
0812 19:24:29.774793 (+ 31916us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:29.775041 (+   248us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:29.775077 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:29.775150 (+    73us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:29.775207 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:29.775281 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:29.775419 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:29.782212  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2566) took 3693 ms. Trace:
I20260812 19:24:29.782796  6230 rpcz_store.cc:276] 0812 19:24:26.088817 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:26.093379 (+  4562us) service_pool.cc:227] Handling call
0812 19:24:26.093651 (+   272us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:28.897136 (+2803485us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:29.781871 (+884735us) spinlock_profiling.cc:243] Waited 2.7 s on lock 0x7b540013f954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:29.782133 (+   262us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6221050112}
I20260812 19:24:29.800348  6232 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
W20260812 19:24:29.785095 15372 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.989s	user 0.041s	sys 0.042s
W20260812 19:24:29.818851  6417 connection.cc:232] RPC call timeout handler was delayed by -2.4685587571002543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
I20260812 19:24:29.823479 15485 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:29.824195 15485 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:29.826195  7603 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:29.826994 15485 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:29.828331 15485 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:29.829129  6417 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:24:29.818563 15372 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.017s	user 0.041s	sys 0.043s
I20260812 19:24:29.808563 15143 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:24:29.821925  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 203110us
W20260812 19:24:29.822296  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 204559us
I20260812 19:24:29.843894  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:29.845875  6345 raft_consensus.cc:595] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:29.845662  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:29.853425  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:29.833624 15341 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:29.829499 15411 raft_consensus.cc:3032] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:24:29.854717  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:29.855794  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 133659us
I20260812 19:24:29.856353  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:29.820013 15307 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:29.855650  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260812 19:24:29.864333  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:29.861526  6482 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 11.
I20260812 19:24:29.867141  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:24:29.880415  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:29.871821  6238 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2352) took 1787 ms (client timeout 1639 ms). Trace:
W20260812 19:24:29.881771  6238 rpcz_store.cc:269] 0812 19:24:28.085077 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:29.871596 (+1786519us) service_pool.cc:214] Skipping call since client already timed out
0812 19:24:29.871744 (+   148us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260812 19:24:29.883908  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:29.886893 15500 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:29.887068 15504 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:29.887495 15500 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:29.887895 15504 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:29.889676 15500 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:29.890246 15500 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:29.891106 15357 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:29.891741 15357 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:29.892268 15357 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:29.893769 15504 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:29.861955 15487 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:29.895443 15373 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:29.895779 15487 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:29.897200 15487 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:29.901568  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:29.880256 15307 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:29.905026 15307 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:29.852229 15143 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:29.907557  6297 connection.cc:232] RPC call timeout handler was delayed by -1.5727120507508516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
I20260812 19:24:29.911770 15365 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:29.912238 15365 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:29.912923  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:29.913133 15365 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:29.862118 15141 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:29.914471 15141 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:29.916726 15141 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:29.917153  6235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2358) took 1665 ms (client timeout 1599 ms). Trace:
I20260812 19:24:29.917953 15503 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:29.918123 15141 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:29.919296  7598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 631) took 1416 ms. Trace:
W20260812 19:24:29.917596  6235 rpcz_store.cc:269] 0812 19:24:28.252203 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:28.788114 (+535911us) service_pool.cc:227] Handling call
0812 19:24:29.916963 (+1128849us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540001d454. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:29.917075 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":451710720}
I20260812 19:24:29.914422  6416 leader_election.cc:398] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13.
W20260812 19:24:29.917608  6297 connection.cc:232] RPC call timeout handler was delayed by -1.561358013888821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.267s for a response
W20260812 19:24:29.929301  6297 connection.cc:232] RPC call timeout handler was delayed by -1.5232120507862419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
I20260812 19:24:29.928901  6416 leader_election.cc:401] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260812 19:24:29.929703  6297 connection.cc:232] RPC call timeout handler was delayed by -1.4809120506979525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
I20260812 19:24:29.927143  7598 rpcz_store.cc:276] 0812 19:24:28.503391 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:28.503769 (+   378us) service_pool.cc:227] Handling call
0812 19:24:29.055240 (+551471us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:29.056707 (+  1467us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:29.056941 (+   234us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:29.057201 (+   260us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:24:29.057564 (+   363us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:29.058100 (+   536us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:29.919056 (+860956us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b540048b550. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:29.919219 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1264585472}
I20260812 19:24:29.835493 15485 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:29.863345 15411 raft_consensus.cc:729] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:24:29.933176  6297 connection.cc:232] RPC call timeout handler was delayed by -1.0264120507054031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
I20260812 19:24:29.936522  6178 leader_election.cc:398] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17.
I20260812 19:24:29.870114 15438 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:29.938787  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:29.869776 15185 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:29.945274  6178 leader_election.cc:401] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:24:29.894500 15357 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:29.957259  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:29.890556 15500 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:29.935587  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:29.914456 15365 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:29.972047  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:29.880004 15441 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:29.956880 15141 raft_consensus.cc:686] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:29.974004  6228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2578) took 3489 ms (client timeout 1534 ms). Trace:
I20260812 19:24:29.912238 15504 consensus_queue.cc:1046] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.020s
I20260812 19:24:29.961459 15373 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17.
I20260812 19:24:29.962148 15185 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:29.957342 15438 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:29.975137 15185 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:29.975617 15185 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:29.870797 15341 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:29.977162 15440 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:29.951282 15132 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:29.964479 15499 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:29.979166 15499 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:29.979640 15499 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:29.965494 15485 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:29.971235 15411 consensus_queue.cc:260] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:29.982082 15411 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:29.974421 15141 consensus_queue.cc:237] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:29.983776 15143 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:29.926049 15503 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:29.984635 15503 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:29.985076 15185 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:29.987111 15185 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:29.990788  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:29.991068  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:29.991705  6470 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:29.974994 15504 raft_consensus.cc:3032] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:29.999985  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.000108  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.001698  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:29.974459  6228 rpcz_store.cc:269] 0812 19:24:26.484918 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:26.525365 (+ 40447us) service_pool.cc:227] Handling call
0812 19:24:29.973774 (+3448409us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b54000f4bd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:29.973917 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4967579520}
I20260812 19:24:30.018025  6353 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:29.991595  6464 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:30.012199  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:29.965559  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:30.019485  6347 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:30.024430  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:30.025077  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 59605us
I20260812 19:24:30.026870  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.029459  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.030200  6345 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:30.027168  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:30.032389  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.036116  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:30.037482  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.038219  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.031036  6464 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:30.043812  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:30.039000  6235 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:30.039192  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.046514  6236 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:29.991518 15500 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:30.050770  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:30.056967  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.059234  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.062858  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.064713  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:29.952710 15307 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260812 19:24:30.017058 15504 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:30.028115 15507 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
W20260812 19:24:30.081197  6416 connection.cc:232] RPC call timeout handler was delayed by -3.5821779321413487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260812 19:24:30.081605  6416 connection.cc:232] RPC call timeout handler was delayed by -3.5713779320940375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
I20260812 19:24:30.071722  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.077085  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:30.082171  6416 connection.cc:232] RPC call timeout handler was delayed by -3.5263779321685433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
I20260812 19:24:30.082230  6235 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:30.082403  6238 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
W20260812 19:24:30.082583  6416 connection.cc:232] RPC call timeout handler was delayed by -3.4690254440065473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260812 19:24:30.084227  6298 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:30.038462 15505 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:30.047472 15372 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:30.079942  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:30.084285  6416 connection.cc:232] RPC call timeout handler was delayed by -3.4236954830121249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
W20260812 19:24:30.092092  6416 connection.cc:232] RPC call timeout handler was delayed by -3.394831407815218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
I20260812 19:24:30.093395  6353 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:30.093624  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.078599  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.085670  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:30.096071  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:30.096354  6416 connection.cc:232] RPC call timeout handler was delayed by -3.29417793196626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
W20260812 19:24:30.096797  6416 connection.cc:232] RPC call timeout handler was delayed by -3.2770779321435839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
W20260812 19:24:30.097101  6416 connection.cc:232] RPC call timeout handler was delayed by -3.2504211571067572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260812 19:24:30.097646  6416 connection.cc:232] RPC call timeout handler was delayed by -3.10714258486405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
I20260812 19:24:30.098683  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:30.099040  6416 connection.cc:232] RPC call timeout handler was delayed by -3.0528954828623682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
W20260812 19:24:30.099416  6416 connection.cc:232] RPC call timeout handler was delayed by -2.9513625029940158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260812 19:24:30.099690  6416 connection.cc:232] RPC call timeout handler was delayed by -2.9045625030994415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260812 19:24:30.094627  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:30.101405  6416 connection.cc:232] RPC call timeout handler was delayed by -2.8910625029820949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260812 19:24:30.101863  6416 connection.cc:232] RPC call timeout handler was delayed by -2.8865625029429793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260812 19:24:30.102157  6416 connection.cc:232] RPC call timeout handler was delayed by -2.8865625029429793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260812 19:24:30.102469  6416 connection.cc:232] RPC call timeout handler was delayed by -2.8028625031001866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
I20260812 19:24:30.086189  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2612) took 3331 ms. Trace:
I20260812 19:24:30.092202  6236 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:30.095067  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:30.102797  6416 connection.cc:232] RPC call timeout handler was delayed by -2.7634341111406684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260812 19:24:30.105387  6416 connection.cc:232] RPC call timeout handler was delayed by -2.7221888720523566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
I20260812 19:24:30.104717  6298 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:24:30.105706  6416 connection.cc:232] RPC call timeout handler was delayed by -2.7092625030782074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
I20260812 19:24:30.094424  6359 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
W20260812 19:24:30.106112  6416 connection.cc:232] RPC call timeout handler was delayed by -2.6325158390682191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260812 19:24:30.106446  6416 connection.cc:232] RPC call timeout handler was delayed by -2.6138625030871481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260812 19:24:30.106781  6416 connection.cc:232] RPC call timeout handler was delayed by -2.5859046888072044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260812 19:24:30.107087  6416 connection.cc:232] RPC call timeout handler was delayed by -2.5553625030443072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260812 19:24:30.103976  6483 rpcz_store.cc:276] 0812 19:24:26.756785 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:26.758188 (+  1403us) service_pool.cc:227] Handling call
0812 19:24:29.910602 (+3152414us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:24:29.910882 (+   280us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:29.921760 (+ 10878us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:24:29.945137 (+ 23377us) log.cc:842] Serialized 14 byte log entry
0812 19:24:30.085811 (+140674us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:30.085867 (+    56us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:30.085929 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:30.085996 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:30.086116 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":30339,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":105,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":1958,"spinlock_wait_cycles":8924032,"thread_start_us":140257,"threads_started":1}
I20260812 19:24:30.108330  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:30.107391  6416 connection.cc:232] RPC call timeout handler was delayed by -2.4699195930734277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260812 19:24:30.109020  6416 connection.cc:232] RPC call timeout handler was delayed by -2.3888625029940158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
W20260812 19:24:30.109298  6416 connection.cc:232] RPC call timeout handler was delayed by -2.3618625029921532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
I20260812 19:24:30.107918 15481 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:30.107813  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:30.109519  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:30.083614 15479 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:30.091204 15505 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:24:30.114180  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 125199us
I20260812 19:24:30.125551  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:30.109628  6416 connection.cc:232] RPC call timeout handler was delayed by -2.3575459888670594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
W20260812 19:24:30.132179  6416 connection.cc:232] RPC call timeout handler was delayed by -2.31793411122635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260812 19:24:30.132526  6416 connection.cc:232] RPC call timeout handler was delayed by -2.1800625030882657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2444s for a response
W20260812 19:24:30.132776  6416 connection.cc:232] RPC call timeout handler was delayed by -2.1667459888849407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260812 19:24:30.133011  6416 connection.cc:232] RPC call timeout handler was delayed by -2.0864625030662864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2548s for a response
I20260812 19:24:30.133831  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:30.096136 15143 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:30.144078  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:30.138834  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.143669  6352 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260812 19:24:30.147348  6352 pending_rounds.cc:76] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 7
I20260812 19:24:30.147672  6352 pending_rounds.cc:97] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260812 19:24:30.147966  6352 raft_consensus.cc:2866] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:30.146760  6345 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:30.109226 15372 raft_consensus.cc:686] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:30.159901  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:30.164244  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.165901  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:24:30.174384  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 9444dc5105264169a510f4261e7a1f40, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.173318  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:30.174806  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 9444dc5105264169a510f4261e7a1f40, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.136243 15341 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:30.154392 15400 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:30.154085 14889 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:30.179610  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:30.137588 15505 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:30.124475 14622 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.221294 14622 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:30.229143 15047 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.157765 15485 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:30.172766 15503 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:30.197746  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.198818  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:30.199043  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:30.199725  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:30.200560  7607 raft_consensus.cc:2354] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17.
I20260812 19:24:30.197367  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:30.211863 15438 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:30.126737 15481 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.195336 15400 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:30.158481 15143 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.183498 15372 consensus_queue.cc:237] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.174440 15141 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:30.236106  6354 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: []
W20260812 19:24:30.236757  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 139104us
I20260812 19:24:30.258594  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.260222  6179 leader_election.cc:398] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17.
W20260812 19:24:30.241784  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44550.9us
I20260812 19:24:30.127094 15479 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.161183 15268 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:30.255393  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 89639.9us
I20260812 19:24:30.129503 15504 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.265300  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:30.245724 15357 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:30.246006 15219 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260812 19:24:30.254835 15509 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260812 19:24:30.262910  6465 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:30.261461  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:30.254383 15400 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:30.271620  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:30.273022  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:30.274910  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:30.270824 15219 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:30.270440 15357 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:30.276666 15447 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260812 19:24:30.290318  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 112916us
W20260812 19:24:30.292596  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 171791us
I20260812 19:24:30.278965 15219 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:30.279036 14815 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:30.312582 15528 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:30.313231 15528 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:30.313711 15528 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
W20260812 19:24:30.278048 15132 consensus_queue.cc:1159] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a1541d11be514114966dc1e92a345298" responder_term: 13 status { last_received { term: 13 index: 6 } last_committed_idx: 4 last_received_current_leader { term: 13 index: 6 } }
I20260812 19:24:30.327687  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.295946 15357 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:30.326445  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:30.291630 15504 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:30.341605  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:30.340406  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.344776  6236 raft_consensus.cc:2396] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for term 18 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260812 19:24:30.344955  6344 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260812 19:24:30.348368  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 2661573faf994c8f9bb837f55af974d9, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:30.348822  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 2661573faf994c8f9bb837f55af974d9, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:30.349064  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 74235.4us
I20260812 19:24:30.325970 15485 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:30.360929  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.353160  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:30.362638  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:30.370177  6342 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:30.338488 14889 raft_consensus.cc:686] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:30.371093 15538 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:24:30.371490 14889 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.352156  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.373081 15538 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:30.376621  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:30.379479 15481 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:30.380344 15513 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260812 19:24:30.384130 15414 raft_consensus.cc:979] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:24:30.369613 15047 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:30.375686  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:30.350922 14815 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260812 19:24:30.391845  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet d0976a98f9404c3d8150d0de9a8b385c, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:30.392365  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet d0976a98f9404c3d8150d0de9a8b385c, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.398087  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:30.351845 15449 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:30.405053 15307 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:30.406839 15481 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:30.408952 15533 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:24:30.367790 15485 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:30.409235 15481 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:30.435909 15485 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:30.436040 15481 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:30.437655  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:30.384667 15414 raft_consensus.cc:1067] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Signalling peer bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:24:30.399935 15503 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:30.442534 15503 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:30.443019 15503 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:30.369246 15339 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260812 19:24:30.447276 15518 raft_consensus.cc:979] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:30.448695 15505 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:30.450021 15517 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260812 19:24:30.451174  7598 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:30.412002 15268 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:30.394670  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:30.453354  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:30.455714 14622 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:30.456846 15400 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.418397  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:30.457918  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:30.401364 15449 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:24:30.460218 15519 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.244s	user 0.004s	sys 0.001s
I20260812 19:24:30.461826 15500 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.462882 15449 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:30.459295 15487 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:30.378477 15499 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.467178 15499 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:30.467835  7603 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:30.459419  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:30.414951  6342 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:30.426115  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.426331 15494 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:30.429059  6349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2334) took 4404 ms (client timeout 1659 ms). Trace:
I20260812 19:24:30.431089 15340 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:30.435117  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:30.480213 15494 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.480677 15340 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.434965 15219 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.453352 15143 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:30.400027 15047 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:30.454702 15518 raft_consensus.cc:1067] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:30.480206  6228 raft_consensus.cc:2379] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:30.456929 15528 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:30.415112 15514 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.199s	user 0.000s	sys 0.006s
I20260812 19:24:30.420149 15479 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:30.458967  7599 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:24:30.474342  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:30.418999  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:30.479315 15458 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:30.483392 15047 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:30.492951 15047 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:30.493244 15500 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:30.480211  6349 rpcz_store.cc:269] 0812 19:24:26.024389 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:26.024944 (+   555us) service_pool.cc:227] Handling call
0812 19:24:30.428781 (+4403837us) spinlock_profiling.cc:243] Waited 2.74 s on lock 0x7b5400410fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:30.428945 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6294022016}
I20260812 19:24:30.494860 15531 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:30.495152 15340 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:30.498544  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 96575us
I20260812 19:24:30.485122  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:30.482486 15494 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:30.499559  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:30.455181 15481 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.504709  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:30.507877  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:30.502607  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:30.510083  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:30.511600  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.513065  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:30.514073  6345 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:30.486413 15307 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:30.514427  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:30.482995 15505 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:30.491387 15518 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:30.519876  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:30.518704  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:30.525938  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:30.500507 15507 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13.
I20260812 19:24:30.507295 15340 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:30.523036  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:30.511780 15447 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:30.505771 15479 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:30.507439 15500 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:30.515944 15268 raft_consensus.cc:2741] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260812 19:24:30.518757 15143 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:30.542363  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:30.543470  6353 raft_consensus.cc:2379] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:30.545351  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:30.533933 15537 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:30.527035 15185 consensus_queue.cc:1046] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260812 19:24:30.546460 15537 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:30.546582  6464 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:33386
I20260812 19:24:30.546986 15537 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:30.547226  6464 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:30.547603  6464 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:30.523985 15436 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:30.551116  6345 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:30.522606 15181 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:30.555753  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:30.577615  6353 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:30.582950  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:30.578574  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:30.583859 15507 consensus_queue.cc:1046] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 19:24:30.584299  6417 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:30.529245  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:30.585273  6464 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.538666 15219 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:30.590873 15440 raft_consensus.cc:3032] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:30.538996 15372 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:30.595671 15528 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:30.595957  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:30.548100 15340 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:30.555088  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:30.602669  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:30.589253 15537 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.607831  6352 raft_consensus.cc:2379] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 13: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:30.629861  6235 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:30.549219 15143 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:30.611725  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 82598.6us
I20260812 19:24:30.541378 15479 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:30.623776  6464 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:30.624157  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:30.530174 15540 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:30.552091 15436 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:30.529212 15532 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
I20260812 19:24:30.655179  6465 raft_consensus.cc:1226] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:30.633503  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:30.633519 15365 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:30.551739 15442 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260812 19:24:30.639585 15143 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:30.626602 14318 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:30.674351  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:30.622612 15307 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260812 19:24:30.577776 15500 raft_consensus.cc:686] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:30.619011 15141 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:24:30.616976 15440 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:30.619746 15372 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:30.626746 15535 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:30.666283  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:30.683357  7599 raft_consensus.cc:3032] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Stepping down as leader of term 12
W20260812 19:24:30.667619  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 144564us
I20260812 19:24:30.668524  6470 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:30.669438  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:30.634805  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:30.641508 15479 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:30.637984  7594 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260812 19:24:30.677572 15504 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:30.675289 14318 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:30.693614  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:30.676508  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:30.650816 15219 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:30.654911 15436 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:30.645551 15540 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:30.698558  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:30.678297 15141 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:30.702800  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.683825  7599 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:30.677959 15528 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:30.703944  6464 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:30.705530 15500 consensus_queue.cc:237] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.689249 15456 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:30.698072  6416 leader_election.cc:398] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14.
I20260812 19:24:30.715862  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.700098  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:30.717432  6416 leader_election.cc:401] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260812 19:24:30.701609  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.701995  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.717936  6232 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:30.683444 15372 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:30.677692  6353 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
I20260812 19:24:30.717293  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:30.679098 15400 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:30.716270  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:30.722990  6482 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:30.720901  6470 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:30.713003  6474 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:30.727233  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:30.716071  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.731912  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.733064  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.733300  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.734521 15449 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.736685  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:30.736944 15449 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:30.702592 15540 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:30.696492 14318 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:30.741794  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:30.742403  7594 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:30.699009 15442 raft_consensus.cc:2741] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260812 19:24:30.746912  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:30.747104  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:30.747942 15537 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:30.681666 15047 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.749890 15047 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:30.750443  7607 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:30.710397 15141 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:30.753142 15494 consensus_queue.cc:1046] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 19:24:30.754355 15494 raft_consensus.cc:3032] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:30.754739 15494 raft_consensus.cc:729] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:30.703260 15307 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260812 19:24:30.719684 15440 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.757745 15503 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.758838 15440 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:30.759500 15339 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:30.759935 15339 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:30.760812 15339 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.762171 15339 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:30.699009 15507 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:30.703830 15481 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:30.762902 15507 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:30.763159 15132 raft_consensus.cc:3032] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:30.763780  6470 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:30.763721 15132 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:30.764889 15132 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.766255 15132 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:30.710088 15528 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:30.766851 15528 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:30.768651  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.734289  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:30.769510  6241 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:30.767783 15494 consensus_queue.cc:260] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.770992  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.713296  7599 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:30.777029  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.777842  6224 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:30.779726  6224 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:53178
I20260812 19:24:30.780284  6224 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:30.780709  6224 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:30.697584 15504 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:30.712401 15357 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.782017 15504 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:30.763453 15507 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:30.782827  7599 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:30.783771 15357 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:30.784274 15408 consensus_queue.cc:1159] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "54f83319db6b49929cc8f18a66a66975" responder_term: 12 status { last_received { term: 12 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 12 index: 10 } }
I20260812 19:24:30.688084 15340 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.771847 15494 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:30.789079  6238 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:30.790539  6483 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:30.792052  6344 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:30.734525  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:30.818847  7594 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:30.828315  6235 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
I20260812 19:24:30.831161  6482 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
W20260812 19:24:30.848762  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 127805us
I20260812 19:24:30.857679  7607 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: [13.10-14.11]
I20260812 19:24:30.861183  7599 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:30.860903 15540 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.864220  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:30.873131  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:30.841629 14815 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14.
W20260812 19:24:30.790002 15441 consensus_queue.cc:1159] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdfa5579d4534c618c00db6b4a841c81" responder_term: 13 status { last_received { term: 12 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:24:30.827775 15479 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.843091 15485 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.847911 15372 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:30.915462  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 188318us
I20260812 19:24:30.931067  6298 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:30.934020  6417 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:30.935915  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:30.936913  6482 raft_consensus.cc:2379] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:30.944495  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:30.947288 15561 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:30.947983 15561 raft_consensus.cc:686] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:30.955168  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet f1b6d90aaa384b5fb66f3320981f1aa0, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:30.955631  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet f1b6d90aaa384b5fb66f3320981f1aa0, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.961304  6344 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260812 19:24:30.905395 15143 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:30.918071 15523 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:30.969538  6477 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:30.928601 15411 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:30.970691  6228 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:30.993456  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:30.983283 15408 consensus_queue.cc:1046] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260812 19:24:30.996613 15408 raft_consensus.cc:3032] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:30.997093 15408 raft_consensus.cc:729] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:30.969396 15307 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260812 19:24:31.003918 15479 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:31.005786 15372 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:30.993515  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.025709  6344 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:30.984870 15438 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:30.970279 15365 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
W20260812 19:24:31.071532 15555 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260812 19:24:30.948995 15561 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:31.065979  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:24:31.066465 15559 log.cc:924] Time spent T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260812 19:24:30.998235 15408 consensus_queue.cc:260] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:31.067646 15548 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260812 19:24:31.031720 15438 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:31.025839  6224 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:31.089355  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 52260.7us
W20260812 19:24:31.064263  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 214850us
I20260812 19:24:31.077028  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:30.985450 15523 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:31.091404  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:31.095774  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:31.096601  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:31.098872  6224 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:31.119556  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:31.128997 15485 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:31.132295 15507 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.133841 15540 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:31.119818 15531 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:31.140738  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:31.074628 15411 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:31.145509  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:31.078418 15365 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:24:31.152007  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 198695us
I20260812 19:24:31.157389  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:31.145130 15540 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:31.034278 15528 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.165709  6481 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260812 19:24:31.098788 15523 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:31.136763 15500 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:31.122354 15479 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:31.171717  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.135820 15531 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:31.134860 15503 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:31.134631 15507 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:31.176096  6482 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:31.141912 15143 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:31.174492  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.171582 15540 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:31.209642 14318 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:31.140686 15414 consensus_queue.cc:1159] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a1541d11be514114966dc1e92a345298" responder_term: 12 status { last_received { term: 12 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 12 index: 11 } }
I20260812 19:24:31.177748  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.206854  6470 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:31.222856  6477 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:31.215430  6465 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:31.179700  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.177066  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.219599  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:31.219791  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 49367.6us
I20260812 19:24:31.164354 15357 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:31.155140 15485 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:31.220624  6464 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:31.226226  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.155447 15408 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:31.220393  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:31.232059  7599 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
W20260812 19:24:31.224151  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 293184us
W20260812 19:24:31.207608 15436 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260812 19:24:31.168707 15546 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:31.229560 15528 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:31.235317  6483 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:31.235747  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:31.220162 15531 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:31.222416 15540 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:31.239820  6477 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:31.179337 15479 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:31.177448 15500 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:31.227900 15357 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:31.247320  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.227509 15485 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:31.208510 15504 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.237519 15546 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:31.244688 15479 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:31.282272  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.285467  6477 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:31.207082 15411 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:31.293383  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:31.294301  6473 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:31.295050  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.220861 15438 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.295490  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.296123 15438 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:31.296361  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.296658  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.297709  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:31.298900 15539 consensus_queue.cc:1159] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdfa5579d4534c618c00db6b4a841c81" responder_term: 13 status { last_received { term: 13 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 13 index: 7 } }
I20260812 19:24:31.299979 15504 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:31.272987 15357 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:31.301707  6060 catalog_manager.cc:5495] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:24:31.302867 15535 consensus_meta.cc:287] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.001s
I20260812 19:24:31.303339 15535 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:31.306052  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.304689  6060 catalog_manager.cc:5495] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 10 to 11, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 11 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:24:31.306896  6475 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:31.245042 15365 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:31.078387  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:31.307943  6060 catalog_manager.cc:5495] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 9 to 10, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 10 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:31.309881  6060 catalog_manager.cc:5495] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:24:31.295110  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:31.314735  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:31.300058  6055 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 120) took 16339 ms (client timeout 15000 ms). Trace:
I20260812 19:24:31.245352 15500 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:31.331274  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.273924 15485 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:31.238195 15436 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:31.344379  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 165450us
I20260812 19:24:31.279021 15546 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:31.348043  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.350078  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.350416  6475 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:31.335888  6465 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:31.353005  6477 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:31.353869  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:31.295511 14318 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:31.363049 15141 consensus_meta.cc:287] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.611s	user 0.002s	sys 0.009s
I20260812 19:24:31.364485  6483 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260812 19:24:31.369055  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:31.356359 15132 consensus_meta.cc:287] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.004s
I20260812 19:24:31.371479  6481 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
W20260812 19:24:31.374816 15586 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
I20260812 19:24:31.376248  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.376665  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.376950  6482 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
W20260812 19:24:31.377353 15494 consensus_meta.cc:287] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
I20260812 19:24:31.377494  6470 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:31.379525  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.379729 15141 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:31.380831  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.381902 15141 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:31.383013  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.383632  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:31.384244  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.384881  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:31.385588  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:31.386386  6482 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:31.391232  6236 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
W20260812 19:24:31.393532  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 143772us
I20260812 19:24:31.395123  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:31.398228  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.399050  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.400405  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:31.394140  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:24:31.367792 15440 consensus_meta.cc:287] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.001s
I20260812 19:24:31.387707  6060 catalog_manager.cc:5495] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 8 to 11, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 11 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:24:31.402891  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.406150  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.407156  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.413182  7594 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260812 19:24:31.317984  6055 rpcz_store.cc:269] 0812 19:24:14.961231 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:14.961510 (+   279us) service_pool.cc:227] Handling call
0812 19:24:31.299946 (+16338436us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:24:25.576611 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:24:25.649005 (+ 72394us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:24:25.649059 (+    54us) write_op.cc:435] Acquired schema lock
0812 19:24:25.649076 (+    17us) tablet.cc:660] Decoding operations
0812 19:24:25.650235 (+  1159us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:24:25.650364 (+   129us) write_op.cc:641] Partition lock acquired for write op
0812 19:24:25.650412 (+    48us) tablet.cc:683] Acquiring locks for 11 operations
0812 19:24:25.772843 (+122431us) tablet.cc:699] Row locks acquired
0812 19:24:25.772885 (+    42us) write_op.cc:260] PREPARE: finished
0812 19:24:25.773103 (+   218us) write_op.cc:270] Start()
0812 19:24:25.773263 (+   160us) write_op.cc:276] Timestamp: P: 1786562665773024 usec, L: 0
0812 19:24:25.773299 (+    36us) op_driver.cc:331] REPLICATION: starting
0812 19:24:25.774058 (+   759us) log.cc:842] Serialized 4301 byte log entry
0812 19:24:26.104546 (+330488us) op_driver.cc:444] REPLICATION: finished
0812 19:24:27.318149 (+1213603us) write_op.cc:301] APPLY: starting
0812 19:24:27.325181 (+  7032us) tablet.cc:1365] starting BulkCheckPresence
0812 19:24:28.415778 (+1090597us) tablet.cc:1368] finished BulkCheckPresence
0812 19:24:28.486345 (+ 70567us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:24:29.687762 (+1201417us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:24:29.773632 (+ 85870us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0812 19:24:29.787354 (+ 13722us) write_op.cc:312] APPLY: finished
0812 19:24:29.840079 (+ 52725us) log.cc:842] Serialized 105 byte log entry
0812 19:24:30.038980 (+198901us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:24:30.055042 (+ 16062us) write_op.cc:454] Released schema lock
0812 19:24:30.055163 (+   121us) write_op.cc:341] FINISH: Updating metrics
0812 19:24:30.055696 (+   533us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:24:30.064118 (+  8422us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1061114,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":1211914,"apply.run_cpu_time_us":185158,"apply.run_wall_time_us":2766666,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50173,"num_ops":11,"prepare.queue_time_us":775896,"prepare.run_cpu_time_us":11891,"prepare.run_wall_time_us":356769,"raft.queue_time_us":87992,"raft.run_cpu_time_us":19952,"raft.run_wall_time_us":828603,"replication_time_us":331136,"thread_start_us":1536966,"threads_started":5,"wal-append.queue_time_us":407807,"wal-append.run_cpu_time_us":15993,"wal-append.run_wall_time_us":2318411}]]}
I20260812 19:24:31.416436  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.414391  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.417193  6359 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:31.414856  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:31.415659  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.413089  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.414113  6350 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:31.418744  6350 raft_consensus.cc:595] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:31.419112  6350 raft_consensus.cc:603] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:31.422729  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.423525  6470 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:31.425524  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:31.426474  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:31.428206  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.419776  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:31.430316  6482 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
W20260812 19:24:31.431628 15590 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260812 19:24:31.432825  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:31.433645  6473 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:31.434355  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:31.435892  6416 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:31.441581  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.443387  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.450450  6344 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:31.455263  6349 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:31.458057  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:31.459072  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.461206 15141 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:31.461723 15141 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:31.462132 15141 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:31.462853  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.464131  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.466391  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.467212  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:31.467826 15132 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:31.468596  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:31.469805 15518 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:31.470145 15442 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:31.471915  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:31.472888 15339 consensus_meta.cc:287] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.710s	user 0.011s	sys 0.001s
I20260812 19:24:31.472709 15141 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:31.473218 15599 consensus_queue.cc:1046] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:31.410290 14318 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260812 19:24:31.474280 14318 consensus_queue.cc:1225] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260812 19:24:31.474393 15442 raft_consensus.cc:3032] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:31.474817  6232 raft_consensus.cc:2396] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260812 19:24:31.444469 15532 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:31.474978 15442 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:31.475474 15532 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:31.475858  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:31.476171 15442 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.477054  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.477756 15442 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:31.477834 15436 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:31.478583 15436 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:31.455952 15540 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.481837  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:31.457428  6359 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:31.475930 15532 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:31.492370  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:31.487612  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:31.500401  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:31.511698 15141 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:31.512264 15357 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.515714  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:31.442857 15498 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:31.519400  6060 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 8 to 10, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 10 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:24:31.529243  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:31.533722  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.479291 15436 raft_consensus.cc:686] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:31.537601  6416 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:31.491784 15535 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:31.540876  7607 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 9.
I20260812 19:24:31.516258 15181 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:31.602578 15181 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:31.604400 15181 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:31.608114  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 578169us
I20260812 19:24:31.610029  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.610707  6344 raft_consensus.cc:3032] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:31.611038  6344 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:31.611889  6344 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.612493 15372 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:31.613204 15372 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.613942  6344 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:31.613868  6242 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:31.615371 15372 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:31.619442 15339 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:31.619974 15339 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.620817  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.622074 15339 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:31.567175  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.580462 15268 consensus_queue.cc:1046] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:31.622642  6344 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:31.654897 15436 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.629443  6228 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260812 19:24:31.635454 15494 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260812 19:24:31.656847 15599 raft_consensus.cc:3032] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:31.657030  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.657346 15599 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:31.657684  6228 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:31.627441  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.659930  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.661226  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.634956  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:31.460551 15588 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.107s
I20260812 19:24:31.663208  6232 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:31.664157  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.664767  6232 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:31.636432 15339 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260812 19:24:31.623135  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.662374  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.671377  6224 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:31.672561  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:31.674407  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.623510  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.659467 15479 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.627908  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:31.637080  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.698830  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:31.704355  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 67356.7us
I20260812 19:24:31.704416  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.705420  6235 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:31.705807  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:31.707583  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.709563  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.710541  6229 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:31.636267 15531 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.695708  6224 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:31.718930 15531 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:31.720105  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.631108  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.669618 15540 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:31.630052 15523 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:31.722625  6241 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:31.705650  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.723802 15523 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:31.676102  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.536952 15357 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:31.576596 15143 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:31.658309 15599 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.682934  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:31.685837 15546 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:31.735213 15602 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.056s	user 0.004s	sys 0.001s
I20260812 19:24:31.742969  6345 raft_consensus.cc:595] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:31.743314  6473 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260812 19:24:31.563166  6060 catalog_manager.cc:5495] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 10 to 11, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 11 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:24:31.743773  6238 raft_consensus.cc:2379] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:31.627703  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.623118  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:31.703244  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 263891us
I20260812 19:24:31.745270  6236 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:31.537950 15528 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:31.724074  6224 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:31.731416  6344 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260812 19:24:31.666950  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.732371  6235 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:31.519378 15504 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:31.725847  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.736281  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:31.758220  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:31.738958  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:31.738481 15550 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.113s	user 0.000s	sys 0.011s
I20260812 19:24:31.759327  6229 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:31.741694 15479 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:31.734515 15555 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.196s	user 0.000s	sys 0.004s
I20260812 19:24:31.743389  6345 raft_consensus.cc:603] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:31.691534  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:31.766981  6464 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:31.723933 15339 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:31.528059 15561 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:31.749768  6417 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:31.694097  6232 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:31.753763  6242 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:31.755106  6465 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:31.755685  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.532768 15141 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:24:31.736727 15597 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.327s	user 0.005s	sys 0.000s
I20260812 19:24:31.741211  6228 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:31.760350  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.741444 14815 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:31.762957  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:31.785701  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:31.733139 15535 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:31.765303  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:31.777639 15561 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:31.771507  6344 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:31.735538 15132 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:24:31.532577 14889 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.224s
I20260812 19:24:31.752921 15540 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260812 19:24:31.786873  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:31.765044 15143 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:31.789968  6060 catalog_manager.cc:5495] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:24:31.816470  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:31.722908 15494 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:31.767517 15357 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:31.767840 15503 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:31.768731 15528 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:31.809105 15499 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:31.786283  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.758345 15400 consensus_queue.cc:1046] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260812 19:24:31.811175  6224 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:31.817757  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:31.786954 15569 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:31.819801  7594 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260812 19:24:31.796471 15535 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:31.789842 15440 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:31.787351 15479 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader election won for term 9
W20260812 19:24:31.849642  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 318674us
I20260812 19:24:31.823241  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:24:31.864593  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 78400.6us
I20260812 19:24:31.790889  6236 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:31.849232  6481 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:31.865442  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.787860 15504 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:31.809703 15561 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:31.791551 15531 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:31.860950  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:31.886133  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:31.820179 15132 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:31.868016 15546 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:31.895828  6229 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260812 19:24:31.896106  6465 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:31.896625  6236 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:31.896108  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.869112 15599 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:31.859153 15185 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:31.818143 15307 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:31.871292 15610 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
W20260812 19:24:31.873473 15500 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.521s	user 0.005s	sys 0.005s
I20260812 19:24:31.915108 15307 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:31.915650 15500 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.916396 15535 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.917129  6477 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:31.861569 15565 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:31.918395 15535 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:31.861173 15143 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:31.918285 15565 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.921031 15565 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:31.921618  6241 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:24:31.922264 15408 consensus_meta.cc:287] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.001s
I20260812 19:24:31.887749 15531 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:31.923472 15531 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:31.854876 15357 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.875545 15507 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:31.926849 15507 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:31.875864  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:31.928251  6345 raft_consensus.cc:595] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:31.929679 15507 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.932921 15507 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:31.933148  7599 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:31.933502  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.934368 15546 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:31.934711 15357 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:31.895632 15540 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:31.935145  7599 raft_consensus.cc:595] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.935575  7599 raft_consensus.cc:603] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:31.884125  6228 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:31.886360  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:31.937925  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 51669.7us
I20260812 19:24:31.939051  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.940331  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.940459  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:31.824322  6060 catalog_manager.cc:5495] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 5 to 8, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 8 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:31.888839  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:31.941180  6345 raft_consensus.cc:595] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:31.890293  6464 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:31.942410 15546 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:31.891413  6232 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260812 19:24:31.943070 15440 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:31.943548 15185 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:31.943851  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:31.944307 15440 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:31.944106 15185 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:31.944954 15440 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:31.945590  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:31.942276  6060 catalog_manager.cc:5495] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 7 to 8, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 8 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:31.891904  6235 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:31.854326 15449 consensus_queue.cc:1046] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260812 19:24:31.947124 15540 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:31.947806 15449 raft_consensus.cc:3032] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:31.948165 15449 raft_consensus.cc:729] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:31.948585  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:24:31.893437  6238 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:31.949080 15449 consensus_queue.cc:260] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:31.949002 15400 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:31.900843  6242 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:31.950734 15400 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:31.887388 15494 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:31.916437 15307 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:31.951771 15433 consensus_queue.cc:1159] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdfa5579d4534c618c00db6b4a841c81" responder_term: 14 status { last_received { term: 14 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 14 index: 10 } }
I20260812 19:24:31.952214 15307 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
W20260812 19:24:31.912094 15485 consensus_meta.cc:287] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260812 19:24:31.953018 15185 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:31.953394 15485 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.953982  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:31.954475  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.955542 15485 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:31.880036 15569 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.956390  6474 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:31.956730  6178 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:31.917886 15500 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:31.941720  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 52943.8us
I20260812 19:24:31.967518 15494 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:24:31.968350  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:31.969630  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:31.879019 15499 raft_consensus.cc:686] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:31.822093 14815 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:31.900317  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:31.970431 15485 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:31.970506 15500 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:31.972373 15485 raft_consensus.cc:686] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:31.972641 15499 consensus_queue.cc:237] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:31.973527 15485 consensus_queue.cc:237] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:31.974584 15494 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:24:31.975769 15565 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:31.976150 15565 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:31.976293  6483 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:31.946851  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.977892  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.956091 15504 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:31.957815 15569 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:32.001775  6475 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:31.911757 15600 raft_consensus.cc:3032] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:31.927075  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:31.915256 15610 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:31.955549  6229 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:31.882472 15479 raft_consensus.cc:686] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:31.950388 15449 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:31.959193 15185 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260812 19:24:31.959707  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60921.6us
I20260812 19:24:31.959771 15441 consensus_queue.cc:1046] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:24:31.966195  6241 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:31.950476  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:24:32.056640  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:31.981191  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:32.059355  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 78243.4us
I20260812 19:24:32.060932  7599 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260812 19:24:31.982136  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:24:32.062355  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 80362.8us
I20260812 19:24:32.051610  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:31.994725 15546 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:31.977070 15565 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.073289  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:31.996387  6473 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:31.999625  6477 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:32.005036  6465 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:32.013787  6482 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:32.024842 15531 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.063310  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:32.079948  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:31.989364  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:32.080408 15531 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:32.070627  6238 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260812 19:24:32.070638  6464 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:32.082933 15607 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:32.083178 15565 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:32.083539 15500 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:32.084204 15500 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:32.085275 15500 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.086844 15357 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:32.090992  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:32.094028 14815 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:32.094673 14815 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:32.004379 15600 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:32.077493  6474 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:32.073007  6417 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:32.071857  6345 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260812 19:24:32.047456 15532 consensus_meta.cc:287] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.003s
I20260812 19:24:32.099186 15523 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:32.044736 15504 raft_consensus.cc:686] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:32.120289  6483 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:32.106460  6481 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:32.108485  6229 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260812 19:24:32.108564  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:24:32.110471  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 121190us
I20260812 19:24:32.122844  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:32.124346  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:32.125243 15569 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:32.125598 15569 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:32.125790 15607 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:32.126024 15569 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:32.125623  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:32.127854  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:32.117439  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:32.067445 15400 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:32.101506 15456 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:32.128948  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:32.132588 15608 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260812 19:24:32.135025 15499 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260812 19:24:32.138978 15503 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:32.139501 15531 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:32.140208 15569 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.113592 15357 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:32.143683  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:24:32.216176  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 72675.4us
I20260812 19:24:32.111276 15507 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:32.128804 15610 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.102701 15540 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260812 19:24:32.188687 15339 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:32.142807 15505 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260812 19:24:32.213969 15185 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:32.140123 15479 consensus_queue.cc:237] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:32.153185 15607 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:32.201014 15504 consensus_queue.cc:237] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.202086 15600 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:32.246313  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:32.204344 15546 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:32.183310 15561 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.184654 15596 raft_consensus.cc:3032] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:32.253901  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:32.205868  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 47979.8us
I20260812 19:24:32.255995  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:32.256671  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:32.206481  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 77578.4us
I20260812 19:24:32.116452 15494 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:32.259169 15605 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260812 19:24:32.218544  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:32.259178 15494 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:32.261901 15494 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:32.221065  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:32.147050 15456 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:32.263734  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:32.223102  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:32.265755  6178 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:32.267055  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:32.270529  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:32.271354  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:32.225775  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 108401us
I20260812 19:24:32.223910  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:32.272408  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:32.227607 15610 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:32.227782  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:32.229125 15583 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:32.244124 15507 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:32.231724  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:32.190111 14815 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.116362 15532 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.242610  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:32.222095 15485 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:32.224072 15531 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:32.260280 15569 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:32.274609  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:32.301793 15485 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:32.302380 15531 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.302899 15485 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.303642 15132 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:32.303073  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:32.229210 14889 raft_consensus.cc:979] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:32.305269 14889 raft_consensus.cc:1067] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:32.305486  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:32.306425 15141 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:32.306334 15507 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.244949 15505 consensus_queue.cc:1225] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260812 19:24:32.283941  6242 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:32.286224 15181 consensus_queue.cc:1046] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:32.256321 15596 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:32.298282  6228 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:32.293112  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:32.315830  6345 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260812 19:24:32.317109  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:32.249869 15357 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:32.300150 15503 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:24:32.301023  6352 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:32.309763  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:32.319979  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:32.277042 15607 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:32.286523 15583 raft_consensus.cc:686] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:24:32.377717  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 59125.5us
W20260812 19:24:32.378995  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 69329.3us
I20260812 19:24:32.254577 15535 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260812 19:24:32.282126 15185 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:32.406442 14889 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260812 19:24:32.408139 15466 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:32.413837 15357 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:32.407908 15339 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:32.435277 15456 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:32.307183 15141 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:24:32.407994 15540 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:24:32.444012 15588 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:32.301491 15532 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:32.445892 15600 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:32.447999 15143 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:32.450431  6345 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:32.452244  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:32.423836 15400 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:32.465140  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:32.466615  6230 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260812 19:24:32.436774 15494 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.323587 15307 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260812 19:24:32.382496 15612 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260812 19:24:32.464349 15599 consensus_meta.cc:287] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.002s
I20260812 19:24:32.483510  7598 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:32.480671  6242 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:32.430339  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:32.315827 15436 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.169s
I20260812 19:24:32.539630  6470 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260812 19:24:32.494977  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:32.502859 15400 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.472433 15466 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:32.451107 15438 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260812 19:24:32.489068 15588 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.506453 15561 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:32.507193  6235 raft_consensus.cc:2396] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260812 19:24:32.472673 15357 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:32.482507 15546 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260812 19:24:32.483332 15608 raft_consensus.cc:3032] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Stepping down as leader of term 11
W20260812 19:24:32.527714  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:32.533082  6232 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260812 19:24:32.534842  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 104618us
I20260812 19:24:32.556327  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:32.531571 15141 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:32.558008  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:32.536360  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:32.486443 15181 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:32.550957  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:32.544448 15307 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:32.534714 15569 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:24:32.535363  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 70285.6us
I20260812 19:24:32.544040 15268 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:32.571354  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:32.587918  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:32.554258 15608 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:32.569864 15535 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:32.570050 15565 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:32.544431 15540 consensus_queue.cc:1046] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260812 19:24:32.547843 15499 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260812 19:24:32.572829 15503 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260812 19:24:32.597780  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 58299.5us
I20260812 19:24:32.583132 15339 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:32.572623 15561 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260812 19:24:32.584838 15185 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260812 19:24:32.597630 15565 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:32.572966 15181 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.607344 15414 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:32.643141 15494 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:32.642987 15414 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:32.570883 15583 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:32.645443 15414 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:32.622712 15535 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:32.647387 15634 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260812 19:24:32.647194 14889 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:32.648008 15365 consensus_queue.cc:1046] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:24:32.648228 15535 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.649487 15438 raft_consensus.cc:3032] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:32.649869 15438 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:32.625911 15143 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:32.626760 14318 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260812 19:24:32.650727 15438 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.626504 15268 raft_consensus.cc:686] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:32.653802 15268 consensus_queue.cc:237] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.625238 15507 raft_consensus.cc:3032] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:32.660763  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:32.665261  6350 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:32.627971 15607 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:32.674033  6352 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:32.639488 15565 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:32.682253  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:32.684415  6470 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:32.688180  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:32.689098  6236 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:32.663338 15507 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:32.691294  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 103479us
I20260812 19:24:32.691887  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:32.700810  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:32.700882  6350 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:32.700809  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:32.709733  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:32.664101 15143 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.711351  6353 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260812 19:24:32.687915 15607 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:32.675405 15436 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.029s
I20260812 19:24:32.710855 15658 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:32.641216 15608 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.751389  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:32.747272  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:32.753618  6483 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260812 19:24:32.753427  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 106533us
I20260812 19:24:32.754819  6236 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260812 19:24:32.754989  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:32.755410  6477 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:32.756867  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:32.757012  6352 raft_consensus.cc:2396] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260812 19:24:32.752643  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:32.758793  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:32.760648  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:32.712735 15466 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:32.747373 15400 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:32.767362  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:32.768476  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:32.749684 15357 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:32.751022 15588 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:32.744518 15185 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260812 19:24:32.756585 14889 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:32.824229  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:32.827090  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:32.834765  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:32.836089  6342 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:32.761125 15658 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:32.762097 15535 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:32.814051 15449 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:32.813838 15653 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:32.780431 15440 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260812 19:24:32.834162 15608 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:32.841854 15357 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:32.841341 15507 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.853113 15658 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:32.854084 15648 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260812 19:24:32.852180 15449 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:32.846467 15339 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:32.842991 15588 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.019s
I20260812 19:24:32.858263 15357 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:32.843518 14889 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.939182 15181 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:32.952028 15644 log.cc:924] Time spent T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260812 19:24:32.952617 15651 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
W20260812 19:24:32.953251 15650 log.cc:924] Time spent T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260812 19:24:32.955752 15438 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:32.958612 15143 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:32.855813 15653 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:32.856098 15607 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:32.857015 15185 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.089s
I20260812 19:24:32.960745 15365 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:32.964205  6350 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:32.941253 15449 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:32.848922 15535 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:32.993223 15639 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
W20260812 19:24:33.034971  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 192490us
I20260812 19:24:32.856009 15660 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.147s
I20260812 19:24:33.002055 15357 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
W20260812 19:24:33.070945  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 309448us
W20260812 19:24:33.069845  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 369092us
I20260812 19:24:33.017298 15600 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:33.062696 15143 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:33.078722  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 323804us
I20260812 19:24:33.077093 15538 raft_consensus.cc:979] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:33.082218  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:33.094116  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:33.099181  6236 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260812 19:24:33.101603  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:33.102197  6236 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260812 19:24:33.106158  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:33.063082 15365 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.115746 15646 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:33.118391  6228 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260812 19:24:33.115818  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:33.121438  6230 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
W20260812 19:24:33.123018  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 46536.1us
I20260812 19:24:33.125967  6224 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260812 19:24:33.143476  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:33.144587  7594 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:33.149408  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:33.152516  6359 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260812 19:24:33.112766 15339 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:33.082362 15600 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:33.162977  6470 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:33.105044 15440 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260812 19:24:33.104509 15185 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260812 19:24:33.145809 15583 raft_consensus.cc:1067] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:33.097855 15143 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:33.216611  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 130932us
I20260812 19:24:33.286134  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:33.178990 15339 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:33.130589 15646 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:33.211592 15503 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:33.183084 15660 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:33.304466  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:33.347334  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 129676us
W20260812 19:24:33.349565  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 200265us
I20260812 19:24:33.376686  7599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 665) took 1108 ms. Trace:
I20260812 19:24:33.377290  7599 rpcz_store.cc:276] 0812 19:24:32.268053 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:32.279238 (+ 11185us) service_pool.cc:227] Handling call
0812 19:24:32.279614 (+   376us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:32.280012 (+   398us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:32.280043 (+    31us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:32.290133 (+ 10090us) log.cc:842] Serialized 52 byte log entry
0812 19:24:32.558992 (+268859us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:32.588159 (+ 29167us) log.cc:842] Serialized 14 byte log entry
0812 19:24:32.588393 (+   234us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:32.588481 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:33.376342 (+787861us) raft_consensus.cc:1671] finished
0812 19:24:33.376375 (+    33us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:33.376606 (+   231us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":29808,"raft.queue_time_us":954,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":16144,"spinlock_wait_cycles":3844352,"thread_start_us":235389,"threads_started":1,"wal-append.queue_time_us":293398}
I20260812 19:24:33.444056  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:33.376557 15500 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:33.391723 15605 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:33.442059 15528 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:33.376158 15653 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:33.427670 14889 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:33.456115 15535 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:33.472172 15605 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:33.468307 15181 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:33.377683 15660 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.504618 15672 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:33.506368 15600 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:33.486711 15674 raft_consensus.cc:3032] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:33.489656 15339 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:33.528856  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:33.472679 15500 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.503343 15605 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:33.481171 15528 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.554975 15701 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:33.565718 15690 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:33.573189 15565 consensus_meta.cc:287] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.880s	user 0.010s	sys 0.002s
I20260812 19:24:33.544009 15143 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:33.581132 15500 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:33.566445 15705 consensus_queue.cc:1046] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260812 19:24:33.515298 15674 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:33.508648 15365 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:33.564680 15673 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.411s	user 0.001s	sys 0.000s
I20260812 19:24:33.511106 15672 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:33.500823 15440 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:33.563269  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:33.697207  6349 raft_consensus.cc:595] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
W20260812 19:24:33.696375 15449 consensus_meta.cc:287] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.004s
I20260812 19:24:33.697621  6349 raft_consensus.cc:603] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:33.698176 15449 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:33.698523 15503 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:33.699337 15503 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.699780 15440 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.701822 15449 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:33.697412 15672 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.702325 15440 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:33.683076  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.066s	sys 0.098s
W20260812 19:24:33.703059  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.066s	sys 0.099s
I20260812 19:24:33.703600  7599 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:33.703871 15503 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:33.704313  7599 raft_consensus.cc:595] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:33.707937  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:33.528887 15479 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:33.708667  6349 raft_consensus.cc:595] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
W20260812 19:24:33.565299 15691 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260812 19:24:33.564535 15681 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260812 19:24:33.714672  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 270900us
I20260812 19:24:33.568089 15660 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:33.567222 15692 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260812 19:24:33.628948 15456 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:33.713685  6349 raft_consensus.cc:603] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:33.632779 15565 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.772331 15646 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:33.760562 15181 consensus_queue.cc:1046] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260812 19:24:33.783887 15706 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:33.784365 15565 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:33.784590 15706 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:33.763623 15438 consensus_meta.cc:287] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.716s	user 0.013s	sys 0.001s
I20260812 19:24:33.788360  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2405) took 1128 ms. Trace:
W20260812 19:24:33.733508  6175 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.005s	sys 0.001s
W20260812 19:24:33.791298  6175 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.006s	sys 0.001s
I20260812 19:24:33.520881 15219 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:33.682585 15653 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:33.691409 15143 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:33.712648 15433 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:33.709599 15500 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:33.765527  6475 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.016s	sys 0.009s
I20260812 19:24:33.554586 15339 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:33.760742 15651 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.000s	sys 0.027s
I20260812 19:24:33.529197 15716 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:33.774935  7598 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.011s	sys 0.020s
I20260812 19:24:33.717716 15479 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:33.793196  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.053s	sys 0.084s
I20260812 19:24:33.820983  6347 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:33.799782 15600 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:33.800169  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 44570.4us
I20260812 19:24:33.628412 15701 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:33.805058 15658 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:33.720893 15365 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
W20260812 19:24:33.809355  6475 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.017s	sys 0.009s
I20260812 19:24:33.683734 15690 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.797202 15565 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:33.797477 15660 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:33.908891 15660 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.910540 15588 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260812 19:24:33.821408  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.053s	sys 0.084s
I20260812 19:24:33.910864 15709 consensus_queue.cc:1046] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:33.911137 15181 consensus_queue.cc:1046] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260812 19:24:33.822135  7598 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.011s	sys 0.020s
I20260812 19:24:33.805403 15653 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.912535 15438 raft_consensus.cc:3032] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:33.912781 15675 raft_consensus.cc:3032] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:33.912936 15438 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:33.913319 15675 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:33.913694 15653 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:33.803267 15219 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:33.913966 15438 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.915302 15438 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:33.915794 15219 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:33.915431 15596 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:33.788769  6232 rpcz_store.cc:276] 0812 19:24:32.660021 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:32.660234 (+   213us) service_pool.cc:227] Handling call
0812 19:24:32.677891 (+ 17657us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:32.678298 (+   407us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:32.678352 (+    54us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:32.687498 (+  9146us) log.cc:842] Serialized 26 byte log entry
0812 19:24:32.994337 (+306839us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:32.994387 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:32.994461 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:33.788122 (+793661us) raft_consensus.cc:1671] finished
0812 19:24:33.788144 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:33.788289 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":5791,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":14603,"thread_start_us":306425,"threads_started":1,"wal-append.queue_time_us":383892}
W20260812 19:24:33.804270  7594 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.018s	sys 0.038s
I20260812 19:24:33.917510  6345 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Stepping down as leader of term 13
W20260812 19:24:33.917706  7594 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.018s	sys 0.038s
I20260812 19:24:33.918025  6345 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:33.825681  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:33.813746 15500 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:33.918912  6345 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.920603 15500 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:33.827725 15339 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:33.835353 15722 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:33.835379  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:33.835711  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2193) took 1083 ms. Trace:
W20260812 19:24:33.829095 15631 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.153s	user 0.004s	sys 0.015s
I20260812 19:24:33.837294 15185 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:33.837276 15600 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:33.813115 15651 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.000s	sys 0.028s
I20260812 19:24:33.839020  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:33.809877 15143 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:33.812453 15433 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:33.840186 15701 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:33.951438  6230 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:33.841055 15528 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:33.771699 15674 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.843248  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2393) took 1213 ms. Trace:
I20260812 19:24:33.843696  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:33.847405  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:33.952096  6347 raft_consensus.cc:595] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:33.851547  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2400) took 1631 ms. Trace:
I20260812 19:24:34.073807  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.074502  6347 raft_consensus.cc:603] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:34.068523  6354 rpcz_store.cc:276] 0812 19:24:32.630192 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:32.630521 (+   329us) service_pool.cc:227] Handling call
0812 19:24:32.630943 (+   422us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:32.646427 (+ 15484us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:24:32.707614 (+ 61187us) log.cc:842] Serialized 14 byte log entry
0812 19:24:33.080324 (+372710us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:33.087299 (+  6975us) log.cc:842] Serialized 26 byte log entry
0812 19:24:33.087493 (+   194us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:33.087551 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:33.087659 (+   108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:33.843034 (+755375us) raft_consensus.cc:1671] finished
0812 19:24:33.843062 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:33.843199 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":62829,"prepare.queue_time_us":133443,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":10646,"raft.queue_time_us":44770,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":9351,"thread_start_us":384829,"threads_started":2,"wal-append.queue_time_us":460336}
I20260812 19:24:34.076112  6235 rpcz_store.cc:276] 0812 19:24:32.220615 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:32.220785 (+   170us) service_pool.cc:227] Handling call
0812 19:24:33.851273 (+1630488us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54000febd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:33.851466 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":560730880}
I20260812 19:24:34.081354  6345 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:34.061070  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:33.949860  6232 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:34.088546  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:33.937918  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.090797  6229 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:34.092330  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:34.092603  6473 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260812 19:24:34.092710  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 154345us
I20260812 19:24:34.094616  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.094928  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:33.911535  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 742175us
I20260812 19:24:33.950109  6242 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:53178
I20260812 19:24:33.971712  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:33.943899  6236 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:34.143049 15669 raft_consensus.cc:465] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Not starting pre-election -- already a leader
I20260812 19:24:33.979772 15143 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.143805 15749 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:33.908341 15365 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:34.064042  6228 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260812 19:24:34.145144  6228 pending_rounds.cc:76] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 10
I20260812 19:24:34.145267 15741 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:34.144899 15749 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.146308 15741 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.902743 15436 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260812 19:24:34.002465 15504 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:34.009828 15507 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:34.151081 15436 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:34.150815 15504 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.151602 15436 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:34.153273 15436 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.154007 15504 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:33.821081 15479 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.144908 15365 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:34.156253  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.157383  6235 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:33.810097 15503 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:33.850600 15518 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:34.010612 15610 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:34.160964 15518 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:34.161140 15610 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:34.163125 15518 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.163268 15610 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.165002 15518 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:34.166028 15610 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:34.018436 15672 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:33.971058 15674 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:33.914167 15675 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.175199  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.166474  6483 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:34.176322  6481 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:34.176505 15675 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:34.177625  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:34.021272 15679 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.905s	user 0.001s	sys 0.008s
I20260812 19:24:34.179010  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2240) took 1342 ms. Trace:
I20260812 19:24:34.179562  6350 rpcz_store.cc:276] 0812 19:24:32.763014 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:32.763130 (+   116us) service_pool.cc:227] Handling call
0812 19:24:32.963913 (+200783us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:33.046035 (+ 82122us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:34.070380 (+1024345us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b5400408dd0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:34.105322 (+ 34942us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":460905856}
I20260812 19:24:33.811961 15686 consensus_queue.cc:1046] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260812 19:24:34.183854 15686 raft_consensus.cc:3032] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:34.184070 15749 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.184350 15686 raft_consensus.cc:729] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:34.187372  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2192) took 1435 ms. Trace:
I20260812 19:24:34.187973  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:34.187860  6475 rpcz_store.cc:276] 0812 19:24:32.751742 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:32.751890 (+   148us) service_pool.cc:227] Handling call
0812 19:24:32.762509 (+ 10619us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:32.762810 (+   301us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:32.762840 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:32.823338 (+ 60498us) log.cc:842] Serialized 26 byte log entry
0812 19:24:33.070624 (+247286us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:33.182600 (+111976us) log.cc:842] Serialized 14 byte log entry
0812 19:24:33.856333 (+673733us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:33.856453 (+   120us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:34.018759 (+162306us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b18001616e0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:24:34.020341 (+  1582us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:34.186822 (+166481us) raft_consensus.cc:1671] finished
0812 19:24:34.186866 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:34.187148 (+   282us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":125,"prepare.queue_time_us":58143,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":292299,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"spinlock_wait_cycles":20118656,"thread_start_us":962103,"threads_started":3,"wal-append.queue_time_us":273171}
W20260812 19:24:33.982057 15687 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.437s	user 0.000s	sys 0.001s
I20260812 19:24:34.143083 15400 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:34.191303 15400 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:33.982348 15690 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.192229 15181 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:33.846220 15702 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:33.851606 15706 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:34.194339  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 134040us
W20260812 19:24:33.983949 15707 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260812 19:24:33.905385 15710 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.159628 15503 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.197782 15710 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.200663 15503 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.200812 15710 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:33.836760 15711 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:33.860448 15716 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.177641  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.202876 15504 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.203562 15504 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.204540  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.205052 15716 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.016170 15717 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:33.907815 15732 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:33.921613 15722 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.981711 15735 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:33.998972 15736 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:34.013931 15746 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.080705  6354 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:33.922070  6474 rpcz_store.cc:276] 0812 19:24:32.752072 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:32.753014 (+   942us) service_pool.cc:227] Handling call
0812 19:24:32.767845 (+ 14831us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:32.860142 (+ 92297us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:32.860183 (+    41us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:32.939869 (+ 79686us) log.cc:842] Serialized 52 byte log entry
0812 19:24:33.080902 (+141033us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:33.439945 (+359043us) log.cc:842] Serialized 14 byte log entry
0812 19:24:33.440190 (+   245us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:33.440298 (+   108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:33.835452 (+395154us) raft_consensus.cc:1671] finished
0812 19:24:33.835475 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:33.835647 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15152,"prepare.queue_time_us":439256,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":6329,"raft.queue_time_us":164039,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":3953,"thread_start_us":451765,"threads_started":3,"wal-append.queue_time_us":212704}
I20260812 19:24:33.949833 15185 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:24:33.964452 15357 consensus_meta.cc:287] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.887s	user 0.014s	sys 0.000s
I20260812 19:24:33.885445 15440 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.014576 15494 raft_consensus.cc:3032] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:33.980261 15540 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:33.907114 15565 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.823732 15583 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:33.916668 15596 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:33.951122 15605 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:33.848431 15608 consensus_meta.cc:287] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.990s	user 0.013s	sys 0.000s
I20260812 19:24:33.880936 15658 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:33.911195 15660 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:33.936532  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:34.061491  6224 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260812 19:24:34.113996  6470 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:34.117352  6473 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:34.116521  6342 raft_consensus.cc:595] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:34.132112 15731 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.193097 15400 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.206136 15504 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.140244  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:34.219799  6349 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:34.252107  6464 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:34.253424  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.253796 15702 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:34.143260 15532 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.254138 15746 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:34.254571 15702 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.255100 15532 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.255688  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.256438  6470 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:34.145545  6228 pending_rounds.cc:97] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260812 19:24:34.251802 15339 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.257997  6228 raft_consensus.cc:2866] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:34.258478 15339 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:33.967339 15528 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260812 19:24:34.259820  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:33.978063 15600 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.180253 15750 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:34.261642  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.261824  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:33.984022 15433 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.023531 15684 raft_consensus.cc:3032] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:34.146842 15438 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.263280 15684 raft_consensus.cc:729] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:34.263733  6477 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:34.264437 15307 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:34.265558  6477 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:34.265066 15684 consensus_queue.cc:260] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.265754 15357 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:34.266799 15684 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:34.257692 15532 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.271270 15565 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.262848 15702 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.246503 15731 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.274004  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:34.274755  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.275213  6236 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:34.276103 15494 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:34.276506  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:34.277532  6235 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:34.135087  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:34.178465  6481 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:34.205425  6483 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:34.216526  6230 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:34.216877  6242 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:34.215721  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.245198 15722 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.245780 15400 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:34.247181 15607 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.246570 15736 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:34.248607 15440 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.206526 15717 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:34.250296  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 52593.4us
I20260812 19:24:34.251045 15725 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:24:34.298319  6344 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260812 19:24:34.202239 15711 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:34.252028 15605 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.258337 15583 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:34.206614 15732 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:34.220541  6232 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:34.280824 15357 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:34.213424 15365 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.232617 15706 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.263680 15438 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:34.282992  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.186017 15686 consensus_queue.cc:260] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.320925 15706 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.261435 15339 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:34.258455 15746 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:34.229606  6465 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:34.324133 15438 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:34.290406  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.324607  6465 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:34.262550  6228 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:34.279565  6242 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:34.263525  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.290279 15132 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.293464 15607 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.295456 15436 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:34.329528  6228 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:53178
I20260812 19:24:34.330186  6228 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:34.330432 15607 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.331419  6238 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:34.331846 15185 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.333408 15706 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.334204 15440 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.335000 15132 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.335438  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.336377  6349 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:34.336620  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.337375 15132 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.330595  6228 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:34.296710 15736 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:34.218978  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.290333  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:34.274113 15679 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260812 19:24:34.265111  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.257614  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.309175 15588 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.311645  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:34.312295  6474 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:34.315726 15732 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:34.321111 15722 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:34.321739 15357 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:34.286689  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:34.359659 15357 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:34.360139 15357 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:34.324930  6464 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
W20260812 19:24:34.320897  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 209611us
I20260812 19:24:34.325796  6224 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:34.329135  6482 raft_consensus.cc:2396] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260812 19:24:34.329288  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.361869  6465 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:34.341653  6477 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:34.324476 15365 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:34.343217  6241 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:34.347007 15741 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.277863 15494 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.347148  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.338778  6347 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:24:34.316455 15711 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:34.357249  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.358361 15722 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.367568  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:24:34.368127 15143 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.368616 15588 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.369524  6464 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:34.387054  6224 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:34.387632  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.369889  6470 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:34.370620  6229 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:24:34.370908  6354 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:34.371381  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.371573 15736 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:34.372080  6230 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:34.372995  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:34.373839 15583 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:34.354054 15658 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:34.374480  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 63100.2us
I20260812 19:24:34.374738 15438 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:34.375898  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.396828  6352 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:34.366458  6342 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:34.376500  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.378304 15706 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.388697  6242 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.394428  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.406219  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.411152 15494 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:34.413604  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:34.414996  6474 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:34.415189  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:34.415233 15268 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:34.416118  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.416428 15268 raft_consensus.cc:3032] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:34.416874 15268 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:34.416916  6474 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:34.408571  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:34.418833 15711 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.396301 15438 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:34.419461 15438 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:34.420895 15736 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.421540 15736 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.393872 15143 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.423713 15736 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.426154  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 2194) took 1673 ms. Trace:
I20260812 19:24:34.426614  6482 rpcz_store.cc:276] 0812 19:24:32.752366 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:32.753100 (+   734us) service_pool.cc:227] Handling call
0812 19:24:34.425886 (+1672786us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b540003c5d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:34.426067 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3553353600}
I20260812 19:24:34.432040  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.408833  6228 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.418424  6474 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260812 19:24:34.435117  6470 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:34.434981 15706 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.436460  6470 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:34.438077  6470 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260812 19:24:34.427067 15731 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.428807  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:34.429139 15709 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:34.440294 15709 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:34.440397 15600 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:34.440706 15709 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:34.419456 15711 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.440671  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:34.447526  6464 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:34.429903 15686 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:34.408878  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:34.440902 15600 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:34.450264 15600 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:34.450011  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2392) took 1881 ms. Trace:
I20260812 19:24:34.450870  6344 rpcz_store.cc:276] 0812 19:24:32.569166 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:32.569384 (+   218us) service_pool.cc:227] Handling call
0812 19:24:32.569795 (+   411us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:34.299958 (+1730163us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:34.446884 (+146926us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b540036e054. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:34.449944 (+  3060us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3971428096}
I20260812 19:24:34.453084  6228 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.454077 15143 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.455291 15717 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.456681 15588 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.458401 15706 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.467011 15722 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.467604 15583 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:34.468101 15583 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:34.468525 15583 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:34.471091 15588 consensus_queue.cc:1046] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:34.472271 15588 consensus_queue.cc:1225] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer bdfa5579d4534c618c00db6b4a841c81 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260812 19:24:34.473001 15608 raft_consensus.cc:3032] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:34.473385 15608 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:34.473954 15711 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.474390 15608 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.475742 15608 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:34.476760  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:34.479720 15667 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:34.480163 15667 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:34.480568 15667 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:34.491744  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.493781  6474 raft_consensus.cc:2379] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 11: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:34.494318  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.495324  6473 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:34.496220  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.495982  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.497104  6473 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:34.497581  6474 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:34.498155  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:34.502357  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet d1275ccc06f94fcdaa82a73420569651, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.504101  6345 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260812 19:24:34.507426  6353 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:34.418004 15268 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.515447 15438 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.530393  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:34.539871  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.496340  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.563745  6483 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:34.568305 15607 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:34.568918 15339 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:34.572899 15702 consensus_queue.cc:1046] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:34.573769 15440 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:34.574663  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:34.575496 15741 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.576327 15653 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.577700  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.577996  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.502126 15709 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.581413 15458 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.525719  6477 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:34.536355  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.590076 15596 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:34.631825 15599 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260812 19:24:34.637221 15440 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.642701 15458 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:34.643267 15596 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:34.636261 15653 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.645138 15440 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.645524 15596 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:34.638397  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 108297us
I20260812 19:24:34.634433 15741 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.648147 15711 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:34.648890 15741 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.639170 15268 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:34.650704  6228 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:34.651079 15711 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:24:34.636436 15607 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:34.652482  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.653304  6347 raft_consensus.cc:2354] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 14. Current term is 15.
I20260812 19:24:34.654927 15607 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:34.650985  6349 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260812 19:24:34.641654 15438 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.655303  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:34.636754  6229 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:34.646160 15653 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.636411 15339 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:34.636942  7594 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:34.660562 15339 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:34.637890 15722 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:34.662276  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:34.662978  6236 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:24:34.667519 15596 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:34.668598 15596 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:34.669617 15731 raft_consensus.cc:3032] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:34.602212  6235 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:34.603088  6242 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:34.598971  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet d1275ccc06f94fcdaa82a73420569651, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.620299  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:34.670783  6232 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:34.618721  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2389) took 2076 ms. Trace:
I20260812 19:24:34.667646  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:34.544088 15583 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.671700  7598 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
W20260812 19:24:34.675163  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55349.5us
I20260812 19:24:34.676362  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:34.677460  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:34.677704 15607 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:34.671366  6345 rpcz_store.cc:276] 0812 19:24:32.535224 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:32.536060 (+   836us) service_pool.cc:227] Handling call
0812 19:24:32.550576 (+ 14516us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:33.917400 (+1366824us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b540024a020. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7708730 00007f98f777a300 00007f98f777b371 00007f98f7777edf 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc
0812 19:24:34.080642 (+163242us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5800711eb0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f76f3f63 00007f98f7757aba 00007f98f776f3af 00007f98f7770b4e 00007f98f777ac89 00007f98f777b556 00007f98f7777edf 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684
0812 19:24:34.599105 (+518463us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:34.611557 (+ 12452us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":420903936}
I20260812 19:24:34.676388 15653 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:34.681651  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:34.589689 15357 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:34.689121  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 62332.8us
I20260812 19:24:34.670049 15731 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:34.698753  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:34.700862  6350 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260812 19:24:34.678166 15607 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:34.680300 15653 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:34.702085 15607 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:34.702240 15653 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:34.704757 15731 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.688246 15339 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:34.681399 15658 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:34.708046 15339 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:34.716635  7598 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:34.693578 15438 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:34.721547  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:34.706562 15731 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:34.727442  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:34.735749  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.736004  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:34.719233 15339 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:34.724408 15438 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:34.751104 15440 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:34.751822 15440 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:34.752388 15440 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:34.755110  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.755574  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.756301  6349 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:34.757474  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:34.757983  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.759061  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.759845  6352 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:34.760682  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.761267  6352 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:34.762547  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.744415  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.767475  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:34.769222  6352 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260812 19:24:34.751174 15709 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:34.748400 15518 consensus_meta.cc:287] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.583s	user 0.017s	sys 0.001s
I20260812 19:24:34.748745 15438 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:34.789208  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.783449 15702 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.795634 15185 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:34.796002 15702 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:34.796468 15185 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.802350  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.804540  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.807322 15185 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.808967 14889 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:34.809448 14889 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:34.809790 14889 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:34.737644 15658 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:34.811411 15667 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.812631 15583 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.803608  6347 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:34.813738  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.811905 15357 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:34.813737 15667 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.824822  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.831446  6345 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:34.835143  6342 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:34.784914 15596 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.837222 15702 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:34.853855 15672 consensus_meta.cc:287] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.004s
I20260812 19:24:34.869107  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.851799 15268 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:24:34.867156 15771 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.123s	user 0.000s	sys 0.002s
I20260812 19:24:34.896219  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.897414  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.898149  6235 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:34.901029  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.901839  6352 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:34.903234  6228 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:34.904446  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.905112  6228 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:34.906428  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.906980  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.907652  6236 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:34.908921  6228 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260812 19:24:34.911562  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.878742 15658 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:34.910336  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.915191  6354 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260812 19:24:34.918856  6242 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:34.920351  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:34.920890  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 58238.6us
I20260812 19:24:34.922962  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.924345  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.917935  6055 catalog_manager.cc:5495] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:34.925086  6230 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:34.925539  6238 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260812 19:24:34.926982 15718 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260812 19:24:34.927798  6232 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260812 19:24:34.928432 15458 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:34.937242  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.939528  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.940310  6241 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:34.940243  6352 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
W20260812 19:24:34.930334 15764 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.209s	user 0.000s	sys 0.002s
I20260812 19:24:34.946676  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.947926  6342 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:34.953681  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.954753  6242 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:34.956210  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.894994 15268 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:34.958598  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 4eac496b52764773a5bb2dceffc30dc3, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:34.959009  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 4eac496b52764773a5bb2dceffc30dc3, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:34.959565  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:34.955850 15600 consensus_meta.cc:287] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.007s
I20260812 19:24:34.968124  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.968976  6242 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:34.979779  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:34.982583  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 52116.7us
I20260812 19:24:34.981542  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:34.986533  6342 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260812 19:24:34.988300  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:34.988996  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.989508  6352 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 15: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:34.989948  6238 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
W20260812 19:24:34.971343  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.671s (SENT) [suppressed 20 similar messages]
I20260812 19:24:34.998172  6345 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260812 19:24:35.002012  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:35.002424 15599 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:35.002946 15538 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:34.979809 15672 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:35.004055 15672 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:34.970736 15600 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.007170  6353 raft_consensus.cc:2379] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 15: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:35.000036  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:35.010257  6241 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:35.006464 15600 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:35.013900 15538 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:24:35.014644 15538 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:35.015205  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:34.993312 15709 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:35.016906  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:35.021318 15600 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:35.022578 15538 raft_consensus.cc:3032] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:35.023119 15538 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:35.024223 15538 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.025990 15538 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:34.970992 15658 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:35.031292 15658 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:35.034026 15658 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:35.040787  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:35.034315  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:35.016887 15709 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:35.057076  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:35.058439  6354 raft_consensus.cc:2396] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260812 19:24:35.059526  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:35.006445 15672 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:35.069207  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:35.069373  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:35.070873  6344 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:35.022253 15607 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.072504  6353 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:35.083803  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:35.086220  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 94102.2us
W20260812 19:24:35.090372  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet f7798b18b2fb4b0baa349294c1006e91, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:35.090768  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet f7798b18b2fb4b0baa349294c1006e91, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:35.092336  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 58140.6us
I20260812 19:24:35.074967 15518 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:35.097368  6232 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260812 19:24:35.100477  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:35.103999 15772 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260812 19:24:35.115969  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 67c9cd7e3397473ba76fb87340b6c6e0, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:35.116345  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 67c9cd7e3397473ba76fb87340b6c6e0, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.116715  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:35.117689  6352 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:35.116436  6228 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:35.098116 15518 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:35.127239  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:35.131537  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:35.133414  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:35.128844 15518 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:35.151314  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:35.149147  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:35.155017  6228 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:35.132666 15268 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:35.138278 15653 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.152686 15504 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:35.161900  6349 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:35.166749  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:35.157516 15709 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:35.176451  6238 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:35.176582 15722 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:35.185129  6353 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:35.171640 15357 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:35.177260  6055 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:35.204459  6055 catalog_manager.cc:5495] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:35.170758 15504 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.201725 15357 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:35.212337 15767 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.208s	user 0.001s	sys 0.001s
I20260812 19:24:35.177274 15722 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:35.218567  6060 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 196) took 30318 ms (client timeout 15000 ms). Trace:
I20260812 19:24:35.220992 15507 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:35.221947 15507 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.224581 15507 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:35.225287 15507 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:35.220896  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:35.219224  6060 rpcz_store.cc:269] 0812 19:24:04.947526 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:05.036943 (+ 89417us) service_pool.cc:227] Handling call
0812 19:24:35.218216 (+30181273us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:24:32.314778 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:24:32.450263 (+135485us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:24:32.450306 (+    43us) write_op.cc:435] Acquired schema lock
0812 19:24:32.450328 (+    22us) tablet.cc:660] Decoding operations
0812 19:24:32.522083 (+ 71755us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:24:32.522178 (+    95us) write_op.cc:641] Partition lock acquired for write op
0812 19:24:32.522229 (+    51us) tablet.cc:683] Acquiring locks for 10 operations
0812 19:24:32.523396 (+  1167us) tablet.cc:699] Row locks acquired
0812 19:24:32.523425 (+    29us) write_op.cc:260] PREPARE: finished
0812 19:24:32.523653 (+   228us) write_op.cc:270] Start()
0812 19:24:32.523837 (+   184us) write_op.cc:276] Timestamp: P: 1786562672523575 usec, L: 0
0812 19:24:32.523866 (+    29us) op_driver.cc:331] REPLICATION: starting
0812 19:24:32.524798 (+   932us) log.cc:842] Serialized 3970 byte log entry
0812 19:24:33.838785 (+1313987us) op_driver.cc:444] REPLICATION: finished
0812 19:24:33.982921 (+144136us) write_op.cc:301] APPLY: starting
0812 19:24:33.983023 (+   102us) tablet.cc:1365] starting BulkCheckPresence
0812 19:24:34.230575 (+247552us) tablet.cc:1368] finished BulkCheckPresence
0812 19:24:34.230861 (+   286us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:24:34.439784 (+208923us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:24:34.446210 (+  6426us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0812 19:24:34.446634 (+   424us) write_op.cc:312] APPLY: finished
0812 19:24:34.545552 (+ 98918us) log.cc:842] Serialized 97 byte log entry
0812 19:24:34.545824 (+   272us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:24:34.546250 (+   426us) write_op.cc:454] Released schema lock
0812 19:24:34.546341 (+    91us) write_op.cc:341] FINISH: Updating metrics
0812 19:24:34.546900 (+   559us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:24:34.546948 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":168624,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":143770,"apply.run_cpu_time_us":22701,"apply.run_wall_time_us":564490,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45987,"num_ops":10,"prepare.queue_time_us":283410,"prepare.run_cpu_time_us":17851,"prepare.run_wall_time_us":336154,"raft.queue_time_us":753865,"raft.run_cpu_time_us":34446,"raft.run_wall_time_us":125659,"replication_time_us":1314809,"thread_start_us":1291054,"threads_started":4,"wal-append.queue_time_us":117689}]]}
I20260812 19:24:35.231326  6055 catalog_manager.cc:5495] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:35.226320 15518 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:35.241549  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 270220us
I20260812 19:24:35.213624 15607 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:35.250101  6359 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:35.256163  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:35.264810  6055 catalog_manager.cc:5495] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:35.265569  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:35.269553  6345 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:35.271085 15705 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:35.271605 15705 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:35.271966 15705 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:35.273002  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:35.241209 15507 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.274735 14815 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:35.275072  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:35.275393 14815 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.276432 15507 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:35.277813 14815 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:35.278191 15658 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:35.278898 15658 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:35.278932  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:35.279266 15504 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:35.280555 15607 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:35.280932 15518 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:35.281924 15653 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:35.282495  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:35.283391 15653 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:35.285049 15722 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:35.288959  6342 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:35.289836  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:35.241748 15339 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.303710  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:35.304782 15339 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:35.305508 15339 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:35.306478  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:35.307017  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:35.309106  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:35.310925  6349 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:35.313405  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:35.309410 15599 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:35.311721 15494 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260812 19:24:35.322125  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.050s	sys 0.062s
I20260812 19:24:35.322242 15494 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:24:35.322593  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.050s	sys 0.062s
I20260812 19:24:35.325001  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:35.326359  7598 raft_consensus.cc:2396] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260812 19:24:35.312856 15653 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:35.332691 15494 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:35.335690  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:35.343734  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:35.347512 15731 consensus_meta.cc:287] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.619s	user 0.012s	sys 0.002s
I20260812 19:24:35.350050  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:35.350937  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:35.351790  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:35.359179  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:35.360637 15672 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:35.361081 15672 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:35.361609 15672 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:35.361647 15653 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 19:24:35.321224 15357 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:35.362426 15653 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:35.363385 15653 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:35.363667 15774 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:35.364538 15774 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.363723 15653 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:35.366811 15653 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.368459 15653 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:35.360991  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:35.371287 15731 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:35.371462  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:35.371716 15731 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:35.372092 15731 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:35.372453  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:35.373782  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:35.321732 15599 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:35.374874 15702 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:35.374962 15599 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:35.375309 15702 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:35.375798 15702 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:35.375659 15494 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:35.379196  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:35.331383 15607 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:35.312958 14889 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:35.383421 15440 consensus_meta.cc:287] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.005s
I20260812 19:24:35.398283  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:35.398700  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:35.399471  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:35.403309  6238 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:35.399617  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:35.400195  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:35.400622 15774 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:35.400885  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:35.409701  6241 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
W20260812 19:24:35.401437 15438 consensus_meta.cc:287] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.599s	user 0.005s	sys 0.008s
I20260812 19:24:35.401650  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:35.405026  6475 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 15
I20260812 19:24:35.411062  6344 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:35.401674  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:35.404314  6477 pending_rounds.cc:76] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 6
I20260812 19:24:35.413908  6477 pending_rounds.cc:97] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260812 19:24:35.414258  6477 raft_consensus.cc:2866] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:35.404947  6482 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:35.388320 15583 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:35.419201  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:35.419546  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:35.419924  6465 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:35.420437  6482 raft_consensus.cc:2379] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:35.423395  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:35.424153  6470 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:35.424060  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:35.391043 15741 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:35.421640  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:35.430943  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:35.417275 15774 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:35.434202 15774 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:35.434211  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:35.434756 15774 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:35.434964  6473 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:35.442308  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:35.442828 15600 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:35.442938  6473 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:35.443616 15600 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.445794 15600 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:35.445847 15709 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:35.449762  6235 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:35.446412 15600 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:35.389184 15494 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:35.455513  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 306398us
I20260812 19:24:35.418517 15583 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:35.394505 15538 consensus_queue.cc:1046] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260812 19:24:35.457971  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:35.409731 15440 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.455117 15600 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:35.416435 15438 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.485671  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:35.493891  6235 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:35.488626  6475 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:35.466876 15583 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:35.498888  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:35.447202 15709 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.520290 15709 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:35.520756 15672 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:35.522553  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 46750.6us
I20260812 19:24:35.523331  6232 raft_consensus.cc:2396] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260812 19:24:35.524065 15717 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:35.524546 15717 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:35.524948 15717 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:35.527077  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:35.531111  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:35.532114 15438 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:35.532615  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:35.533510  6235 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:35.536019 15440 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:35.538165 15686 raft_consensus.cc:3032] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:35.538576 15686 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:35.539479 15686 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:35.540818 15686 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:35.541004 15731 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.491564 15600 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
W20260812 19:24:35.547403 15786 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260812 19:24:35.551448 14889 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:35.532819  6353 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:35.527205  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:35.561569  7598 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
W20260812 19:24:35.563939 15789 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260812 19:24:35.566710  6242 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260812 19:24:35.568217 15793 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.117s	user 0.004s	sys 0.000s
I20260812 19:24:35.570348  6470 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:35.571426  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:35.573840 15705 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:35.574239  6465 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:35.575958 15705 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:35.577739  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:35.578629  7598 raft_consensus.cc:2354] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
I20260812 19:24:35.578775  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:35.579592  7597 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:35.580905  7594 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260812 19:24:35.532147  7599 raft_consensus.cc:2379] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 15: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
W20260812 19:24:35.584091  6230 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.019s	sys 0.026s
I20260812 19:24:35.583525  6238 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:35.526122 15774 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.594316  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:35.585321  6230 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.019s	sys 0.026s
I20260812 19:24:35.608310  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:35.614480  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:35.611817 15658 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260812 19:24:35.650519  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 276801us
I20260812 19:24:35.615531 15672 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:35.649489  6241 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:35.649708 15357 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:35.665781  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:35.656940  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:35.584491 15599 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.657825 15731 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:35.673334  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 61930.6us
W20260812 19:24:35.677961  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 235724us
I20260812 19:24:35.658417 15185 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:35.656643 15607 raft_consensus.cc:686] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:35.659078 15799 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:35.683213  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:35.689958  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:35.690080  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:35.692584  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:35.693074  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:35.693792  6470 raft_consensus.cc:2379] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:35.694945  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:35.691079  6238 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:35.695418  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:35.697640  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:35.678576 15731 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:35.699647  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:35.687319 15339 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:35.687111 15799 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:35.699076  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:35.715921  6354 raft_consensus.cc:2379] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:35.716463  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:35.716930  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:24:35.714118  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 308047us
I20260812 19:24:35.718279  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:35.719421  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:35.720932  6344 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:35.713006 15357 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:35.721999 15357 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:35.722404 15357 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:35.730846 15268 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:35.731561 15268 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:35.732551 15268 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.733722 15774 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:35.734987  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:35.735627  6465 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 16
I20260812 19:24:35.737581 15731 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:35.714824 15799 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:35.738591 15731 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.742424 15822 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:35.743894  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:35.692438 15596 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:24:35.747989  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:35.748904  6475 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
W20260812 19:24:35.816447  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 71931.5us
I20260812 19:24:35.818531  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:35.755944 15802 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260812 19:24:35.819594  6465 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
I20260812 19:24:35.817921  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:24:35.821641  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 71063.1us
I20260812 19:24:35.823134  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:35.823824  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47460.3us
I20260812 19:24:35.824164  6354 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:35.824440  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:35.697189 15185 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.757555 15800 raft_consensus.cc:2741] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260812 19:24:35.755394 15518 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:35.754287 15596 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:24:35.826383  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 67852.5us
I20260812 19:24:35.832341  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:35.760066 15774 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:35.876300  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:35.877076  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:35.877300  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:35.876773  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:35.853852  6241 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:35.886510  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:35.887681  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:35.888573  6238 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:35.890197  6465 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:35.821759 15809 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:35.822129 15438 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:35.897914  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:35.899380  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:35.903276 15811 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:35.903869  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 76135.9us
I20260812 19:24:35.898736  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:35.897836  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:35.906162  6481 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:35.828994 14889 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:35.833451 15339 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:35.878129 15709 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:35.812668 15702 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.813449 15600 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:35.878369 15658 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:35.827245 15583 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.901714 15800 raft_consensus.cc:2741] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260812 19:24:35.980219  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 150624us
I20260812 19:24:35.889631 15774 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:35.837173 15507 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260812 19:24:35.894899 15596 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:35.958915  6417 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:35.835376 15717 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:35.918633 15812 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:24:36.001119  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 283409us
I20260812 19:24:35.981978 15686 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:36.013690  6417 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:35.988333 15774 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:36.015710  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:35.900789 15607 consensus_queue.cc:237] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.998708 15800 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:35.911023 15438 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:35.926424 15811 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.003868 15599 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.003743 15709 raft_consensus.cc:686] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:35.987013 15339 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:36.037750  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 122342us
I20260812 19:24:36.015913 15686 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.039454 15599 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:36.065346  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:36.018700 15812 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:36.033751 15800 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.074855 15835 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:36.074501 15507 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:24:36.092690  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 197168us
I20260812 19:24:36.087407 15709 consensus_queue.cc:237] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:36.096338 15832 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260812 19:24:36.097684 15600 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:36.098857 15583 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.099108 15841 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:24:36.106848 15830 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260812 19:24:36.073024 15599 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.096444 15809 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260812 19:24:36.109519 15658 raft_consensus.cc:3032] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:36.098578 15842 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:36.109964 15658 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:36.110378 15842 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:36.110885 15842 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:36.111116 15658 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.112386 15686 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:36.115263 15829 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260812 19:24:36.117429 15835 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.120972 15339 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:36.046263 15518 raft_consensus.cc:686] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:36.104461  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:36.122203 15518 consensus_queue.cc:237] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.124310  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:36.126510  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:36.127835  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:36.127257  6353 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:36.126967 15809 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:36.129652  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:36.130463  6349 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:24:36.133950 15809 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:36.134231 15777 consensus_queue.cc:1046] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:36.135391 15777 raft_consensus.cc:3032] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:36.135996 15777 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:36.135468 15809 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.136878 15777 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.138177 15777 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
W20260812 19:24:36.140511 15816 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
W20260812 19:24:36.098537 15828 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260812 19:24:36.087391 15185 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.128916  6359 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:36.185866 15339 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:36.181111 15843 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:36.202472 15843 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.186708 15339 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.211043 15717 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:36.073714  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 60167.6us
W20260812 19:24:36.221302  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 205673us
I20260812 19:24:36.222641  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:36.226233  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:36.228070 15658 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
W20260812 19:24:36.238463  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 415623us
I20260812 19:24:36.247669  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:36.171114 14889 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:36.277190  6417 leader_election.cc:398] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
I20260812 19:24:36.277588  6417 leader_election.cc:401] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:24:36.268855  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:36.270134 15811 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.227784 15839 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:36.271610  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:36.272234 15849 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:36.276547 15339 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.275239 15843 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.249230 15702 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.275274 15812 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:36.270315 15599 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.284614  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:36.274982  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:36.287112  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:36.296689  6342 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:36.275707 15507 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:36.293121  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:36.300494  6344 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:36.293905  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:36.277688 15538 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260812 19:24:36.302304  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 254480us
I20260812 19:24:36.267313 15848 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:24:36.290593 15686 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:36.307053  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:36.309762  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:36.290747 15800 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:36.312244  6345 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:36.335115  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:36.303717 15538 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:36.307322 15848 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:36.334314  6349 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:36.290912 15838 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260812 19:24:36.381644  6345 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
W20260812 19:24:36.382555  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 157772us
I20260812 19:24:36.370199  6359 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:36.363804  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:36.319383 15822 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.021s	sys 0.044s
W20260812 19:24:36.386935  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 74249.9us
I20260812 19:24:36.386473  6417 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:36.300096 15583 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260812 19:24:36.389343  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:36.388149  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:36.410113  7594 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:36.413744  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:36.414037  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:36.390250  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:36.414626  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:36.398911  6352 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:36.363605 15538 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:36.376763 15717 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:36.411691  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:36.415318  6474 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:36.328748 15686 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:36.389742 15357 consensus_meta.cc:287] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.667s	user 0.021s	sys 0.001s
I20260812 19:24:36.414858  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:36.421134  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:24:36.390817  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 119288us
I20260812 19:24:36.328131 15800 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
I20260812 19:24:36.417567  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:36.329471 15835 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:36.414466  6241 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:36.424185  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:36.421720  6359 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:36.423614  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:36.425376  6224 raft_consensus.cc:1226] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: []
W20260812 19:24:36.420730  6354 consensus_meta.cc:287] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.586s	user 0.022s	sys 0.000s
I20260812 19:24:36.426508  6354 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
I20260812 19:24:36.427246  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:36.427613  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:36.387655 15438 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:36.411331 15822 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.025s	sys 0.049s
I20260812 19:24:36.432766  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:36.433408  6235 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:36.403041 15849 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:36.432520  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:36.377681 15850 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:36.435647  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:36.378311 15848 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:36.427973  6232 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:36.438115  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:36.454067  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:36.440304  6354 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:36.455103  6465 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 15
W20260812 19:24:36.459932  6481 consensus_meta.cc:287] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.538s	user 0.018s	sys 0.000s
I20260812 19:24:36.439976  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:36.460546  6481 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:36.461959  6465 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:36.454067  6353 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:36.416790 15717 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:36.451049  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:36.419934 15812 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:36.451606  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:36.465181  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:36.361562 14889 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.539314  6345 raft_consensus.cc:2379] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 15: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:24:36.515671 15596 consensus_meta.cc:287] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.509s	user 0.014s	sys 0.003s
I20260812 19:24:36.424489 15599 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:36.431444 15357 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:36.453719  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:36.431998 15507 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:36.424887  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:24:36.535831  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 100245us
I20260812 19:24:36.456657 15837 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:36.433118 15822 raft_consensus.cc:686] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:36.459103 15849 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:36.457050 15800 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:36.556535  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:36.458981 15845 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:36.540289 15185 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:36.561419  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:36.519086 15717 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:36.536134 15702 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:36.568485  6482 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:36.427999 15686 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.560245  7607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:36.571118 15856 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:36.577395 15856 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:36.577765 15856 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:36.569789 15849 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:36.583845 15357 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:36.538359 15518 consensus_queue.cc:1046] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260812 19:24:36.547502 15339 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:36.567582 15599 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:36.569836 15800 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:36.557240 15507 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:36.550679 15842 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:36.575376  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:36.571282  6473 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
W20260812 19:24:36.589102  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 58139.8us
I20260812 19:24:36.569694 15845 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:24:36.589771  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 191406us
I20260812 19:24:36.463171 15835 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260812 19:24:36.556715 15596 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:36.539093 15850 raft_consensus.cc:686] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:36.600282  7597 raft_consensus.cc:2379] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 15: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:36.606330  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:36.589591 15599 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:36.587581 15185 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.610368  6342 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:36.588601 15357 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:36.591361 15800 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:36.628453 15686 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.594352 15507 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:36.630476  6482 raft_consensus.cc:2379] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 15: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:36.586932 15702 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.616199 15810 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:36.630867 15599 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:24:36.630980 15799 consensus_meta.cc:287] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.892s	user 0.013s	sys 0.005s
I20260812 19:24:36.602608 15731 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:36.603209 15845 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:36.603289 15607 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:24:36.719066  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 116107us
I20260812 19:24:36.723464  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:36.719614  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 268088us
I20260812 19:24:36.600560 15339 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.680390 15357 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:36.722548 15799 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:36.736538 15799 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.740618 15800 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.743722 15800 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:36.705734 15841 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:36.751215 15185 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.754779 15842 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:36.755967 15702 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.720124 15810 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:36.760161 15596 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.760612 15822 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:36.731231 15731 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.763013 15339 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.763661 15850 consensus_queue.cc:237] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:36.764729 15811 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:36.616071 15833 consensus_queue.cc:1046] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.110s
I20260812 19:24:36.726260  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:36.785080  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 223709us
I20260812 19:24:36.731297 15357 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
W20260812 19:24:36.797518  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 117874us
I20260812 19:24:36.799185  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:36.770306 15717 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:36.784019 15874 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:36.800475  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:24:36.805480  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 79299.7us
I20260812 19:24:36.782778 15841 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.812139 15600 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:36.812773 15600 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:36.813220 15600 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:36.813999 15841 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.814874 15800 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:36.815317 15800 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:36.815652 15800 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:36.772050 15607 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.804682  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:36.796080 15658 consensus_meta.cc:287] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.000s
I20260812 19:24:36.827147  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:36.786201 15848 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:36.830118  6352 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 18. Current term is 19. Ops: []
I20260812 19:24:36.829869  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:36.831171 15842 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:24:36.831642 15848 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:36.832124 15835 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:36.832556 15835 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:36.833511 15835 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.834884 15835 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:36.844907 15848 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:36.846159 15848 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:36.847054 15848 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:36.851326  7607 raft_consensus.cc:595] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:36.851766  7607 raft_consensus.cc:603] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:36.851941  6242 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260812 19:24:36.855757  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:36.822371 15777 consensus_meta.cc:287] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.684s	user 0.014s	sys 0.007s
I20260812 19:24:36.854422  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:36.856464  6232 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:36.862635  7599 raft_consensus.cc:2354] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16.
W20260812 19:24:36.863610  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 140277us
I20260812 19:24:36.809605 15874 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:36.868815  6465 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:36.871760  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:36.872502  6481 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:36.873658  6236 raft_consensus.cc:3032] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:36.822726 15873 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:36.874049  6236 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:36.875591  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:36.876515  6473 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260812 19:24:36.840939 15705 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260812 19:24:36.863507 15857 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260812 19:24:36.842068 15833 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260812 19:24:36.865993 15774 consensus_meta.cc:287] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.834s	user 0.016s	sys 0.003s
I20260812 19:24:36.899036 15774 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:36.900288 15862 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:36.901248 15774 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:36.881171  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:36.901013 15862 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:36.890363 15841 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:36.903475 15837 raft_consensus.cc:3032] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:36.904044 15837 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:36.903532 15841 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.904767 15438 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:36.904924 15837 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.905282 15438 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.906891  6230 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:36.907261 15438 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.890856 14889 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:36.908878 14889 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:36.912971 15848 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.862944 15607 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.919055 15810 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:36.887239 15867 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260812 19:24:36.887614 15798 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:36.872884 15874 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:36.880115  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:36.939064  6232 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:36.888968  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:36.940824  6481 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:36.892819  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:36.893934  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:36.943511  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 50825.1us
I20260812 19:24:36.896587 15849 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.899290 15731 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.882104  6242 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:36.808564 15811 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:36.885123  6236 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.938298  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:24:36.948590  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 67495.5us
W20260812 19:24:36.937294 15538 consensus_meta.cc:287] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.000s
I20260812 19:24:36.879036 15873 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:36.884614 15658 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:36.951407  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:36.957422 15848 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.957346 15538 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:36.973721  6482 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:36.911193 15841 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:36.950372 15268 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:36.983922  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:36.959805 14889 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:36.958863 15871 raft_consensus.cc:3032] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:36.973938 15810 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:36.999330  7607 raft_consensus.cc:2379] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 10: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:36.960315 15873 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:36.987457  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:36.974707  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:37.003526  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 140185us
I20260812 19:24:37.004418  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:36.995798 15268 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:37.006289 15268 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:36.956681 15809 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:36.958819  7597 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:36.996343 15731 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:37.019740 15731 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:37.020668 15731 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:36.976397 15658 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:37.001675 15871 raft_consensus.cc:729] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:37.022765 15810 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:37.023399 15658 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:37.025213 15810 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:37.006982 15777 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:37.027011 15777 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:37.027441 15777 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:37.030642 15811 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:37.031189 15809 raft_consensus.cc:686] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:37.032274 15809 consensus_queue.cc:237] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:37.036409 15849 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:37.038990  7597 raft_consensus.cc:595] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:37.041065 15845 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:37.004416  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:37.057655  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:37.006868 14889 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:37.017292 15839 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:36.953505 15856 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:37.016650 15599 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:37.018245 15862 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:37.067786  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:37.010746  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:37.044481  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 155156us
W20260812 19:24:37.077419  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 67410.8us
I20260812 19:24:37.078135  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:37.084163  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:37.084474  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:37.085351  6352 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 16
I20260812 19:24:37.009673 15841 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
W20260812 19:24:37.059609  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55465.5us
I20260812 19:24:37.089334  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:37.060956 15811 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:37.062294 15800 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:37.019086 15717 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:37.084821  6242 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:24:37.011795  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 65748.8us
I20260812 19:24:37.091609  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:37.098412  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:37.109746  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:37.110037  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:37.111516  6230 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 14
I20260812 19:24:37.107460  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:37.112665  6353 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:37.115698  7597 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260812 19:24:37.116559 15507 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:37.118623  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:37.119500  6354 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:37.119581  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:37.091938 15811 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:37.120872 15811 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:37.121206 15357 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:37.122161 15800 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:37.093518 14889 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:24:37.101385 15538 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:37.127691  6342 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:37.130863  6359 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:37.131417  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:37.136070  6464 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:37.135224  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:37.136962  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:37.137564  6242 raft_consensus.cc:2396] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260812 19:24:37.141556  6477 raft_consensus.cc:2379] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:37.142789  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:37.143153  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:37.143754  6344 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:37.144801  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:37.145701  6475 raft_consensus.cc:2379] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:37.146824  7591 raft_consensus.cc:2379] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:37.136962  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:37.144810  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:37.091153 15884 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:37.156952  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:37.158329  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:37.152119  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:37.161624  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:37.163563 15702 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:37.163666  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:37.164274 15702 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:37.164794 15702 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:37.166877 15876 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:37.167409  6470 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260812 19:24:37.167640 15518 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:37.168223 15518 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:37.168630 15518 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:37.170331  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:37.171483  6470 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:37.172106  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:37.167446 15876 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:37.173728 15876 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:37.174057  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:37.171177  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:37.174736  6470 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:37.101574 15774 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:37.091796 15862 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:37.160184  6298 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:37.102012 15841 raft_consensus.cc:686] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:37.179116  6354 raft_consensus.cc:2396] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260812 19:24:37.138710 15507 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:37.137477 15607 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:37.101423 15810 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260812 19:24:37.198511 15882 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:37.183367 15822 consensus_queue.cc:1046] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260812 19:24:37.176419 15583 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:37.101754 15838 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260812 19:24:37.202579  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:37.163057 15812 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260812 19:24:37.207841  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:37.210763  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 206358us
I20260812 19:24:37.218815  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:37.023424 15871 consensus_queue.cc:260] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:37.218118  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:37.218523  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 58444.7us
I20260812 19:24:37.220890  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:37.135257 15848 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
W20260812 19:24:37.206236  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 44714us
I20260812 19:24:37.076395 15839 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:37.224594  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:37.225414  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:37.216323 15607 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:37.239305  6235 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:37.240388 15357 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:37.240996 15357 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:37.241101 15607 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:37.241521 15357 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:37.242969  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:37.243834  6224 raft_consensus.cc:2379] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:37.244649 15599 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:37.245975 15895 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.179s	user 0.000s	sys 0.003s
I20260812 19:24:37.246946  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:37.247771  6232 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:37.198596 15856 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:37.213181 15538 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:37.214187  7597 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:37.256865  6298 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:37.218570 15862 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:37.218878 15583 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:37.287559  6345 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:37.222384 15774 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:37.262337  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:37.313207  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 50980.1us
I20260812 19:24:37.158666 15874 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:37.324922  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:37.318447  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:37.321870  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:37.213887 15800 consensus_queue.cc:1046] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260812 19:24:37.329924  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:37.375710  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:37.216631 15600 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:37.398157  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:37.323931  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:37.260422 15882 raft_consensus.cc:3032] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:37.329058  6241 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:37.285317 15538 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:37.399539  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:37.260165 15843 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.138s
I20260812 19:24:37.458885 15774 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:37.459699 15862 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:37.216755 15897 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.248s
I20260812 19:24:37.510499  6230 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
W20260812 19:24:37.330943  6416 connection.cc:232] RPC call timeout handler was delayed by -1.1502194639761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260812 19:24:37.319777 15583 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:37.512284  6349 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:37.324193  7597 raft_consensus.cc:595] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:37.525558  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 210876us
I20260812 19:24:37.609424  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:37.543413  6353 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:37.589228  6238 raft_consensus.cc:2354] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18.
I20260812 19:24:37.589646  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:37.591182  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 267353us
I20260812 19:24:37.611160  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:37.593874  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:37.317705 15717 consensus_queue.cc:1046] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.241s
W20260812 19:24:37.598815  6416 connection.cc:232] RPC call timeout handler was delayed by -1.1052194640506059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260812 19:24:37.623623  6416 connection.cc:232] RPC call timeout handler was delayed by -1.1025194639805704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
W20260812 19:24:37.624099  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0827194638550282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
W20260812 19:24:37.624439  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0818194639869034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
W20260812 19:24:37.624809  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0422194639686495s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
I20260812 19:24:37.533160 15810 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:37.517117 15882 raft_consensus.cc:729] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:37.613834  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:37.612041  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:37.627661  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:37.627991  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:37.639807  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:37.582130 15538 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:37.629565  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:37.630369  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:37.611958  6230 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:37.560431 15845 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:37.553659 15841 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:37.646306 15909 log.cc:924] Time spent T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260812 19:24:37.647112  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:37.648089  6475 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:37.647936  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:37.649312  6474 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:37.649165  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:37.653739  6465 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:37.654460  6477 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:37.655441  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:37.672704  6465 raft_consensus.cc:2379] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:37.673673  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:37.689074  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 442109us
W20260812 19:24:37.680459 15835 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.006s	sys 0.008s
W20260812 19:24:37.694324 15835 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.006s	sys 0.008s
W20260812 19:24:37.694334 15859 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.008s	sys 0.008s
I20260812 19:24:37.675712  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:37.703794  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:37.692903  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:37.671468  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:37.706059  6349 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:37.707320  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:37.708388  6349 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 15: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:37.709493  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:37.710326  6349 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:37.713168  6241 raft_consensus.cc:2379] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:37.715783 15841 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:37.711618  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:37.716672 15841 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:37.723004  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:37.726509  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:37.727339  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:37.724402  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:37.675624  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:37.650942 15811 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.002s
I20260812 19:24:37.738878  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:37.804658  6475 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:24:37.805136 15904 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
W20260812 19:24:37.806099  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:24:37.806366 15905 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260812 19:24:37.649199 15874 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:37.635329 15810 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:37.655642 15884 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:37.802037  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:37.692368 15357 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:37.606886 15869 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:37.743449  6481 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:24:37.806943 15873 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.797s	user 0.006s	sys 0.005s
I20260812 19:24:37.845614  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:37.795521  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:37.846390  6482 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:37.809770  6474 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260812 19:24:37.812723  6230 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 14. Current term is 15. Ops: []
W20260812 19:24:37.839493  6352 consensus_meta.cc:287] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.738s	user 0.009s	sys 0.002s
I20260812 19:24:37.840404  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:37.840346  6473 raft_consensus.cc:2396] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260812 19:24:37.848059  6352 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
I20260812 19:24:37.849277  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:37.849969  6481 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:37.851162  6465 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:37.852334  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:37.853130  6349 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:37.849879  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:37.855437  6352 raft_consensus.cc:2379] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 12: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:24:37.860150  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet fa4336f7dd434c238a9022aa16490450, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:37.860589  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet fa4336f7dd434c238a9022aa16490450, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:37.802927 15897 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260812 19:24:37.866801  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 143875us
I20260812 19:24:37.863729  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:37.843461 15809 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.006s	sys 0.010s
I20260812 19:24:37.871639  6352 raft_consensus.cc:2379] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 16: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:37.839241 15810 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:37.871358  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:37.875574  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:37.879889  6474 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:37.878875  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:37.845664 15874 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:37.882373  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:37.882403  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:37.881923  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:37.886510  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 274547us
I20260812 19:24:37.814941 15938 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:37.893122  6475 raft_consensus.cc:2354] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14.
I20260812 19:24:37.897732  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:37.898473  6228 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:37.902216  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:37.903020 15600 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:37.903527  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:37.904210  6230 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:37.904481 15600 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:37.904942 15600 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:37.905300 15600 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:37.907871  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:37.908571  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:37.812484 15811 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:37.914881  6481 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
W20260812 19:24:37.873132 15809 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.006s	sys 0.010s
I20260812 19:24:37.908582  6352 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
W20260812 19:24:37.910152  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 132895us
I20260812 19:24:37.890347  6470 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260812 19:24:37.887871  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:37.917769  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:37.879703 15839 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:37.924952  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:37.924723  6481 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:37.917272  6228 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:37.931094  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:37.929183  6349 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:37.850816 15873 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:37.940281  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 52506.1us
I20260812 19:24:37.941048  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:37.944036  6349 raft_consensus.cc:1226] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:37.906786 15869 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:37.998852  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:37.999996  6229 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:38.005600  6473 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:38.000926  6230 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:38.021467  6352 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:38.022627  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:38.023466  6352 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:38.024696 15357 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:38.025234 15357 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.027398 15873 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:38.030984  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:38.025496 15946 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:38.039669  6483 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:37.920743 15938 raft_consensus.cc:686] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:38.051035  7603 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260812 19:24:38.052429  6475 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260812 19:24:37.937307 15925 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:38.072291  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:38.033902 15809 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:38.042817 15874 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:38.086236  6473 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:38.042023 15946 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:38.102149  6235 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260812 19:24:37.997148 15839 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260812 19:24:38.078423 15607 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:37.886121 15882 consensus_queue.cc:260] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:38.040832 15869 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:38.053117 15884 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.122121  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:38.102111 15916 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:38.142410  6354 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260812 19:24:38.183079  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 141087us
I20260812 19:24:38.170475  6474 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:38.140666  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 2299) took 1043 ms. Trace:
I20260812 19:24:38.187525  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:38.194342  6475 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:38.193962  6359 rpcz_store.cc:276] 0812 19:24:37.097440 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:37.097606 (+   166us) service_pool.cc:227] Handling call
0812 19:24:38.140416 (+1042810us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b540003f7d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:38.140590 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":23794560}
W20260812 19:24:38.138173  7599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 675) took 1785 ms (client timeout 2172 ms). Trace:
I20260812 19:24:38.207692  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:38.208647  6347 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:24:38.205833  7599 rpcz_store.cc:269] 0812 19:24:36.352841 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:36.375940 (+ 23099us) service_pool.cc:227] Handling call
0812 19:24:38.137934 (+1761994us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b54002a9ed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:38.138086 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1005564160}
I20260812 19:24:38.101390 15841 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:38.131896 15914 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260812 19:24:38.133006 15596 raft_consensus.cc:979] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower bdfa5579d4534c618c00db6b4a841c81 to start an election
W20260812 19:24:38.132632 15932 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260812 19:24:38.251405  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:38.127490 15518 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.958s	user 0.011s	sys 0.003s
I20260812 19:24:38.252426 15518 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.252925  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.253671  6475 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:38.074061 15538 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:38.145054 15942 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260812 19:24:38.233070  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:38.112087 15946 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:38.198401 15607 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.241490  6342 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260812 19:24:38.245533 15889 consensus_queue.cc:1046] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260812 19:24:38.246686  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.254506  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.247510  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.248894  6464 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:38.141201 15859 raft_consensus.cc:3032] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:24:38.132463 15931 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260812 19:24:38.247617 15869 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:38.219208 15926 consensus_queue.cc:1159] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "54f83319db6b49929cc8f18a66a66975" responder_term: 16 status { last_received { term: 15 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:24:38.078945 15915 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.417s
I20260812 19:24:38.125865 15951 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.119s
I20260812 19:24:38.260793  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.255028  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:38.258982 15607 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.261621  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.256426 15538 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:38.293618  6473 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:38.263320  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.292402  6482 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:38.264286  6416 leader_election.cc:398] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 14. Current term is 15.
I20260812 19:24:38.259119 15841 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:38.271539  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.142326 15822 raft_consensus.cc:3032] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:38.296067  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.271831  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.271862  6353 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:38.297720  6464 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:24:38.257210 15583 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.003s
I20260812 19:24:38.279621  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2714) took 1097 ms. Trace:
I20260812 19:24:38.295384  6416 leader_election.cc:401] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:24:38.299552  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:38.259909  6481 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:24:38.289430  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 48855.9us
I20260812 19:24:38.295436  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:38.261063 15268 consensus_meta.cc:287] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.254s	user 0.011s	sys 0.000s
I20260812 19:24:38.257721  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.305040  6464 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260812 19:24:38.325408  6242 rpcz_store.cc:276] 0812 19:24:37.182063 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:37.182270 (+   207us) service_pool.cc:227] Handling call
0812 19:24:37.216925 (+ 34655us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:37.253866 (+ 36941us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:37.253896 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:37.286378 (+ 32482us) log.cc:842] Serialized 26 byte log entry
0812 19:24:37.882969 (+596591us) raft_consensus.cc:1631] Marking committed up to 5
0812 19:24:37.883010 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:37.883097 (+    87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:38.279331 (+396234us) raft_consensus.cc:1671] finished
0812 19:24:38.279359 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:38.279527 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":33566,"spinlock_wait_cycles":50141440,"thread_start_us":364350,"threads_started":1,"wal-append.queue_time_us":957090}
W20260812 19:24:38.324015  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 380559us
I20260812 19:24:38.325933  6482 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 18
I20260812 19:24:38.102308 15809 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:38.327379  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.022s	sys 0.026s
I20260812 19:24:38.328923  6465 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:38.331933  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:38.274411 15702 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.109s	user 0.011s	sys 0.001s
W20260812 19:24:38.297894  6298 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.021s	sys 0.025s
I20260812 19:24:38.333750  6481 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:38.220006 15717 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
W20260812 19:24:38.334023  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.023s	sys 0.027s
I20260812 19:24:38.254606 15518 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.261818 15859 raft_consensus.cc:729] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:38.348342  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:38.363987  6242 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:38.365160  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:38.365880  6242 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:38.292351 15916 raft_consensus.cc:686] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:38.275297 15596 raft_consensus.cc:1067] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEADER]: Signalling peer bdfa5579d4534c618c00db6b4a841c81 to start an election
W20260812 19:24:38.339375  6298 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.021s	sys 0.025s
W20260812 19:24:38.374770  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 1.11791e+06us
I20260812 19:24:38.376667  6298 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:38.347631  7554 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.006s	sys 0.042s
W20260812 19:24:38.378083  7554 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.011s	sys 0.042s
I20260812 19:24:38.379061  6298 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:38.274852 15931 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:38.282744 15357 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:38.341852  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:38.300367 15841 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:38.299659 15822 raft_consensus.cc:729] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:38.267051 15967 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:38.349921  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.353384  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:38.407835  6475 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:38.367533  6353 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:38.333488  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.410589  6477 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
W20260812 19:24:38.392045  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 127870us
I20260812 19:24:38.368762  6482 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:24:38.395753  6464 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:38.397085  6298 leader_election.cc:398] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16.
I20260812 19:24:38.343227 15835 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 14. Current term is 15.
I20260812 19:24:38.343453 15839 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:38.430953  6298 leader_election.cc:401] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:24:38.340070 15811 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:38.455987  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 452154us
W20260812 19:24:38.462420  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 109175us
W20260812 19:24:38.467140  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 70265.4us
W20260812 19:24:38.412352 15876 consensus_meta.cc:287] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.238s	user 0.011s	sys 0.003s
I20260812 19:24:38.331404 15268 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.399923 15518 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:24:38.330749 15583 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.141800 15938 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:38.461615 15777 consensus_meta.cc:287] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.434s	user 0.012s	sys 0.003s
I20260812 19:24:38.476297  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:38.477806  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:38.341454 15702 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.340567 15600 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:38.483402  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:38.484931  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:38.464462 15951 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:38.489192  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:38.493016  7594 raft_consensus.cc:2354] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14.
I20260812 19:24:38.493330  6350 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:38.483587  6242 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:38.495924  6482 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:33386
I20260812 19:24:38.478369 15811 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:38.494760  7607 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260812 19:24:38.525053  6482 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:38.493808  7603 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:38.525607  6482 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:24:38.522406  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 152378us
I20260812 19:24:38.411012 15931 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.495007  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:38.504421  6228 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:38.487349 15968 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16.
I20260812 19:24:38.482460 15946 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.501479 15916 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:38.512137 15966 raft_consensus.cc:2741] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260812 19:24:38.512633 15976 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:38.513065 15936 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:38.513494  7552 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.009s	sys 0.039s
I20260812 19:24:38.462846 15967 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:38.547757  7552 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.009s	sys 0.039s
W20260812 19:24:38.513875  6295 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.000s	sys 0.021s
W20260812 19:24:38.549081  6295 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.000s	sys 0.022s
I20260812 19:24:38.514230 15959 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
I20260812 19:24:38.491030 15948 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:38.491197 15357 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260812 19:24:38.515645 15863 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:38.483139 15859 consensus_queue.cc:260] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:38.480379 15876 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.520183 15268 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.520596 15702 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.523828  6352 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:38.470062 15839 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:38.509529 15810 consensus_meta.cc:287] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.002s
I20260812 19:24:38.542389  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:38.487848 15777 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.558517  6349 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260812 19:24:38.550913 15948 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:24:38.569371  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 74428.6us
I20260812 19:24:38.502367 15951 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.562048  6298 leader_election.cc:398] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14.
I20260812 19:24:38.603066  6298 leader_election.cc:401] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260812 19:24:38.533934 15811 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:38.500128 15822 consensus_queue.cc:260] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:38.588173  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 95252.9us
I20260812 19:24:38.585990  6464 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:38.604756  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:38.588390  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:38.589629 15986 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:38.589665 15985 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:38.590826 15931 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.591876 15600 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:38.591931  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:38.592926 15809 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.594470 15967 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:38.595336 15583 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.596668 15777 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.598366 15839 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.598731 15948 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:38.599731 15946 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.600350  6230 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:38.567513 15966 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:38.582820 15810 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.601372 15876 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.601933 15859 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
W20260812 19:24:38.582506  6178 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.671s (SENT)
W20260812 19:24:38.607254  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 45366.8us
I20260812 19:24:38.608686  6482 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:38.601948 15702 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:38.581465 15268 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:38.608507  6347 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:24:38.680052  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:38.680570  6482 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:38.681313  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:38.629001  6242 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:38.633831 15951 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.557646 15936 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.690402 15936 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.690953 15936 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:38.584606 15731 consensus_queue.cc:1046] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260812 19:24:38.634425 15992 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:38.691846 15731 consensus_queue.cc:1225] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Peer 54f83319db6b49929cc8f18a66a66975 log is divergent from this leader: its last log entry 15.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260812 19:24:38.691880 15992 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:38.635521 15596 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:38.692540 15992 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:38.692881 15596 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:38.633719 15583 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14.
I20260812 19:24:38.624679 15960 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:38.615780 15986 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:38.641534 15811 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:38.643282  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:38.704876  7607 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:38.647024 15837 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:38.656102  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2733) took 1796 ms. Trace:
I20260812 19:24:38.664095  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:38.678329  6477 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 9. Current term is 10. Ops: []
I20260812 19:24:38.581815 15863 raft_consensus.cc:686] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:38.686100  6347 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:38.675168 15809 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:38.676685 15913 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:38.709537  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:38.686406  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:38.686868 15702 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:38.687599  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:24:38.687995  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 105520us
I20260812 19:24:38.711747  7603 raft_consensus.cc:3032] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEADER]: Stepping down as leader of term 9
I20260812 19:24:38.712069 15809 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.713214 15915 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:38.713718 15915 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.687727 15268 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.710264  6242 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
W20260812 19:24:38.695921  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 91293.3us
I20260812 19:24:38.696244  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2425) took 1442 ms. Trace:
I20260812 19:24:38.703377  6342 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260812 19:24:38.676618 15777 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:38.705730  6483 rpcz_store.cc:276] 0812 19:24:36.859519 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:36.859726 (+   207us) service_pool.cc:227] Handling call
0812 19:24:36.875423 (+ 15697us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:38.053983 (+1178560us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:38.655782 (+601799us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540003c5d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:38.656030 (+   248us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2659094784}
I20260812 19:24:38.708104  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:38.695250 15596 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:38.712093  7603 raft_consensus.cc:729] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:38.715469  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:38.716753  6354 rpcz_store.cc:276] 0812 19:24:37.253456 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:37.253622 (+   166us) service_pool.cc:227] Handling call
0812 19:24:38.142127 (+888505us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:38.192062 (+ 49935us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:38.696009 (+503947us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b540003f7d0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:38.696164 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1928516992}
I20260812 19:24:38.717831  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:38.722541  6241 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:38.714392 15809 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.727341  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:38.727569  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:38.716822 15658 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:38.741981  6482 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260812 19:24:38.744575  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:38.725227  7603 consensus_queue.cc:260] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:38.709887 15583 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260812 19:24:38.746533  7603 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:38.745538  6354 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:38.728169 15849 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:38.752622  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:38.754057  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:38.758019 15268 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.760039 15702 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:38.760190  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:38.760826  6473 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:38.763204  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.764575  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.765199  6482 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:38.734200 15936 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260812 19:24:38.742111 16002 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:38.752628 15849 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.768501 15849 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:38.768884 15810 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.769301  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:38.770390 15986 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:38.770392  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:38.771903  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:38.771807 15863 consensus_queue.cc:237] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:38.773034 15910 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.228s	user 0.000s	sys 0.004s
I20260812 19:24:38.773718  6359 raft_consensus.cc:1261] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260812 19:24:38.716527 15913 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.776533 15913 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.749872  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:38.777485  6464 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:38.780467 15915 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.782586  6344 raft_consensus.cc:2396] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260812 19:24:38.748323 16009 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:38.708102 15960 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:38.725715 15876 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:38.794217  6464 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:38.785918  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:38.855293  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:38.785687 15438 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:38.857540  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 56471.5us
I20260812 19:24:38.864989  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:38.864935  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:38.881731  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2461) took 1086 ms. Trace:
I20260812 19:24:38.723702 15777 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:24:38.866629  6178 leader_election.cc:334] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.110s (SENT)
I20260812 19:24:38.884531  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:38.884613  6241 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:38.879030  6473 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:38.882391  6230 rpcz_store.cc:276] 0812 19:24:37.795452 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:38.007378 (+211926us) service_pool.cc:227] Handling call
0812 19:24:38.007824 (+   446us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:38.666751 (+658927us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:38.881377 (+214626us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54000f5fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:38.881640 (+   263us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1362130816}
I20260812 19:24:38.904739  6464 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:38.905617  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:38.905977  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:38.906390  6342 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:24:38.969951  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:38.971235  6482 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:38.971501  6342 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
W20260812 19:24:38.974087  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 107481us
I20260812 19:24:38.975742  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:38.976431  6241 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:38.979630 16010 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:38.979687  6342 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:38.980448 16010 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:38.982417 16010 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:38.901556 15811 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:38.984333 15686 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:38.984764 15686 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:38.985899  6354 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:38.985620 15686 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:38.986207 15777 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:38.987032 15686 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:38.971235  6473 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:38.883359 15876 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:24:38.997135  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 408782us
I20260812 19:24:38.994874  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:38.999642  6241 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:39.000272  6230 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:39.001149  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:38.996179  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:39.003827  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:38.998319  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:38.786891 15658 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:38.900930 15848 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:39.010250  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:38.900692 15915 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:39.019496  6230 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:39.021415  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.021986  6230 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:39.022198  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:39.026129 15913 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:39.031579 15913 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.033468 15989 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:39.033927 15913 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:39.034092 15989 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:38.880590 15438 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.037362  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.038151  6241 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:24:39.038379  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:39.038498  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:39.007486 15268 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:39.039424  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:39.053045  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:39.054462  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:39.013543 15777 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:38.862725 16009 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:39.060243  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:39.041136 15859 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:39.058338  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:39.060233  7603 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:24:39.055845 15938 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:39.057060  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.055478 15986 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:39.071259  6241 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:39.069049  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:39.054826 15936 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:39.007040 15992 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:39.056614 15837 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:39.056353  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.059634 15777 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:39.014146 15948 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.027535 15848 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.075923  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:39.067829 15838 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:39.114012  6354 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260812 19:24:39.062882 15849 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:39.068465  6417 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:39.037573 15915 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.077162  6230 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:24:39.064641 15809 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:39.124505 15809 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:39.124752 15915 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:39.047396 15811 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260812 19:24:39.125074 15948 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:39.125597  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 57244.7us
I20260812 19:24:39.055684 15989 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.126350 15357 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:24:39.112445 15837 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:39.064481 16011 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260812 19:24:39.127903 15986 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:39.059857 15702 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260812 19:24:39.078583 15777 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
W20260812 19:24:39.119397  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 59282.8us
I20260812 19:24:39.135743  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:39.055850 15268 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.119829  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.099483 15936 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:39.075457 15938 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:39.122558  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:39.124042 15992 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:39.142256 15799 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:39.142823 15799 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:39.143262 15799 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:39.126367 15811 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:39.148204 15811 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:39.151346 15960 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:39.153448 16009 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:39.153921  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:39.156176 15268 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:39.157419 15702 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:39.158074 15702 raft_consensus.cc:686] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:39.159251 15702 consensus_queue.cc:237] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.161737  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:39.162693 15658 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:39.163861 15936 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:39.165161 15936 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.122180 15849 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:39.166946 15849 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:39.133235 15838 raft_consensus.cc:686] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:39.171932 15838 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:39.174211 15811 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:39.176923  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:39.164242  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:39.183360 16022 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260812 19:24:39.112866 15848 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:39.134688 15837 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:24:39.121351  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 54866.3us
I20260812 19:24:39.100147  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:39.166343  6483 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260812 19:24:39.125015 15809 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:24:39.186311  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 86286.2us
I20260812 19:24:39.186107 15837 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.188700 15848 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:39.189229 15848 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:39.189709 15848 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:39.191479  6347 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 18. Current term is 19. Ops: []
I20260812 19:24:39.193056  6347 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260812 19:24:39.194072  6353 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 899) took 1391 ms (client timeout 1815 ms). Trace:
I20260812 19:24:39.068885 16002 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260812 19:24:39.196762  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:39.194566  6353 rpcz_store.cc:269] 0812 19:24:37.802946 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:37.865753 (+ 62807us) service_pool.cc:227] Handling call
0812 19:24:39.193849 (+1328096us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54001b9754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:39.193972 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":884986112}
I20260812 19:24:39.198050  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:39.203049  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:39.205693  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:39.207120 15833 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260812 19:24:39.077853 15876 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:39.207835 15982 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.623s	user 0.010s	sys 0.005s
I20260812 19:24:39.199808 15357 raft_consensus.cc:686] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:39.190543 15889 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260812 19:24:39.209460 15357 consensus_queue.cc:237] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:39.185516 15938 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:39.212065  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:39.215797  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:39.218117  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:39.212863  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:39.213739 15992 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260812 19:24:39.224196 15961 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:39.224754 15961 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:39.218936 15889 raft_consensus.cc:2741] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260812 19:24:39.225639 15961 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:39.226274 15185 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:39.220569 16016 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260812 19:24:39.226969 15185 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.229115 15185 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:39.232717 15841 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:39.199884 15959 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260812 19:24:39.226745 15889 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:39.238328 15889 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:39.238834 15889 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:39.215544 15986 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:39.212888  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:39.200188 16009 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:39.213863 15948 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:39.215171 14889 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:39.243944 15884 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:39.262696 15884 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.264183 15960 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:39.264767 15960 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:39.266145 15960 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.266919 15799 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:39.267907 15960 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:39.269160 15799 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:39.273500  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:39.211863 16011 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260812 19:24:39.213995 15268 consensus_queue.cc:1046] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260812 19:24:39.264789 15884 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:39.260726  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:39.277619  7607 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:39.261114 15992 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:39.261000  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:39.278424 15992 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:39.239359 15897 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260812 19:24:39.279207  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 901) took 1352 ms. Trace:
I20260812 19:24:39.279955 15992 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.267925  6349 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260812 19:24:39.287166  7598 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:39.244438  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:39.279587  6352 rpcz_store.cc:276] 0812 19:24:37.926603 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:38.024023 (+ 97420us) service_pool.cc:227] Handling call
0812 19:24:38.024346 (+   323us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:38.569000 (+544654us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:39.278949 (+709949us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54001b8854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:39.279140 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1148194048}
I20260812 19:24:39.291927  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2460) took 1499 ms. Trace:
I20260812 19:24:39.292404  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:39.293119  6242 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:39.292625  6228 rpcz_store.cc:276] 0812 19:24:37.792796 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:37.932801 (+140005us) service_pool.cc:227] Handling call
0812 19:24:37.933190 (+   389us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:38.531685 (+598495us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:39.291633 (+759948us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54000f4bd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:39.291859 (+   226us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1308063616}
I20260812 19:24:39.241952 16002 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260812 19:24:39.304462  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 60196.4us
I20260812 19:24:39.305840  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:39.314854  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:39.322297  6228 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:39.313488  6242 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
I20260812 19:24:39.314971 15842 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:39.314421 16011 raft_consensus.cc:2741] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260812 19:24:39.332779  6416 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:39.314779 15926 consensus_queue.cc:1046] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260812 19:24:39.317061 15686 consensus_queue.cc:1046] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260812 19:24:39.331640 16002 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:39.350173  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:39.350241 15845 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:24:39.350900 15845 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:39.351526  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:53166 (request call id 300) took 1424 ms. Trace:
I20260812 19:24:39.353983  6359 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260812 19:24:39.352033  6232 rpcz_store.cc:276] 0812 19:24:37.945499 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:38.135454 (+189955us) service_pool.cc:227] Handling call
0812 19:24:39.350888 (+1215434us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54000f4bd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fdaf0 00007f98f7780f2a 00007f98fc6bdc6e 00007f98f5dc0807 00007f98f5dc0792 00007f98f5dc06c1 00007f98f5dc063c 00007f98f5dbf8f2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:39.351413 (+   525us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":840633088}
I20260812 19:24:39.359119  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:39.369326  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:24:39.370184  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 84633.1us
I20260812 19:24:39.376466  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:39.377213  6465 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:39.379760  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:39.382421  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:39.383668  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:39.383798  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:39.384249  6465 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:39.393590  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:39.398104  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:39.347249 15842 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:39.358551 15926 consensus_queue.cc:1225] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer 54f83319db6b49929cc8f18a66a66975 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260812 19:24:39.391376 15986 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:39.395670 15850 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:39.398586  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:39.355871 16002 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:39.424432  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.425631  6232 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:39.432461  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:39.433765  6464 raft_consensus.cc:2396] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260812 19:24:39.436115  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.431102  7607 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:39.441571  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:39.443022  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.443202  6298 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:24:39.445348  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 7e0797ad50cb46cfb10b4a38cc815917, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.470091  6232 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:39.456390  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:39.473232  6477 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:39.398993 16031 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election won for term 14
W20260812 19:24:39.470952  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 7e0797ad50cb46cfb10b4a38cc815917, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.352010 15845 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:39.430485 16002 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:39.394090 15989 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260812 19:24:39.439088 15799 consensus_queue.cc:1046] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260812 19:24:39.430853 15915 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:39.435084 15850 raft_consensus.cc:686] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:39.473287  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.395982 15809 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:39.422969 15849 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.417650 15948 raft_consensus.cc:3032] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:24:39.475798 16027 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:39.483150 15837 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:39.497479  6232 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:39.419620 15842 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:39.499384  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2724) took 1157 ms. Trace:
I20260812 19:24:39.500622 16011 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260812 19:24:39.503826  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 368145us
I20260812 19:24:39.506843  6230 rpcz_store.cc:276] 0812 19:24:38.341969 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:39.132524 (+790555us) service_pool.cc:227] Handling call
0812 19:24:39.171191 (+ 38667us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:39.171914 (+   723us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:39.171965 (+    51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:39.172677 (+   712us) log.cc:842] Serialized 26 byte log entry
0812 19:24:39.324877 (+152200us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:39.324916 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:39.325837 (+   921us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:39.499102 (+173265us) raft_consensus.cc:1671] finished
0812 19:24:39.499131 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:39.499307 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3806,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":63,"thread_start_us":151711,"threads_started":1,"wal-append.queue_time_us":228622}
I20260812 19:24:39.510192  6464 raft_consensus.cc:1261] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260812 19:24:39.511205  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.516393  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.522059  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.526151  6232 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
W20260812 19:24:39.527930  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet c8fcb9244e2242f0bb95ee6cb9a69d50, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:39.528398  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet c8fcb9244e2242f0bb95ee6cb9a69d50, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.531142  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:39.530560  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:39.533049  6352 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:39.421226 15986 raft_consensus.cc:686] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:39.535441  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.535831  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:39.537467  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:39.505571 15948 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:39.538955  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:39.542745  6359 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
W20260812 19:24:39.545917  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 186922us
I20260812 19:24:39.531975  6232 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:39.550293  6224 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260812 19:24:39.553503  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:39.528864 15837 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:39.536788 15845 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Advancing to term 19
W20260812 19:24:39.556941  6229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2713) took 2368 ms (client timeout 1547 ms). Trace:
W20260812 19:24:39.562777  6345 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 2300) took 2444 ms (client timeout 2203 ms). Trace:
W20260812 19:24:39.557150  6238 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2448) took 2223 ms (client timeout 1857 ms). Trace:
W20260812 19:24:39.563441  6345 rpcz_store.cc:269] 0812 19:24:37.105536 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:37.105699 (+   163us) service_pool.cc:227] Handling call
0812 19:24:39.549976 (+2444277us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400408dd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:39.550127 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":331262720}
I20260812 19:24:39.557544  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2306) took 2439 ms. Trace:
I20260812 19:24:39.498780 15915 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.495831 15777 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.564855  6350 rpcz_store.cc:276] 0812 19:24:37.112858 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:37.113024 (+   166us) service_pool.cc:227] Handling call
0812 19:24:37.142716 (+ 29692us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:38.498490 (+1355774us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:39.551641 (+1053151us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003b15d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:39.551902 (+   261us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3105541504}
I20260812 19:24:39.565733  6230 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:39.580914  6241 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:24:39.564240  6238 rpcz_store.cc:269] 0812 19:24:37.329417 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:37.329590 (+   173us) service_pool.cc:227] Handling call
0812 19:24:39.552100 (+2222510us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54002f9754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:39.552276 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":527143680}
W20260812 19:24:39.563414  6229 rpcz_store.cc:269] 0812 19:24:37.181649 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:37.204212 (+ 22563us) service_pool.cc:227] Handling call
0812 19:24:39.549700 (+2345488us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54002931d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:39.549887 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1754482048}
I20260812 19:24:39.596647  6230 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260812 19:24:39.597250  6230 pending_rounds.cc:76] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 8
I20260812 19:24:39.597532  6230 pending_rounds.cc:97] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260812 19:24:39.597828  6230 raft_consensus.cc:2866] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:39.602887  6229 raft_consensus.cc:1261] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260812 19:24:39.619521  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 101208us
I20260812 19:24:39.618891  6477 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:39.616288  6350 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:39.626361  6350 raft_consensus.cc:595] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:39.627274  6350 raft_consensus.cc:603] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:39.509342 16027 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.629801  6477 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260812 19:24:39.628685  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 117613us
W20260812 19:24:39.625270  6178 leader_election.cc:334] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.651s (SENT)
I20260812 19:24:39.596725 16031 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:39.679563 15702 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:39.679967  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:39.679642 15952 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260812 19:24:39.682502 16031 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.692868  7594 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:39.693641  7594 raft_consensus.cc:595] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
W20260812 19:24:39.695576  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 529ed979cd2842acb5bc24debb151b93, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:39.696033  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 529ed979cd2842acb5bc24debb151b93, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.674628  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:39.703354  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:39.715624  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:39.718158  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 170463us
I20260812 19:24:39.704078 15841 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:39.593266 15850 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:39.691995 16035 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260812 19:24:39.643193 15705 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260812 19:24:39.702975 15583 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:39.737965  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.618999 15986 consensus_queue.cc:237] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.693325 15809 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:39.747957  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2728) took 1016 ms. Trace:
W20260812 19:24:39.722434 15848 consensus_meta.cc:287] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.532s	user 0.015s	sys 0.001s
I20260812 19:24:39.704433 15849 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:39.715620 15876 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:39.672204 15810 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260812 19:24:39.735600 15952 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:39.769006  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:39.784658  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.640774 15837 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:39.628108 15948 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:39.786283  6416 connection.cc:232] RPC call timeout handler was delayed by -1.1357889629434794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
I20260812 19:24:39.756104 15936 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260812 19:24:39.792346  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0304889630060643s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260812 19:24:39.793416  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0070889629423618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
I20260812 19:24:39.793335  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.794514  6229 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
W20260812 19:24:39.786934  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 108950us
I20260812 19:24:39.795003  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:39.796049  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:39.796928  6229 raft_consensus.cc:2379] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:39.775775 15871 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:39.797782  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:39.805586  6229 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 9. Current term is 10. Ops: []
I20260812 19:24:39.807757  6229 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:39.773206 15777 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:39.744378 15841 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:39.839927  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 45031.6us
I20260812 19:24:39.841799  6229 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260812 19:24:39.847879  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:39.842851  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:39.750914 15357 consensus_queue.cc:1046] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260812 19:24:39.783651 15952 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:39.854588  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:39.774495 15848 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.856263 15856 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:39.858002 15848 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:39.860155 15959 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 19:24:39.860853 15959 consensus_queue.cc:1225] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260812 19:24:39.866393 16062 raft_consensus.cc:2741] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260812 19:24:39.871240  6229 pending_rounds.cc:76] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 10
I20260812 19:24:39.871590  6229 pending_rounds.cc:97] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260812 19:24:39.871919  6229 raft_consensus.cc:2866] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:24:39.873351 15960 consensus_meta.cc:287] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.006s
I20260812 19:24:39.875061 15915 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:39.875548 16051 raft_consensus.cc:3032] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:39.875984 16051 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:39.760267 15583 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.878822  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:39.883328  6232 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:39.879906 15848 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:39.884984 16058 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:39.884492 16051 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:39.885843 16036 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260812 19:24:39.877847 15952 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
W20260812 19:24:39.886749 16043 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
W20260812 19:24:39.893114  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 177609us
W20260812 19:24:39.876590 15889 consensus_meta.cc:287] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.000s
I20260812 19:24:39.847648 15948 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:39.883074  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:39.906287  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:39.909085  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:39.893366 16062 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 19:24:39.877278 15918 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:39.851919  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:39.894543 15848 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:24:39.900838 16037 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260812 19:24:39.913247  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:39.945658  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:39.922726  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:39.924026  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:39.947525  6349 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 15: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:39.924266  6347 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260812 19:24:39.925271  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:39.925815  6359 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260812 19:24:39.927327  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:39.927608  7607 raft_consensus.cc:3032] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:39.949107  7607 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:39.949153  6354 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:39.929458  6352 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260812 19:24:39.930959  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:39.933094  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 81418.3us
I20260812 19:24:39.912307  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:39.901150 15458 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:39.897568 16058 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:39.910751 16051 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:39.958164  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 45939.4us
I20260812 19:24:39.958251 15809 raft_consensus.cc:2741] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260812 19:24:39.967204 15809 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:24:39.969655 15809 raft_consensus.cc:3032] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:39.970085 15809 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:39.971604  6345 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
W20260812 19:24:39.972374  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.949s (SENT) [suppressed 31 similar messages]
I20260812 19:24:39.972781 15458 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:39.972608 15809 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.950152  7607 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:39.974081  7591 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:39.974704  7607 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:39.975214 15809 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:39.981711  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:39.983831 16078 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260812 19:24:39.985289 15777 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:39.986617 15185 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:39.910290 15889 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.989452  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2737) took 1240 ms. Trace:
I20260812 19:24:39.990018 15889 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:39.989977  6238 rpcz_store.cc:276] 0812 19:24:38.749011 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:39.582621 (+833610us) service_pool.cc:227] Handling call
0812 19:24:39.583099 (+   478us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:39.616032 (+ 32933us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:39.616077 (+    45us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:39.636205 (+ 20128us) log.cc:842] Serialized 52 byte log entry
0812 19:24:39.775011 (+138806us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:39.944757 (+169746us) log.cc:842] Serialized 14 byte log entry
0812 19:24:39.945746 (+   989us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:39.945825 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:39.988549 (+ 42724us) raft_consensus.cc:1671] finished
0812 19:24:39.988782 (+   233us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:39.989273 (+   491us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6659,"prepare.queue_time_us":77688,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":25459,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":4799,"thread_start_us":175215,"threads_started":2,"wal-append.queue_time_us":174028}
I20260812 19:24:39.959540  6352 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260812 19:24:39.960507 16058 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:39.960306  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:39.961545  6347 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260812 19:24:39.963186 16062 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:39.963557  7597 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:24:39.964051  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:39.965488  6359 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260812 19:24:39.959357 16071 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260812 19:24:39.995857  6416 leader_election.cc:398] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18.
I20260812 19:24:40.008855  6416 leader_election.cc:401] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:24:40.009876  6349 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 13: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:40.010807  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:40.000452  6354 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:24:39.910686 16047 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:39.937722 15842 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260812 19:24:39.953969 15938 consensus_meta.cc:287] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.004s
I20260812 19:24:40.022074  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:39.956391 15837 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:39.944720 15848 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:40.019551  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:40.022806  6345 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:40.008409  7607 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260812 19:24:40.029057  6347 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:40.023151  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:40.025041  6350 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:40.034767  6350 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260812 19:24:40.016263 15889 consensus_queue.cc:1046] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260812 19:24:40.029312 15938 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:40.036947 15889 raft_consensus.cc:3032] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:40.037423 15889 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:40.037972 15938 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:40.038802  7603 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:40.038399 15889 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:39.938753 15357 consensus_queue.cc:1046] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.085s
I20260812 19:24:40.000855 15986 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:40.049857  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:39.944996 15918 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:40.025978 16053 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:40.025818 16046 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18.
I20260812 19:24:40.025905 15837 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:40.030011 16047 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:40.072239  6238 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 17. Current term is 18. Ops: []
W20260812 19:24:40.051909 16002 consensus_meta.cc:287] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.003s
I20260812 19:24:40.040115 15889 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:40.021399 16031 consensus_queue.cc:1046] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260812 19:24:40.038805 15841 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:40.023279 14889 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260812 19:24:40.080329  6347 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:40.084612 16081 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260812 19:24:40.092080  6345 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:24:40.096772  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:40.042971 15926 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260812 19:24:40.111840  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:40.115505  6178 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:40.079326 15837 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:40.074003 15842 raft_consensus.cc:3032] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:40.041687 16089 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260812 19:24:40.120676 15339 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:40.089118 16002 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.082346 15185 consensus_queue.cc:1046] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260812 19:24:40.109668 16062 raft_consensus.cc:686] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:40.087136 15357 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260812 19:24:40.134892 15777 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:40.135416 15845 consensus_queue.cc:1046] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260812 19:24:40.193606 16002 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:40.187542 15842 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:40.155902 15919 raft_consensus.cc:3032] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
W20260812 19:24:40.162525 15897 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260812 19:24:40.197096  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:40.119844 15884 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:40.150961  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2454) took 2555 ms. Trace:
I20260812 19:24:40.144007 15583 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:40.148223  6344 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2428) took 2865 ms (client timeout 2795 ms). Trace:
W20260812 19:24:40.203683  6344 rpcz_store.cc:269] 0812 19:24:37.283156 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:37.283497 (+   341us) service_pool.cc:227] Handling call
0812 19:24:40.147980 (+2864483us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400180954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:40.148140 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3349825408}
I20260812 19:24:40.158501  6236 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:40.150029 15438 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:40.077798 16047 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:24:40.182029  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 64232us
I20260812 19:24:40.166359 16027 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:40.135833 16031 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:40.200081  6235 rpcz_store.cc:276] 0812 19:24:37.595549 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:37.653403 (+ 57854us) service_pool.cc:227] Handling call
0812 19:24:37.730398 (+ 76995us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:38.108589 (+378191us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:40.150608 (+2042019us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b5400179154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:40.150864 (+   256us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":854196608}
I20260812 19:24:40.145908 15918 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:40.201797  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 178740us
W20260812 19:24:40.207158  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 196404us
I20260812 19:24:40.214035  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:40.247458  6229 raft_consensus.cc:2396] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260812 19:24:40.214115  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.217247  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:40.197496 15919 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:24:40.251119  6178 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.523s (SENT)
I20260812 19:24:40.251787  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:40.256402  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.257053  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.258069  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.212167 16047 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:40.259366  6473 raft_consensus.cc:2396] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260812 19:24:40.260102  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.261422  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:40.262143  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.204180 15777 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:40.263614  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.264672  6464 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:40.267516  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.267628  6482 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:40.269471  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.270134  6482 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:40.275406  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.274030 15952 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:40.276258  6474 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:40.278319  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.279135 15952 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:40.279633  6474 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:40.277376  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.281414  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.210803 15884 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:40.254557 15918 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:40.284216  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:40.262861 15339 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:40.285883  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:40.287603 15856 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:40.288277 15856 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:40.285730 15339 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.290287  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:40.292349  6473 raft_consensus.cc:2396] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260812 19:24:40.295751  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.293434  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.297271  6474 raft_consensus.cc:2362] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16. Re-sending same reply.
W20260812 19:24:40.297896  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 46835.2us
I20260812 19:24:40.298492  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.299216  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:40.299821  6474 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:40.300016  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.300177  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.301357  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.293035  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.304675  6482 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:40.301203  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.305842  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.307495  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.307590  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:40.305975  6474 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:24:40.314092  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.316311 16129 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:24:40.316668  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:40.317082  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.317327 15889 consensus_queue.cc:1046] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:40.318039  6482 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:40.318172  6235 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260812 19:24:40.318626 16118 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:40.319118  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.319774  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.319770  6482 raft_consensus.cc:2362] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18. Re-sending same reply.
I20260812 19:24:40.322986  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:40.325819  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:40.328855  6483 raft_consensus.cc:2354] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14.
I20260812 19:24:40.283417 15884 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:40.389747  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:40.390141  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.391116  6482 raft_consensus.cc:2354] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13.
I20260812 19:24:40.392383  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.393281  6482 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:40.394043  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.395043  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.395750  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.249716 16031 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:40.396523  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.396983  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.397740  6477 raft_consensus.cc:2354] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13.
I20260812 19:24:40.250300 16062 consensus_queue.cc:237] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:40.259330 15357 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.068s
I20260812 19:24:40.203285 15842 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.425280  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:40.398551  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.459684  6477 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:40.409936  6465 raft_consensus.cc:2396] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260812 19:24:40.304209 15873 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:40.336071  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.398352 16031 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:40.459357  7607 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
I20260812 19:24:40.291016 15919 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.464026  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.462805  6464 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:40.294909 15777 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:40.406299 16042 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260812 19:24:40.469509  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.472580  6417 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:40.476689  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.477895  6477 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:40.479163  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.483675  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.483994  7607 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:40.484764  6482 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:40.466933 15357 consensus_queue.cc:1225] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260812 19:24:40.488221  6483 raft_consensus.cc:2354] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15.
W20260812 19:24:40.492223 16110 log.cc:924] Time spent T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260812 19:24:40.496853 15777 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:40.496955 15856 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:40.496933  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:40.480494 15919 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:40.457605 16002 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260812 19:24:40.527681  6354 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:40.466785 15956 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.101s
I20260812 19:24:40.532492 16047 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.533221 15800 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Stepping down as leader of term 15
W20260812 19:24:40.468539 16051 consensus_queue.cc:1159] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "54f83319db6b49929cc8f18a66a66975" responder_term: 15 status { last_received { term: 13 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 14. Current term is 15. Ops: [14.10-14.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:24:40.458340 15837 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.542515  6474 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:40.547290  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.553759 16128 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:40.546416 15800 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:40.557091 15800 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:40.559331 15876 consensus_meta.cc:287] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.776s	user 0.012s	sys 0.000s
I20260812 19:24:40.559814 15876 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:40.561972  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.560518 16047 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:40.563602  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.564252  6482 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:40.488469 15873 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:40.338841  6344 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:40.563823  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.487937 15842 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:40.545305  6236 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260812 19:24:40.570326  6236 pending_rounds.cc:76] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 6
I20260812 19:24:40.570849  6236 pending_rounds.cc:97] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260812 19:24:40.570982  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 878) took 1600 ms. Trace:
I20260812 19:24:40.571328  6236 raft_consensus.cc:2866] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:40.566851  6464 raft_consensus.cc:2354] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15.
I20260812 19:24:40.572882  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2703) took 3710 ms. Trace:
I20260812 19:24:40.571448  6475 rpcz_store.cc:276] 0812 19:24:38.970709 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:38.972401 (+  1692us) service_pool.cc:227] Handling call
0812 19:24:38.972738 (+   337us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:38.973105 (+   367us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:38.973131 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:40.193804 (+1220673us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b2c000cda88. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:24:40.194235 (+   431us) log.cc:842] Serialized 26 byte log entry
0812 19:24:40.549119 (+354884us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:40.549183 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:40.549286 (+   103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:40.549350 (+    64us) raft_consensus.cc:1671] finished
0812 19:24:40.549367 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:40.570913 (+ 21546us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":353,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"spinlock_wait_cycles":38481152,"thread_start_us":354425,"threads_started":1,"wal-append.queue_time_us":297683}
I20260812 19:24:40.573829  6342 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 15: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:24:40.574882  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 236712us
I20260812 19:24:40.575832  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:40.577179  6475 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:40.578318  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.579887  6475 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260812 19:24:40.581491  6475 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260812 19:24:40.573494  6236 rpcz_store.cc:276] 0812 19:24:36.862161 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:36.862313 (+   152us) service_pool.cc:227] Handling call
0812 19:24:36.873544 (+ 11231us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:38.575356 (+1701812us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b18002b4b80. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f77b3856 00007f98f7705f7e 00007f98f776f367 00007f98f7770b4e 00007f98f777ac89 00007f98f777b556 00007f98f7777edf 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684
0812 19:24:40.157974 (+1582618us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b58005c06b0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f76f3f63 00007f98f7757aba 00007f98f776f3af 00007f98f7770b4e 00007f98f777ac89 00007f98f777b556 00007f98f7777edf 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684
0812 19:24:40.572197 (+414223us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:40.572816 (+   619us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2101200000}
I20260812 19:24:40.534756 15357 consensus_queue.cc:1046] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260812 19:24:40.585759  6475 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:40.586850  6235 raft_consensus.cc:1226] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:40.540963 15848 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.572742 15607 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:40.629698  6475 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260812 19:24:40.568593 15873 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:40.588152 16031 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:40.644526  6347 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:40.650930 16118 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:40.651599 16118 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:40.653038 15848 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:40.639783 15873 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:40.638388 15607 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:40.640291 16058 consensus_meta.cc:287] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.004s
I20260812 19:24:40.650795 15933 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:40.664374 15933 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:40.666123 16058 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.668371 16058 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:40.669193 15933 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:40.669713  6473 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:40.672952  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.675046  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2732) took 1935 ms. Trace:
I20260812 19:24:40.675457  6241 rpcz_store.cc:276] 0812 19:24:38.739873 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:39.077594 (+337721us) service_pool.cc:227] Handling call
0812 19:24:40.674817 (+1597223us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b540027ddd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:40.674958 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1021263616}
I20260812 19:24:40.643391 16047 raft_consensus.cc:3032] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:40.685947  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:40.692975  6236 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:40.696627  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:40.697407  6241 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 10.
W20260812 19:24:40.701363  7591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 628) took 1540 ms (client timeout 1801 ms). Trace:
W20260812 19:24:40.701830  7591 rpcz_store.cc:269] 0812 19:24:39.161303 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:39.161449 (+   146us) service_pool.cc:227] Handling call
0812 19:24:40.701176 (+1539727us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b540048b554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:40.701299 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1866536192}
I20260812 19:24:40.653057 16118 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.712949  6417 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:40.713670 16118 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:40.722239 16051 raft_consensus.cc:2741] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260812 19:24:40.684592 15933 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:40.684929 16047 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:40.723095 15837 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:40.724095  6241 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:40.728013  6481 raft_consensus.cc:2396] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260812 19:24:40.743481  7591 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260812 19:24:40.739132  6236 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:40.739590 15933 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:40.756740 15933 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:40.760030 15882 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:40.766134 15822 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:40.805611 15985 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:40.828948  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 129898us
I20260812 19:24:40.828325 15916 raft_consensus.cc:979] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:40.833014 15956 raft_consensus.cc:1067] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:40.833225 15985 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.835795 15985 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:40.840325  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:40.841653 15916 raft_consensus.cc:3032] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:24:40.848472  6236 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:56292
I20260812 19:24:40.849560  6236 raft_consensus.cc:465] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Not starting forced leader election -- already a leader
I20260812 19:24:40.849066 15916 raft_consensus.cc:729] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:40.853688 15916 consensus_queue.cc:260] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:40.846699 16058 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:40.855469 16058 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:40.856442 16058 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.839129 15842 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260812 19:24:40.825981 16047 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:40.865110 15916 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:40.871930 16047 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
W20260812 19:24:40.874435 16051 consensus_queue.cc:1159] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f4ef77b3328a44e8a21dd902b370e25a" responder_term: 16 status { last_received { term: 13 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: [15.12-15.12]" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:24:40.876824  7603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 692) took 1617 ms. Trace:
I20260812 19:24:40.877411  7603 rpcz_store.cc:276] 0812 19:24:39.259732 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:39.265167 (+  5435us) service_pool.cc:227] Handling call
0812 19:24:39.265535 (+   368us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:40.039299 (+773764us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:40.876441 (+837142us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54004d12d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:40.876701 (+   260us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1777766272}
I20260812 19:24:40.866114 15856 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:40.878844  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:40.878566 15856 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.879753  6475 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 12: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:40.879873 15809 raft_consensus.cc:3032] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:40.880237 15809 raft_consensus.cc:729] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:40.880502 15985 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:40.880662  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:40.881342 15856 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:40.881031 15809 consensus_queue.cc:260] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.842031 16137 consensus_queue.cc:1046] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260812 19:24:40.882200 15809 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:40.892020 15918 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:40.892781 15918 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:40.870599 15842 consensus_queue.cc:1225] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260812 19:24:40.901715 15842 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:40.902426 15842 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.918797 16031 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:40.919593 16031 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.920393 15889 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:40.920825 15889 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:40.921793 15889 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.921875 15842 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:39.772017  6228 rpcz_store.cc:276] 0812 19:24:38.731912 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:39.367995 (+636083us) service_pool.cc:227] Handling call
0812 19:24:39.368372 (+   377us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:39.368609 (+   237us) raft_consensus.cc:1520] Early marking committed up to index 7
0812 19:24:39.645316 (+276707us) log.cc:842] Serialized 14 byte log entry
0812 19:24:39.747531 (+102215us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:39.747584 (+    53us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:39.747628 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:39.747718 (+    90us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:39.747878 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":25456,"prepare.queue_time_us":312908,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":23173,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":1647,"thread_start_us":281487,"threads_started":2}
I20260812 19:24:40.924599 15268 raft_consensus.cc:3032] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:40.925889 15889 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:40.921949 16031 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:40.926005  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2451) took 3379 ms. Trace:
I20260812 19:24:40.941766  6224 rpcz_store.cc:276] 0812 19:24:37.546377 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:37.601769 (+ 55392us) service_pool.cc:227] Handling call
0812 19:24:39.550027 (+1948258us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:39.550818 (+   791us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:40.925776 (+1374958us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54002931d0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:40.925938 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4370128256}
W20260812 19:24:40.933192 15946 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.424s	user 0.017s	sys 0.019s
I20260812 19:24:40.934289 15268 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:40.955018 15268 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.956744 15268 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:40.958354  6055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 121) took 9075 ms. Trace:
I20260812 19:24:40.955976 16046 raft_consensus.cc:3032] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:40.963097 16046 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:40.963482 16143 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.124s	user 0.003s	sys 0.000s
I20260812 19:24:40.964174 16046 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:40.895498 15985 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:40.952108 15946 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.445s	user 0.017s	sys 0.020s
I20260812 19:24:40.959036  6055 rpcz_store.cc:276] 0812 19:24:31.883252 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:31.883873 (+   621us) service_pool.cc:227] Handling call
0812 19:24:40.958212 (+9074339us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:24:35.729046 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:24:35.729704 (+   658us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:24:35.729759 (+    55us) write_op.cc:435] Acquired schema lock
0812 19:24:35.729771 (+    12us) tablet.cc:660] Decoding operations
0812 19:24:35.730537 (+   766us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:24:35.730626 (+    89us) write_op.cc:641] Partition lock acquired for write op
0812 19:24:35.730689 (+    63us) tablet.cc:683] Acquiring locks for 5 operations
0812 19:24:35.731406 (+   717us) tablet.cc:699] Row locks acquired
0812 19:24:35.731443 (+    37us) write_op.cc:260] PREPARE: finished
0812 19:24:35.731625 (+   182us) write_op.cc:270] Start()
0812 19:24:35.731805 (+   180us) write_op.cc:276] Timestamp: P: 1786562675731560 usec, L: 0
0812 19:24:35.731827 (+    22us) op_driver.cc:331] REPLICATION: starting
0812 19:24:35.732588 (+   761us) log.cc:842] Serialized 2039 byte log entry
0812 19:24:36.463455 (+730867us) op_driver.cc:444] REPLICATION: finished
0812 19:24:36.883834 (+420379us) write_op.cc:301] APPLY: starting
0812 19:24:36.966529 (+ 82695us) tablet.cc:1365] starting BulkCheckPresence
0812 19:24:37.021619 (+ 55090us) tablet.cc:1368] finished BulkCheckPresence
0812 19:24:37.021732 (+   113us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:24:37.461183 (+439451us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:24:37.598365 (+137182us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0812 19:24:37.606383 (+  8018us) write_op.cc:312] APPLY: finished
0812 19:24:37.645864 (+ 39481us) log.cc:842] Serialized 57 byte log entry
0812 19:24:37.848142 (+202278us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:24:37.867317 (+ 19175us) write_op.cc:454] Released schema lock
0812 19:24:37.870526 (+  3209us) write_op.cc:341] FINISH: Updating metrics
0812 19:24:37.908892 (+ 38366us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:24:37.912689 (+  3797us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":470984,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":297528,"apply.run_cpu_time_us":30336,"apply.run_wall_time_us":1070956,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":378672,"prepare.run_cpu_time_us":22174,"prepare.run_wall_time_us":150686,"raft.queue_time_us":309080,"raft.run_cpu_time_us":22020,"raft.run_wall_time_us":351334,"replication_time_us":706801,"thread_start_us":865507,"threads_started":5,"wal-append.queue_time_us":502885,"wal-append.run_cpu_time_us":41519,"wal-append.run_wall_time_us":2706948}]]}
I20260812 19:24:41.006817 15871 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:40.993033 16046 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:40.987005 15873 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:41.013520 15871 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:41.025976 15800 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:41.047609 15985 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:41.060828  6242 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:41.061645  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 794) took 2709 ms. Trace:
I20260812 19:24:41.062009  6242 rpcz_store.cc:276] 0812 19:24:38.352064 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:39.327329 (+975265us) service_pool.cc:227] Handling call
0812 19:24:41.060404 (+1733075us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b5800001898. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:24:41.060617 (+   213us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:41.061353 (+   736us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:41.061577 (+   224us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3422464}
I20260812 19:24:41.066340 15607 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.077708 15918 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.079416 16088 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:41.080060 16088 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:41.081020 16088 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.081588 15889 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:41.082227 15889 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.082933 15989 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:24:41.083673 15989 consensus_queue.cc:1225] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer f4ef77b3328a44e8a21dd902b370e25a log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260812 19:24:41.083931 16011 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:41.084643 15889 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:41.084398 16011 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.097503  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 914) took 1041 ms. Trace:
I20260812 19:24:41.098098  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:41.115078  6481 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:41.090523  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2344) took 1088 ms. Trace:
I20260812 19:24:41.088605  7599 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:41.114455  6350 rpcz_store.cc:276] 0812 19:24:40.056122 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:40.056460 (+   338us) service_pool.cc:227] Handling call
0812 19:24:40.056794 (+   334us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:40.057009 (+   215us) raft_consensus.cc:1520] Early marking committed up to index 11
0812 19:24:40.257029 (+200020us) log.cc:842] Serialized 14 byte log entry
0812 19:24:41.097159 (+840130us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:41.097211 (+    52us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:24:41.097262 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:41.097333 (+    71us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:41.097445 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":860732,"prepare.queue_time_us":62412,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":58,"thread_start_us":151741,"threads_started":1}
I20260812 19:24:41.120750  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:41.095387 15438 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:41.095623 15989 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:41.129523 15938 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:41.129362 15438 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.130046 15938 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:41.130620 15938 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:41.129740 15989 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.086488 16011 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:41.136126  7603 pending_rounds.cc:76] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Aborting all ops after (but not including) 11
I20260812 19:24:41.142554  7603 pending_rounds.cc:97] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260812 19:24:41.140014  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:41.142916  6350 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260812 19:24:41.143062  7603 raft_consensus.cc:2866] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:41.144222  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:41.095094 14889 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:41.092032 15871 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:41.093925 16089 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:41.093526 15458 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.127744 15538 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:41.138929 16127 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:41.119303 15873 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:41.134968  6349 rpcz_store.cc:276] 0812 19:24:40.001821 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:40.030286 (+ 28465us) service_pool.cc:227] Handling call
0812 19:24:40.030634 (+   348us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:40.030820 (+   186us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:24:40.077111 (+ 46291us) log.cc:842] Serialized 14 byte log entry
0812 19:24:41.090126 (+1013015us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:41.090203 (+    77us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:41.090265 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:41.090344 (+    79us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:41.090459 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1032367,"prepare.queue_time_us":87746,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":1013488,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93}
I20260812 19:24:41.194512  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:41.191797  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:41.197950  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 951292us
I20260812 19:24:41.147526 16046 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:41.204509  6298 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:41.249644  6474 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260812 19:24:41.250640  6473 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:41.251946 15438 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.252491  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 911) took 1967 ms. Trace:
W20260812 19:24:41.252746 16165 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260812 19:24:41.226990 15986 raft_consensus.cc:3032] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:41.253319  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 2347) took 1069 ms. Trace:
I20260812 19:24:41.220038  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:41.255728 16089 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:41.255426 15538 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.256479 16127 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:41.257550 16046 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:41.320432  6470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2771) took 1927 ms (client timeout 1694 ms). Trace:
W20260812 19:24:41.320906  6470 rpcz_store.cc:269] 0812 19:24:39.393069 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:39.393241 (+   172us) service_pool.cc:227] Handling call
0812 19:24:41.320160 (+1926919us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54004457d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:41.320343 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1165841792}
I20260812 19:24:41.258033  6477 raft_consensus.cc:2396] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260812 19:24:41.259265  6475 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:41.261085  6350 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
I20260812 19:24:41.323093  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.323869  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:41.221215 15871 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:41.261788  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:41.229996 16167 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260812 19:24:41.269320  6353 rpcz_store.cc:276] 0812 19:24:39.284720 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:39.285006 (+   286us) service_pool.cc:227] Handling call
0812 19:24:39.312740 (+ 27734us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:39.318680 (+  5940us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:39.318734 (+    54us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:41.027909 (+1709175us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b1800394c00. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a
0812 19:24:41.080519 (+ 52610us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b2c00012928. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:24:41.081103 (+   584us) log.cc:842] Serialized 26 byte log entry
0812 19:24:41.136299 (+ 55196us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:24:41.136334 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:41.136417 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:41.252206 (+115789us) raft_consensus.cc:1671] finished
0812 19:24:41.252232 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:41.252429 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2411,"raft.queue_time_us":2569,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":3391,"spinlock_wait_cycles":14407424,"thread_start_us":53939,"threads_started":1,"wal-append.queue_time_us":167416}
I20260812 19:24:41.331976  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:41.332424  6352 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:24:41.274235  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:41.275691  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 71336.9us
I20260812 19:24:41.231559 15967 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
I20260812 19:24:41.310127  6347 rpcz_store.cc:276] 0812 19:24:40.183652 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:40.184371 (+   719us) service_pool.cc:227] Handling call
0812 19:24:41.253051 (+1068680us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54001ba154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:41.253252 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1022256512}
I20260812 19:24:41.281591  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:41.252524 15989 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.324501  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:41.327126  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 2285) took 1057 ms. Trace:
I20260812 19:24:41.336961  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:41.323134  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:41.328745  7597 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:41.339622  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:41.330674  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 68978.1us
I20260812 19:24:41.340881  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.333359  6473 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:41.342821  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:41.337565  6464 rpcz_store.cc:276] 0812 19:24:40.269671 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:40.469169 (+199498us) service_pool.cc:227] Handling call
0812 19:24:41.326927 (+857758us) spinlock_profiling.cc:243] Waited 84 ms on lock 0x7b54002d2154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:41.327069 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":193185536}
I20260812 19:24:41.345021  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:41.345809  6473 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:41.345990  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:41.346681  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:41.347247  6473 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:41.347654  6475 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260812 19:24:41.335570  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:41.314206  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:41.336894  6474 raft_consensus.cc:2396] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260812 19:24:41.348958  6475 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:41.344553  6470 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:41.344604  6344 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:41.353955  6350 raft_consensus.cc:2396] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260812 19:24:41.311128 15986 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:41.315554 15946 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:41.316902 15841 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:41.194562 14889 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.354159  6464 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:41.362483  6349 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260812 19:24:41.356825  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.356523  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:41.382019  6352 raft_consensus.cc:2354] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
I20260812 19:24:41.356773  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:41.352620 15931 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:41.383737  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.360441  6347 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:41.332217 15599 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:41.372136  6473 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:41.386016  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:41.367533  6475 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260812 19:24:41.339731 15833 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:41.331782 16179 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:41.380074  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:41.359768 15992 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:41.362989  6354 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:41.365569  7591 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260812 19:24:41.386871  6475 pending_rounds.cc:76] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 11
I20260812 19:24:41.387586  7598 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260812 19:24:41.392344  6475 pending_rounds.cc:97] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260812 19:24:41.392854  6475 raft_consensus.cc:2866] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:41.393215  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:41.393868  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:41.392397  6350 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260812 19:24:41.370040 15946 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:41.339907 15871 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:41.387840 15583 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:41.398281  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:41.423475 14889 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.398676  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:41.425374 16089 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:41.425678  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:41.426455  6349 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 19.
I20260812 19:24:41.406616  6352 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260812 19:24:41.416376 15986 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.416575  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:41.428485 15986 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:41.429270  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 917) took 1211 ms. Trace:
I20260812 19:24:41.429615 15800 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:41.430527  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:41.431224  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:41.429692  6359 rpcz_store.cc:276] 0812 19:24:40.218225 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:40.218431 (+   206us) service_pool.cc:227] Handling call
0812 19:24:40.248317 (+ 29886us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:41.095918 (+847601us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:41.095969 (+    51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:41.096604 (+   635us) log.cc:842] Serialized 26 byte log entry
0812 19:24:41.313427 (+216823us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:24:41.313495 (+    68us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:41.313601 (+   106us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:41.429051 (+115450us) raft_consensus.cc:1671] finished
0812 19:24:41.429079 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:41.429209 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":847148,"raft.queue_time_us":898022,"spinlock_wait_cycles":82785024,"thread_start_us":216334,"threads_started":1,"wal-append.queue_time_us":272490}
I20260812 19:24:41.352807 16113 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:41.384176 15931 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:41.432685 15931 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:41.431243 15800 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:41.434775 16128 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:41.435756  7594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44858 (request call id 14) took 1743 ms. Trace:
I20260812 19:24:41.352566 15686 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260812 19:24:41.421900 15871 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:41.368453 15841 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.419697 15458 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:41.418344 16088 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:41.439002  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:41.439373  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:41.442616  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:41.436211  7594 rpcz_store.cc:276] 0812 19:24:39.692576 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:39.692722 (+   146us) service_pool.cc:227] Handling call
0812 19:24:41.435412 (+1742690us) spinlock_profiling.cc:243] Waited 94.7 ms on lock 0x7b54004d2c20. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f770ddc0 00007f98f77729c2 00007f98fc6bc81a 00007f98f5dbbd04 00007f98f5dbbc92 00007f98f5dbbbc1 00007f98f5dbbb3c 00007f98f5dbadf2 00007f98f5bae94c 00007f98f5badd86
0812 19:24:41.435665 (+   253us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":217802112}
I20260812 19:24:41.417104 15948 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:41.414882 15946 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:41.446441 16009 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:41.457939  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:41.460455  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:41.456521  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:24:41.462558  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:24:41.463376  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:41.467701  6416 leader_election.cc:398] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
I20260812 19:24:41.468250  6416 leader_election.cc:401] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260812 19:24:41.444710 15458 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:41.453050 15842 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:41.479600 15538 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.485411 15938 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:41.486457 16009 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
I20260812 19:24:41.486788  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33386 (request call id 888) took 1273 ms. Trace:
I20260812 19:24:41.455227 15799 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:24:41.453404 15989 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260812 19:24:41.487393 15458 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:41.488689  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 956de4b24b3d4a2693e1dcc392b1dd00, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:41.492599  6342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2448) took 1562 ms (client timeout 1800 ms). Trace:
W20260812 19:24:41.526714  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 956de4b24b3d4a2693e1dcc392b1dd00, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.527196  6353 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260812 19:24:41.500041  6465 rpcz_store.cc:276] 0812 19:24:40.213437 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:40.213757 (+   320us) service_pool.cc:227] Handling call
0812 19:24:41.486538 (+1272781us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400364054. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:41.486724 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":370804608}
I20260812 19:24:41.443070 16184 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260812 19:24:41.499805  7597 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:41.504573  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:24:41.526881  6342 rpcz_store.cc:269] 0812 19:24:39.930411 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:39.930561 (+   150us) service_pool.cc:227] Handling call
0812 19:24:41.492404 (+1561843us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b5400028854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:41.492537 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1432044288}
I20260812 19:24:41.507261 15799 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:41.547091 15799 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:24:41.456509 15800 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260812 19:24:41.501817 16051 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:41.559954  7599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 684) took 3087 ms (client timeout 1639 ms). Trace:
W20260812 19:24:41.560483  7599 rpcz_store.cc:269] 0812 19:24:38.470485 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:38.470637 (+   152us) service_pool.cc:227] Handling call
0812 19:24:41.558088 (+3087451us) spinlock_profiling.cc:243] Waited 2.54 s on lock 0x7b54002e95d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:41.558227 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5849923328}
I20260812 19:24:41.501580 15357 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:41.561533  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:41.565315  6344 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 15: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:24:41.567423  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 62913.3us
I20260812 19:24:41.494081 15946 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260812 19:24:41.499303 15986 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260812 19:24:41.509754 15863 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260812 19:24:41.571846  6482 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260812 19:24:41.577900  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:41.578341  6482 pending_rounds.cc:76] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 9
I20260812 19:24:41.578752  6482 pending_rounds.cc:97] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260812 19:24:41.579141  6482 raft_consensus.cc:2866] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:41.544829 16046 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:41.572956  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.575342 15849 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:24:41.571404  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 2288) took 1300 ms. Trace:
I20260812 19:24:41.583029  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:41.583942 15915 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:41.588382 15458 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:41.569602 15869 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:41.572124 15357 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.595849 15938 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.600760 15583 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:41.602475 15841 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.627108 15961 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:41.577689 15686 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.030s
I20260812 19:24:41.562873 16051 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:41.615957  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 53126.7us
I20260812 19:24:41.614439  6477 rpcz_store.cc:276] 0812 19:24:40.270711 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:40.564805 (+294094us) service_pool.cc:227] Handling call
0812 19:24:41.571174 (+1006369us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b5400271354. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:41.571346 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1560743680}
I20260812 19:24:41.621173  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.623605  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:41.648269  6344 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 15: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:24:41.628079  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 1.30228e+06us
I20260812 19:24:41.577463 15538 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:41.619383 15915 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:41.620193 16046 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:41.649446  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.652176  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2476) took 1330 ms. Trace:
I20260812 19:24:41.622861 16179 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:41.653143  6230 rpcz_store.cc:276] 0812 19:24:40.321888 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:40.322511 (+   623us) service_pool.cc:227] Handling call
0812 19:24:40.391749 (+ 69238us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:40.392033 (+   284us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:24:40.464967 (+ 72934us) log.cc:842] Serialized 14 byte log entry
0812 19:24:40.568558 (+103591us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b1800410260. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff57b 00007f98f778288a
0812 19:24:40.962780 (+394222us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:41.651747 (+688967us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:41.651817 (+    70us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:41.651867 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:41.651957 (+    90us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:41.652100 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":959637,"prepare.queue_time_us":71625,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"spinlock_wait_cycles":18798720,"thread_start_us":142248,"threads_started":1,"wal-append.queue_time_us":345854}
I20260812 19:24:41.657447  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:41.658463  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:41.658797  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:41.659701  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:41.660821  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:41.661218 16051 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:41.661715 16046 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.645538  6417 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:41.674865  6481 raft_consensus.cc:2396] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260812 19:24:41.629318 16072 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:41.634162 15960 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:41.680426  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:41.631623 16131 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:41.634255 15961 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:41.685736  6465 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:41.684105  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:41.690230  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:41.691061 15876 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:41.691632 15884 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:41.724089  6477 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260812 19:24:41.631222 15989 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260812 19:24:41.693348 15731 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:41.663259 15538 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:41.694151 15777 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:41.740926 15777 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.743055 15777 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.743389 15799 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:41.695621 15952 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:41.695755 15458 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:41.755146  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:41.694422 15339 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:41.699067  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.756307  6465 raft_consensus.cc:2396] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260812 19:24:41.699980  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.622887 16113 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260812 19:24:41.663020 15946 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:41.703446  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.762997  6241 raft_consensus.cc:2396] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260812 19:24:41.704291  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.705737 15357 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:41.706679 15800 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:41.708989  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:41.713343  6475 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:41.767607  7599 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260812 19:24:41.719087  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:41.722247  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:41.668336 15915 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:41.727633  6178 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:41.771497  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.773975  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.693470  6230 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260812 19:24:41.730855  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2272) took 1465 ms. Trace:
I20260812 19:24:41.775954  6482 rpcz_store.cc:276] 0812 19:24:40.265181 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:40.573790 (+308609us) service_pool.cc:227] Handling call
0812 19:24:41.571345 (+997555us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:41.579717 (+  8372us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:41.730551 (+150834us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b5400271350. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:41.730777 (+   226us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2264943360}
I20260812 19:24:41.737244  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.777819  6235 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:41.632731 15869 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.743887  6236 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260812 19:24:41.748638 15992 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:41.724594 15961 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:41.749630 15731 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.750619 15538 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:41.694829 16027 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:41.808445  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.809307  6230 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:41.635363 15931 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.756402  6242 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
I20260812 19:24:41.811807  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.812680  6242 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:41.813855  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.757045  6224 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:41.681025 16179 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:41.779953  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.821362  6232 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:41.822690  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.823367  6232 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 19.
I20260812 19:24:41.824342  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.825760  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.825819  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:41.781435  6228 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:24:41.757149 16188 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260812 19:24:41.763736 15952 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.827114  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:41.827443  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:41.827960 15849 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:41.828370  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:41.828445 15849 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:41.828833 15952 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.829027 15849 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:41.829196 15799 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:41.829733 16027 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.739301 16131 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:41.760643 15960 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:41.831202 15960 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:41.807309  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.832216 16027 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.832908 15873 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:41.833393 15873 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:41.833911 15873 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:41.832223 15960 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.835237 15960 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:41.763319 15339 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:41.837787 15339 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:41.833256  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:41.839358  6241 raft_consensus.cc:2396] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260812 19:24:41.840399 15869 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.840479  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:41.791514 15809 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:41.816958  6242 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:41.823387  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.807840 16081 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260812 19:24:41.845456  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:41.846534  7599 raft_consensus.cc:2379] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:41.708212 16072 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.852434 16072 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.807617 16041 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:41.826439  6232 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:41.853583 16041 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.855149  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.802419 15800 raft_consensus.cc:686] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:41.855966 16041 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.848109  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:41.828047  6228 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:41.819206 15884 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:41.857494  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:41.857462 15884 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:41.859624 16046 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:41.859879 16128 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:41.805361 15702 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:41.860328 16128 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:41.861831  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.867274  6228 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:41.867611  6235 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:41.863144  6224 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:41.856268  6232 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:41.864234  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:41.869366  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.869112  6354 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:41.871057  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:41.871471  6232 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:41.872913  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:41.874423  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.875322  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:41.875191  6232 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:41.877805 15731 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.875608  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.879397  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.880029  6230 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:41.880522  6232 raft_consensus.cc:2396] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260812 19:24:41.883828  6475 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:41.847074  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:41.886869  6242 raft_consensus.cc:3037] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
W20260812 19:24:41.887243  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 113366us
I20260812 19:24:41.888929  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.890393  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.891834  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.872951  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:41.894502  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:41.901676  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.902314  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.904503  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.907244  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.906242  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.914404  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.915383  6232 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:41.914852  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.916499  6235 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:41.916810  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:41.920528  7553 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:41.921345  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:41.859684 15884 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:41.870417 16128 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:41.920382 15799 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:41.950165  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.951049  6235 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260812 19:24:41.951608  6235 pending_rounds.cc:76] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 7
I20260812 19:24:41.951930  6235 pending_rounds.cc:97] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260812 19:24:41.952245  6235 raft_consensus.cc:2866] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:41.952025  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 807) took 1639 ms. Trace:
I20260812 19:24:41.909015  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.955047  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:41.955215  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46290.5us
I20260812 19:24:41.955801  6354 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:41.956272  6242 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:41.956751  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:41.923471 15809 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:41.929417  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:41.918340  6228 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260812 19:24:41.901122 15986 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:41.915377 16081 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:41.900935 15731 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:41.901953 16041 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:41.920629 15842 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:41.920145 15848 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:41.919838 16072 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:41.919943 16011 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:42.012779 16011 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:42.013267 16011 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:42.013777 16114 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:42.015475 15507 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:42.016033 15507 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.018046 15507 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:41.952957  6229 rpcz_store.cc:276] 0812 19:24:40.312172 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:40.312998 (+   826us) service_pool.cc:227] Handling call
0812 19:24:40.313354 (+   356us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:40.313554 (+   200us) raft_consensus.cc:1520] Early marking committed up to index 12
0812 19:24:40.313842 (+   288us) log.cc:842] Serialized 14 byte log entry
0812 19:24:41.622997 (+1309155us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b180039c400. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f47d34ca 00007f98fdea8f99 00007f98f4697990 00007f98f4859864 00007f98f4859155 00007f98f77703d0 00007f98f7782576 00007f98f77930d7 00007f98f7793058
0812 19:24:41.951504 (+328507us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:41.951595 (+    91us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:24:41.951688 (+    93us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:41.951787 (+    99us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:41.951947 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":45903,"prepare.queue_time_us":7062,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":1313543,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":6592,"spinlock_wait_cycles":13706624,"thread_start_us":328179,"threads_started":1}
I20260812 19:24:41.971791  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:41.975198  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:42.023132  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 48094.6us
W20260812 19:24:42.023309  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 51671.7us
I20260812 19:24:42.024160  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:42.024355  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:42.024871 15268 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:42.025302  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:42.025396 15268 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:42.025931 15809 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:42.026170 15946 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:42.026430 16131 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:41.975425  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:42.026623 15946 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:42.026993 16131 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:42.027175  6242 raft_consensus.cc:3037] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:42.027544 16131 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:42.028524  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:42.030045 15992 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:42.030495 15992 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:41.969215 16027 raft_consensus.cc:2741] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260812 19:24:41.987762  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:41.958989 15339 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:41.977716 16113 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:41.970232 15989 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:42.011756  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:41.929199  6475 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260812 19:24:42.067253  6236 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:24:41.958503 15916 raft_consensus.cc:2781] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:42.037070  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:42.040088  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 08db676d084c41abaa2e196e5c2653b5, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.033727  6349 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
W20260812 19:24:42.075049  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 08db676d084c41abaa2e196e5c2653b5, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.076846  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:42.077445 16113 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:42.078083  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:42.036993  6178 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:42.078888 15919 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:42.078949 15916 raft_consensus.cc:686] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:42.079764  6178 leader_election.cc:398] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13.
I20260812 19:24:41.921557 15800 consensus_queue.cc:237] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:41.994345  6232 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:41.969345 16179 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.047091 15686 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260812 19:24:42.137274 15799 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260812 19:24:42.136570  6230 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:42.130254 15849 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.055751 15848 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.093s
I20260812 19:24:42.148958  6482 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:42.085939 15339 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:42.056293 16134 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:42.001106  6241 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:42.041821  6242 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:24:42.030629 15915 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.026021 15268 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:42.054172 15873 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.014425 16114 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:42.030874 15992 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:41.979741 15986 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:41.981300 15884 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:42.151162 15849 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:41.987414 15842 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:42.037947  6354 raft_consensus.cc:2454] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
W20260812 19:24:42.128643 16202 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260812 19:24:42.081110  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:42.227612  6241 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260812 19:24:42.217137  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:42.081410 16041 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 19:24:42.033614 15507 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:42.127777 16203 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260812 19:24:42.162331 15919 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
W20260812 19:24:42.226742 16214 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260812 19:24:42.209352 15931 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:42.253531 15960 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:42.215818 15842 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:42.027202 15946 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
W20260812 19:24:42.240227 16198 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.167s	user 0.001s	sys 0.001s
I20260812 19:24:42.118633 16127 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:42.284602  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:42.285379  6354 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:42.288117  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:42.238903  6481 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:42.055989 15987 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.160s
I20260812 19:24:42.204736 15986 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:42.243495 15884 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:42.208521 16046 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:42.081434  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:42.318167  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 236786us
I20260812 19:24:42.275146  6475 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:42.164779  6349 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 20.
I20260812 19:24:42.210592 15702 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:24:42.235193  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 154141us
I20260812 19:24:42.338531  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:42.228864 15873 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:42.294035  6241 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260812 19:24:42.273633 16223 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:42.201763  6236 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 20.
I20260812 19:24:42.340145  6178 leader_election.cc:398] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13.
I20260812 19:24:42.228183 15849 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:42.276559 16088 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:42.352483  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:42.080523 15916 consensus_queue.cc:237] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:42.357096  6178 leader_election.cc:398] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14.
I20260812 19:24:42.373005  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:42.374581  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:42.370838  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:42.380054 16041 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:42.358309  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:42.387478  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:42.345587 15959 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:42.342325 15583 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:42.385254  6178 leader_election.cc:398] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15.
W20260812 19:24:42.436400  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 51316us
I20260812 19:24:42.437242  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:42.343042 15884 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:42.276249 15507 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.282274 15961 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:42.362488 16088 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:42.362994 15873 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:42.461827 15268 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.472327 15873 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.474153 15268 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:42.452513 16224 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:42.479983 16224 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.446743  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:42.482000 15884 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:42.284195 15960 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:42.484331 15960 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:42.484642 15884 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:42.450944 15959 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:42.487185 15959 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:42.487272 15884 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:42.460294 16226 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:42.461020 15915 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:42.460932  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:42.371876 15849 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:42.462044 16215 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260812 19:24:42.462400 15538 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.000s
I20260812 19:24:42.462893 16227 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:42.463426 16217 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260812 19:24:42.565977  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:42.452299 16205 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:42.387511 16027 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:42.468211 15507 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:42.467942 16128 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.436450 16114 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:42.512533 15873 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:42.588828  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 556475us
I20260812 19:24:42.470964 16225 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:24:42.471246 16220 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260812 19:24:42.470713 16011 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.456362  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:42.502559  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:42.482275 16224 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:42.462913 16216 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260812 19:24:42.532562  7591 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:42.589604  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:42.584360  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:42.598150  6241 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 20: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:42.599913  6241 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260812 19:24:42.601553  6241 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260812 19:24:42.371491 16223 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.583123  6475 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
W20260812 19:24:42.586863 16131 consensus_meta.cc:287] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.000s
I20260812 19:24:42.527281 15960 consensus_queue.cc:1046] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
W20260812 19:24:42.613950  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 111489us
I20260812 19:24:42.616016  6483 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
W20260812 19:24:42.614410 16081 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.004s
I20260812 19:24:42.609095 16114 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:42.595359 15507 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:42.533524 15538 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.606397 15873 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:42.613852 16027 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:42.526974 16226 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.614745 16224 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:42.623155 16124 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.030s	sys 0.046s
W20260812 19:24:42.668911  6232 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.010s	sys 0.018s
I20260812 19:24:42.669256 16245 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260812 19:24:42.669456  6232 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.010s	sys 0.018s
I20260812 19:24:42.583040 16227 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.649379 16081 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260812 19:24:42.666268 16124 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.030s	sys 0.046s
I20260812 19:24:42.606081 16225 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.691818  7597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 704) took 1036 ms. Trace:
I20260812 19:24:42.669966 16245 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:42.617357 16131 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.681062  6475 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:42.715397  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2479) took 1090 ms. Trace:
I20260812 19:24:42.717540  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:24:42.715585  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 375801us
I20260812 19:24:42.716136  6347 rpcz_store.cc:276] 0812 19:24:41.625260 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:41.625483 (+   223us) service_pool.cc:227] Handling call
0812 19:24:41.625925 (+   442us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:41.635979 (+ 10054us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:41.636033 (+    54us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:41.647247 (+ 11214us) log.cc:842] Serialized 26 byte log entry
0812 19:24:41.931481 (+284234us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:42.696997 (+765516us) log.cc:842] Serialized 14 byte log entry
0812 19:24:42.714933 (+ 17936us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:42.715045 (+   112us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:42.715106 (+    61us) raft_consensus.cc:1671] finished
0812 19:24:42.715125 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:42.715315 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":361198,"prepare.queue_time_us":688552,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":13329,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":19443,"thread_start_us":631519,"threads_started":2,"wal-append.queue_time_us":431145}
I20260812 19:24:42.692360  7597 rpcz_store.cc:276] 0812 19:24:41.655204 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:41.655330 (+   126us) service_pool.cc:227] Handling call
0812 19:24:41.655627 (+   297us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:41.669040 (+ 13413us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:24:41.669085 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:41.669598 (+   513us) log.cc:842] Serialized 26 byte log entry
0812 19:24:42.033841 (+364243us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:42.033896 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:42.033995 (+    99us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:42.691553 (+657558us) raft_consensus.cc:1671] finished
0812 19:24:42.691574 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:42.691745 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12900,"raft.queue_time_us":15085,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":10469,"thread_start_us":275386,"threads_started":1,"wal-append.queue_time_us":497515}
I20260812 19:24:42.722795 15357 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:42.653023 15507 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.656184 15873 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.655915 16027 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.652616 16114 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.666474 16224 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.724043 16243 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:42.727612  6236 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:42.738893  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:42.740001 15873 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:42.742707 15538 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:42.719311 16179 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:42.743964 16179 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.746919 16243 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:42.747514 16243 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:42.747748 16131 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:42.747927 15842 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.749091  6465 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:42.746500 16179 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:42.755722 16046 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:42.756234 16046 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:42.763077 16128 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:42.765313  7607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 700) took 1405 ms. Trace:
W20260812 19:24:42.767186 16237 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260812 19:24:42.765791  7607 rpcz_store.cc:276] 0812 19:24:41.359899 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:41.360553 (+   654us) service_pool.cc:227] Handling call
0812 19:24:41.380832 (+ 20279us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:41.392559 (+ 11727us) raft_consensus.cc:1520] Early marking committed up to index 12
0812 19:24:41.504664 (+112105us) log.cc:842] Serialized 14 byte log entry
0812 19:24:41.768599 (+263935us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:41.768667 (+    68us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:24:41.768723 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:42.765055 (+996332us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b540058e154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:42.765106 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:42.765247 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5231,"prepare.queue_time_us":181592,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":89,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":21668,"spinlock_wait_cycles":26378112,"thread_start_us":350210,"threads_started":2,"wal-append.queue_time_us":480636}
I20260812 19:24:42.767894 16243 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.771044 15538 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260812 19:24:42.771278 16242 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260812 19:24:42.775285 15869 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:42.775897 16225 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:42.776206  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2482) took 1030 ms. Trace:
W20260812 19:24:42.776832 16233 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260812 19:24:42.776974 15848 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:42.777565 15848 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:24:42.778342 16234 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260812 19:24:42.778712 15848 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.780397 15339 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:42.780712 16226 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:42.781339  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2764) took 1082 ms. Trace:
I20260812 19:24:42.781704  6229 rpcz_store.cc:276] 0812 19:24:41.707582 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:42.019603 (+312021us) service_pool.cc:227] Handling call
0812 19:24:42.020039 (+   436us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:42.020463 (+   424us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:42.020504 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:42.021171 (+   667us) log.cc:842] Serialized 26 byte log entry
0812 19:24:42.213241 (+192070us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:42.213369 (+   128us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:42.213525 (+   156us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:42.781114 (+567589us) raft_consensus.cc:1671] finished
0812 19:24:42.781139 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:42.781279 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":5279,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":120,"thread_start_us":178037,"threads_started":1,"wal-append.queue_time_us":416340}
I20260812 19:24:42.784071  6229 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:42.784137 15848 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:42.784862 15946 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:42.787626 16114 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:42.789345 15507 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:42.791181 16224 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:42.792721 16227 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:42.776605  6224 rpcz_store.cc:276] 0812 19:24:41.745642 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:41.815134 (+ 69492us) service_pool.cc:227] Handling call
0812 19:24:42.776024 (+960890us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b540001de54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:42.776142 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":42935040}
I20260812 19:24:42.796911  6242 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:42.724292 16081 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:42.696156 16245 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
W20260812 19:24:42.845494  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44188.1us
I20260812 19:24:42.728621 15961 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:42.903290  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 54175.7us
W20260812 19:24:42.810546 16214 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260812 19:24:42.795601 16027 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:42.810767 16081 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:24:42.927277  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 80590.7us
I20260812 19:24:42.960732  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:42.910310  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:42.770509 16243 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:42.984596  6359 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.001s	sys 0.027s
I20260812 19:24:42.935505 16114 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:42.937117 15799 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:42.947479 15507 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:42.967890  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:42.735570 15989 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.172s
I20260812 19:24:42.911919 16224 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:42.990451  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 400916us
W20260812 19:24:42.914892 16072 consensus_meta.cc:287] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.876s	user 0.013s	sys 0.000s
I20260812 19:24:42.993793  6470 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
W20260812 19:24:42.986990 15916 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.008s	sys 0.017s
W20260812 19:24:42.806057 15438 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.018s	sys 0.007s
W20260812 19:24:42.985278  6359 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.001s	sys 0.027s
I20260812 19:24:42.911888 15538 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260812 19:24:42.810027 16232 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.197s
I20260812 19:24:42.985769 16081 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:42.962831 16011 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:43.005177 16128 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260812 19:24:43.024534 15916 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.008s	sys 0.018s
I20260812 19:24:43.023691  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:42.907194 15915 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.096s
W20260812 19:24:43.120281  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 96707.2us
I20260812 19:24:43.121344  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:42.907794 16227 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260812 19:24:43.016579  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:43.022786  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 405645us
I20260812 19:24:42.995687 15799 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:43.052485 16041 consensus_meta.cc:287] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.000s
I20260812 19:24:43.052742 16089 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:24:43.053804 15992 consensus_meta.cc:287] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.845s	user 0.004s	sys 0.011s
I20260812 19:24:43.054561  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2780) took 1154 ms. Trace:
I20260812 19:24:43.024039  7553 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:43.141428  6230 rpcz_store.cc:276] 0812 19:24:41.899939 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:41.901118 (+  1179us) service_pool.cc:227] Handling call
0812 19:24:43.054371 (+1153253us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b540001d454. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:43.054495 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":537999744}
I20260812 19:24:43.143016  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:43.143888  6230 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:43.145256  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2759) took 1447 ms. Trace:
I20260812 19:24:43.146148  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260812 19:24:43.142558  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 118632us
I20260812 19:24:43.006176 15873 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:43.016626 15583 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:43.003178 16223 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:43.145705  6235 rpcz_store.cc:276] 0812 19:24:41.697418 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:41.960619 (+263201us) service_pool.cc:227] Handling call
0812 19:24:41.982482 (+ 21863us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:41.982757 (+   275us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:24:42.327267 (+344510us) log.cc:842] Serialized 14 byte log entry
0812 19:24:43.144109 (+816842us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:43.144173 (+    64us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:43.144959 (+   786us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:43.145050 (+    91us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:43.145189 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":112852,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":9957,"raft.queue_time_us":322634,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":16052,"thread_start_us":1111152,"threads_started":3,"wal-append.queue_time_us":703610}
I20260812 19:24:43.123674  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:43.118899 15946 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:43.128744 16011 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:43.045539  6470 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:42.997427 16114 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.002537 16225 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260812 19:24:43.130106  6474 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:43.133635  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2772) took 1390 ms. Trace:
I20260812 19:24:43.305706  6232 rpcz_store.cc:276] 0812 19:24:41.743349 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:42.158314 (+414965us) service_pool.cc:227] Handling call
0812 19:24:42.158636 (+   322us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:42.158861 (+   225us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:24:42.159218 (+   357us) log.cc:842] Serialized 14 byte log entry
0812 19:24:43.133250 (+974032us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:43.133313 (+    63us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:43.133369 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:43.133441 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:43.133572 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":2497,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":252711,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":35936,"thread_start_us":973568,"threads_started":2,"wal-append.queue_time_us":572666}
I20260812 19:24:43.307860  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:43.308547  6232 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:43.003396 16179 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.114s
I20260812 19:24:43.152717  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:43.155995  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:43.116778 16128 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:43.034358 16205 raft_consensus.cc:686] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:43.359997  6230 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:43.019659 16072 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:43.177846  6470 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260812 19:24:43.178259  6178 leader_election.cc:398] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15.
I20260812 19:24:43.374408  6178 leader_election.cc:401] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260812 19:24:43.037703 15438 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.019s	sys 0.008s
I20260812 19:24:43.174302  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 927) took 1728 ms. Trace:
I20260812 19:24:43.384742 16027 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15.
I20260812 19:24:43.383064  6350 rpcz_store.cc:276] 0812 19:24:41.445475 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:41.445616 (+   141us) service_pool.cc:227] Handling call
0812 19:24:41.445973 (+   357us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:41.446194 (+   221us) raft_consensus.cc:1520] Early marking committed up to index 13
0812 19:24:42.590009 (+1143815us) log.cc:842] Serialized 14 byte log entry
0812 19:24:43.173694 (+583685us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:43.173772 (+    78us) raft_consensus.cc:1631] Marking committed up to 13
0812 19:24:43.173847 (+    75us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:43.174043 (+   196us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:43.174227 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1035241,"prepare.queue_time_us":940325,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":3904,"raft.queue_time_us":338004,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":6924,"thread_start_us":730944,"threads_started":2}
I20260812 19:24:43.352912 16226 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:43.141515 16041 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:43.153596 15916 raft_consensus.cc:2781] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:43.019129 16224 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.304590  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:43.445680  6235 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:43.313788 16114 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:43.158993 15838 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:43.288699 16113 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260812 19:24:43.318205  6241 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.044s	sys 0.117s
W20260812 19:24:43.472162  6241 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.045s	sys 0.117s
W20260812 19:24:43.344102  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 220495us
W20260812 19:24:43.351015  6345 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.010s	sys 0.030s
W20260812 19:24:43.473125  6345 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.010s	sys 0.030s
I20260812 19:24:43.132228 16051 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:43.304193 15842 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:43.153347 15992 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.145457 16089 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:43.315507 16259 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:43.169575 15873 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:43.384752  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 248081us
I20260812 19:24:43.175581  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:43.337499 16223 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:24:43.382545  6296 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.007s	sys 0.020s
I20260812 19:24:43.287878 15583 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:43.394941  6232 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:43.516263  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:43.517127  6232 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
W20260812 19:24:43.395442  6229 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.019s	sys 0.062s
I20260812 19:24:43.353183 16011 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:43.372624 16124 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.021s	sys 0.054s
I20260812 19:24:43.428131  6230 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:43.527756  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:43.356390 15915 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:43.532965 15915 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:43.361116 16128 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:43.535329 15915 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:43.389003 16240 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.482s	user 0.000s	sys 0.001s
I20260812 19:24:43.383498 15731 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:43.455766 15919 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:24:43.527050 16124 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.021s	sys 0.054s
I20260812 19:24:43.456451 15916 raft_consensus.cc:686] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:43.457989  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:24:43.556491  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 98590us
I20260812 19:24:43.557353  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:43.459093  7591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 641) took 1782 ms. Trace:
I20260812 19:24:43.458871 16205 consensus_queue.cc:237] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.459998 16134 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:43.463064 15849 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:43.568238  6359 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.016s	sys 0.029s
W20260812 19:24:43.568624  6359 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.016s	sys 0.029s
W20260812 19:24:43.464121 16046 consensus_meta.cc:287] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.707s	user 0.008s	sys 0.005s
I20260812 19:24:43.465376  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:43.472211 16253 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.471s	user 0.001s	sys 0.000s
W20260812 19:24:43.563141 16251 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.418s	user 0.000s	sys 0.001s
I20260812 19:24:43.580411  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:43.507090  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 331587us
I20260812 19:24:43.504922 15800 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:43.588443  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:43.592051  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:43.593189  6347 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
W20260812 19:24:43.519575  6229 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.019s	sys 0.062s
I20260812 19:24:43.532024 16283 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:43.609462  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:43.532353 16275 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:24:43.487118 16051 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:43.494982 15842 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:43.538921  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:43.544845  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 191240us
I20260812 19:24:43.496789 16232 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:43.492884 16278 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:43.444446 15986 consensus_meta.cc:287] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.089s	user 0.011s	sys 0.002s
I20260812 19:24:43.549009  6474 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260812 19:24:43.558197  7591 rpcz_store.cc:276] 0812 19:24:41.676778 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:41.677136 (+   358us) service_pool.cc:227] Handling call
0812 19:24:41.700258 (+ 23122us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:42.597186 (+896928us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:43.458852 (+861666us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54002e68d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:43.459022 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1911996800}
I20260812 19:24:43.561488 15915 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:43.561586  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:43.662074  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 100557us
I20260812 19:24:43.562255 16254 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:43.476579 15838 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:43.567422  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2762) took 1869 ms. Trace:
I20260812 19:24:43.700748  6228 rpcz_store.cc:276] 0812 19:24:41.698201 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:41.971118 (+272917us) service_pool.cc:227] Handling call
0812 19:24:41.971487 (+   369us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:41.997084 (+ 25597us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:41.997141 (+    57us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:41.997765 (+   624us) log.cc:842] Serialized 26 byte log entry
0812 19:24:42.326645 (+328880us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:42.360949 (+ 34304us) log.cc:842] Serialized 14 byte log entry
0812 19:24:42.361589 (+   640us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:43.559882 (+1198293us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b54002f8854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:43.559951 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:43.560655 (+   704us) raft_consensus.cc:1671] finished
0812 19:24:43.567144 (+  6489us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:43.567351 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19158,"prepare.queue_time_us":43581,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":5396,"raft.queue_time_us":20555,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":24550,"spinlock_wait_cycles":50048256,"thread_start_us":260627,"threads_started":1,"wal-append.queue_time_us":424334}
I20260812 19:24:43.703569  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:43.704416  6228 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:43.704778  6235 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:43.705335  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:43.705758  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:43.507114  6296 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.008s	sys 0.020s
I20260812 19:24:43.706391  6235 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:43.581892  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:43.708106  6350 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:43.709312  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:43.527468 16223 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:43.581175  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 928) took 1933 ms. Trace:
I20260812 19:24:43.580304 15799 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:43.584285 16261 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260812 19:24:43.584357  7597 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:43.722556  7597 raft_consensus.cc:595] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 13 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:43.585000 15931 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:43.585876 15992 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:43.554028 15731 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.556149 15919 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.577953 15849 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:43.574816 16134 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:43.585009 16269 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
I20260812 19:24:43.536938 16011 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.566897 15837 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:43.582755  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:43.613945  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:43.613942  6465 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:24:43.617969 16268 log.cc:924] Time spent T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260812 19:24:43.617839  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:43.792289  6353 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:43.653203 15842 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.793531  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:43.612854 16226 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:43.627651  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:43.630033  6178 connection.cc:232] RPC call timeout handler was delayed by -1.7118945301044732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
W20260812 19:24:43.797943  6178 connection.cc:232] RPC call timeout handler was delayed by -1.6274369659367949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260812 19:24:43.743712 15538 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:43.613029 15800 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:43.618762  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:43.781289 16242 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.080s	user 0.000s	sys 0.004s
I20260812 19:24:43.513134 16259 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:43.658582  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:43.673672  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:43.812045  6354 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:43.630679 16051 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:43.714567  6232 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:43.814218  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:43.816893  7603 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:43.817531  7603 raft_consensus.cc:595] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:43.724257  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 63715.5us
I20260812 19:24:43.579062 16046 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.654042 16295 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:43.742668  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:43.828207  6474 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:43.656841 16089 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:43.743244  6224 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.003s	sys 0.011s
W20260812 19:24:43.831727  6224 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.004s	sys 0.012s
I20260812 19:24:43.675849 15915 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:43.655865 16275 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:43.876401  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:43.877338  6474 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:43.785593  6230 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:43.720165 16282 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:43.794437  6353 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:43.815372 15583 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:43.631331  7599 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:43.656917 16232 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.653679  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:43.893622  6349 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:43.894711  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:43.801513  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:43.677314 15986 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.754725 16277 raft_consensus.cc:465] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Not starting pre-election -- already a leader
I20260812 19:24:43.812182  6342 raft_consensus.cc:2354] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
I20260812 19:24:43.713152  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:43.779839 16284 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:43.817315  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:43.885468 15799 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:43.905181 15848 consensus_meta.cc:287] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.120s	user 0.012s	sys 0.006s
I20260812 19:24:43.778308 14889 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:24:43.819497  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 163030us
I20260812 19:24:43.823187  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:43.824990  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:43.781980 16072 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:43.660989 16278 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.987713 15838 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:43.988009 15339 raft_consensus.cc:3032] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:43.988510 15339 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:43.989356 16278 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:43.989586 16290 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.375s	user 0.001s	sys 0.008s
I20260812 19:24:43.791674 15948 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:24:43.986786 16207 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.646s	user 0.008s	sys 0.024s
I20260812 19:24:43.990236 15948 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:43.989403 15339 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.992522 15339 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:43.992843 15948 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:43.743743 15931 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.995055 15931 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:43.995661  6349 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
W20260812 19:24:43.997309 16293 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260812 19:24:43.749643 15849 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.808739 16224 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:43.872498  6235 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
W20260812 19:24:43.832495  6477 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.007s	sys 0.033s
W20260812 19:24:44.011270  6477 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.014s	sys 0.035s
I20260812 19:24:43.673270 15916 consensus_queue.cc:237] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:43.811411 15960 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:43.804991 16226 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.887810  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.028894  6353 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 15: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:43.799029  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:44.029887  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 230930us
I20260812 19:24:43.937583 16299 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:43.937120 16258 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:44.034632 16258 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:43.876448 16124 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:44.035130 16258 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
W20260812 19:24:43.939069 16297 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260812 19:24:43.877980 15915 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:44.035369 16124 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.037818 16124 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:43.935775 16109 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:44.038573 16109 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.039865  7606 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:43.812515 15538 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:43.885980 16114 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:44.042991 16114 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.970111  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.043099 15915 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.044971  6350 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:44.044924  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:44.045477 16114 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:44.045730  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 2786) took 1138 ms. Trace:
I20260812 19:24:43.966324  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.046144  6232 rpcz_store.cc:276] 0812 19:24:42.907240 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.044624 (+1137384us) service_pool.cc:227] Handling call
0812 19:24:44.045674 (+  1050us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:44.046622 15915 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:43.721220  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:43.904573 16245 consensus_meta.cc:287] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 1.059s	user 0.013s	sys 0.000s
I20260812 19:24:44.047444 16245 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.048082  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:44.048410 15538 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:44.041002 16109 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:44.049413  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.049940  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.050076  6352 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:24:43.894549 15873 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:43.710426  6359 rpcz_store.cc:276] 0812 19:24:41.647517 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:41.647711 (+   194us) service_pool.cc:227] Handling call
0812 19:24:41.651479 (+  3768us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:41.651795 (+   316us) raft_consensus.cc:1520] Early marking committed up to index 12
0812 19:24:43.030053 (+1378258us) log.cc:842] Serialized 14 byte log entry
0812 19:24:43.580801 (+550748us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:43.580868 (+    67us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:24:43.580919 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:43.580990 (+    71us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:43.581115 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":631338,"prepare.queue_time_us":870239,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":62817,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":32942,"thread_start_us":1296771,"threads_started":2}
I20260812 19:24:43.986786  6473 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:43.986956 16072 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.051590  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.051009  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.052273  6359 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:44.052350  6232 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:44.052892 16072 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:43.800894 16261 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260812 19:24:44.053227  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.054783  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2805) took 2338 ms. Trace:
I20260812 19:24:44.055202  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.056046  6352 raft_consensus.cc:2379] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:44.055146  6464 rpcz_store.cc:276] 0812 19:24:41.716124 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:41.716792 (+   668us) service_pool.cc:227] Handling call
0812 19:24:41.717304 (+   512us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:41.734629 (+ 17325us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:24:42.214533 (+479904us) log.cc:842] Serialized 14 byte log entry
0812 19:24:42.721683 (+507150us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:42.722355 (+   672us) log.cc:842] Serialized 26 byte log entry
0812 19:24:42.722522 (+   167us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:42.722566 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:42.735605 (+ 13039us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:44.054503 (+1318898us) raft_consensus.cc:1671] finished
0812 19:24:44.054526 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.054680 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":44537,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":22049,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":4694,"thread_start_us":861008,"threads_started":2,"wal-append.queue_time_us":841985}
I20260812 19:24:44.056923  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.057272  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:43.976843 16273 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260812 19:24:43.834568 16295 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.001147  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.058437  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.059859  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:44.059939  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.060420 16295 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:44.061054  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.022917  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.034341 16277 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:44.061564  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:44.034355  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:43.872004 16283 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:44.053226  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.062232  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.063361 16283 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.064201  6464 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 8.
I20260812 19:24:44.065213  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:44.065362  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.065596 16283 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:44.046484  6474 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:44.049535 16245 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:44.065969  6235 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:44.066407 16245 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:44.066749  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:44.066982 16245 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:43.968590  6228 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:24:44.068301  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:44.068886  6228 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:44.069113  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:43.818008  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.070823 16283 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:44.070984  6470 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 16
I20260812 19:24:44.071318 16283 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:44.071729 16283 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:44.043049 16258 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.062232  6359 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:44.067395  6474 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:43.886183 16271 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:44.075083  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:44.074982 16271 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.075969 16277 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:44.076388 16277 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:44.076719 16277 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:44.077418 16271 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:43.968497 16301 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260812 19:24:44.078627  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.080525 16245 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:44.088872  6228 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:44.092216 16271 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:44.095184 16271 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.095868  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.097617  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.098522 16271 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:44.058439  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.099402  6352 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:44.093169  6470 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260812 19:24:44.099538  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.094297  6474 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:44.099315  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.102059  6352 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:44.103209  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:44.103885  6228 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:44.092582 16258 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:44.130823  6353 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260812 19:24:44.138473 15873 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:24:44.139029 16310 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260812 19:24:44.139194 15873 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.141772 15873 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:44.134126 16271 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:44.145515 16271 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.144873 15873 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:44.107969 15960 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.146718 15873 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.149096 15873 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:44.134873 16299 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.151577  6347 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:44.152386 15339 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:24:44.153121 16292 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.320s	user 0.001s	sys 0.001s
I20260812 19:24:44.152966 15339 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.153682 16299 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:44.154518 16291 log.cc:924] Time spent T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260812 19:24:44.155253 15339 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:44.155588 16294 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260812 19:24:44.156055  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2779) took 2256 ms. Trace:
W20260812 19:24:44.157080 16313 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260812 19:24:44.157433  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2783) took 1836 ms. Trace:
I20260812 19:24:44.157845  6229 rpcz_store.cc:276] 0812 19:24:42.320544 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:42.784907 (+464363us) service_pool.cc:227] Handling call
0812 19:24:42.785247 (+   340us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:42.785487 (+   240us) raft_consensus.cc:1520] Early marking committed up to index 7
0812 19:24:42.785516 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:42.786027 (+   511us) log.cc:842] Serialized 26 byte log entry
0812 19:24:43.601781 (+815754us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:43.601861 (+    80us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:43.601986 (+   125us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:44.157177 (+555191us) raft_consensus.cc:1671] finished
0812 19:24:44.157200 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.157369 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":815267,"threads_started":1,"wal-append.queue_time_us":776915}
I20260812 19:24:44.158707  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 810) took 3619 ms. Trace:
I20260812 19:24:44.159714  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.160208 16323 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:44.160806 16323 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:43.976457 16284 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.161773 16283 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.162083  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.163060  7607 raft_consensus.cc:2379] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
W20260812 19:24:44.165506  6475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2816) took 1843 ms (client timeout 1990 ms). Trace:
W20260812 19:24:44.165905  6475 rpcz_store.cc:269] 0812 19:24:42.321645 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:42.322402 (+   757us) service_pool.cc:227] Handling call
0812 19:24:44.165331 (+1842929us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400272754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:44.165448 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":467550464}
I20260812 19:24:44.166716 15842 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:44.166798 16279 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:44.167703 16279 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:44.169107 16279 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:44.170811 16223 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:44.173223 16081 consensus_meta.cc:287] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.055s	user 0.017s	sys 0.000s
I20260812 19:24:44.173738 16081 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:43.984052 15799 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.175705 16232 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:44.176716 15799 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:44.177404  7599 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 11.
I20260812 19:24:44.177709 15986 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:44.129765 15800 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:43.998967 14889 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.179206 16134 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:44.180320 14889 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:44.180538 15968 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:44.010308 16275 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.181282 15968 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.167755 16011 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:44.181291  6344 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:44.176746  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.184651  6235 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:44.185253  6359 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:44.187359  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.167120  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2809) took 2269 ms. Trace:
I20260812 19:24:44.188844  6482 rpcz_store.cc:276] 0812 19:24:41.897531 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:41.897698 (+   167us) service_pool.cc:227] Handling call
0812 19:24:41.927896 (+ 30198us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:42.149463 (+221567us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.166888 (+2017425us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b540003c0d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:44.167060 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":507752704}
I20260812 19:24:44.187816  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.186115  6475 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:44.191807  6229 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:44.159209  6238 rpcz_store.cc:276] 0812 19:24:40.539116 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:40.539309 (+   193us) service_pool.cc:227] Handling call
0812 19:24:40.554936 (+ 15627us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:41.643159 (+1088223us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:41.643198 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:43.556612 (+1913414us) spinlock_profiling.cc:243] Waited 7.23 ms on lock 0x7b18003efb00. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a
0812 19:24:43.557031 (+   419us) log.cc:842] Serialized 26 byte log entry
0812 19:24:43.808094 (+251063us) raft_consensus.cc:1631] Marking committed up to 14
0812 19:24:43.808134 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:43.808222 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:44.158292 (+350070us) raft_consensus.cc:1671] finished
0812 19:24:44.158323 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.158605 (+   282us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1118955,"raft.queue_time_us":1088649,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8548,"spinlock_wait_cycles":17916032,"thread_start_us":243499,"threads_started":1,"wal-append.queue_time_us":390149}
I20260812 19:24:44.196241  6359 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260812 19:24:44.196973  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2346) took 4013 ms. Trace:
I20260812 19:24:44.134305  6349 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:44.197548  6345 rpcz_store.cc:276] 0812 19:24:40.183254 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:40.185952 (+  2698us) service_pool.cc:227] Handling call
0812 19:24:40.198539 (+ 12587us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:41.223042 (+1024503us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:24:42.205733 (+982691us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b1800056e00. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f47d34ca 00007f98fdea8f99 00007f98f4697990 00007f98f4859864 00007f98f4859155 00007f98fb14d167 00007f98f7782807 00007f98f7791f0f 00007f98f7791e88
0812 19:24:42.668778 (+463045us) log.cc:842] Serialized 14 byte log entry
0812 19:24:44.179340 (+1510562us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b1800056e00. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff57b
0812 19:24:44.179651 (+   311us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:44.180171 (+   520us) log.cc:842] Serialized 26 byte log entry
0812 19:24:44.180347 (+   176us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:44.180391 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.180479 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:44.196710 (+ 16231us) raft_consensus.cc:1671] finished
0812 19:24:44.196738 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.196903 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1003472,"prepare.queue_time_us":1024550,"prepare.run_cpu_time_us":3771,"prepare.run_wall_time_us":28570,"raft.queue_time_us":998972,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":7939,"spinlock_wait_cycles":42919680,"thread_start_us":1165777,"threads_started":2,"wal-append.queue_time_us":777122}
I20260812 19:24:44.021955 16278 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:44.205646 16278 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.206460 15849 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:44.207984 16278 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:44.183072 16128 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.648s	user 0.025s	sys 0.006s
I20260812 19:24:44.208320 15968 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:44.208643 16128 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.209399  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2784) took 1888 ms. Trace:
I20260812 19:24:44.170689 16226 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:44.211774 16323 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:44.212359  6481 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:44.213219  6482 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260812 19:24:44.215654  6236 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2497) took 1932 ms (client timeout 1913 ms). Trace:
W20260812 19:24:44.216166  6236 rpcz_store.cc:269] 0812 19:24:42.283190 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:42.392652 (+109462us) service_pool.cc:227] Handling call
0812 19:24:44.215458 (+1822806us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54001635d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:44.215571 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":302266112}
I20260812 19:24:44.209793  6224 rpcz_store.cc:276] 0812 19:24:42.320894 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:42.794086 (+473192us) service_pool.cc:227] Handling call
0812 19:24:42.794486 (+   400us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:42.794862 (+   376us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:42.794894 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:42.795360 (+   466us) log.cc:842] Serialized 26 byte log entry
0812 19:24:43.832280 (+1036920us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:43.832330 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:43.832418 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:44.209137 (+376719us) raft_consensus.cc:1671] finished
0812 19:24:44.209164 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.209338 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":259392,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":1036559,"threads_started":1,"wal-append.queue_time_us":1011858}
I20260812 19:24:44.218704  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2817) took 1290 ms. Trace:
I20260812 19:24:44.219166  6477 rpcz_store.cc:276] 0812 19:24:42.928609 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:42.929512 (+   903us) service_pool.cc:227] Handling call
0812 19:24:42.957691 (+ 28179us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:42.958191 (+   500us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:42.958240 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:43.000620 (+ 42380us) log.cc:842] Serialized 26 byte log entry
0812 19:24:44.011702 (+1011082us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:44.011782 (+    80us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.011861 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:44.218470 (+206609us) raft_consensus.cc:1671] finished
0812 19:24:44.218495 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.218625 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18777,"raft.queue_time_us":102,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":12704,"spinlock_wait_cycles":22784,"thread_start_us":948640,"threads_started":1,"wal-append.queue_time_us":958606}
I20260812 19:24:44.156492  6241 rpcz_store.cc:276] 0812 19:24:41.899270 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:42.602332 (+703062us) service_pool.cc:227] Handling call
0812 19:24:42.608332 (+  6000us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:43.472636 (+864304us) raft_consensus.cc:1520] Early marking committed up to index 6
0812 19:24:43.626384 (+153748us) log.cc:842] Serialized 14 byte log entry
0812 19:24:43.782722 (+156338us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:43.783660 (+   938us) log.cc:842] Serialized 26 byte log entry
0812 19:24:43.783806 (+   146us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:43.784014 (+   208us) log.cc:842] Serialized 14 byte log entry
0812 19:24:43.788148 (+  4134us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:43.788371 (+   223us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:44.155803 (+367432us) raft_consensus.cc:1671] finished
0812 19:24:44.155827 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.155987 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9463,"prepare.queue_time_us":440773,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":130,"raft.queue_time_us":148198,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":11730,"spinlock_wait_cycles":4024320,"thread_start_us":1143404,"threads_started":3,"wal-append.queue_time_us":523704}
I20260812 19:24:44.222482  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2790) took 1313 ms. Trace:
I20260812 19:24:44.223037  6224 rpcz_store.cc:276] 0812 19:24:42.908995 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.218189 (+1309194us) service_pool.cc:227] Handling call
0812 19:24:44.218581 (+   392us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.222108 (+  3527us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:44.222142 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:44.222183 (+    41us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:44.222227 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.222301 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.222421 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:44.180258 16259 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:44.224756 16131 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:44.224947 16284 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:44.136945 15919 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:43.897360 16282 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.225363 16131 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.219933  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2787) took 1312 ms. Trace:
I20260812 19:24:44.226861  6238 rpcz_store.cc:276] 0812 19:24:42.908011 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.219017 (+1311006us) service_pool.cc:227] Handling call
0812 19:24:44.219412 (+   395us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.219601 (+   189us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:44.219637 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:44.219683 (+    46us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:44.219722 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.219775 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.219874 (+    99us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:44.227583 16282 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:44.228209  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:44.228602 16046 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:44.229177  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2818) took 1300 ms. Trace:
I20260812 19:24:44.229600  6483 rpcz_store.cc:276] 0812 19:24:42.929003 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:42.929133 (+   130us) service_pool.cc:227] Handling call
0812 19:24:44.228049 (+1298916us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:24:44.229116 (+  1067us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":50551168}
I20260812 19:24:44.229820  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.228044 16051 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.231266  6359 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:44.224784  6224 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:44.232491  6345 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260812 19:24:44.232586  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2794) took 1321 ms. Trace:
I20260812 19:24:44.233896  6224 rpcz_store.cc:276] 0812 19:24:42.911410 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.224191 (+1312781us) service_pool.cc:227] Handling call
0812 19:24:44.224591 (+   400us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.232359 (+  7768us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.232537 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:44.222446  6477 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:44.239866  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.242274  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.244374  6241 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260812 19:24:44.245891  6359 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260812 19:24:44.248279  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:44.249212  6345 raft_consensus.cc:595] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:44.250281 16277 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.253883  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.253810  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:44.196839 16271 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:44.255659  6465 raft_consensus.cc:2354] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18.
W20260812 19:24:44.256085  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 449716us
I20260812 19:24:44.257332  6359 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:44.230834 15992 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:44.260221  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.259426  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:44.262053 15837 raft_consensus.cc:686] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:44.241714 16283 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:44.289332  7607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:44.243645 15731 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:44.309918  6230 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:24:44.273507  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 288513us
I20260812 19:24:44.306233  7607 raft_consensus.cc:595] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:44.314265  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.317384  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.346776  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.347369  6474 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:44.256664 16128 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:44.349887  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:44.264571 15849 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:44.364871  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:44.366335  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 48021.9us
W20260812 19:24:44.368959  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 109611us
I20260812 19:24:44.384536  6228 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:44.263527 15992 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:44.347772  6475 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:44.379577  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:44.379104  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:44.347350 16258 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260812 19:24:44.391412  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.392093  6474 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:44.392647  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.393018  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:44.393146  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.394016  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.394541 16245 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:44.394994 16245 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:44.395120  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.383039  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.396245  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.397258  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.397886  6481 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:44.398480 16245 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:44.399878  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:44.400796 15960 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:44.384452  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:44.402123  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:44.388072  6359 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:44.395185  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.403792  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.404430  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.405134  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.405829  6359 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:44.381973 15849 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:44.397720  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.406879 15849 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:44.400980  6481 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:44.408281  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.408423  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.409050  6475 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:44.409871 16128 raft_consensus.cc:2741] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260812 19:24:44.410383  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.409966 15986 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:44.411751 15986 raft_consensus.cc:686] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:44.412456  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.412727 15986 consensus_queue.cc:237] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.377643 16046 consensus_queue.cc:1046] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260812 19:24:44.415727 16046 raft_consensus.cc:3032] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:44.416102 16046 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:44.377357  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:44.420202  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.416651 16325 raft_consensus.cc:979] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:44.379639 16011 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:44.378602  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.434469  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.435489  6345 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:44.436923  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:44.438448  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.406785  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.412734  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:44.412122  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:44.428337  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.445344  6481 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:44.422483 16131 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:44.386210 15968 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:44.447202  6359 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:44.442713  6345 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:44.511006  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.512368  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.512753  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.461190 16051 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:44.460709 16046 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.462841  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.518991  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.464007 15837 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.465729 16081 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:44.467379 16011 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:44.468012 15992 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.433643 15915 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:44.470008  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.471673  7603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.475447 16245 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.475869 15849 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.477005  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.477922  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:44.479012  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 66978.4us
I20260812 19:24:44.479188 16331 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:44.479491 16325 raft_consensus.cc:1067] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:44.554730  7593 raft_consensus.cc:2379] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:44.516832  7597 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: []
W20260812 19:24:44.527621  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 58476us
I20260812 19:24:44.532656  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.543105  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:44.533900 16011 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:44.560351  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:44.558379 15915 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:44.553581 15992 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:44.556135 16331 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:44.579756 16277 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:44.543893  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:44.579576 16331 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:44.570474 16343 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:44.540704 15968 raft_consensus.cc:686] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:44.601188 16343 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:44.629364 16252 raft_consensus.cc:3032] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:44.629985 16252 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:44.631140 16252 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.632424 16252 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:44.643272 16343 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.420684  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:44.693790  6228 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:44.694418  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:44.699348  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.701323  6230 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:44.702049  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 825) took 1066 ms. Trace:
I20260812 19:24:44.702872  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.700125  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:44.708982  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2773) took 2965 ms. Trace:
I20260812 19:24:44.709518  6242 rpcz_store.cc:276] 0812 19:24:41.743633 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:42.161831 (+418198us) service_pool.cc:227] Handling call
0812 19:24:42.796572 (+634741us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:42.797300 (+   728us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.708426 (+1911126us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b540001de50. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:44.708715 (+   289us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1459002624}
I20260812 19:24:44.705014  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:44.466723  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2792) took 1557 ms. Trace:
I20260812 19:24:44.707176  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2789) took 1798 ms. Trace:
I20260812 19:24:44.711382  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.711745  6236 rpcz_store.cc:276] 0812 19:24:42.908662 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.217127 (+1308465us) service_pool.cc:227] Handling call
0812 19:24:44.217535 (+   408us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:44.217909 (+   374us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:44.217934 (+    25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:44.218411 (+   477us) log.cc:842] Serialized 26 byte log entry
0812 19:24:44.706354 (+487943us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:44.706482 (+   128us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.706613 (+   131us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:44.706715 (+   102us) raft_consensus.cc:1671] finished
0812 19:24:44.706726 (+    11us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.706996 (+   270us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":7236,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":487271,"threads_started":1,"wal-append.queue_time_us":402107}
I20260812 19:24:44.713050  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.714154  6242 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:44.714057  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.711110  6241 rpcz_store.cc:276] 0812 19:24:42.909684 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.221176 (+1311492us) service_pool.cc:227] Handling call
0812 19:24:44.221495 (+   319us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.245625 (+ 24130us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.466405 (+220780us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b54000064d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:44.466624 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":47927552}
I20260812 19:24:44.707327  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2500) took 1228 ms. Trace:
I20260812 19:24:44.715312  6232 rpcz_store.cc:276] 0812 19:24:43.478510 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.053015 (+574505us) service_pool.cc:227] Handling call
0812 19:24:44.706948 (+653933us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b540035eb54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:44.707149 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1476391680}
I20260812 19:24:44.707212  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2796) took 1264 ms. Trace:
I20260812 19:24:44.715919  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:44.716233  6238 rpcz_store.cc:276] 0812 19:24:43.442240 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.227790 (+785550us) service_pool.cc:227] Handling call
0812 19:24:44.228143 (+   353us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.228368 (+   225us) raft_consensus.cc:1520] Early marking committed up to index 7
0812 19:24:44.229155 (+   787us) log.cc:842] Serialized 14 byte log entry
0812 19:24:44.706382 (+477227us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:44.706486 (+   104us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:44.706630 (+   144us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.706805 (+   175us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.707022 (+   217us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":321,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"thread_start_us":476417,"threads_started":1,"wal-append.queue_time_us":412365}
W20260812 19:24:44.423609  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46356.3us
I20260812 19:24:44.723174  6236 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:44.724898  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.727006  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.727537  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:44.729559  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:44.759845  7594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 706) took 1172 ms. Trace:
I20260812 19:24:44.760427  7594 rpcz_store.cc:276] 0812 19:24:43.587623 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:43.588145 (+   522us) service_pool.cc:227] Handling call
0812 19:24:44.759221 (+1171076us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b54002e86d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:44.759512 (+   291us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2214765440}
I20260812 19:24:44.767328  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 827) took 1131 ms. Trace:
I20260812 19:24:44.771065  6242 rpcz_store.cc:276] 0812 19:24:43.635808 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.756895 (+1121087us) service_pool.cc:227] Handling call
0812 19:24:44.760345 (+  3450us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.760783 (+   438us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:44.766737 (+  5954us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:44.766847 (+   110us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:44.766949 (+   102us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.767048 (+    99us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.767228 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:24:44.730608  6342 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.008s	sys 0.013s
W20260812 19:24:44.776625  6342 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.009s	sys 0.013s
I20260812 19:24:44.513985  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.777992  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 828) took 1126 ms. Trace:
I20260812 19:24:44.778921  6345 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:44.780865  6345 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:44.530439  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.782166  6359 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
W20260812 19:24:44.783303  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 54066.3us
I20260812 19:24:44.730223  6298 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:44.785485  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 55629.8us
I20260812 19:24:44.771093 14889 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election won for term 16
W20260812 19:24:44.734617  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 174159us
I20260812 19:24:44.736332  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:44.787591 14889 raft_consensus.cc:686] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:44.787972  6352 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:44.788803  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:44.789805  7607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:44.718449  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.791036  7607 raft_consensus.cc:595] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:44.738390  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2327) took 1211 ms. Trace:
I20260812 19:24:44.738899  6417 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:44.741696  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2829) took 1024 ms. Trace:
I20260812 19:24:44.745016  6481 raft_consensus.cc:1261] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260812 19:24:44.732934  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2492) took 1152 ms. Trace:
I20260812 19:24:44.749087  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.745342  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:44.739799  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2330) took 1110 ms. Trace:
I20260812 19:24:44.751385  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2821) took 1762 ms. Trace:
I20260812 19:24:44.752890  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 2328) took 1225 ms. Trace:
I20260812 19:24:44.702629  6229 rpcz_store.cc:276] 0812 19:24:43.635067 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.229858 (+594791us) service_pool.cc:227] Handling call
0812 19:24:44.230191 (+   333us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:44.230635 (+   444us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:44.230866 (+   231us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:44.242215 (+ 11349us) log.cc:842] Serialized 26 byte log entry
0812 19:24:44.637307 (+395092us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b48001110d8. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fc61f7f1 00007f98fc6168e7 00007f98fc61677a 00007f98fc70a95f 00007f98fc70a627 00007f98fc71eb2c 00007f98fc71ead8 00007f98fc71ea58 00007f98fc71ea13 00007f98fc71dcbc 00007f98fb69fbe6
0812 19:24:44.699627 (+ 62320us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:24:44.700569 (+   942us) log.cc:842] Serialized 14 byte log entry
0812 19:24:44.701090 (+   521us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.701285 (+   195us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:44.701368 (+    83us) raft_consensus.cc:1671] finished
0812 19:24:44.701492 (+   124us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.701792 (+   300us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":2631,"raft.run_wall_time_us":397140,"spinlock_wait_cycles":4345216,"thread_start_us":411025,"threads_started":1,"wal-append.queue_time_us":383616}
I20260812 19:24:44.569299  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:44.772516  7591 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260812 19:24:44.754951  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:44.798719 15702 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:44.799755 15702 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.795301  6482 rpcz_store.cc:276] 0812 19:24:43.716892 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.216392 (+499500us) service_pool.cc:227] Handling call
0812 19:24:44.216746 (+   354us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.216967 (+   221us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:24:44.264894 (+ 47927us) log.cc:842] Serialized 14 byte log entry
0812 19:24:44.740380 (+475486us) log.cc:842] Serialized 14 byte log entry
0812 19:24:44.740802 (+   422us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:44.740901 (+    99us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:44.741006 (+   105us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.741170 (+   164us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.741461 (+   291us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":36333,"prepare.queue_time_us":158078,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"thread_start_us":474197,"threads_started":1,"wal-append.queue_time_us":360061}
I20260812 19:24:44.789541 14889 consensus_queue.cc:237] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.795888  6470 rpcz_store.cc:276] 0812 19:24:43.629291 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.100596 (+471305us) service_pool.cc:227] Handling call
0812 19:24:44.100937 (+   341us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:44.186859 (+ 85922us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:24:44.253549 (+ 66690us) log.cc:842] Serialized 14 byte log entry
0812 19:24:44.544839 (+291290us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:44.555112 (+ 10273us) log.cc:842] Serialized 26 byte log entry
0812 19:24:44.555410 (+   298us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:44.555446 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.555519 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:44.739125 (+183606us) raft_consensus.cc:1671] finished
0812 19:24:44.739175 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.739543 (+   368us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":90601,"prepare.queue_time_us":145946,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":4633,"raft.queue_time_us":95311,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":38444,"thread_start_us":238204,"threads_started":1,"wal-append.queue_time_us":384680}
I20260812 19:24:44.805871  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:24:44.806568 15507 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:44.807338 15507 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:44.807883 15507 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:44.804100 15968 consensus_queue.cc:237] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.795611  6344 rpcz_store.cc:276] 0812 19:24:43.580225 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:43.582455 (+  2230us) service_pool.cc:227] Handling call
0812 19:24:44.732398 (+1149943us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54001ce3d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:44.732639 (+   241us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":901221632}
I20260812 19:24:44.796267  6473 rpcz_store.cc:276] 0812 19:24:42.988824 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:42.989097 (+   273us) service_pool.cc:227] Handling call
0812 19:24:42.989553 (+   456us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.051176 (+1061623us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.750713 (+699537us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b5400363b54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:44.751108 (+   395us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2292744448}
I20260812 19:24:44.798022  6347 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:24:44.585249 15915 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:44.778589  6242 rpcz_store.cc:276] 0812 19:24:43.651802 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.776655 (+1124853us) service_pool.cc:227] Handling call
0812 19:24:44.777210 (+   555us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.777527 (+   317us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:44.777571 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:44.777644 (+    73us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:44.777691 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.777756 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.777900 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:44.796342  6465 rpcz_store.cc:276] 0812 19:24:43.527025 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:43.802458 (+275433us) service_pool.cc:227] Handling call
0812 19:24:44.752323 (+949865us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54003a8254. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:44.752646 (+   323us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":623958912}
I20260812 19:24:44.793818  6464 rpcz_store.cc:276] 0812 19:24:43.526536 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.093926 (+567390us) service_pool.cc:227] Handling call
0812 19:24:44.094409 (+   483us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:44.185322 (+ 90913us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:44.185365 (+    43us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:44.186091 (+   726us) log.cc:842] Serialized 52 byte log entry
0812 19:24:44.736392 (+550301us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:44.737135 (+   743us) log.cc:842] Serialized 14 byte log entry
0812 19:24:44.737539 (+   404us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.737766 (+   227us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:44.737840 (+    74us) raft_consensus.cc:1671] finished
0812 19:24:44.737854 (+    14us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.738116 (+   262us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":103106,"raft.queue_time_us":91415,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":15381,"thread_start_us":430314,"threads_started":1,"wal-append.queue_time_us":362155}
I20260812 19:24:44.931131 15960 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:44.938374 16081 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:44.939118  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:44.939612 16081 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:44.941736 16081 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:44.942834  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2797) took 1065 ms. Trace:
I20260812 19:24:44.943149  6230 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:44.942282 16081 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:44.944727 15731 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:44.952143 16245 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:44.954078 16282 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260812 19:24:44.946224 16088 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:44.957957 15538 raft_consensus.cc:979] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:44.948769  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:44.959066 15838 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:44.960116 15838 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:44.960843 16271 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
W20260812 19:24:44.963085  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 172954us
I20260812 19:24:44.958133 16088 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:44.965729  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:44.967110 15873 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260812 19:24:44.970783  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 232535us
I20260812 19:24:44.972909 16046 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:44.975040 16051 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:44.975400 15986 consensus_queue.cc:1046] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:44.943406  6236 rpcz_store.cc:276] 0812 19:24:43.877485 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.940890 (+1063405us) service_pool.cc:227] Handling call
0812 19:24:44.941543 (+   653us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.942373 (+   830us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:44.942414 (+    41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:44.942481 (+    67us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:24:44.942537 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:44.942625 (+    88us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:44.942772 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:44.966316 15842 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election won for term 16
W20260812 19:24:44.993599  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 45048.2us
I20260812 19:24:44.995373  6228 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:24:44.886231 15702 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:45.003561  6242 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260812 19:24:45.044888  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2520) took 1238 ms. Trace:
I20260812 19:24:45.045365  6242 rpcz_store.cc:276] 0812 19:24:43.806904 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.853717 (+1046813us) service_pool.cc:227] Handling call
0812 19:24:44.998438 (+144721us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:45.043736 (+ 45298us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:45.044589 (+   853us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b5400191750. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:45.044787 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":140766976}
I20260812 19:24:45.007280 15849 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:44.970837  6053 catalog_manager.cc:5495] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 8 to 12, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 12 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:45.020661 15931 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:45.024262 15873 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:45.024489  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 81700.9us
I20260812 19:24:45.024866 15842 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:45.042685  6179 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:44.996789 16081 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.006132  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:45.020680 15863 raft_consensus.cc:1067] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
W20260812 19:24:45.072436  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 66428.3us
I20260812 19:24:45.074702 15873 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:45.075881  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:45.071635  6053 catalog_manager.cc:5495] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 8 to 14, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 14 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:45.072817  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:45.073431 15986 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260812 19:24:45.080667  6475 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.000s	sys 0.012s
W20260812 19:24:45.081241  6475 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.001s	sys 0.013s
I20260812 19:24:45.081429 15873 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:45.081962 15986 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:45.084141  6229 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260812 19:24:45.084380 15986 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:45.085026  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2519) took 1281 ms. Trace:
I20260812 19:24:45.085446  6229 rpcz_store.cc:276] 0812 19:24:43.803795 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.884703 (+1080908us) service_pool.cc:227] Handling call
0812 19:24:45.049760 (+165057us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:45.084713 (+ 34953us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:45.084955 (+   242us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:24:45.088933  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 312836us
I20260812 19:24:45.088783 15842 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.093744 15833 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:45.094311 15833 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:45.094729 15833 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
W20260812 19:24:45.098558  6350 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.001s	sys 0.013s
I20260812 19:24:45.127858  6228 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260812 19:24:45.053172 15507 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:45.138833  6350 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.001s	sys 0.014s
W20260812 19:24:45.146441  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 577042us
I20260812 19:24:45.153252  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:24:45.164288 16081 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:45.147104  6477 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.001s	sys 0.013s
I20260812 19:24:45.160956 16341 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:45.146543  6235 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.011s	sys 0.002s
I20260812 19:24:45.162585 15931 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:45.216506  6230 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
W20260812 19:24:45.217967  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 78202.6us
W20260812 19:24:45.225488  6235 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.011s	sys 0.006s
W20260812 19:24:45.221515  6241 consensus_meta.cc:287] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.014s
I20260812 19:24:45.118942 15702 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.093s
W20260812 19:24:45.229720  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 109292us
W20260812 19:24:45.230400  6477 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.004s	sys 0.015s
I20260812 19:24:45.226703  6241 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:45.245491  6352 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:45.219097 15931 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:45.254735 15731 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:45.255687  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:45.255695 15731 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.258152  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:45.267604  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 194938us
I20260812 19:24:45.272431 15849 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:45.267187 16341 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.273409  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:45.271317  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:45.284307  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:45.284543 16298 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:45.285187 16298 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.285503 16299 consensus_queue.cc:1046] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:45.286700  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:45.289374 16341 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:45.288628  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:45.290354  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:45.285533 16271 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:45.296663 16109 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:45.296815 16224 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:45.297348 16109 raft_consensus.cc:686] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:45.297562 16224 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:45.301196  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 48096.9us
I20260812 19:24:45.303092 15800 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:45.303294  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2354) took 1302 ms. Trace:
I20260812 19:24:45.303591 16279 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:45.303591 15800 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:45.304150 16279 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:45.304544 15686 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:24:45.304796 16109 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:45.304301 15800 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:45.255788 15507 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:45.302307  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:45.309430  6416 leader_election.cc:398] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
I20260812 19:24:45.311278 16248 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:45.311815 16248 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:45.312219 16248 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:45.314633 16283 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:45.316241 15686 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:24:45.316491 16011 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.740s	user 0.001s	sys 0.014s
I20260812 19:24:45.316823 15686 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:45.317008 16011 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.318209  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:45.318699  6474 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:45.319859 15507 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:45.321662  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2841) took 1032 ms. Trace:
I20260812 19:24:45.320886  6350 rpcz_store.cc:276] 0812 19:24:44.001091 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.222397 (+221306us) service_pool.cc:227] Handling call
0812 19:24:44.222721 (+   324us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.222951 (+   230us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:24:44.520286 (+297335us) log.cc:842] Serialized 14 byte log entry
0812 19:24:45.262039 (+741753us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:45.281615 (+ 19576us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:45.302874 (+ 21259us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:45.303013 (+   139us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:45.303205 (+   192us) inbound_call.cc:173] Queueing success response
0812 19:24:45.309349 (+  6144us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b4800111558. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fc61f7f1 00007f98fc6168e7 00007f98fc61677a 00007f98fc70a95f 00007f98fc70a627 00007f98fc71eb2c 00007f98fc71ead8 00007f98fc71ea58 00007f98fc71ea13 00007f98fc71dcbc 00007f98fb69fbe6
Metrics: {"mutex_wait_us":27224,"prepare.queue_time_us":370951,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":76,"raft.queue_time_us":30140,"raft.run_cpu_time_us":2846,"raft.run_wall_time_us":63795,"spinlock_wait_cycles":16300288,"thread_start_us":884098,"threads_started":2}
I20260812 19:24:45.323019  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 826) took 1506 ms. Trace:
I20260812 19:24:45.322321  6474 rpcz_store.cc:276] 0812 19:24:44.289427 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.392750 (+103323us) service_pool.cc:227] Handling call
0812 19:24:45.321408 (+928658us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b540003c5d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:45.321601 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2126551424}
I20260812 19:24:45.273274 15849 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.326166 16224 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:45.264101 15931 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:45.323442  6224 rpcz_store.cc:276] 0812 19:24:43.635449 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.235635 (+600186us) service_pool.cc:227] Handling call
0812 19:24:44.235979 (+   344us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.236414 (+   435us) raft_consensus.cc:1520] Early marking committed up to index 12
0812 19:24:44.249175 (+ 12761us) log.cc:842] Serialized 14 byte log entry
0812 19:24:44.464670 (+215495us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b1800301b40. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:24:44.693319 (+228649us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b1800301b40. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff57b 00007f98f778288a
0812 19:24:45.094073 (+400754us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:45.099403 (+  5330us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:24:45.119502 (+ 20099us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:45.127141 (+  7639us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:45.141976 (+ 14835us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8692,"prepare.queue_time_us":12591,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":26013,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":18188,"spinlock_wait_cycles":43996928,"thread_start_us":354528,"threads_started":1,"wal-append.queue_time_us":1012505}
I20260812 19:24:45.326534  6416 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:45.331954  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 932) took 1551 ms. Trace:
I20260812 19:24:45.304709 16279 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:45.355100  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2846) took 1036 ms. Trace:
I20260812 19:24:45.319878 15959 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:45.355999  6475 rpcz_store.cc:276] 0812 19:24:44.318995 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.414136 (+ 95141us) service_pool.cc:227] Handling call
0812 19:24:44.414518 (+   382us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:44.426205 (+ 11687us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:44.426248 (+    43us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:44.429760 (+  3512us) log.cc:842] Serialized 52 byte log entry
0812 19:24:45.147843 (+718083us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:45.230815 (+ 82972us) log.cc:842] Serialized 14 byte log entry
0812 19:24:45.274408 (+ 43593us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:45.330326 (+ 55918us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:45.330384 (+    58us) raft_consensus.cc:1671] finished
0812 19:24:45.330396 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:45.355017 (+ 24621us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14836,"prepare.queue_time_us":22855,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"raft.queue_time_us":22850,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":18276,"thread_start_us":538659,"threads_started":1,"wal-append.queue_time_us":763017}
I20260812 19:24:45.416733  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:45.390511  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 112453us
I20260812 19:24:45.366222  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:45.362679 16227 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.011s	sys 0.029s
I20260812 19:24:45.390324 16224 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:45.423630 15849 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:45.352042 16298 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:45.364384 15731 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:45.363734 16283 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:45.468643 16283 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.445992  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:45.302493 15986 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:45.436874 16113 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:45.408726 15507 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:45.455101  6350 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260812 19:24:45.455202  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:53166 (request call id 302) took 3362 ms. Trace:
I20260812 19:24:45.442485 16224 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:24:45.457397  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 131018us
W20260812 19:24:45.458755 15992 consensus_meta.cc:287] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.826s	user 0.012s	sys 0.003s
I20260812 19:24:45.459174 16344 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260812 19:24:45.459692 16343 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.006s	sys 0.029s
W20260812 19:24:45.466169 16331 consensus_meta.cc:287] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.869s	user 0.003s	sys 0.014s
W20260812 19:24:45.466986 16252 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.834s	user 0.014s	sys 0.015s
I20260812 19:24:45.467136  6224 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260812 19:24:45.467394  6298 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:45.336768 15833 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:45.473918  6238 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.011s	sys 0.029s
W20260812 19:24:45.443710 16227 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.015s	sys 0.034s
I20260812 19:24:45.314875  6053 catalog_manager.cc:5495] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 9 to 12, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 12 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:45.475759  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:45.480913  6228 rpcz_store.cc:276] 0812 19:24:42.092996 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:45.149868 (+3056872us) service_pool.cc:227] Handling call
0812 19:24:45.455109 (+305241us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:24:45.481758  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:45.352430  6342 rpcz_store.cc:276] 0812 19:24:43.782344 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.063279 (+280935us) service_pool.cc:227] Handling call
0812 19:24:44.063659 (+   380us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.063903 (+   244us) raft_consensus.cc:1520] Early marking committed up to index 15
0812 19:24:44.777270 (+713367us) log.cc:842] Serialized 14 byte log entry
0812 19:24:45.253242 (+475972us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:45.274132 (+ 20890us) raft_consensus.cc:1631] Marking committed up to 15
0812 19:24:45.279960 (+  5828us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:45.292893 (+ 12933us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:45.331861 (+ 38968us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":229506,"prepare.queue_time_us":491779,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":7575,"raft.queue_time_us":119228,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":32793,"spinlock_wait_cycles":5155712,"thread_start_us":1055934,"threads_started":2,"wal-append.queue_time_us":626183}
I20260812 19:24:45.483955  7599 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 17. Ops: []
I20260812 19:24:45.481669 16224 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:45.472325 16088 consensus_meta.cc:287] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.007s
W20260812 19:24:45.489573  6238 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.012s	sys 0.029s
I20260812 19:24:45.492755 15833 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:45.493654 16331 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:45.489850 16343 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.006s	sys 0.030s
I20260812 19:24:45.495934 15986 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:45.497417  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:45.501962  6230 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:56292
I20260812 19:24:45.552793  6230 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:45.553233  6230 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:45.508576 15841 raft_consensus.cc:3032] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:45.511879  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2785) took 3190 ms. Trace:
I20260812 19:24:45.516752 16282 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:45.516973 15339 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:45.520390 15800 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.522437  7598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 714) took 1003 ms. Trace:
I20260812 19:24:45.488305 16113 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:45.527119  6242 raft_consensus.cc:1261] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260812 19:24:45.527829 16011 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:45.580356  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:45.530076 16381 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
W20260812 19:24:45.582832  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 101187us
W20260812 19:24:45.532081 16395 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260812 19:24:45.538898  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 109881us
W20260812 19:24:45.596380  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 9e38bc4707784979b4d00b45879a8f0b, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:45.596868  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 9e38bc4707784979b4d00b45879a8f0b, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.540962 15987 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:45.598855  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:45.541329 15507 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.600183 16331 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:45.600445  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:45.600854 16331 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:45.572525 16127 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:24:45.601118 16283 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:45.572715 16282 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:45.601873 16282 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:45.602341  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2836) took 1345 ms. Trace:
I20260812 19:24:45.602864  6477 rpcz_store.cc:276] 0812 19:24:44.257258 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.257424 (+   166us) service_pool.cc:227] Handling call
0812 19:24:44.257810 (+   386us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:44.263336 (+  5526us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:24:44.552783 (+289447us) log.cc:842] Serialized 14 byte log entry
0812 19:24:45.253916 (+701133us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:45.585403 (+331487us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b2c000cda88. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:24:45.585994 (+   591us) log.cc:842] Serialized 26 byte log entry
0812 19:24:45.586200 (+   206us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:45.586252 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:45.586381 (+   129us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:45.601885 (+ 15504us) raft_consensus.cc:1671] finished
0812 19:24:45.602031 (+   146us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:45.602240 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":169753,"prepare.queue_time_us":128106,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":22436,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":31059,"spinlock_wait_cycles":7875840,"thread_start_us":844696,"threads_started":2,"wal-append.queue_time_us":675829}
W20260812 19:24:45.574290  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 77005.6us
I20260812 19:24:45.538208 16248 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.555058 16252 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:45.580539 16344 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260812 19:24:45.590751 16314 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.036s	sys 0.056s
I20260812 19:24:45.591483 15986 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260812 19:24:45.592279 16400 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260812 19:24:45.594070  6053 catalog_manager.cc:5495] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:45.596328  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:45.540879 16046 consensus_meta.cc:287] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.000s
I20260812 19:24:45.601130 15507 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:45.555830 15841 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:45.573487  6354 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
W20260812 19:24:45.585685  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 150912us
I20260812 19:24:45.571380 15873 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:24:45.610441  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 140530us
I20260812 19:24:45.556141  6235 rpcz_store.cc:276] 0812 19:24:42.321247 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.202522 (+1881275us) service_pool.cc:227] Handling call
0812 19:24:44.202988 (+   466us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:44.203420 (+   432us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:44.203449 (+    29us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:44.238878 (+ 35429us) log.cc:842] Serialized 52 byte log entry
0812 19:24:45.510157 (+1271279us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b540011f6a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fdaf0 00007f98f7708028 00007f98f7778a7b 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c
0812 19:24:45.510278 (+   121us) raft_consensus.cc:1631] Marking committed up to 13
0812 19:24:45.510743 (+   465us) log.cc:842] Serialized 14 byte log entry
0812 19:24:45.511151 (+   408us) log.cc:842] Serialized 14 byte log entry
0812 19:24:45.511322 (+   171us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:45.511430 (+   108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:45.511599 (+   169us) raft_consensus.cc:1671] finished
0812 19:24:45.511617 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:45.511794 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":8231,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":11231,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":263,"spinlock_wait_cycles":16670080,"thread_start_us":920300,"threads_started":1,"wal-append.queue_time_us":1011223}
I20260812 19:24:45.576074  7598 rpcz_store.cc:276] 0812 19:24:44.468112 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.551840 (+ 83728us) service_pool.cc:227] Handling call
0812 19:24:44.552308 (+   468us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.552600 (+   292us) raft_consensus.cc:1520] Early marking committed up to index 12
0812 19:24:45.044144 (+491544us) log.cc:842] Serialized 14 byte log entry
0812 19:24:45.406458 (+362314us) log.cc:842] Serialized 14 byte log entry
0812 19:24:45.410878 (+  4420us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:45.416412 (+  5534us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:24:45.425572 (+  9160us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:45.438158 (+ 12586us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:45.471249 (+ 33091us) inbound_call.cc:173] Queueing success response
0812 19:24:45.514255 (+ 43006us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b18003d3e40. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c764 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:24:45.519794 (+  5539us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b18003d3e40. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
Metrics: {"prepare.queue_time_us":706691,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":104,"raft.queue_time_us":7530,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":9442,"spinlock_wait_cycles":13394176,"thread_start_us":792238,"threads_started":2}
I20260812 19:24:45.598958 15987 raft_consensus.cc:686] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:45.636749  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:45.636893 15919 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:45.641335  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:45.619432 16081 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260812 19:24:45.637883 16314 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.036s	sys 0.056s
W20260812 19:24:45.654752  6232 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.048s	sys 0.114s
W20260812 19:24:45.656114  6232 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.048s	sys 0.114s
I20260812 19:24:45.662266  6352 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260812 19:24:45.644721 16081 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:45.676110 15841 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.721266 16081 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:45.721704 15841 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:45.725240 16046 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:45.676710 15800 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:45.678819 15833 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:45.678956 15931 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:45.679813 16243 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:45.680202 16225 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260812 19:24:45.680243  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:45.679054  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 58330.3us
I20260812 19:24:45.683472  7599 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:45.685052 16279 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:45.685508 16345 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260812 19:24:45.685957 15837 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 19:24:45.686291 15959 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 19:24:45.686549 16289 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:45.692126 16224 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:45.641702 15919 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:45.700366 16389 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260812 19:24:45.702106  6354 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 933) took 1914 ms (client timeout 1987 ms). Trace:
W20260812 19:24:45.705910  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 109746us
I20260812 19:24:45.645769 15968 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:45.708338  6053 catalog_manager.cc:5495] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 12 to 14, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 14 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:24:45.710873 15987 consensus_queue.cc:237] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:45.748139  6354 rpcz_store.cc:269] 0812 19:24:43.787315 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:43.822869 (+ 35554us) service_pool.cc:227] Handling call
0812 19:24:45.701765 (+1878896us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400407ed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:45.702013 (+   248us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3616690432}
I20260812 19:24:45.646330 16252 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:45.715832 16412 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260812 19:24:45.720404  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 2661573faf994c8f9bb837f55af974d9, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:45.758066  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 2661573faf994c8f9bb837f55af974d9, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.602365 16113 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.662159  6230 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:45.737370  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:45.729441 16243 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:45.733115 16314 raft_consensus.cc:3032] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:45.732144 16283 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:45.737270 15833 raft_consensus.cc:686] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:45.763290 16314 raft_consensus.cc:729] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:45.763885 16243 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:45.772308 16314 consensus_queue.cc:260] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:45.773787 16314 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
W20260812 19:24:45.775300  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 129493us
I20260812 19:24:45.774994 16283 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:45.776100 16224 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:45.768788 15339 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:45.777235  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:45.777554 16283 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:45.778425 16248 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:45.778779 16289 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.779620  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:45.781210  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:45.782780  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:45.775045 15686 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:45.771159  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:45.791133  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2516) took 2013 ms. Trace:
I20260812 19:24:45.792274  6230 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:45.794178  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2511) took 1782 ms. Trace:
I20260812 19:24:45.752204 15863 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:45.798393  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:45.799125  7599 raft_consensus.cc:3032] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:24:45.791694  6232 rpcz_store.cc:276] 0812 19:24:43.778058 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.802396 (+1024338us) service_pool.cc:227] Handling call
0812 19:24:44.803055 (+   659us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:44.944089 (+141034us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:44.944139 (+    50us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:45.014891 (+ 70752us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b2c0006c608. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:24:45.015684 (+   793us) log.cc:842] Serialized 52 byte log entry
0812 19:24:45.656624 (+640940us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:45.656672 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:45.656761 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:45.786113 (+129352us) raft_consensus.cc:1671] finished
0812 19:24:45.786138 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:45.791032 (+  4894us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":128306,"raft.queue_time_us":128867,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":161,"spinlock_wait_cycles":110801280,"thread_start_us":640437,"threads_started":1,"wal-append.queue_time_us":756150}
I20260812 19:24:45.799463  7599 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:45.807487 15837 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 19:24:45.808022 15837 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:45.808382 15837 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:45.803593 16248 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:45.811138 16248 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:45.811569 16248 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:45.794698  6353 rpcz_store.cc:276] 0812 19:24:43.975679 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.134879 (+159200us) service_pool.cc:227] Handling call
0812 19:24:44.135371 (+   492us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.135638 (+   267us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:24:44.731727 (+596089us) log.cc:842] Serialized 14 byte log entry
0812 19:24:45.531153 (+799426us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:45.729817 (+198664us) log.cc:842] Serialized 14 byte log entry
0812 19:24:45.734688 (+  4871us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:45.738801 (+  4113us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:45.744793 (+  5992us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:45.752164 (+  7371us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:45.758375 (+  6211us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":121828,"prepare.queue_time_us":529771,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":95827,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":8679,"spinlock_wait_cycles":17076992,"thread_start_us":1300811,"threads_started":3,"wal-append.queue_time_us":681036}
I20260812 19:24:45.811579 16331 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:45.786342 15968 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:45.814775  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47957.4us
I20260812 19:24:45.816315  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:45.816692 15968 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:45.817333 15968 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:45.818122 15915 consensus_queue.cc:1046] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:45.795450 16283 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:45.818775 16127 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260812 19:24:45.825445  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:45.822242 15968 raft_consensus.cc:686] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:24:45.828708 16415 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260812 19:24:45.803213 15863 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.847239 16289 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:45.829234 16224 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:45.847976 16224 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:45.848456 16081 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.829336  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:45.833323  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:45.839201 15915 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:45.848858 15869 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:45.840339 15968 consensus_queue.cc:237] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.854131  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:45.851827  6235 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:45.856314  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:45.836621  7599 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:45.831900 16283 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:45.862835  7599 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:45.864262  6230 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:45.859601 15869 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.865756 15863 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:45.778708 15833 consensus_queue.cc:237] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:45.864375  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:45.873703  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:45.848429 16224 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:45.872829  6232 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:24:45.853253 15915 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:45.878226  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:45.855507 16081 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:45.883951  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:45.888480  6354 raft_consensus.cc:2396] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260812 19:24:45.889739  6242 raft_consensus.cc:2396] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260812 19:24:45.875756 16331 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:45.876587 16283 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:45.893489  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:45.891952 16184 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.017s	sys 0.046s
I20260812 19:24:45.880636 15800 raft_consensus.cc:3032] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:45.898097  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:45.902387  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:45.901995 16184 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.017s	sys 0.046s
I20260812 19:24:45.906867  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:24:45.909022  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 52995.4us
I20260812 19:24:45.910326  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:45.911355 15841 consensus_queue.cc:1046] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:45.912292  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:45.912861 15841 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:45.913729 15841 raft_consensus.cc:3032] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:45.914142 15841 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:45.915777 15841 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:45.917685 15841 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:45.903846  6352 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:45.920768  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:45.883551 16088 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260812 19:24:45.926077  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 69806.6us
I20260812 19:24:45.897879 15931 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:45.934136  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:45.900413 16279 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:45.900487 16081 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:24:45.883172 16289 consensus_queue.cc:1046] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260812 19:24:45.938468  6232 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:45.903191 15800 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:45.923599 16127 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:45.956336  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:45.956593  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:45.901012 16331 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:45.958858  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:45.938962 15702 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:45.939708 16081 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:45.939100 16252 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:45.963860  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:45.862109  6053 catalog_manager.cc:5495] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 10 to 12, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 12 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:45.941578 15686 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:45.945668 15731 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:45.983124  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:45.983990  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:45.961230 16298 raft_consensus.cc:3032] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:45.971575  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:45.970793 16081 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:24:45.995594  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:45.995594  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:45.997802  6232 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:45.992884  6230 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:46.001083  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.003935  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:46.008141  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:46.013468  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 331053us
I20260812 19:24:46.014170  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:46.020005  6235 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:45.991380 16298 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:46.014580  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2515) took 2264 ms. Trace:
I20260812 19:24:46.024379  6344 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:46.024766  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:45.973016 15702 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.031291  6349 raft_consensus.cc:2354] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
W20260812 19:24:46.032871  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 68274.5us
I20260812 19:24:46.026813  6238 rpcz_store.cc:276] 0812 19:24:43.750268 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:44.791840 (+1041572us) service_pool.cc:227] Handling call
0812 19:24:44.792342 (+   502us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:44.793079 (+   737us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:24:45.549626 (+756547us) log.cc:842] Serialized 14 byte log entry
0812 19:24:45.994855 (+445229us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:45.994940 (+    85us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:46.014217 (+ 19277us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:46.014373 (+   156us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:46.014515 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":171073,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":148550,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":8260,"thread_start_us":1140350,"threads_started":2}
I20260812 19:24:45.963152 15915 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.025367 16279 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:46.038779  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:46.028303 16252 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:46.008311 15800 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.048386  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:46.002831 15731 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.036033 16340 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:46.046587  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.036696 15919 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:46.060492  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.046691 16275 consensus_queue.cc:1035] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260812 19:24:46.045626 16252 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:46.054481 16340 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:46.047300 15800 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:46.028707 16243 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.048832 16205 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:46.059990 16279 raft_consensus.cc:686] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:46.081490  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.087569  6342 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:46.059198 15987 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:46.077044  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:46.060170 15869 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:46.072851 15339 raft_consensus.cc:3032] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:46.091063  7591 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: []
W20260812 19:24:46.093034  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 44751.3us
I20260812 19:24:46.074635 16252 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:46.086359 16422 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260812 19:24:46.077564 16340 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:46.110499  6350 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:46.092005  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:46.106462  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:46.112001  6224 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:46.105769  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.110102  6241 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 18. Current term is 19. Ops: []
I20260812 19:24:46.113103 15833 consensus_queue.cc:1035] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260812 19:24:46.113654 16424 log.cc:924] Time spent T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260812 19:24:46.113942  6345 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:46.114387 16258 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260812 19:24:46.114882 16417 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260812 19:24:46.115301  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:46.097437 16331 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:46.123365  7594 raft_consensus.cc:2379] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
W20260812 19:24:46.125011  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 129271us
I20260812 19:24:46.115819  6345 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260812 19:24:46.125514  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:46.128167  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:46.128322  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:46.129711  6474 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260812 19:24:46.130462  6230 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:24:46.110697 16282 consensus_meta.cc:287] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.508s	user 0.014s	sys 0.000s
I20260812 19:24:46.048708 16298 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.096997 15339 raft_consensus.cc:729] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:46.147251  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:46.156093  6359 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260812 19:24:46.156827  6229 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260812 19:24:46.166710  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.167497  6347 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:46.169515 16227 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:46.103916 16314 consensus_queue.cc:1046] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260812 19:24:46.134936 16258 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:46.171810  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:46.175504  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:46.176230  6241 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260812 19:24:46.173098  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45032.1us
I20260812 19:24:46.159745  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.177460  6345 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:46.178877 16225 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:46.179167 16423 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260812 19:24:46.178748  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.042538  6053 catalog_manager.cc:5495] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 8 to 13, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 13 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:24:46.174376  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:46.180598  6232 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:46.187399  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:46.187920  6465 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:46.180171  6242 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:46.167572 16205 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:46.178498 15842 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:46.170207 16227 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:46.185817 16418 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260812 19:24:46.200899  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:46.196502  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.190513  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:46.199361  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:46.179922 16258 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:46.202574  6475 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:46.153302 16282 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.208762  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:46.212425  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:46.215283  6053 catalog_manager.cc:5495] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 11 to 12, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 12 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:46.215302 16430 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:46.217675 16430 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.174834 16331 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:46.195704 16205 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:46.192684 16275 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:24:46.210853 16258 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:46.220336  6477 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260812 19:24:46.227108  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.233013 16345 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260812 19:24:46.239253  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.239904  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:46.240797  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 53498.7us
I20260812 19:24:46.234444  6464 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:46.241823  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:46.222280  6224 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:46.217906  6053 catalog_manager.cc:5495] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:46.244267  6232 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:46.224970 15702 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:46.246256 15731 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:46.246596 15702 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:46.247197 15702 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.249125 16243 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:46.249361 15702 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:46.189150 16225 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:46.250727 16248 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.251909 15916 raft_consensus.cc:979] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:24:46.252446 15916 raft_consensus.cc:1067] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Signalling peer bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:24:46.252876 16225 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:46.253118 16248 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:46.264416  6230 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:24:46.267796  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:46.268723  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:46.271504  6242 raft_consensus.cc:2396] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 16 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260812 19:24:46.189832 15837 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:46.240190 15968 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:46.280050  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:46.281735  6241 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:46.279448  6238 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:46.283185  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.314958  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.313373  7599 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:24:46.315614  6465 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:46.318130  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.318835  6350 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:46.315614  6464 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:46.224886 15842 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.235250 16224 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.321167  6353 raft_consensus.cc:2379] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 9: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:24:46.322769  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 78216.2us
I20260812 19:24:46.323917  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.325196  6475 raft_consensus.cc:2396] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260812 19:24:46.331373 16430 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:46.359843  6342 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:24:46.360149  6347 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:46.359155  6349 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:46.364768  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.218822 16279 consensus_queue.cc:237] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.361567  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.374150 15507 raft_consensus.cc:3032] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:46.374706 15507 raft_consensus.cc:729] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:46.374858 15968 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:46.375672 15507 consensus_queue.cc:260] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:46.377409 15837 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:46.369057 15841 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:46.378199 15841 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:46.378566 15841 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:46.375697 15968 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:46.382366  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 102413us
I20260812 19:24:46.383363  6481 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:46.384217  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.383092  6053 catalog_manager.cc:5495] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 8 to 14, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 14 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:46.386544 16345 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260812 19:24:46.406328 16345 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:46.406898 16345 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:46.406507 16258 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.407840  6347 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:46.407784 16345 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:46.408919 16258 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:46.409451 16345 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:46.395380 16298 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:46.396945 15507 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:46.413228 16205 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:46.415458 16205 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:46.415766 16224 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:46.417052  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:46.417709  7599 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:46.392660 15842 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:46.398612  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.355562 16282 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:46.426972  6475 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:46.426754 16127 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:24:46.427686 16127 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:46.428071 16127 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:46.429023 16127 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.429668  6236 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:46.430209  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:46.430680  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.430995  6465 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:46.431288  6473 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:46.431599  6470 raft_consensus.cc:2379] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:46.402916 15916 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 19:24:46.386629 15968 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:46.433113 16127 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:46.433542  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:46.433732  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:46.434417  6464 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:46.434541 15915 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:46.403160  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.406279  6053 catalog_manager.cc:5495] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 8 to 12, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 12 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:46.436702  6053 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 12 to 15, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 15 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:46.398561  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.439277  6342 raft_consensus.cc:2379] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:46.441543  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:46.442484  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:46.443265  6342 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:24:46.443737  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:46.444692  6475 raft_consensus.cc:2396] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260812 19:24:46.443259 16127 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:46.445519 16127 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.447062 16227 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:46.448136 16127 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:46.441573  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:46.451098  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.451915  6353 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:46.452155  6359 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:46.453236  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.453641 16081 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:46.423806  6352 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:24:46.421469  6179 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:46.431123  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.455974  6481 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:46.456290  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.455003  6228 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260812 19:24:46.459731 16437 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:24:46.460343 16437 raft_consensus.cc:686] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:46.460493  6481 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:46.461302 16437 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:46.453925  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:46.462963  6359 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:46.463939  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.465018  6235 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:46.465111  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:46.426414 16428 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.228s	user 0.001s	sys 0.001s
I20260812 19:24:46.438338  6053 catalog_manager.cc:5495] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:24:46.470395  6053 catalog_manager.cc:5495] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:46.482138  6224 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260812 19:24:46.453900  6353 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:46.466379  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:46.486773  7594 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:46.475589  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:46.488471  6344 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:46.471750  6347 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:46.472414  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.472862  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.473680  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.474886  6236 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260812 19:24:46.474777  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:46.475736  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.476787  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:46.444710  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:46.493283  6342 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:46.399652  6241 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:46.435081  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:46.281005 16331 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.492805  6464 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:46.488596  6345 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:46.492853  6481 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:46.495931  6242 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:53178
I20260812 19:24:46.496615  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:46.268100 15339 consensus_queue.cc:260] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.502677  6482 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:46.535444  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:46.511739  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:46.510210  6238 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:46.505590  7599 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:46.543529  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:46.544572  7591 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260812 19:24:46.547510  6230 raft_consensus.cc:2396] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260812 19:24:46.544546  6224 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
W20260812 19:24:46.555011  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 79513.3us
I20260812 19:24:46.555794  6342 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 15. Current term is 16. Ops: [14.10-15.11]
I20260812 19:24:46.555795  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:24:46.502622 16283 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.000s
I20260812 19:24:46.556948  6179 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:46.561672  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.563604  6481 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:46.566941  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.568951  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:46.502173 16430 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:46.568712  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:46.577438  6477 raft_consensus.cc:2396] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260812 19:24:46.537302 15842 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:46.589450  6473 raft_consensus.cc:3032] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:46.550004 15833 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:46.591265  6481 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260812 19:24:46.594523  6342 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260812 19:24:46.593182  6473 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:46.594527  6350 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
W20260812 19:24:46.600633  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 43707.5us
I20260812 19:24:46.605984  6241 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260812 19:24:46.608482  6224 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260812 19:24:46.557013 16081 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:46.618153  6465 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:46.616755  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:46.619378  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:46.619526  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.625574  6481 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 18: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:46.625573  6230 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 15: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:24:46.628302  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 131757us
I20260812 19:24:46.596261 16279 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:46.630936  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:46.632691  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:46.633199  6241 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:46.592790 15842 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:46.596618 16314 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:46.511365 16109 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260812 19:24:46.613662 16224 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:46.615047 15702 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:46.647282  6224 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 18: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:46.569435 16283 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.655761  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:46.566329 16426 consensus_queue.cc:1046] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260812 19:24:46.661118  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:46.662508  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:46.663592  6224 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:46.663345  6241 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:46.641254  6473 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.640760 15842 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:46.662951  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.637017 16314 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:46.672020  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 122567us
I20260812 19:24:46.641021 15507 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:46.649094 16224 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:46.676263  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.679545  6473 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:46.682302  6477 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:24:46.682868  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 66237.9us
I20260812 19:24:46.687959  6229 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:46.689440  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.637444 16430 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.695858  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:46.664392 15702 raft_consensus.cc:686] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:46.687690  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:46.688845 16252 consensus_meta.cc:287] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.001s
I20260812 19:24:46.675397 16314 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:46.711457  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:46.712312  6224 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:46.682199 16224 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:46.708853  6464 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:46.635564  6053 catalog_manager.cc:5495] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 8 to 12, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 12 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:46.720081  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:46.722591  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.691457 16081 raft_consensus.cc:2741] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260812 19:24:46.726569  6465 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:46.734426  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:24:46.719632 16440 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260812 19:24:46.740463  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:46.739570  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 89166.2us
I20260812 19:24:46.754779  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:46.758955 16430 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:46.720563 16252 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.765597  6354 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:46.766616 16252 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:46.752545 16331 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:46.782779  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:46.783674  6464 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:46.767933 16205 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:46.792210  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:46.796732  6224 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:46.787024  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:46.791733  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:46.748317 16449 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260812 19:24:46.781705 16243 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260812 19:24:46.789987 16340 consensus_meta.cc:287] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.005s
I20260812 19:24:46.761134 16275 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
W20260812 19:24:46.836086  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 44961.6us
I20260812 19:24:46.809968 16243 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:46.837577 16243 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:46.837765  6053 catalog_manager.cc:5495] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:24:46.839888  6053 catalog_manager.cc:5495] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 8 to 11, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 11 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } }
I20260812 19:24:46.807042 15841 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:46.766992 15702 consensus_queue.cc:237] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:46.845021 16449 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:24:46.845605 16449 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:46.846706 16449 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:46.848078 16283 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:46.849325  6464 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:46.853296  6053 catalog_manager.cc:5495] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 6 to 11, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 11 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:46.854988  6464 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:33386
I20260812 19:24:46.855618  6464 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:46.856006  6464 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:46.831543 16437 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:46.859395  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:46.860262  6236 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:46.861447  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:46.862259  6229 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:46.835129 16340 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:46.866592  6352 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 13: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:46.867156  6344 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260812 19:24:46.868515 16340 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:46.870997  6475 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260812 19:24:46.883318  6483 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:46.886360 16449 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:24:46.893437  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:46.892750  6353 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:46.904212  6345 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:46.845038 15841 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:46.833765 16331 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:46.917894  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:46.912952  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 126393us
I20260812 19:24:46.913906  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:46.880139 15507 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:46.946206  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:46.948975  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:46.967908  6481 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:46.907253  6464 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:46.880365 16227 consensus_queue.cc:1046] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260812 19:24:46.972445  6482 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:46.973322  6464 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:46.981258  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:47.008394  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:46.915781 16446 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260812 19:24:46.944456 15702 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
W20260812 19:24:47.007334 16433 log.cc:924] Time spent T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260812 19:24:46.951933 15968 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260812 19:24:46.952102 15959 consensus_queue.cc:1046] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260812 19:24:47.026851  6474 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:47.004321 15837 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:47.031534 15837 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:46.974974 15507 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:47.033339 15837 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
W20260812 19:24:47.041016  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 122052us
W20260812 19:24:47.033372 16455 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260812 19:24:47.051855  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 131156us
I20260812 19:24:47.030967 16314 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:47.027045 16331 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260812 19:24:47.079397 16461 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260812 19:24:47.082067 16456 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260812 19:24:47.082970  6481 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:47.076690  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:47.090121  6178 leader_election.cc:398] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18.
I20260812 19:24:47.090728  6178 leader_election.cc:401] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260812 19:24:47.095408  7607 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260812 19:24:47.095978 16481 raft_consensus.cc:3032] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:47.096418 16481 raft_consensus.cc:729] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:47.082247 16314 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:47.097363 16282 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260812 19:24:47.098182 16314 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:47.098606 16314 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:47.099053 16314 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:47.053480 16224 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:47.104831  6359 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:47.097344 16481 consensus_queue.cc:260] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:47.115382  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:47.116568  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:47.117334  6342 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:47.117213 16243 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:47.117343  6474 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:47.115242  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:47.118508  6465 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:47.120909  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:47.123443  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:47.124308  7591 raft_consensus.cc:3032] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:47.124655  7591 raft_consensus.cc:729] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:47.125620  7591 consensus_queue.cc:260] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:47.120307 16282 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18.
I20260812 19:24:47.131577  6354 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:24:47.132033 15507 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:47.134526  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:47.006937  6053 catalog_manager.cc:5495] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 10 to 11, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 11 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:24:47.135577  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:47.160099  7591 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:47.139865 15842 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:47.146090 16243 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:47.147055 15339 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:47.177242  6359 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:47.147163  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:47.122466  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.669s (SENT) [suppressed 9 similar messages]
I20260812 19:24:47.153452  6349 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
W20260812 19:24:47.154757  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 171286us
W20260812 19:24:47.156679  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 49730.4us
I20260812 19:24:47.182766  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:47.181981 16445 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.424s	user 0.000s	sys 0.010s
I20260812 19:24:47.184923  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:47.186900 15968 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:47.191347 16224 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:47.195005 15968 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:47.195622 15968 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:47.196097 15968 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:47.200369 15842 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:47.201575  6475 raft_consensus.cc:1226] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:47.203052 16252 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:47.205574  6350 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:47.206815  7591 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:47.207279 16282 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:47.207379  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:47.209116 15837 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:47.210510 16282 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:47.214087 15837 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:47.215935  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:47.218964 15837 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:47.221866  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:47.226974  6417 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:47.231949  6350 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:24:47.232740  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:47.156091  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:47.240574  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:47.243556  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:47.251628  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 162885us
I20260812 19:24:47.214811 15916 raft_consensus.cc:3032] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Stepping down as leader of term 8
I20260812 19:24:47.252929  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:47.231904 16252 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:24:47.231721 15837 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:47.231943 16282 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:47.254717 15916 raft_consensus.cc:729] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:47.262440 16243 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:47.266475 16491 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260812 19:24:47.264932 16224 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:47.267220  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:47.206832 16314 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:47.259454 15992 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:47.256242 15915 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:47.296084  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:47.256430 16446 consensus_queue.cc:1046] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260812 19:24:47.289858 15837 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:47.332417  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 210000us
I20260812 19:24:47.372854 15915 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:47.283177  6053 catalog_manager.cc:5495] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:47.379755  6053 catalog_manager.cc:5495] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:47.379114 15915 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:47.383986  7594 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260812 19:24:47.296089 15842 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:47.298486 15992 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:47.297266 16224 raft_consensus.cc:686] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:47.295675 16243 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:47.396607  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 139904us
I20260812 19:24:47.368629  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2384) took 1171 ms. Trace:
I20260812 19:24:47.381742  6053 catalog_manager.cc:5495] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:24:47.399444  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 103446us
I20260812 19:24:47.408046  6347 rpcz_store.cc:276] 0812 19:24:46.197650 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:46.513257 (+315607us) service_pool.cc:227] Handling call
0812 19:24:46.513667 (+   410us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:46.548776 (+ 35109us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:24:47.045551 (+496775us) log.cc:842] Serialized 14 byte log entry
0812 19:24:47.367782 (+322231us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:47.367922 (+   140us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:47.368041 (+   119us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:47.368206 (+   165us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:47.368513 (+   307us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":25047,"prepare.queue_time_us":149038,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":1777,"raft.queue_time_us":137181,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":2866,"thread_start_us":627145,"threads_started":3,"wal-append.queue_time_us":211153}
I20260812 19:24:47.443650  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:47.421082 15992 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:47.461452  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:47.398450 16205 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260812 19:24:47.442049 15842 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:47.460005 15507 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election won for term 17
W20260812 19:24:47.487423  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 236856us
W20260812 19:24:47.497980  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 208242us
I20260812 19:24:47.546810 16258 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:24:47.549621 16258 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:47.551340 15842 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:47.562129  6241 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260812 19:24:47.566809 15507 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:47.568465 15507 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:47.468942 15968 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:47.573356 15968 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:47.574348  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 74628.6us
I20260812 19:24:47.575067 16224 consensus_queue.cc:237] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:47.480583 16479 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:47.592200  7607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:47.593036  7607 raft_consensus.cc:595] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:47.593519  7607 raft_consensus.cc:603] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:47.599282  6350 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:24:47.583786  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:47.534399 16498 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:24:47.694738  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 104924us
I20260812 19:24:47.588688 16491 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:47.589121 16479 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:47.669071 15339 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:47.695173 16314 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:47.711545 16507 consensus_queue.cc:1046] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260812 19:24:47.712005 16479 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:47.724542  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2385) took 1503 ms. Trace:
I20260812 19:24:47.725054  6345 rpcz_store.cc:276] 0812 19:24:46.220945 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:46.510397 (+289452us) service_pool.cc:227] Handling call
0812 19:24:46.902215 (+391818us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:46.908501 (+  6286us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:47.724273 (+815772us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b5400180450. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:47.724448 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":900473216}
I20260812 19:24:47.726374  7607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:47.727155  7607 raft_consensus.cc:595] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:47.742106 15842 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:47.742893 15842 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:47.744055 15842 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:47.755654 16503 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
I20260812 19:24:47.707808 16504 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:47.760886  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:47.594347 16243 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:47.761281  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 282239us
I20260812 19:24:47.779035  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:47.784258  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:47.794096  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:47.714427 15339 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:47.797039  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:47.700649 16498 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:47.801828 16498 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:47.589939  6053 catalog_manager.cc:5495] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:47.803980  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:47.805274  7599 raft_consensus.cc:2379] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 11: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:47.804066  6053 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:24:47.807392  6053 catalog_manager.cc:5495] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 11 to 13, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 13 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:47.810177  6053 catalog_manager.cc:5495] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:47.813768 16205 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:47.814332 16205 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:47.814842 16205 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:47.812242  6053 catalog_manager.cc:5495] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 7 to 12, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 12 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:47.836452  6053 catalog_manager.cc:5495] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 8 to 11, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 11 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:47.839327  6053 catalog_manager.cc:5495] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:47.829164 16519 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:47.767253 16521 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:47.841547  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 382348us
I20260812 19:24:47.864696  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:47.828001 16205 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:47.796130 16282 raft_consensus.cc:2741] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260812 19:24:47.857365  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 78423.6us
I20260812 19:24:47.795905 16081 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:47.834569 16527 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:47.864120  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2828) took 1279 ms. Trace:
I20260812 19:24:47.875298  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:47.868351  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:47.876394  6347 raft_consensus.cc:595] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:47.876782  6347 raft_consensus.cc:603] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:47.877070  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:47.878242  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:47.766551 16504 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:47.901722  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:47.902062  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 54153.9us
I20260812 19:24:47.875169  6230 rpcz_store.cc:276] 0812 19:24:46.585184 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:46.626577 (+ 41393us) service_pool.cc:227] Handling call
0812 19:24:46.626950 (+   373us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:46.720792 (+ 93842us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:46.720838 (+    46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:46.721448 (+   610us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:46.721498 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:47.863848 (+1142350us) spinlock_profiling.cc:243] Waited 93.6 ms on lock 0x7b54001649d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:47.863906 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:47.864051 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":215268736}
I20260812 19:24:47.879426  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:47.879703 15863 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:47.880124 16501 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 19:24:47.882889  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 935) took 1010 ms. Trace:
I20260812 19:24:47.862910 16314 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election won for term 16
W20260812 19:24:47.884102  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Leader has not yet committed an operation in its own term
I20260812 19:24:47.884231 16498 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:47.833478 15992 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:47.870132 16491 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:47.921504  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:47.871443 16521 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:47.917377  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:47.875121 16527 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:47.897199 15339 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:47.922633  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:47.923311  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:47.923964  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:47.918511  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:47.898564 16282 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:48.052198 16340 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:48.035840  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.028297  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:48.037918  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 934) took 1165 ms. Trace:
I20260812 19:24:48.019025 16498 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260812 19:24:48.064957  6342 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:48.022058  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:48.036453  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2867) took 1271 ms. Trace:
I20260812 19:24:48.044836 15916 consensus_queue.cc:260] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.028945  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:48.067135 15916 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:48.067567  6232 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:47.915270 16525 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:47.912370  6483 rpcz_store.cc:276] 0812 19:24:46.872997 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:46.884482 (+ 11485us) service_pool.cc:227] Handling call
0812 19:24:46.884907 (+   425us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:47.425481 (+540574us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b180010eb80. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f4859155 00007f98f77703d0 00007f98f7770f6b 00007f98f777b78b
0812 19:24:47.425642 (+   161us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:47.425682 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:47.441897 (+ 16215us) log.cc:842] Serialized 26 byte log entry
0812 19:24:47.834107 (+392210us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:24:47.834158 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:47.834251 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:47.882471 (+ 48220us) raft_consensus.cc:1671] finished
0812 19:24:47.882492 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:47.882807 (+   315us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2893,"raft.queue_time_us":89694,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":22704,"spinlock_wait_cycles":19085568,"thread_start_us":487293,"threads_started":2,"wal-append.queue_time_us":421746}
I20260812 19:24:47.981786  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.042200 16499 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:48.036031  6228 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:48.071230 16499 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:48.066722  6465 rpcz_store.cc:276] 0812 19:24:46.766286 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:46.766491 (+   205us) service_pool.cc:227] Handling call
0812 19:24:46.766895 (+   404us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:47.122936 (+356041us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:48.036135 (+913199us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b5400450e54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:48.036373 (+   238us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":808176000}
W20260812 19:24:48.029697 15837 consensus_meta.cc:287] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.633s	user 0.012s	sys 0.000s
I20260812 19:24:48.075978 15837 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.078151 15837 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:48.064917  6475 rpcz_store.cc:276] 0812 19:24:46.872546 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:46.881986 (+  9440us) service_pool.cc:227] Handling call
0812 19:24:46.882385 (+   399us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:47.202124 (+319739us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:48.037633 (+835509us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54004461d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:48.037845 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":733444480}
I20260812 19:24:48.081322  6359 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:48.082075 16483 raft_consensus.cc:3032] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:48.072530 16499 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.059770  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 930) took 1192 ms. Trace:
I20260812 19:24:48.063499 16282 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.073140  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2386) took 1835 ms. Trace:
W20260812 19:24:48.062053 16533 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.293s	user 0.003s	sys 0.000s
I20260812 19:24:48.063455 16340 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:48.085379 16441 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.373s	user 0.006s	sys 0.017s
I20260812 19:24:47.911625 15842 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.087977 16340 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:48.066414 16344 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.088106 16282 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.085700  6482 rpcz_store.cc:276] 0812 19:24:46.867094 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:46.867246 (+   152us) service_pool.cc:227] Handling call
0812 19:24:46.867617 (+   371us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:46.983966 (+116349us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:48.059410 (+1075444us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54003ef8d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:48.059681 (+   271us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":238927744}
I20260812 19:24:48.082593 16483 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:48.004012 16205 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:47.938939 16535 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.109671  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2815) took 1639 ms. Trace:
I20260812 19:24:48.104580 16535 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.104598 16483 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.012323 16504 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.090319  6349 rpcz_store.cc:276] 0812 19:24:46.237543 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:46.498642 (+261099us) service_pool.cc:227] Handling call
0812 19:24:47.153239 (+654597us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:47.211163 (+ 57924us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:48.072953 (+861790us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54001b8350. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:48.073080 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1406643584}
I20260812 19:24:48.087476 15842 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:47.997007 16479 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:47.994350  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:48.039927  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:24:48.108207  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 264048us
I20260812 19:24:48.048695 15992 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.084561 16481 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:48.092649  6229 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
W20260812 19:24:47.990954  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 64603.1us
I20260812 19:24:48.095093  6350 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:48.023939  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2874) took 1082 ms. Trace:
I20260812 19:24:48.135875  6481 rpcz_store.cc:276] 0812 19:24:46.941830 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:47.009972 (+ 68142us) service_pool.cc:227] Handling call
0812 19:24:47.016287 (+  6315us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:47.083613 (+ 67326us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:48.023606 (+939993us) spinlock_profiling.cc:243] Waited 66.4 ms on lock 0x7b54003a9154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:48.023856 (+   250us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":152630528}
I20260812 19:24:48.002103  7594 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:48.137507  7594 raft_consensus.cc:595] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:48.100653  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:48.088764 16344 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.110265  6235 rpcz_store.cc:276] 0812 19:24:46.469913 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:46.491840 (+ 21927us) service_pool.cc:227] Handling call
0812 19:24:46.492182 (+   342us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:46.503664 (+ 11482us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:24:46.641025 (+137361us) log.cc:842] Serialized 14 byte log entry
0812 19:24:47.925383 (+1284358us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b18004d4a00. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff57b 00007f98f778288a
0812 19:24:48.109156 (+183773us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:48.109232 (+    76us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:48.109287 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:48.109381 (+    94us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:48.109591 (+   210us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":101099,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":96,"raft.queue_time_us":1387,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":10721024,"thread_start_us":259718,"threads_started":2,"wal-append.queue_time_us":1456281}
I20260812 19:24:48.112507  6242 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:48.143579  6242 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:48.133118  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:48.145591  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:48.146509  6241 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:48.113571 16527 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:48.124413  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:48.021397 16454 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.127s	user 0.008s	sys 0.007s
I20260812 19:24:47.993289  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:48.126468  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:48.157370  6353 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:24:48.126932  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.159471  6352 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:48.163208  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:48.115289  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 282327us
I20260812 19:24:48.164717  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:48.088871 16499 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:48.128405  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:48.128615  6347 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:48.115476 16314 raft_consensus.cc:686] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:48.140537  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:48.141940  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:48.151276  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:48.153316  6342 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 8. Current term is 9. Ops: []
I20260812 19:24:48.191310  6359 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:48.191181  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:48.154321  6475 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 16. Current term is 17. Ops: []
W20260812 19:24:48.044482 15915 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.661s	user 0.010s	sys 0.001s
I20260812 19:24:48.156729  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:48.165612  6230 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:47.913146 16081 consensus_queue.cc:1046] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.229s
I20260812 19:24:48.141628 16483 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:48.171893  6229 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 15
I20260812 19:24:48.169772  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:48.201627  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:48.162071 16331 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.201866  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:48.209091  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 2661573faf994c8f9bb837f55af974d9, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:48.210198  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 2661573faf994c8f9bb837f55af974d9, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.165778 15992 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260812 19:24:48.214156  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 44522.7us
I20260812 19:24:48.212877  6241 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:24:48.190907 15507 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:48.229023  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:48.227115  6228 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260812 19:24:48.207931 16469 raft_consensus.cc:979] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:24:48.237475  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:48.270509 15842 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:48.274442  6352 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:48.278894  6474 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:48.276538  6242 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.234957  6483 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260812 19:24:48.228335  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:48.289541  6465 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:48.227633  6475 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260812 19:24:48.199987 16504 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:48.249581 16521 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.199705 16314 consensus_queue.cc:237] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.211936 16525 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:48.149026  6053 catalog_manager.cc:5495] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:48.248235 16184 consensus_queue.cc:1046] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260812 19:24:48.259366 16556 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:48.219611 16331 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.261592  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:48.261691  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:48.262398 16519 raft_consensus.cc:3032] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:48.264240 15800 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:48.206733 16564 consensus_queue.cc:1046] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260812 19:24:48.249820 16498 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260812 19:24:48.266608  7594 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:48.286926 16507 raft_consensus.cc:1067] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Signalling peer bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:24:48.267491  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:48.267728  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 08db676d084c41abaa2e196e5c2653b5, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.235934  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:48.321800  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 08db676d084c41abaa2e196e5c2653b5, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.290375  6230 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:48.322096  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:48.322846  6475 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:48.322782  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:48.323529  6230 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:48.322096  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.291435  6241 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:48.301028  6483 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:48.283332 15837 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.304878  7607 raft_consensus.cc:2379] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:48.304919  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:48.200099 15915 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.311467  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:48.292665 16485 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.339061 16283 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:48.339514 16283 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:48.339264 16485 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.340409 16283 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.341662 16283 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:48.284102 15507 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.345273 15339 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:48.345832 15339 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.312812  6229 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:48.321139  7594 raft_consensus.cc:595] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:48.347254  7594 raft_consensus.cc:603] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:48.328395 15842 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:48.335039 16556 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Stepping down as leader of term 16
W20260812 19:24:48.336163  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 68758.7us
I20260812 19:24:48.336764 16535 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:48.312698 16562 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:48.333148  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.308847 16519 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:48.350965  6230 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:48.347208 16298 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:48.372068 16298 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.356220  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:48.373274  6229 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:48.316015 15863 raft_consensus.cc:3032] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:48.375327  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:48.377055  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:48.353085  6359 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:48.367002  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:24:48.385185  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:24:48.329650 16205 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:48.394300  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 82922.7us
I20260812 19:24:48.395324  6178 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:48.351926 16482 raft_consensus.cc:3032] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:48.386106  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:48.352114 16504 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.321171 15800 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.321590 16521 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260812 19:24:48.399322  6477 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:33386
I20260812 19:24:48.357337 16556 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:48.419454  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:48.445392  6477 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:48.447111  6477 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:48.354082 16525 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:48.419454  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:48.398960  6228 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:48.448343  6359 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:24:48.414194  6229 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:48.388019 15863 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:48.455225  7599 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:48.372839 16344 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:48.447579 16509 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260812 19:24:48.472589  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 141983us
I20260812 19:24:48.473400  6417 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:48.473666  6228 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260812 19:24:48.354775 15837 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.468410  6229 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260812 19:24:48.466406  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 91203.3us
I20260812 19:24:48.438776 16482 raft_consensus.cc:729] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:48.476857  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.418920 15702 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:48.482313  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:48.452478 16499 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.486197  6241 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:24:48.447256 16485 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:48.512938  6242 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.494302 16585 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:24:48.494776 15841 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:24:48.488987 16498 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.495914 16081 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.497670 15863 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.498796 16556 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.499768  6475 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:48.400039 16205 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.504006 16527 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.444039 16504 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.543375 16527 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.543888 16504 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.489374 15702 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:48.544922 15702 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:48.545423 16479 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:48.548153 16562 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:48.548647 16562 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:48.550827  6232 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 15: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:48.521767  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53178 (request call id 2819) took 2032 ms. Trace:
I20260812 19:24:48.528179  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:48.551569  6242 rpcz_store.cc:276] 0812 19:24:46.480698 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:46.490863 (+ 10165us) service_pool.cc:227] Handling call
0812 19:24:48.485679 (+1994816us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400191c54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f776fda7 00007f98fc6bbee0 00007f98f5db9784 00007f98f5db9712 00007f98f5db9641 00007f98f5db95bc 00007f98f5db8872 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:48.513510 (+ 27831us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3712386304}
I20260812 19:24:48.524375 16081 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.555968 16081 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.530550 15339 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.532099 16127 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:24:48.557070 16331 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:48.557471 16127 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:48.557739 16331 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:48.558787 16127 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.533051 16298 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:48.535452 15800 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:48.535452 16205 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.561926  6416 leader_election.cc:398] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
I20260812 19:24:48.562278  6416 leader_election.cc:401] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:24:48.565088 16564 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.565637 16564 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.566480 15800 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
I20260812 19:24:48.567946 16564 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:48.568471 16519 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.569682 16519 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:48.569871  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:48.540876 15837 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.541538 16258 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.511891 15916 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:48.574020  6359 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:24:48.575771  6465 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:48.579339 16482 consensus_queue.cc:260] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.518854 16499 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.583218  6053 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 10 to 13, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 13 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:48.585520 15915 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.586563 16556 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:48.507507 16224 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:48.571530  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.589628  7599 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260812 19:24:48.522379 15959 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.594964  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:48.596930  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:48.558497 16331 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:48.526911 15507 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:48.599607  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 104816us
I20260812 19:24:48.598976  6477 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:48.611047  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 215794us
I20260812 19:24:48.606812  6232 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:24:48.635650  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:48.592955 15916 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:48.637790 15916 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:48.638729 16331 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.634351 16507 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:48.640882 16507 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:48.641004 16331 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:48.618517  7594 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:24:48.636258  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:48.634352 15959 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.603906 16535 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:48.648890 15959 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.649044 15916 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.649848 15837 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:48.650017 16479 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:24:48.650413 15837 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.651479 15916 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:48.651499 15800 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:48.649513 16491 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.652787 15837 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.653374 16491 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.653870 16127 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:48.525485 16498 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.641263 16507 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:48.657799 16498 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.659158  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:48.660149 16527 raft_consensus.cc:3032] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:48.660012 16504 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:48.660604 16527 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:48.661165  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:48.662015 16504 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:48.594799 16258 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.655529 16491 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.661530 16527 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:48.663429 16481 consensus_meta.cc:287] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
I20260812 19:24:48.664211 16258 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.632486 16525 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.667485  6298 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:48.667850  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:48.668526  6359 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 9.
I20260812 19:24:48.669512  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:48.670238  6232 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:48.670517  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:48.671599 16499 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.669579  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:48.675221  6344 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:48.675668  6477 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:48.676366  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:48.603576 15863 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:48.606158 16224 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:48.655382 16482 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
W20260812 19:24:48.691196  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 44279.3us
I20260812 19:24:48.663913 16527 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:48.712342  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:24:48.714108  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 53053.8us
I20260812 19:24:48.714172  6352 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260812 19:24:48.714951  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:48.715616  7599 raft_consensus.cc:3032] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:48.716025  7599 raft_consensus.cc:729] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:48.715514  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:48.716866  7599 consensus_queue.cc:260] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.719728  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:48.693044 16224 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:48.720212  6232 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
I20260812 19:24:48.723971  6416 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:48.705175 16491 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:24:48.719729 16283 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260812 19:24:48.727345 16243 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:48.731024 16498 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:48.732110 16515 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:48.722816 16258 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:48.764103  6359 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260812 19:24:48.766484  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:48.711443 16562 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.695866 15959 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 19:24:48.718688 15800 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260812 19:24:48.684077 16591 raft_consensus.cc:2741] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260812 19:24:48.694876 16499 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.779287  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:48.780486  6349 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:48.780329  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.750203 16491 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:48.681115 16504 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260812 19:24:48.748090  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.719907 16437 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260812 19:24:48.724336  6344 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
I20260812 19:24:48.797941  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:48.798906  6344 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:48.750590  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:48.799256  6344 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:24:48.800009  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 49590.6us
W20260812 19:24:48.800565  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 4995e2d6140a4fa3a2dadad444b9a924, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.751032  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.800199  6344 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.800844  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:48.801499  6344 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:48.801788  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.802438  6242 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:48.791419 16499 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.803401  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.803527 15800 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 8 FOLLOWER]: Advancing to term 9
I20260812 19:24:48.803989  6242 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:48.804906  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.805552  6242 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:48.753182  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:48.684782  6053 catalog_manager.cc:5495] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 8 to 13, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 13 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:24:48.770552  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:48.810864 16535 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:48.811010  6470 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:48.811578 16535 raft_consensus.cc:686] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:48.774782 16498 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:48.812597 16535 consensus_queue.cc:237] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.792861 16491 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:24:48.812597 16498 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.818346  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:48.749116 16331 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:24:48.820122 16562 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.774061  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:48.774377  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:48.767318  6483 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:48.746423  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:48.821827 16437 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:48.822254 16437 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:48.822572  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:48.823155 16564 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:48.823467 16331 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:48.823833 16564 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:48.824236 16331 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:48.824821 16564 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.825160 16331 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.785660  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:48.827215  6353 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:48.785960  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:48.827780 16504 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260812 19:24:48.827917  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 53631.6us
I20260812 19:24:48.792671  6232 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 21: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:48.828279 16504 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:48.748970  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.828804 16504 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:48.828956 16298 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:24:48.829241  6238 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:48.829365  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:48.830401 16298 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:24:48.830713 16515 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:48.830823  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:48.831632 15915 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:48.831423 16515 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:48.832852  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:48.769366 16258 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:48.833902 16340 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:48.834471 16340 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:24:48.800892  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 4995e2d6140a4fa3a2dadad444b9a924, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:48.821867  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 75525.2us
I20260812 19:24:48.836460  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:48.795423  6354 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260812 19:24:48.767905 16243 raft_consensus.cc:686] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:48.773969 15959 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:48.755352  6229 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:48.820526 16485 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:48.772244  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:48.797910  7599 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:48.845503  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.869874  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:48.870452  6238 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:48.870841  6241 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:48.846968  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:48.872165  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:48.868986  6359 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:24:48.772933 16314 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:48.875850  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:48.877351  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:48.879155  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:48.891963  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:48.892469  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:48.892800  6465 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:48.894068  6354 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:48.879427  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:48.897166  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:48.897934  6344 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:48.899268  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:48.903550 16515 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:48.904366  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:48.905997  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:48.804909 16499 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.868747 16536 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:48.912514  7599 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:48.912786  6475 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:48.831359 15702 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.875663 15959 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:48.932471 16491 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.935580 15702 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:48.939788  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:48.835417 16340 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:48.921577  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:48.948196  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:48.891438 15841 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:48.917694 16515 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:48.823081 16437 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:48.943830  6417 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:48.944522  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:48.919639  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:48.916328 15915 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:48.910290 16479 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:48.834643 16258 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:48.960858  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 63772.8us
I20260812 19:24:48.936638 15992 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:48.909099 16314 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.981999  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:48.956712 16485 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:48.987380  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 43657.6us
I20260812 19:24:48.990372 16437 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:48.994822 16507 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.920658 16224 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:48.960724 16515 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:24:49.013164  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 251685us
I20260812 19:24:48.963140 15915 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:48.960309 16184 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:48.959084 15841 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:24:49.019209 16584 log.cc:924] Time spent T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260812 19:24:49.033882  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:49.019631 16481 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:48.987350 16479 raft_consensus.cc:686] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:48.980546 15992 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:24:49.097605  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47544.5us
I20260812 19:24:49.030797 16491 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:49.034626 15915 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
W20260812 19:24:49.101944  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 56489us
I20260812 19:24:49.034931 16184 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:49.043363 15841 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:49.048810 16331 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:49.050642 15837 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:49.097429 15992 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:49.141729  7599 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:24:49.101125 16481 raft_consensus.cc:686] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:49.018996 16243 consensus_queue.cc:237] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.133266 16184 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:49.159557  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 211425us
I20260812 19:24:49.140202 15837 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:49.172652  6224 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:49.176429  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:49.180284  6236 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 21: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:49.179255 15837 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:49.171433 15959 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:49.217955  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:49.221761  6178 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:49.223146  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:49.225714 15702 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election won for term 16
W20260812 19:24:49.226239 16607 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260812 19:24:49.226593 16588 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:49.227332 16596 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260812 19:24:49.227806 16613 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260812 19:24:49.227759 16596 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:49.229669  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.231822  6481 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:24:49.215422 16556 consensus_meta.cc:287] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.005s
I20260812 19:24:49.232669  6298 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:49.237452  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:49.198881 16519 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260812 19:24:49.228363 16560 raft_consensus.cc:3032] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:49.243973  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:49.226303 15702 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:49.254602  7599 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:49.237407 16314 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:49.262645  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:49.264914  6359 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:49.196334 16479 consensus_queue.cc:237] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.267473  6354 raft_consensus.cc:2379] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:24:49.257805 16527 consensus_meta.cc:287] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.004s
I20260812 19:24:49.234208 16596 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:49.240869 16224 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:49.306130 16620 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260812 19:24:49.311407 16615 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260812 19:24:49.314159 15702 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.315336  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:49.211539 16481 consensus_queue.cc:237] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:49.319869 15959 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:49.265573 16624 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:24:49.246033 16560 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:24:49.349169  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 80817.5us
I20260812 19:24:49.353087  6352 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:49.358089  7607 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:49.363933  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:49.365855  7599 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
W20260812 19:24:49.351133 15800 consensus_meta.cc:287] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.002s
I20260812 19:24:49.348284 16491 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:49.355955 16611 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260812 19:24:49.370465  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:49.379846  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:49.378926 16283 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:49.382843 16283 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:49.383369 16283 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:49.413841  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:49.416519 16507 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:49.420277 16609 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.197s	user 0.002s	sys 0.000s
I20260812 19:24:49.419579 16283 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.358698 16519 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:49.433928  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:49.434718  6353 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:49.436606  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:49.439110  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:49.441051  6352 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:24:49.370965 15800 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 19:24:49.432998 16283 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:49.452879  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:49.453737  6235 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:49.371500 16556 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:49.455263 16556 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:49.455767 16556 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:49.456197 16556 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:49.439312 16519 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.372730 16491 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:49.461066 16519 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:49.447548  6417 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:49.461604 16491 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:49.369436 16527 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.081s
I20260812 19:24:49.463279  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:49.463982 15800 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:49.464635 15800 raft_consensus.cc:686] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:49.371281 16624 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:49.465631 15800 consensus_queue.cc:237] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:49.465909 16624 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:49.470310 16560 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.470875 16622 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:24:49.472309 16491 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:24:49.374823 16588 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.098s
I20260812 19:24:49.473690 16491 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:49.474624 16491 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:49.475078 16485 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:49.475948 16491 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:49.477419 16482 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:49.478020 16482 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:49.479278 16298 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:49.479780 16298 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:49.480204 16298 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:49.480510 16482 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:49.484627  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:49.485420  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 503670us
I20260812 19:24:49.486215  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:49.486241  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:49.478372 15863 consensus_meta.cc:287] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.793s	user 0.012s	sys 0.001s
I20260812 19:24:49.515257  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:49.523900  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:49.544114  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.545509  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.561990  6235 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
I20260812 19:24:49.555172  6481 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:24:49.549001  6353 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 10.
I20260812 19:24:49.563722  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:49.563980  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.540249  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.574021  6475 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:49.498819 16127 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:49.566468  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.528707  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:49.573616  6473 raft_consensus.cc:2354] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14.
I20260812 19:24:49.578182  6465 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:49.514295 16485 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:49.581555  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:49.531895 16623 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:24:49.583933 16623 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:49.584214  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.585677  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:49.586354 16515 consensus_meta.cc:287] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.548s	user 0.003s	sys 0.007s
I20260812 19:24:49.587934 16515 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.590613 16515 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:49.591722  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.593171  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:49.595912 16507 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:49.596181  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.596583 16507 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:49.597090  6473 raft_consensus.cc:2354] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14.
I20260812 19:24:49.597641 16507 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:49.521507 16560 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:49.584398 16623 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:49.603463 16596 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.598274  6473 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:49.606307  6475 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260812 19:24:49.607713  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.611980  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:49.613384  6481 raft_consensus.cc:2396] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260812 19:24:49.622897  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:49.548581 16224 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election won for term 15
W20260812 19:24:49.609993 16504 consensus_meta.cc:287] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.754s	user 0.014s	sys 0.000s
I20260812 19:24:49.552414 15863 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:49.614349 16437 consensus_meta.cc:287] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.000s
I20260812 19:24:49.665619  6470 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260812 19:24:49.668978  6470 pending_rounds.cc:76] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 10
I20260812 19:24:49.669478  6470 pending_rounds.cc:97] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260812 19:24:49.688359  6470 raft_consensus.cc:2866] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:24:49.693441  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 313700us
I20260812 19:24:49.694440  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:49.696007  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:49.667428 16252 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:49.732121  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:49.728814 15992 consensus_meta.cc:287] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260812 19:24:49.710996 16585 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:49.739079 16585 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:49.739547 16585 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:49.742404 15915 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.000s
I20260812 19:24:49.742879 15915 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.745625 15915 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:49.715600 16582 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260812 19:24:49.668480 16224 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:49.751528  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:49.757568  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 61662us
I20260812 19:24:49.704217 16596 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:49.761830 16638 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:49.664041 16504 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:49.776265  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.782485  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:49.785614 16283 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:49.786234 16283 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:49.787169 16283 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.789539 16224 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.750910 15992 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.792527 15992 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:49.794291 15837 consensus_meta.cc:287] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.001s
I20260812 19:24:49.794793 15837 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.796993 15837 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:49.777233  6470 raft_consensus.cc:2362] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16. Re-sending same reply.
I20260812 19:24:49.799969 16556 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.802235 16556 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:49.802765  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:49.803483  6352 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:49.804531  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:49.805222  6353 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:24:49.807096 16298 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.807665  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:49.809139 16298 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:49.815254 15841 consensus_meta.cc:287] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.001s
I20260812 19:24:49.815958  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.815769 15841 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.765730 16638 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:49.818451 15841 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:49.818883  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.819676  6470 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:49.821704 16622 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:49.822237 16622 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.822942  6359 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: [12.9-14.10]
I20260812 19:24:49.749680 16252 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:49.825238 16252 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:49.817920 16638 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.828164  6482 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260812 19:24:49.829684  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.831614  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:49.831997 16622 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:49.832221  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.832543  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.832676  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:49.833460  6465 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:49.832266  6481 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:49.833773  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:49.794327 16504 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:49.838819  6483 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:24:49.841055  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 52077.4us
W20260812 19:24:49.844169  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 358014us
W20260812 19:24:49.834296 16184 consensus_meta.cc:287] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.003s
I20260812 19:24:49.838857  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:49.852941  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:49.853773  6359 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:49.843289  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:49.855353  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 273943us
I20260812 19:24:49.863000 16623 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.866307  6464 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 18. Current term is 19. Ops: []
I20260812 19:24:49.875522  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:49.880540  6353 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260812 19:24:49.880451  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:49.881192  6353 pending_rounds.cc:76] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 9
I20260812 19:24:49.881508  6353 pending_rounds.cc:97] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260812 19:24:49.881808  6353 raft_consensus.cc:2866] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:49.883893  6352 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:24:49.889743 16437 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:49.890535 16437 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.893534 16437 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:49.896669  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2869) took 1121 ms. Trace:
I20260812 19:24:49.897120  6242 rpcz_store.cc:276] 0812 19:24:48.775568 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:48.806145 (+ 30577us) service_pool.cc:227] Handling call
0812 19:24:48.806539 (+   394us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:48.865322 (+ 58783us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:48.865360 (+    38us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:48.902970 (+ 37610us) log.cc:842] Serialized 52 byte log entry
0812 19:24:49.427737 (+524767us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b1800480dc0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:24:49.718457 (+290720us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:49.718516 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:49.718612 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:49.868486 (+149874us) raft_consensus.cc:1671] finished
0812 19:24:49.868506 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:49.896603 (+ 28097us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18770,"raft.queue_time_us":20530,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":4802,"spinlock_wait_cycles":4412800,"thread_start_us":290453,"threads_started":1,"wal-append.queue_time_us":962941}
I20260812 19:24:49.855541 16504 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:49.909067  6481 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:49.913853  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:49.870713 15841 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:49.919919  7607 raft_consensus.cc:2354] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12.
I20260812 19:24:49.923597  6359 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:24:49.923197 16585 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.928285  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:49.929152  6481 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 18
I20260812 19:24:49.935786  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:49.936549  7607 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:49.937485  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:49.939899  6242 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260812 19:24:49.940411  6242 pending_rounds.cc:76] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 7
I20260812 19:24:49.940686  6242 pending_rounds.cc:97] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260812 19:24:49.941008  6242 raft_consensus.cc:2866] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:49.942894  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:49.946224  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:49.946316  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:49.947356  6230 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:49.869135 16252 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260812 19:24:49.912979 15702 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:24:49.958633  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:49.959976  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:49.960661  6232 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:49.857657 16184 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.964789  6470 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260812 19:24:49.966374  6481 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:24:49.972823  6230 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:49.974807  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:49.975031  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:49.974862  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:49.975986  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:49.976883  6236 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:49.975629  6235 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:49.982805  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:49.993024  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:49.990401  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:49.996950  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:49.997478  6224 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 16
I20260812 19:24:49.988680  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:49.998570  6481 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260812 19:24:50.003420  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:50.005208  6475 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:24:50.007838  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:49.998256  6232 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:50.008466  6465 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:50.008380  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:49.952876 15916 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:50.029717  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:50.030872  6483 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:50.033229  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:50.033993  6482 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:49.958380 15702 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:49.919071 16504 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:49.964192 16483 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Leader election won for term 10
I20260812 19:24:49.964399 16527 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:49.979120 16624 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.000s	sys 0.028s
I20260812 19:24:50.047379  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:50.058035  6477 raft_consensus.cc:2379] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:50.042414  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:50.059134  6470 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:50.064237  6235 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:49.931108 15841 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.007109 16498 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:50.028636 16588 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:50.028388 16596 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:50.044118 15702 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:50.043380 16469 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260812 19:24:50.066416 16624 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.000s	sys 0.028s
I20260812 19:24:50.084617  6235 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:50.087884  6224 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:50.088362  6465 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:50.088343  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:50.065644 16556 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:50.167716  6359 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:49.991796 16560 consensus_queue.cc:1046] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260812 19:24:50.148574  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:50.039804 16127 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260812 19:24:50.113555  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:50.088100 16252 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:50.179392  6477 raft_consensus.cc:2354] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17.
I20260812 19:24:50.178529  6482 raft_consensus.cc:2354] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17.
I20260812 19:24:50.043447 15916 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:50.086793 16483 raft_consensus.cc:686] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:50.099357 15992 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:50.066267 16527 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.033735 16637 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.156s
W20260812 19:24:50.236316  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 243134us
I20260812 19:24:50.165261 16469 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:50.241276 16592 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:50.268555  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:50.269456  6344 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:50.173377 16588 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:50.236348 16485 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:50.293303  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:50.293275  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:50.147135 16498 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:50.300724  7607 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260812 19:24:50.267379 16469 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:50.272691 16340 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:50.294461 16632 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260812 19:24:50.267536 16585 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.183801 16556 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.260722 16252 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.349684  6344 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:24:50.276830 16623 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:50.360773  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:50.298554 16437 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:50.349423 16615 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260812 19:24:50.263388 15992 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.383383 16437 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:50.384883  6481 raft_consensus.cc:2354] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17.
I20260812 19:24:50.355480 16224 raft_consensus.cc:465] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Not starting pre-election -- already a leader
I20260812 19:24:50.387956  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:50.381768 15863 consensus_meta.cc:287] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.712s	user 0.012s	sys 0.000s
I20260812 19:24:50.299475 16485 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.367592 16525 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:50.290813 16592 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.381111 16184 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.381585 16585 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:50.404716  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:50.410082  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:50.396502 16637 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:50.401252 15863 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:50.374683 16340 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.405697 16624 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:50.380597 16483 consensus_queue.cc:237] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:50.418977 16649 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
W20260812 19:24:50.433971  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 152722us
I20260812 19:24:50.443225  6236 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:50.445649  6298 leader_election.cc:398] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12.
I20260812 19:24:50.446622  6298 leader_election.cc:401] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260812 19:24:50.448565  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:50.449398  6236 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
W20260812 19:24:50.455729 16664 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260812 19:24:50.421734 16504 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.463065  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:50.464113  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:50.427835 16687 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:50.468894  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:50.469000  6477 raft_consensus.cc:2396] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260812 19:24:50.415707 16585 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.471947 16585 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.405540 16525 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.474534  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:50.459405 15841 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.483498  6359 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260812 19:24:50.488833  6359 pending_rounds.cc:76] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 11
I20260812 19:24:50.486219  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:50.489094  6359 pending_rounds.cc:97] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260812 19:24:50.490343  6359 raft_consensus.cc:2866] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:50.476024 16585 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:50.406555 16588 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.497329  6465 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:24:50.504160  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:50.504971  6477 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
W20260812 19:24:50.511078  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 1e69ce57e6c74dea9e207b6ae03c43b2, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:50.511574  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 1e69ce57e6c74dea9e207b6ae03c43b2, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:50.498873 16658 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260812 19:24:50.423146 16637 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.515596  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:50.450546 16624 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:50.476771 16527 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.524806  6470 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:50.484382 15916 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.489078 16482 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260812 19:24:50.552882  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 89428.6us
I20260812 19:24:50.469096 16481 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260812 19:24:50.553709 16556 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.488668 16491 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:50.460489 16596 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:50.517294 16585 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:50.522189 16665 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260812 19:24:50.559564  6482 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260812 19:24:50.563090  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 93caa3d3062a45cbad94ff4ba511f2e0, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:50.565459 16666 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260812 19:24:50.568948 16437 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:50.571208 16637 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.571980  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:24:50.615859  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 44015.9us
I20260812 19:24:50.576026 16340 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.577486 16252 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:50.579114 16667 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260812 19:24:50.585729  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:50.668733 16481 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:50.668987 16596 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.669866 16127 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:50.587260  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:50.669605 16481 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:50.670275 16127 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:50.670768 16127 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:50.555634 15992 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:50.589663  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 93179.6us
I20260812 19:24:50.673233 16624 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:50.619693 16437 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:50.674105 16437 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:50.554260 16498 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.675128 16525 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.555660 16657 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:50.592974  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:50.556686  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 111220us
I20260812 19:24:50.454900 16695 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:24:50.475760 16687 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.583043 16482 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:50.676779  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:50.579567 16703 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260812 19:24:50.731483 16482 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
W20260812 19:24:50.732129 16704 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260812 19:24:50.607895  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 93caa3d3062a45cbad94ff4ba511f2e0, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:50.595515 16670 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260812 19:24:50.613099  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:50.522373 16696 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260812 19:24:50.617723  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:50.598485 16485 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:50.620924 16676 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.218s	user 0.000s	sys 0.004s
W20260812 19:24:50.623355 16669 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260812 19:24:50.607909 16592 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.670538  6470 raft_consensus.cc:2362] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18. Re-sending same reply.
I20260812 19:24:50.480600 16701 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:50.824872 16701 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.825460  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:50.826160  6235 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 17
I20260812 19:24:50.674439 16437 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:50.718070 16657 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:50.829903 16657 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.831218  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:50.831395 16701 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.833300  6342 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:50.723295 15800 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:50.839072 15800 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.841564 15800 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:50.692461  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 106815us
I20260812 19:24:50.726514  6481 raft_consensus.cc:2362] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16. Re-sending same reply.
I20260812 19:24:50.722296  6298 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:50.738270  7607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:44858
W20260812 19:24:50.753131  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 135491us
I20260812 19:24:50.846349  6238 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:50.847777  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:50.759548  6482 raft_consensus.cc:2354] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14.
I20260812 19:24:50.850090  6235 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:50.767185  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:50.783483  6242 raft_consensus.cc:1203] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Deduplicated request from leader. Original: 9.10->[11.11-11.11]   Dedup: 11.11->[]
I20260812 19:24:50.785095  6359 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260812 19:24:50.851486  6242 raft_consensus.cc:1226] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260812 19:24:50.852368  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:50.853117  6359 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:50.793357  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:50.794459  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:50.855116  6345 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:50.855055  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:50.795261  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:50.665225 16585 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.806428  6232 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:50.812541  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:50.814224  6352 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260812 19:24:50.822115  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:50.822484  6350 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:50.861938  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:50.863595  6342 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:50.864687 16592 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:24:50.866791  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2426) took 1065 ms. Trace:
W20260812 19:24:50.864938 15702 consensus_meta.cc:287] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.686s	user 0.005s	sys 0.010s
I20260812 19:24:50.867640 15702 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.870085 15702 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.870688 16687 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:50.870767  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:50.872265  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:50.872954  6350 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
W20260812 19:24:50.873854 16469 consensus_meta.cc:287] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.000s
I20260812 19:24:50.874280  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:50.875073  6352 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:50.823256  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:50.857338  6228 raft_consensus.cc:2396] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260812 19:24:50.877508  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:50.878213  6342 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:24:50.859647  6224 raft_consensus.cc:2396] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260812 19:24:50.864890 16709 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:50.879778 16709 raft_consensus.cc:686] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:50.867211  6354 rpcz_store.cc:276] 0812 19:24:49.800918 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:49.806083 (+  5165us) service_pool.cc:227] Handling call
0812 19:24:49.806496 (+   413us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:49.827760 (+ 21264us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:49.827795 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:49.828333 (+   538us) log.cc:842] Serialized 26 byte log entry
0812 19:24:50.263989 (+435656us) raft_consensus.cc:1631] Marking committed up to 16
0812 19:24:50.289604 (+ 25615us) log.cc:842] Serialized 14 byte log entry
0812 19:24:50.293946 (+  4342us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:50.294167 (+   221us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:50.866543 (+572376us) raft_consensus.cc:1671] finished
0812 19:24:50.866576 (+    33us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:50.866733 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2865,"prepare.queue_time_us":25308,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":58,"raft.queue_time_us":8392,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":6668,"thread_start_us":435097,"threads_started":1,"wal-append.queue_time_us":580010}
I20260812 19:24:50.880715 16709 consensus_queue.cc:237] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.881832  6345 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260812 19:24:50.866910  6229 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:24:50.885051  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 162829us
I20260812 19:24:50.878012 16491 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 11. Current term is 12.
I20260812 19:24:50.889487 16695 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:50.889930 16695 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:50.890314 16695 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:50.893537  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:50.897513  6353 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:24:50.898929  6359 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:50.903354  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:50.904485  6236 raft_consensus.cc:2396] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260812 19:24:50.907956  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:50.908138  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:50.909560 16498 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:50.910327 16498 raft_consensus.cc:686] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:50.911832 16498 consensus_queue.cc:237] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:50.917462  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 181270us
I20260812 19:24:50.921384  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:50.902698 16592 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:50.926874  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:50.928769  6354 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:50.931339  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:50.932453  6236 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:50.874383 16469 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:50.942528 15837 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:50.943215 15837 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:50.944391  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:50.944867  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:50.947224  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:50.948422  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:50.949324  6347 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:24:50.956928  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:50.958436  6241 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:50.959149  7607 raft_consensus.cc:595] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:50.959079  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:50.959688  7607 raft_consensus.cc:603] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:50.963155  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:50.961859  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:50.965531  6236 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:50.966285  6228 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260812 19:24:50.965891  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:50.968289  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:50.944288 16592 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:50.971143  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:50.972195  6232 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260812 19:24:50.973251  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:50.973785  6236 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:50.963361 16525 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:24:50.974527  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:50.975358  6241 raft_consensus.cc:1261] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260812 19:24:50.978611  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:50.962289 16481 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:50.969261 16564 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:50.979123 16224 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:50.981691  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:50.984115  6350 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260812 19:24:50.983011 16491 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:50.990411 16699 consensus_queue.cc:1046] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.007s
I20260812 19:24:50.992484 16592 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.007155  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:50.967337 16252 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260812 19:24:51.012064  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:51.012784  6470 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:51.013798  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:51.014446  6465 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:51.015535  6238 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:51.018110  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:51.018795  6465 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:51.019243 16699 raft_consensus.cc:3032] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:51.018814 16491 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:51.019702 16699 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:51.020401 16491 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.020630 16699 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.021871 16699 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:51.024526  6350 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260812 19:24:51.024870  6359 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:51.025301  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:51.025992  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:51.026350  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:51.027356  6354 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260812 19:24:51.026703  6470 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:50.997046 16482 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:50.969309 15837 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:50.978402  6416 connection.cc:232] RPC call timeout handler was delayed by -1.5093866961542517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260812 19:24:51.029696  6416 connection.cc:232] RPC call timeout handler was delayed by -1.3473866961430758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
I20260812 19:24:51.005683  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:51.030062  6416 connection.cc:232] RPC call timeout handler was delayed by -1.3320866960566491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
I20260812 19:24:50.981591 15992 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:50.992976 16224 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.031620  6482 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:51.032186  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:51.028268 16127 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:50.977487 16624 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:51.043038  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:51.044543  6238 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 16
W20260812 19:24:51.030367  6416 connection.cc:232] RPC call timeout handler was delayed by -1.2357866961974651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
I20260812 19:24:50.996685 16498 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:51.032513  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:51.048513  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:51.032840  6242 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
W20260812 19:24:51.048807  6416 connection.cc:232] RPC call timeout handler was delayed by -1.1817866961937398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
I20260812 19:24:51.049150  6235 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:51.033401  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:51.050900  6349 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260812 19:24:51.051335  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:51.050169  6416 connection.cc:232] RPC call timeout handler was delayed by -1.1124866961035877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
I20260812 19:24:51.052060  6482 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
W20260812 19:24:51.052441  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0953866960480809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260812 19:24:51.052875  6416 connection.cc:232] RPC call timeout handler was delayed by -1.076486696023494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
I20260812 19:24:51.055188  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:51.055732  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0080866960342973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
I20260812 19:24:51.056011  6242 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:51.057803  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:51.057869  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:51.063060  6482 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:51.050779 16624 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:51.059373 16482 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:51.064612  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:51.041172 15992 raft_consensus.cc:686] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:51.067966  6242 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:51.070212  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:51.066072  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 212619us
I20260812 19:24:51.009446 16437 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.068219  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:51.080564  6235 raft_consensus.cc:2396] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260812 19:24:51.068591  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:51.047115 16224 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:51.070379  6470 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 9 FOLLOWER]: Advancing to term 10
I20260812 19:24:51.071288  6232 raft_consensus.cc:2396] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260812 19:24:51.071197  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:51.066596  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:51.086452  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:51.075349  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:51.087036  6242 raft_consensus.cc:2396] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260812 19:24:51.077594  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:51.087978  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:51.088868  6241 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:24:51.065421 15841 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:51.067617 16481 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:51.092907  6229 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:51.095242  6242 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:51.099261 16224 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:51.099879 16127 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:51.099381 16624 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.109148  6230 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:51.109570  6470 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:24:51.110244  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:51.110823  6473 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:51.092965 16485 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.018s
I20260812 19:24:51.100652 15841 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.113448 15841 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:51.088363 15800 raft_consensus.cc:2741] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260812 19:24:51.087072 16469 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:51.091718 16515 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:51.085740 16498 raft_consensus.cc:686] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:51.125080  6473 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
I20260812 19:24:51.136129  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:51.137872  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:51.139045  6473 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:51.140478  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:51.141196 16469 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:51.141876  6345 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260812 19:24:51.142225 16437 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:51.143394  6178 leader_election.cc:334] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.669s (SENT)
I20260812 19:24:51.138320  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:51.164043  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:51.164425 16715 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:51.164542  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:51.164976 16715 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:51.165397 16715 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:51.165729  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:51.166631 15841 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:51.165412 16696 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:24:51.167181 15841 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:51.167598  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:51.168043 15841 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:51.168428 16525 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:51.168853 16525 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:51.169188 16525 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:51.167389 16696 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:51.171103 16696 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:51.166540  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:51.174969  6483 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
W20260812 19:24:51.165215  6178 leader_election.cc:334] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.684s (SENT)
I20260812 19:24:51.177186  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:51.177451  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:51.114099 15992 consensus_queue.cc:237] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.127208 16481 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:51.174633  6473 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:51.188767  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:51.190987  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 104621us
I20260812 19:24:51.192130  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:51.163400 16482 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:51.195669  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:51.208559  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:51.200512  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:51.181604 16596 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:51.133880 16515 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.223592  6224 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:51.192433 16481 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:51.197576 16485 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:51.215005 16687 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:51.205901 16588 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:24:51.228387  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 63216.6us
I20260812 19:24:51.195909 16483 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260812 19:24:51.233851  6178 leader_election.cc:398] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14.
I20260812 19:24:51.212009 16753 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:51.223702 16127 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:51.248325 16751 raft_consensus.cc:2741] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260812 19:24:51.248760 16696 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.253458  6482 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
I20260812 19:24:51.256390  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:51.258525  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:51.262409 16715 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:51.278163  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 98072.3us
I20260812 19:24:51.264379 16588 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260812 19:24:51.315969  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 138586us
I20260812 19:24:51.255054 16127 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:24:51.274855 16745 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.174s	user 0.004s	sys 0.000s
I20260812 19:24:51.334553  6238 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
I20260812 19:24:51.236570 16525 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.284439 16345 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:51.256217 15841 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.332056 16715 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:51.348209 16741 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260812 19:24:51.342523 16624 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260812 19:24:51.279219 16481 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:51.370936  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 114629us
W20260812 19:24:51.376296 16690 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.969s	user 0.005s	sys 0.006s
I20260812 19:24:51.376504 16695 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:51.243093 16687 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.225754 16498 consensus_queue.cc:237] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.335985 16127 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:51.451079  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 55381.3us
W20260812 19:24:51.470757  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 270353us
I20260812 19:24:51.471782  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:51.456310 16750 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.229s	user 0.005s	sys 0.002s
I20260812 19:24:51.485771  6350 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:51.452808 16345 raft_consensus.cc:686] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:51.488621  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:51.472728 16757 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.139s	user 0.000s	sys 0.006s
I20260812 19:24:51.445779 16283 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:51.494660  6359 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:51.495884  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:51.501444  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:51.502767  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:51.503631  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:51.503984 16585 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:51.504812 16753 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:51.505524 16753 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:51.506007 16753 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:51.506928 16753 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:51.511503  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 178720us
I20260812 19:24:51.490445 16703 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:51.482518 16525 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:51.490595 16764 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:51.496778 15800 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:24:51.482156 16596 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260812 19:24:51.508466 16224 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:24:51.525022  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:51.528612  6359 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
W20260812 19:24:51.518299 16760 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260812 19:24:51.513955 16585 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:51.523360 16696 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:51.520434 16764 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:51.535269 16770 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:51.552933 16695 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:51.518126 16703 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:51.503700 16283 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:51.513404 16515 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:51.559748  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 56152.4us
I20260812 19:24:51.501756 16437 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260812 19:24:51.575791  6342 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
W20260812 19:24:51.577121  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 52177.6us
I20260812 19:24:51.579312  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:51.579897  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:51.585065  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 48329.4us
W20260812 19:24:51.576778 16773 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260812 19:24:51.595280  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 123556us
I20260812 19:24:51.584566 16695 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:24:51.598665  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:51.589404 16515 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:51.612777  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:51.611841  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:51.621905  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:51.594640 16592 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.000s	sys 0.014s
I20260812 19:24:51.598788 16695 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:51.573215 16345 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:51.624980 16592 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.000s	sys 0.015s
I20260812 19:24:51.650547  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:51.618522 15841 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:51.598677 16777 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:24:51.623978 15992 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260812 19:24:51.647083 16699 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.625s	user 0.014s	sys 0.005s
I20260812 19:24:51.648432 16695 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
W20260812 19:24:51.658006  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 76315.4us
W20260812 19:24:51.638892 16560 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.374s	user 0.018s	sys 0.030s
I20260812 19:24:51.666186  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:51.652634 15915 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:51.656333 16184 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:51.671303 16685 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:51.635484 16515 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.661228 15992 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:24:51.667078 16560 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.410s	user 0.018s	sys 0.031s
I20260812 19:24:51.651402 16314 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260812 19:24:51.677203 16780 raft_consensus.cc:3032] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:51.677627 16783 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260812 19:24:51.682790 16653 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.473s	user 0.024s	sys 0.000s
I20260812 19:24:51.684301 16775 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election won for term 17
W20260812 19:24:51.676157  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 64677.9us
I20260812 19:24:51.653249 16127 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.693876 16515 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:51.664719 16753 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260812 19:24:51.685474 15992 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:51.712455  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:51.691959 16780 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:24:51.743970  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 88519.9us
I20260812 19:24:51.751644  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:51.752986  6241 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 21.
I20260812 19:24:51.754087  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:51.755443  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:51.755776  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:51.760700  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:51.756152  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:51.722636 16775 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:51.764442 16775 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.765513 16515 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:51.766122 16515 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:51.743499 16314 raft_consensus.cc:3032] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:51.766589 16789 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:24:51.767232 16789 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:51.767017 16515 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.767683 16789 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:24:51.768443 16703 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:51.769651 16783 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:51.762445  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:51.772519  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:51.773176  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:51.774432  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:51.777624  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:51.778663  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:51.779526  6238 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:51.740772 16818 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:51.787999  6241 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260812 19:24:51.754308 16585 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:51.790566  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:51.766932 16314 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:51.743583 16753 consensus_queue.cc:1046] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260812 19:24:51.771508 16699 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:51.795027  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:51.780586 16560 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:51.793072  6465 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:51.780581 16764 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:51.782963 16685 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:51.792076 16283 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:51.785539 16819 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:24:51.782368 15915 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:51.809554  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2569) took 1028 ms. Trace:
I20260812 19:24:51.785341 16807 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:51.817637  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2901) took 2907 ms. Trace:
I20260812 19:24:51.805096 16780 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.824338  6230 rpcz_store.cc:276] 0812 19:24:50.781562 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:50.784110 (+  2548us) service_pool.cc:227] Handling call
0812 19:24:50.834499 (+ 50389us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:51.109681 (+275182us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:51.809266 (+699585us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54002931d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:51.809484 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":631078656}
I20260812 19:24:51.809126 16699 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:51.805936 16813 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:51.839706  6477 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260812 19:24:51.810518 16585 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:51.851995  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:51.852629  6232 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:51.826527  6474 rpcz_store.cc:276] 0812 19:24:48.901807 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:48.914026 (+ 12219us) service_pool.cc:227] Handling call
0812 19:24:48.937004 (+ 22978us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:48.937518 (+   514us) raft_consensus.cc:1520] Early marking committed up to index 7
0812 19:24:49.596786 (+659268us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b18003b3500. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f47d34ca 00007f98fdea8f99 00007f98f4697990 00007f98f4859864 00007f98f4859155 00007f98fb14d167 00007f98f7782807 00007f98f7791f0f 00007f98f7791e88
0812 19:24:49.597141 (+   355us) log.cc:842] Serialized 14 byte log entry
0812 19:24:49.839992 (+242851us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:49.859908 (+ 19916us) log.cc:842] Serialized 26 byte log entry
0812 19:24:49.860084 (+   176us) raft_consensus.cc:1631] Marking committed up to 7
0812 19:24:49.860122 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:49.860207 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:51.591360 (+1731153us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:51.809019 (+217659us) raft_consensus.cc:1671] finished
0812 19:24:51.809055 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:51.809234 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29156,"prepare.queue_time_us":661954,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":7454,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":10744,"spinlock_wait_cycles":21822080,"thread_start_us":241868,"threads_started":1,"wal-append.queue_time_us":445609}
I20260812 19:24:51.838089  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:51.839237 15915 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:51.843134  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:51.821863 16819 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:51.869167  6224 raft_consensus.cc:3032] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:51.869655  6224 raft_consensus.cc:729] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:51.874966  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:51.878082  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:51.870538  6224 consensus_queue.cc:260] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.879709  6224 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:51.848205  6238 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:51.849324 16813 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:51.840250 16699 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:51.825790 16807 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:51.850255  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:51.861524  6232 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:24:51.866230  6236 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:24:51.874246  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 161887us
I20260812 19:24:51.882970  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:51.883234  6473 raft_consensus.cc:2354] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18.
I20260812 19:24:51.892441  6238 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 18
I20260812 19:24:51.889031  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:51.887323  6465 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:51.894009  6232 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260812 19:24:51.894356  6482 raft_consensus.cc:2396] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260812 19:24:51.901136  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:51.901837  6483 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:51.902339  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:51.904517  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 130157us
W20260812 19:24:51.904937  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 112348us
I20260812 19:24:51.905767  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:51.905094  6232 raft_consensus.cc:2396] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260812 19:24:51.908811  6224 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260812 19:24:51.907604  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:51.909065  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:51.909833  6350 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:51.911597  6224 pending_rounds.cc:76] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 8
I20260812 19:24:51.911566  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:51.912259  6224 pending_rounds.cc:97] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260812 19:24:51.912456  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:51.912663  6224 raft_consensus.cc:2866] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:51.912782  6232 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:51.913239  6224 pending_rounds.cc:97] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260812 19:24:51.913653  6224 raft_consensus.cc:2866] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:51.915422  6228 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: []
I20260812 19:24:51.889082 16813 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:51.929827  6236 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:51.930934  6238 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:51.932337  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:51.936131  6477 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 10.
I20260812 19:24:51.936151  6178 leader_election.cc:398] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17.
I20260812 19:24:51.936934  6178 leader_election.cc:401] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260812 19:24:51.938294  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:51.837116 16314 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:51.938113  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:51.895048 16807 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:51.915372 16283 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:24:51.937142  6224 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:51.970523  6228 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: []
I20260812 19:24:51.930528 16491 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:51.939442 16753 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:51.897012 16775 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260812 19:24:51.980154  6241 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260812 19:24:51.904032 16790 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260812 19:24:51.904408 16814 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260812 19:24:51.925205 16596 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260812 19:24:51.968600 16314 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:51.981159 16753 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:52.013456 16753 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:51.990693 16840 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260812 19:24:52.014232 16687 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:51.991756 16734 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.962s	user 0.003s	sys 0.000s
I20260812 19:24:51.992146 16795 consensus_queue.cc:1046] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
W20260812 19:24:51.991776 16831 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260812 19:24:51.944737 16819 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.005009 15837 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:52.013340 15915 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:51.936467 16695 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:24:51.991619 16830 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260812 19:24:51.975358 16491 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:52.026404 16722 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.078s	user 0.003s	sys 0.000s
I20260812 19:24:51.934995 16824 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
W20260812 19:24:52.031404 16638 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260812 19:24:52.032671 16712 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:51.964987 16184 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.028s
I20260812 19:24:52.034742 16789 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:52.035435  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2582) took 1107 ms. Trace:
W20260812 19:24:52.039220 16811 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.333s	user 0.000s	sys 0.002s
I20260812 19:24:52.040127  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2574) took 1014 ms. Trace:
I20260812 19:24:52.042819 15992 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.043360  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:52.018262 16776 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.482s	user 0.001s	sys 0.002s
W20260812 19:24:52.044945  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 9444dc5105264169a510f4261e7a1f40, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:52.131140  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 9444dc5105264169a510f4261e7a1f40, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.130348  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 976) took 1393 ms. Trace:
I20260812 19:24:52.017208  6241 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260812 19:24:52.131647  6344 rpcz_store.cc:276] 0812 19:24:50.737313 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:50.737666 (+   353us) service_pool.cc:227] Handling call
0812 19:24:50.816476 (+ 78810us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:50.816918 (+   442us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:50.816955 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:50.844169 (+ 27214us) log.cc:842] Serialized 26 byte log entry
0812 19:24:50.958409 (+114240us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:24:50.958455 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:50.958548 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:51.990940 (+1032392us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:52.122022 (+131082us) raft_consensus.cc:1671] finished
0812 19:24:52.122061 (+    39us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:52.130273 (+  8212us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3867,"raft.queue_time_us":27228,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":8516,"spinlock_wait_cycles":18766976,"thread_start_us":113916,"threads_started":1,"wal-append.queue_time_us":184613}
I20260812 19:24:52.022936  7607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44858 (request call id 23) took 1392 ms. Trace:
I20260812 19:24:52.057483  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:52.088992 16699 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:52.115252  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 179211us
I20260812 19:24:52.117419  6229 rpcz_store.cc:276] 0812 19:24:50.927817 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:50.930459 (+  2642us) service_pool.cc:227] Handling call
0812 19:24:50.930862 (+   403us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:51.100831 (+169969us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:52.035172 (+934341us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54000fe954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:52.035370 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":372194176}
W20260812 19:24:52.091588 16482 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.006s	sys 0.011s
W20260812 19:24:52.139358 16482 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.007s	sys 0.011s
I20260812 19:24:52.139741 16482 raft_consensus.cc:686] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:52.140858 16482 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:52.125834 16777 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:52.143316 16777 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.145797 16777 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:52.146963 16483 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 19:24:52.147826 16695 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:52.149541 16789 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:52.150238  7598 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22. Ops: []
I20260812 19:24:52.153831 16699 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:52.125484 16712 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.156345 16712 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:52.158479  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet c3c085c12bc74f5b8a4f6f69990e1a82, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:52.158941  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet c3c085c12bc74f5b8a4f6f69990e1a82, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.158497  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:52.108119 16795 consensus_queue.cc:1225] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260812 19:24:52.167084 16491 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:52.160233 16813 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.172111  6477 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:52.172308  6465 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260812 19:24:52.176936  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2567) took 1221 ms. Trace:
I20260812 19:24:52.124475  6483 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:52.083719 16252 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:52.126667  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:52.126255  6342 rpcz_store.cc:276] 0812 19:24:51.025302 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:51.026269 (+   967us) service_pool.cc:227] Handling call
0812 19:24:51.026579 (+   310us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:51.577816 (+551237us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:52.039840 (+462024us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54001ccfd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:52.040063 (+   223us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1262483712}
I20260812 19:24:52.092583 16283 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17.
I20260812 19:24:52.093879 16819 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:24:52.129635  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 169436us
I20260812 19:24:52.127821 16824 consensus_queue.cc:1225] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 18.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260812 19:24:52.136233  6178 leader_election.cc:398] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17.
I20260812 19:24:52.236025  6178 leader_election.cc:401] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260812 19:24:52.133641  7607 rpcz_store.cc:276] 0812 19:24:50.630382 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:50.738080 (+107698us) service_pool.cc:227] Handling call
0812 19:24:52.022702 (+1284622us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54002a9ed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7772bc3 00007f98fc6bc81a 00007f98f5dbbd04 00007f98f5dbbc92 00007f98f5dbbbc1 00007f98f5dbbb3c 00007f98f5dbadf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:52.022840 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":264225152}
I20260812 19:24:52.197129  6347 rpcz_store.cc:276] 0812 19:24:50.955225 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:50.955878 (+   653us) service_pool.cc:227] Handling call
0812 19:24:52.176655 (+1220777us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b5400408dd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:52.176856 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1610172672}
I20260812 19:24:52.195262  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:52.237861  6241 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
W20260812 19:24:52.213088  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 86848.2us
I20260812 19:24:52.223435 16252 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.233963  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:52.193311 16780 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:52.175989 15800 raft_consensus.cc:3032] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:24:52.240795  7606 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260812 19:24:52.243360  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:52.224534 16770 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.025s	sys 0.084s
W20260812 19:24:52.250692 16770 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.025s	sys 0.084s
I20260812 19:24:52.251091 16770 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:52.252579 16770 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.224908 16751 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:52.177268 15992 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:52.262931  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:52.244988  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 108893us
I20260812 19:24:52.267458  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:52.269572  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:52.248932 16824 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260812 19:24:52.268774 16314 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:52.272583 16847 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260812 19:24:52.273450 16795 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 19:24:52.275329  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:52.275573 16498 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:24:52.276152 16824 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:52.276227 16498 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:52.276841 16711 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:52.277544  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:52.277418 16498 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.278851 16491 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:52.279443 16491 raft_consensus.cc:686] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:52.280421 16491 consensus_queue.cc:237] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.278704 16711 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:52.276268  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:52.283532 16824 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:52.283850 16314 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:24:52.288172 16485 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:24:52.288594 16485 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:52.289441 16485 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.291564 16695 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:52.292308 16808 raft_consensus.cc:3032] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:52.292348 16695 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:52.292940 16808 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:52.293578 16695 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.299889  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:52.300525  6228 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:52.301182 16485 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:52.248312 16835 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17.
I20260812 19:24:52.303215 16855 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:52.303890 16855 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:52.304893 16855 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.293856 16808 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.308388  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:52.312361  6242 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260812 19:24:52.225143 16564 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260812 19:24:52.315547  6224 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260812 19:24:52.316713  6228 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:52.328919  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:52.249331 15800 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:52.329107  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:52.323081  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:52.330543  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 63168.9us
I20260812 19:24:52.331775  6178 leader_election.cc:398] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17.
I20260812 19:24:52.332228  6178 leader_election.cc:401] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:24:52.339995  6241 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 22.
I20260812 19:24:52.343096  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:52.343334  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:52.344251  6232 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22. Ops: [20.16-21.17]
I20260812 19:24:52.345937  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:52.346899  6224 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:52.353529  7591 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:52.356981  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:52.319060 16696 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.020s	sys 0.026s
I20260812 19:24:52.367506  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:52.367844  6224 raft_consensus.cc:2396] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260812 19:24:52.318516 16813 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:52.374374  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:52.341506 16751 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:52.380752  7591 raft_consensus.cc:595] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:52.381075  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:52.379323  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:52.382565  6297 leader_election.cc:398] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18.
I20260812 19:24:52.383045  6297 leader_election.cc:401] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260812 19:24:52.384753  6235 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260812 19:24:52.346120 16835 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:52.411006  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:52.351938 16314 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:24:52.377063  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:52.357981 16437 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17.
I20260812 19:24:52.384438 16699 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260812 19:24:52.370230 16753 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260812 19:24:52.390945  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:52.426249  6470 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:24:52.394012 16127 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:52.394716  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:52.429637  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:52.395515 16779 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18.
I20260812 19:24:52.390307 16729 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:24:52.402277  6242 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260812 19:24:52.434621  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:52.367224 16696 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.020s	sys 0.026s
I20260812 19:24:52.448318 16252 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:52.452518  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:52.454883 16491 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:52.455478 16491 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:52.456413 16491 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.378331  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:52.465189  6241 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:52.465857  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:52.375536 16866 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260812 19:24:52.421525  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:52.473068  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 51639.2us
I20260812 19:24:52.371443 16808 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:52.379323 15800 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.318776 16807 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.354768 16824 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260812 19:24:52.351830 16224 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260812 19:24:52.447822 16729 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 22 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:52.454324 16498 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260812 19:24:52.467262  6228 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:52.435405 16499 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:52.474677  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:52.432561 16846 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:52.428541 16813 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:52.480001  6470 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:24:52.466475 16127 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:52.468060 16258 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 19:24:52.495939 16846 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:52.504544 16258 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:52.505043 16846 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:52.505236 16258 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:52.492486  6228 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:52.507951  6228 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.509280  6228 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:52.477213 16753 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:52.496102 16699 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:52.503825  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:52.517812  6353 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: []
I20260812 19:24:52.503593  6230 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:52.515281  6359 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260812 19:24:52.490036 15800 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:52.428385 16751 consensus_queue.cc:1046] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260812 19:24:52.521811  6470 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:52.524437  6347 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
W20260812 19:24:52.505367 16774 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260812 19:24:52.533967  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:52.529793  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:52.535266 16864 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260812 19:24:52.536537  6349 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:52.533805  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:52.538213  6470 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 18: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:52.481552 16252 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
W20260812 19:24:52.533747 16849 consensus_queue.cc:1159] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "54f83319db6b49929cc8f18a66a66975" responder_term: 18 status { last_received { term: 18 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:24:52.496269 16485 raft_consensus.cc:3032] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:24:52.529034  6241 raft_consensus.cc:2396] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260812 19:24:52.539110  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:52.549800  6470 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:52.531256  6344 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260812 19:24:52.541853  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:52.490088 16711 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260812 19:24:52.551608  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:52.556740  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:52.561498  6229 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260812 19:24:52.568971  6241 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260812 19:24:52.542874 16751 consensus_queue.cc:1225] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer 54f83319db6b49929cc8f18a66a66975 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260812 19:24:52.572211  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:52.573113  6229 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:52.577111 16498 consensus_queue.cc:1046] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260812 19:24:52.577217 16853 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:52.578811 16853 consensus_queue.cc:1225] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260812 19:24:52.579411 16829 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:52.579818 16829 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:52.581166  6228 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260812 19:24:52.580971 16829 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.581634  6228 pending_rounds.cc:76] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 9
I20260812 19:24:52.582052  6228 pending_rounds.cc:97] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260812 19:24:52.548766 16485 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:52.525859 16699 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:52.549263 16842 consensus_queue.cc:1046] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260812 19:24:52.575361  6481 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:52.582389  6228 raft_consensus.cc:2866] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:52.620136  6475 raft_consensus.cc:3032] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:52.610396  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:52.619653  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:52.618203  6224 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:52.641539  6475 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:52.579706  6470 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:52.604911  6474 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260812 19:24:52.647073  6474 pending_rounds.cc:76] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 9
I20260812 19:24:52.647473  6474 pending_rounds.cc:97] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260812 19:24:52.647874  6474 raft_consensus.cc:2866] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:52.650270  6229 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: []
I20260812 19:24:52.615796  7598 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:44858
W20260812 19:24:52.658449  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 48156.5us
I20260812 19:24:52.658838  7598 raft_consensus.cc:595] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:52.659605  7598 raft_consensus.cc:603] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:52.642774  6475 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.660802  6229 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:24:52.746848  6475 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:52.666373  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:52.687146  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:52.749617  6477 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:52.562872 16795 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:52.741941  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:52.667550  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:52.755880  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:52.761636  6347 raft_consensus.cc:595] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:52.761806  6475 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260812 19:24:52.762152  6347 raft_consensus.cc:603] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:52.762396  6475 pending_rounds.cc:76] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 8
I20260812 19:24:52.762809  6475 pending_rounds.cc:97] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260812 19:24:52.763165  6475 raft_consensus.cc:2866] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:52.763837  6470 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 19: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:52.582365 16829 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:52.662048 15959 raft_consensus.cc:979] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:24:52.662938  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:52.584960 16481 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
W20260812 19:24:52.687817 16875 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.005s
I20260812 19:24:52.768682  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:52.613951 16498 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:24:52.587827 16588 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:24:52.711798 15841 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:52.775210  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 198912us
W20260812 19:24:52.775444  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 112584us
I20260812 19:24:52.791577  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:52.791837  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:52.739409 16485 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.793756 16485 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
W20260812 19:24:52.798785 16870 log.cc:924] Time spent T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.135s	user 0.005s	sys 0.007s
I20260812 19:24:52.800172  6470 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260812 19:24:52.809346 16874 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.094s	user 0.000s	sys 0.005s
I20260812 19:24:52.774971 16657 raft_consensus.cc:1067] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Signalling peer bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:24:52.812039 16699 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:52.812537  7598 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:52.813356  7598 raft_consensus.cc:595] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:52.774029 16224 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260812 19:24:52.813730  7598 raft_consensus.cc:603] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:52.786190 16588 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:52.815744  6483 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:52.775954  6481 raft_consensus.cc:2396] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 19 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 6.
I20260812 19:24:52.604604 16525 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:52.595924 16807 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:52.695289 16813 raft_consensus.cc:3032] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:24:52.689350 16711 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:52.775836  6475 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:52.818356  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:52.738154 16258 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:52.821885  6473 raft_consensus.cc:2396] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260812 19:24:52.822165  6474 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:24:52.773869 16499 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:52.828327  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:24:52.828547  6465 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260812 19:24:52.828480  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:52.582895 16753 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.192s
I20260812 19:24:52.848242 16499 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.570516 16729 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:52.823972 16491 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:24:52.786147 16498 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:52.783890 16855 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:52.858366 15800 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:52.858366 16498 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:52.859489 15800 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:24:52.860124 16498 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:24:52.860898 15800 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:24:52.861303 15800 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:52.861183 16184 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:52.861528  6416 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:52.828096 16873 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.091s	user 0.002s	sys 0.002s
I20260812 19:24:52.862596 16499 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:52.846957  6464 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:52.847244  6344 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 10. Current term is 11. Ops: []
I20260812 19:24:52.863147 16853 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:24:52.853502  6465 pending_rounds.cc:76] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 9
I20260812 19:24:52.864022  6465 pending_rounds.cc:97] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260812 19:24:52.852672  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:24:52.864310  6465 raft_consensus.cc:2866] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:52.771302 16846 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.865123 16753 consensus_queue.cc:1225] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260812 19:24:52.865737 16753 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:52.866500 16846 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:52.829437 16252 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.028s
I20260812 19:24:52.867930  6359 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:24:52.868031 16258 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:52.855988  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:52.864868  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:52.869603  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:52.870710 16855 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:52.871073 16855 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:52.871404 16855 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:52.873602  7599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 750) took 1281 ms. Trace:
I20260812 19:24:52.873981  7599 rpcz_store.cc:276] 0812 19:24:51.592522 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:51.592801 (+   279us) service_pool.cc:227] Handling call
0812 19:24:52.873424 (+1280623us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002a9ed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:52.873549 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2607320832}
I20260812 19:24:52.829183 16814 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260812 19:24:52.876092 16814 raft_consensus.cc:3032] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:24:52.876493 16814 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:52.876849  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 499985us
I20260812 19:24:52.877605  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:52.877322 16814 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.829908 16588 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.879837 16588 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
W20260812 19:24:52.880692  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 460808us
I20260812 19:24:52.882838 16764 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:52.883347 16764 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:52.884207 16764 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.884734 16283 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:52.885396 16283 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:52.886773 16491 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:52.887657 16491 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:52.862501 16842 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:24:52.869758 16711 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:52.903756  6347 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260812 19:24:52.830116 16813 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:52.820282 16795 consensus_queue.cc:1159] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a1541d11be514114966dc1e92a345298" responder_term: 14 status { last_received { term: 13 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:24:52.830492 16525 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:52.833038  6477 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:33386
I20260812 19:24:52.890419  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:52.907313 15959 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260812 19:24:52.820676 15841 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:52.921578 16855 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:52.925992  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:52.878561 16814 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:24:52.940717  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 50383.8us
I20260812 19:24:52.950489  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:52.956367 16835 raft_consensus.cc:2741] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Leader pre-election decision vote started in defunct term 15: won
W20260812 19:24:52.963958  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 48990.7us
I20260812 19:24:52.964787  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:52.964946  6178 leader_election.cc:398] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14.
I20260812 19:24:52.908953  6483 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:52.907891 16842 consensus_queue.cc:1225] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer 54f83319db6b49929cc8f18a66a66975 log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260812 19:24:52.899632 16853 consensus_queue.cc:1159] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "54f83319db6b49929cc8f18a66a66975" responder_term: 18 status { last_received { term: 18 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:24:52.962170 16283 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:52.984500  6483 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260812 19:24:52.993388 16789 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260812 19:24:52.994827 15841 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:52.996526  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:52.998684  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:53.007361 16184 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:53.007819  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:53.008522  6238 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:53.014426  6230 raft_consensus.cc:1261] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260812 19:24:53.020006  6474 raft_consensus.cc:1261] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260812 19:24:53.020442  6474 pending_rounds.cc:76] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 8
I20260812 19:24:53.020767  6474 pending_rounds.cc:97] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260812 19:24:53.021067  6474 raft_consensus.cc:2866] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:53.020485 16525 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:52.972457 16712 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:53.022347  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:53.026158  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 57990.1us
I20260812 19:24:53.027005  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:52.962507 16622 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260812 19:24:53.046504  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:53.047425  6359 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:53.054163  6347 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260812 19:24:53.056037  6238 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260812 19:24:53.058986 16596 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260812 19:24:53.063711  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:53.064167  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:53.069602  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:53.041096 16283 raft_consensus.cc:2741] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260812 19:24:53.074463  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:53.075201  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 213721us
I20260812 19:24:53.079726  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:52.990756 16813 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:53.096652  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:53.099074  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:53.103521 16885 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260812 19:24:53.104832  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:53.106043  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:53.106377 15800 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:53.107622 16829 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:24:53.110262 16813 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:53.110846 16842 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:24:53.059363 16833 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260812 19:24:53.072432 16588 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:53.119431 16588 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:53.120417 16588 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:53.121869 16888 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260812 19:24:53.107723 15800 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:53.122275 16588 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:53.131871  6345 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260812 19:24:53.087678  6359 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:24:53.133916  6353 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260812 19:24:53.148388  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 46330.7us
I20260812 19:24:53.151912  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:53.183920  6345 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260812 19:24:53.134577 16224 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:53.146180 16855 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:53.203351  6482 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:53.150722  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:53.209213  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 58606.7us
I20260812 19:24:53.209717  6359 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:53.166342 16446 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260812 19:24:53.211705  6477 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:53.215327  6477 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:53.220703  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:53.221966  6482 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:53.221650  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:24:53.208915 16816 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 1.506s	user 0.004s	sys 0.003s
I20260812 19:24:53.194340 16224 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:53.214674 16596 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:53.244272 16696 raft_consensus.cc:3032] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:24:53.244951 16696 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:53.244544  6477 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:53.222975 16751 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:53.259739  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:53.209991  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:53.263020  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 53126.9us
I20260812 19:24:53.263993  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:53.265214  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:53.293457 16833 raft_consensus.cc:2741] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260812 19:24:53.294333 16807 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:53.296725  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:53.297591 16807 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:53.231299 16814 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260812 19:24:53.301492  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:53.268543  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:53.308446  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:53.310866 16498 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:53.310873  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:53.270083 16283 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:53.266882 16596 raft_consensus.cc:2741] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260812 19:24:53.311640 16498 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:53.240830 16797 consensus_queue.cc:1046] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260812 19:24:53.314496 16252 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 19:24:53.311905 16258 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260812 19:24:53.315019 16797 raft_consensus.cc:3032] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:53.315536 16797 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:53.312067 16699 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:53.316731 16699 raft_consensus.cc:686] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:53.316555 16797 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:53.317723 16699 consensus_queue.cc:237] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:53.240763 16340 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260812 19:24:53.313346 16498 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:53.305485 16224 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:53.311434  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:53.318289 16797 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:53.342489  6464 raft_consensus.cc:2396] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260812 19:24:53.265658  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:53.246083 16696 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:53.327091  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:53.347414  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:53.349447  6354 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:24:53.312651  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:53.350967  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:53.352777  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:53.271369 16592 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:53.285544 16813 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:53.361297  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:53.356712  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:53.361907  6238 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:53.367012  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:53.312230 16283 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:53.380721  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:53.374773  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:53.381740  6464 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:53.351176 16711 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:53.389834  6477 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:53.391140  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:53.391580  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:53.391958  7606 raft_consensus.cc:3032] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Stepping down as leader of term 10
I20260812 19:24:53.358376 16596 raft_consensus.cc:2741] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260812 19:24:53.397466  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:53.393090  7606 raft_consensus.cc:729] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:53.271922 16751 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:53.403609  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:53.404244  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:53.361018 16224 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:24:53.408398  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:53.412313  6475 raft_consensus.cc:2396] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260812 19:24:53.310874 15841 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260812 19:24:53.406826  7606 consensus_queue.cc:260] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:53.383287 16437 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260812 19:24:53.396997 16729 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.000s	sys 0.026s
I20260812 19:24:53.422075  7606 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 10 FOLLOWER]: Advancing to term 11
I20260812 19:24:53.423177  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:53.425904  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 2962) took 1093 ms. Trace:
I20260812 19:24:53.437083  6482 rpcz_store.cc:276] 0812 19:24:52.325238 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:52.326002 (+   764us) service_pool.cc:227] Handling call
0812 19:24:53.417940 (+1091938us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b54002d2154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:53.418047 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1944619520}
I20260812 19:24:53.379228 16813 raft_consensus.cc:686] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:53.389195 16283 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:53.360925 16807 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260812 19:24:53.431715  6342 pending_rounds.cc:76] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 16
I20260812 19:24:53.440631 16855 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:53.492947  6342 pending_rounds.cc:97] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260812 19:24:53.493304  6342 raft_consensus.cc:2866] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:53.417232 16224 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:53.493953 16224 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:53.441699  6482 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:24:53.405800 16491 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:24:53.466084 16340 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:53.495668 16340 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:53.496181  6482 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 7. (term mismatch)
I20260812 19:24:53.496551  6482 pending_rounds.cc:76] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 6
I20260812 19:24:53.496749  6482 pending_rounds.cc:97] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 15.7
I20260812 19:24:53.496973  6482 raft_consensus.cc:2866] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:53.497251  6482 pending_rounds.cc:97] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260812 19:24:53.497486  6482 raft_consensus.cc:2866] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:53.497797 16340 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:53.416210 16814 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:53.480866  6470 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
W20260812 19:24:53.433182 16729 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.000s	sys 0.027s
I20260812 19:24:53.396552 16780 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260812 19:24:53.474579  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:53.504756  6482 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: [12.9-14.10]
I20260812 19:24:53.510854  6238 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:53.505445  6470 pending_rounds.cc:76] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 10
I20260812 19:24:53.511530  6470 pending_rounds.cc:97] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260812 19:24:53.511911  6470 raft_consensus.cc:2866] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:53.419986 16596 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:53.515497  6347 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:53.515616 16596 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:53.522038  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:53.529006  6482 raft_consensus.cc:2396] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 18 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260812 19:24:53.570933  6482 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 18. Current term is 19. Ops: []
I20260812 19:24:53.574537  6238 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:53.575984  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:53.580942 16314 raft_consensus.cc:3032] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:53.581665  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:53.587496  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2591) took 1047 ms. Trace:
I20260812 19:24:53.581418 16314 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:53.589461 16915 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260812 19:24:53.580987 16916 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260812 19:24:53.589509  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2961) took 1277 ms. Trace:
I20260812 19:24:53.593940  6465 rpcz_store.cc:276] 0812 19:24:52.312383 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:52.312597 (+   214us) service_pool.cc:227] Handling call
0812 19:24:52.312876 (+   279us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:52.864929 (+552053us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:53.589261 (+724332us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54001031d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:53.589448 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1185058560}
I20260812 19:24:53.597682  6224 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260812 19:24:53.600222  6224 raft_consensus.cc:1203] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Deduplicated request from leader. Original: 14.9->[16.10-16.10]   Dedup: 16.10->[]
I20260812 19:24:53.600862  6224 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260812 19:24:53.610051  6236 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260812 19:24:53.588100  6349 rpcz_store.cc:276] 0812 19:24:52.541735 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:52.542090 (+   355us) service_pool.cc:227] Handling call
0812 19:24:52.554337 (+ 12247us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:52.554545 (+   208us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:24:52.662446 (+107901us) log.cc:842] Serialized 14 byte log entry
0812 19:24:53.249924 (+587478us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b1800425440. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff57b 00007f98f778288a
0812 19:24:53.573155 (+323231us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:53.573308 (+   153us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:53.579540 (+  6232us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:53.587144 (+  7604us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:53.587402 (+   258us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39724,"prepare.queue_time_us":107171,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":46961,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":53758336,"thread_start_us":276794,"threads_started":1}
I20260812 19:24:53.618157  6482 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:24:53.518062 16814 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:53.634166  6464 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:53.602391  6224 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260812 19:24:53.635289  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 254642us
I20260812 19:24:53.639772  6224 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:24:53.653388  6236 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:24:53.560954 16592 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.080s
I20260812 19:24:53.678959  6236 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260812 19:24:53.680591  6236 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260812 19:24:53.681614 15800 consensus_meta.cc:287] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.002s
I20260812 19:24:53.682420  6473 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260812 19:24:53.682972  6473 pending_rounds.cc:76] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 9
I20260812 19:24:53.683251  6473 pending_rounds.cc:97] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260812 19:24:53.683542  6473 raft_consensus.cc:2866] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:53.687852  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:53.658604  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:53.689566  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:53.610015 16485 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:53.632443 16258 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:53.652724 16437 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:53.707947  6464 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:24:53.729580  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:53.691665 15800 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:53.759442  6482 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260812 19:24:53.629554 16711 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260812 19:24:53.651465 16849 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
W20260812 19:24:53.758528 16926 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260812 19:24:53.759943 16875 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260812 19:24:53.629554 16813 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:53.801517  6482 pending_rounds.cc:76] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 8
I20260812 19:24:53.801914  6482 pending_rounds.cc:97] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260812 19:24:53.802310  6482 raft_consensus.cc:2866] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:24:53.835287  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 314811us
W20260812 19:24:53.838943  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 184318us
I20260812 19:24:53.676842 16596 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:53.724211 16485 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:53.848924 16947 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:53.790038 16764 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:53.794432 16780 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:53.856099 16483 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
W20260812 19:24:53.858429 16920 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260812 19:24:53.859059  6232 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.014s	sys 0.010s
W20260812 19:24:53.859469  6232 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.014s	sys 0.010s
W20260812 19:24:53.863085 16905 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
W20260812 19:24:53.864538 16898 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.271s	user 0.000s	sys 0.000s
W20260812 19:24:53.865893 16930 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260812 19:24:53.873890  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2947) took 1306 ms. Trace:
I20260812 19:24:53.874960  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2600) took 1360 ms. Trace:
I20260812 19:24:53.875160  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:53.876605 16897 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260812 19:24:53.878080  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2942) took 1492 ms. Trace:
I20260812 19:24:53.878439  6235 rpcz_store.cc:276] 0812 19:24:52.385924 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:52.418396 (+ 32472us) service_pool.cc:227] Handling call
0812 19:24:52.418945 (+   549us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:52.879270 (+460325us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:52.879300 (+    30us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:52.879845 (+   545us) log.cc:842] Serialized 52 byte log entry
0812 19:24:53.222906 (+343061us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:53.222949 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:53.223019 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:53.877865 (+654846us) raft_consensus.cc:1671] finished
0812 19:24:53.877889 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:53.878021 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":459822,"raft.queue_time_us":466617,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":73,"thread_start_us":342698,"threads_started":1,"wal-append.queue_time_us":555874}
I20260812 19:24:53.880795  6235 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260812 19:24:53.881117  6235 pending_rounds.cc:76] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 8
I20260812 19:24:53.881316  6235 pending_rounds.cc:97] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260812 19:24:53.881559  6235 raft_consensus.cc:2866] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:53.875385  6228 rpcz_store.cc:276] 0812 19:24:52.514174 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:52.641739 (+127565us) service_pool.cc:227] Handling call
0812 19:24:52.642107 (+   368us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:52.887907 (+245800us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:52.887943 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:52.888342 (+   399us) log.cc:842] Serialized 26 byte log entry
0812 19:24:53.327478 (+439136us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:24:53.327535 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:53.327631 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:53.874739 (+547108us) raft_consensus.cc:1671] finished
0812 19:24:53.874762 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:53.874899 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":245439,"raft.queue_time_us":246302,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":7851,"thread_start_us":438823,"threads_started":1,"wal-append.queue_time_us":634996}
I20260812 19:24:53.874382  6229 rpcz_store.cc:276] 0812 19:24:52.567662 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:52.769307 (+201645us) service_pool.cc:227] Handling call
0812 19:24:52.769711 (+   404us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:52.909945 (+140234us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:52.909974 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:52.919183 (+  9209us) log.cc:842] Serialized 26 byte log entry
0812 19:24:53.278734 (+359551us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:53.278783 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:53.278853 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:53.873666 (+594813us) raft_consensus.cc:1671] finished
0812 19:24:53.873698 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:53.873833 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":139809,"raft.queue_time_us":140296,"spinlock_wait_cycles":65692544,"thread_start_us":358759,"threads_started":1,"wal-append.queue_time_us":547149}
I20260812 19:24:53.761715 16437 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:53.895556 16485 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:53.895562 16437 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:53.779536 15800 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:53.906433  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 218716us
I20260812 19:24:53.918576 16679 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:53.919215 16679 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:53.921221 16679 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:53.903724 16847 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:53.905095 16780 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260812 19:24:53.942112  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 86209.8us
I20260812 19:24:53.906467 16814 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:53.956534  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:53.947463  7606 consensus_meta.cc:287] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.002s
I20260812 19:24:53.960119  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:53.980674  7606 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 11.
I20260812 19:24:53.923162 16258 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:54.001130  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:53.854121 16842 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:53.930043 16764 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.057s
W20260812 19:24:54.028707  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 424122us
I20260812 19:24:53.943602 16712 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260812 19:24:53.978055 16627 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260812 19:24:53.962574 16847 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:54.152544 15800 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:54.028894 16711 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.129s
W20260812 19:24:54.197711 16446 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.017s	sys 0.030s
I20260812 19:24:54.037359 16893 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 16.10, Next index: 10, Last known committed idx: 9, Time since last communication: 0.180s
I20260812 19:24:54.155557 16962 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:54.217269 16283 consensus_meta.cc:287] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.702s	user 0.012s	sys 0.000s
I20260812 19:24:54.035744 16842 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:54.250986  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 255463us
I20260812 19:24:54.255481  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 906) took 1180 ms. Trace:
W20260812 19:24:54.248347 16908 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260812 19:24:54.241629 16446 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.017s	sys 0.030s
I20260812 19:24:54.261071  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:54.281148 16252 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.004s	sys 0.049s
W20260812 19:24:54.284093  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 297042us
I20260812 19:24:54.253221 16833 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:54.303876 16847 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:54.305523 16842 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:54.259218 16958 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
W20260812 19:24:54.298403 16224 consensus_meta.cc:287] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.804s	user 0.012s	sys 0.002s
I20260812 19:24:54.196712 16258 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:54.316509 16961 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260812 19:24:54.293403 16657 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:54.259553 16962 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:54.328789 16962 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:54.329879 16953 log.cc:924] Time spent T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260812 19:24:54.331763  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2430) took 1144 ms. Trace:
I20260812 19:24:54.332129  6470 rpcz_store.cc:276] 0812 19:24:53.187624 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.512863 (+325239us) service_pool.cc:227] Handling call
0812 19:24:53.534535 (+ 21672us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:53.535011 (+   476us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:53.535053 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:53.535519 (+   466us) log.cc:842] Serialized 26 byte log entry
0812 19:24:53.794974 (+259455us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:24:53.842515 (+ 47541us) log.cc:842] Serialized 14 byte log entry
0812 19:24:53.842773 (+   258us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:53.842857 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:54.331478 (+488621us) raft_consensus.cc:1671] finished
0812 19:24:54.331502 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:54.331681 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2105,"prepare.queue_time_us":76514,"raft.queue_time_us":391,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":21514,"spinlock_wait_cycles":35137408,"thread_start_us":183626,"threads_started":1,"wal-append.queue_time_us":411039}
W20260812 19:24:54.335199 16917 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
I20260812 19:24:54.336758  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 990) took 1334 ms. Trace:
W20260812 19:24:54.338423 16938 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260812 19:24:54.337199  6483 rpcz_store.cc:276] 0812 19:24:53.002153 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.002315 (+   162us) service_pool.cc:227] Handling call
0812 19:24:53.005550 (+  3235us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:53.006220 (+   670us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:53.006267 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:53.006819 (+   552us) log.cc:842] Serialized 26 byte log entry
0812 19:24:53.362235 (+355416us) raft_consensus.cc:1631] Marking committed up to 13
0812 19:24:53.362281 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:53.362369 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:54.336467 (+974098us) raft_consensus.cc:1671] finished
0812 19:24:54.336496 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:54.336671 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":354879,"threads_started":1,"wal-append.queue_time_us":922364}
W20260812 19:24:54.340169 16950 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260812 19:24:54.340489  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2985) took 1335 ms. Trace:
I20260812 19:24:54.340875  6473 rpcz_store.cc:276] 0812 19:24:53.005055 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.122182 (+117127us) service_pool.cc:227] Handling call
0812 19:24:53.122460 (+   278us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:53.684030 (+561570us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:54.340254 (+656224us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54003a9154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:54.340437 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1287000448}
I20260812 19:24:54.342904 16751 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:54.343027  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 998) took 1001 ms. Trace:
I20260812 19:24:54.343577  6345 rpcz_store.cc:276] 0812 19:24:53.341877 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.342418 (+   541us) service_pool.cc:227] Handling call
0812 19:24:53.344362 (+  1944us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:53.348699 (+  4337us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:53.348740 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:53.359384 (+ 10644us) log.cc:842] Serialized 26 byte log entry
0812 19:24:53.704163 (+344779us) raft_consensus.cc:1631] Marking committed up to 13
0812 19:24:53.704210 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:53.704283 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:54.342752 (+638469us) raft_consensus.cc:1671] finished
0812 19:24:54.342783 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:54.342954 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3898,"raft.queue_time_us":5772,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":7245,"thread_start_us":311971,"threads_started":1,"wal-append.queue_time_us":632943}
I20260812 19:24:54.345162 16812 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:54.345712  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2604) took 1194 ms. Trace:
I20260812 19:24:54.346176  6241 rpcz_store.cc:276] 0812 19:24:53.151393 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.477500 (+326107us) service_pool.cc:227] Handling call
0812 19:24:53.477967 (+   467us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:53.500461 (+ 22494us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:53.500506 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:53.506571 (+  6065us) log.cc:842] Serialized 26 byte log entry
0812 19:24:53.725252 (+218681us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:53.725522 (+   270us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:53.725604 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:54.345438 (+619834us) raft_consensus.cc:1671] finished
0812 19:24:54.345466 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:54.345633 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22082,"raft.queue_time_us":26277,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":10079,"thread_start_us":149361,"threads_started":1,"wal-append.queue_time_us":412986}
I20260812 19:24:54.347756 16696 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:24:54.352039 16588 consensus_meta.cc:287] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.197s	user 0.011s	sys 0.002s
I20260812 19:24:54.261144 16283 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:54.309973 16709 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:54.358119 16709 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:54.321067 16711 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:54.359966 16499 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:54.361763 16588 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:54.325548 16224 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:54.345753 16812 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:54.387502 16711 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:54.396871 16499 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:54.399636 16588 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:54.527123 16961 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260812 19:24:54.525413 16498 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.164s	user 0.011s	sys 0.003s
W20260812 19:24:54.589924  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.007s	sys 0.014s
W20260812 19:24:54.601419  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.007s	sys 0.014s
W20260812 19:24:54.602272  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 872706us
I20260812 19:24:54.603260  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:54.603266  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2602) took 1072 ms. Trace:
I20260812 19:24:54.604739  6344 rpcz_store.cc:276] 0812 19:24:53.530480 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.530684 (+   204us) service_pool.cc:227] Handling call
0812 19:24:53.862408 (+331724us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b5800004598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ce2b0 00007f98fc6b97f9 00007f98fc6b92a2 00007f98f5dab684
0812 19:24:53.905667 (+ 43259us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:53.905924 (+   257us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:24:54.172642 (+266718us) log.cc:842] Serialized 14 byte log entry
0812 19:24:54.602791 (+430149us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:54.602871 (+    80us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:54.602934 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:54.603033 (+    99us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:54.603180 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":38372,"prepare.queue_time_us":443630,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"spinlock_wait_cycles":4979456,"thread_start_us":637140,"threads_started":2}
I20260812 19:24:54.550963 16709 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:54.548838 16996 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:54.633953  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:54.637641  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:54.653640  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2992) took 1331 ms. Trace:
I20260812 19:24:54.654122  6481 rpcz_store.cc:276] 0812 19:24:53.322627 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.581780 (+259153us) service_pool.cc:227] Handling call
0812 19:24:53.582118 (+   338us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:53.659858 (+ 77740us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:53.659904 (+    46us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:53.677788 (+ 17884us) log.cc:842] Serialized 52 byte log entry
0812 19:24:53.930060 (+252272us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:53.951995 (+ 21935us) log.cc:842] Serialized 14 byte log entry
0812 19:24:53.952214 (+   219us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:53.952311 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:54.653392 (+701081us) raft_consensus.cc:1671] finished
0812 19:24:54.653419 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:54.653574 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":48203,"prepare.queue_time_us":32128,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3028,"raft.queue_time_us":37868,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":52452,"thread_start_us":205998,"threads_started":1,"wal-append.queue_time_us":337626}
I20260812 19:24:54.650226 16780 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:54.711045 16627 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:54.711621 16627 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:54.712100 16685 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:24:54.712160 16835 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260812 19:24:54.713656  6296 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.012s	sys 0.009s
W20260812 19:24:54.714020  6296 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.012s	sys 0.009s
I20260812 19:24:54.714090 16937 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:54.650439 16446 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:54.714744 16937 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:54.714965 16446 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:54.716920 16937 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:54.717458 16937 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:54.718051 16685 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:54.718391 16978 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260812 19:24:54.718617 16685 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:54.684954 16997 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:54.720690 16685 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:54.720157 16997 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:54.720948  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:54.722330  7591 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:54.722536 16997 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:54.723002  7591 raft_consensus.cc:595] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:54.717866 16937 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:54.725066  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:54.709313  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 74239.2us
W20260812 19:24:54.636381 16797 consensus_meta.cc:287] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.287s	user 0.015s	sys 0.000s
W20260812 19:24:54.717730 16988 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260812 19:24:54.586576 16498 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:54.763723  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:54.709683 16258 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:54.717806 16446 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:54.776165  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:54.656044 16709 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:24:54.781590  6354 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
W20260812 19:24:54.710516 16994 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
W20260812 19:24:54.748996 16920 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260812 19:24:54.792084  6359 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260812 19:24:54.792407  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:54.788655  6347 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260812 19:24:54.684922 16437 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:54.793108  6353 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:54.680456 16968 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:24:54.794337  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:54.797333  6342 raft_consensus.cc:595] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:54.686669 16283 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:54.714020 16627 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:54.803309  6353 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:24:54.709453 16588 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:54.925444  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 81376.9us
I20260812 19:24:54.795100 16224 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:54.779886 16258 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:54.927843  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:54.780488 16997 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260812 19:24:54.840818 16446 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:54.657893 16996 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:54.803925 16712 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.138s
I20260812 19:24:54.960726  6345 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 18 index: 7. (index mismatch)
W20260812 19:24:54.978837  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 52475.5us
I20260812 19:24:54.985407  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2455) took 1343 ms. Trace:
I20260812 19:24:54.807979 16437 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:54.957585 16588 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:54.954715 16711 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:54.986006  6349 rpcz_store.cc:276] 0812 19:24:53.641853 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.642061 (+   208us) service_pool.cc:227] Handling call
0812 19:24:53.688176 (+ 46115us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:53.961761 (+273585us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:53.965354 (+  3593us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:53.966895 (+  1541us) log.cc:842] Serialized 52 byte log entry
0812 19:24:54.361706 (+394811us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:54.361738 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:54.361813 (+    75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:54.985042 (+623229us) raft_consensus.cc:1671] finished
0812 19:24:54.985074 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:54.985322 (+   248us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18553,"raft.queue_time_us":148616,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":12016,"thread_start_us":604161,"threads_started":2,"wal-append.queue_time_us":532285}
I20260812 19:24:55.000777  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:54.963498 17010 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:54.972101 16937 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:54.950353 16967 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260812 19:24:54.976720 16499 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:54.963804 16446 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:55.005716 16995 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
I20260812 19:24:54.980170 16812 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:55.035531 17001 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260812 19:24:55.037060 17016 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260812 19:24:55.038839 17008 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260812 19:24:55.039654 17013 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260812 19:24:55.011358 17010 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.007413 17015 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:55.055943  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 913) took 1098 ms. Trace:
I20260812 19:24:55.054948  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 2996) took 1731 ms. Trace:
W20260812 19:24:55.022760 17018 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260812 19:24:55.002667 16588 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.048174 16764 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.065012  6229 rpcz_store.cc:276] 0812 19:24:53.957806 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.957957 (+   151us) service_pool.cc:227] Handling call
0812 19:24:53.958366 (+   409us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:53.958830 (+   464us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:53.958871 (+    41us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:53.978346 (+ 19475us) log.cc:842] Serialized 52 byte log entry
0812 19:24:54.397130 (+418784us) raft_consensus.cc:1631] Marking committed up to 15
0812 19:24:54.397173 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:54.397256 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:55.055700 (+658444us) raft_consensus.cc:1671] finished
0812 19:24:55.055728 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:55.055887 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3575,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":11824,"thread_start_us":369276,"threads_started":1,"wal-append.queue_time_us":596127}
W20260812 19:24:55.055910 17000 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.284s	user 0.001s	sys 0.001s
I20260812 19:24:55.063778  6465 rpcz_store.cc:276] 0812 19:24:53.323906 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.614498 (+290592us) service_pool.cc:227] Handling call
0812 19:24:53.615149 (+   651us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:53.923204 (+308055us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:53.923236 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:53.923649 (+   413us) log.cc:842] Serialized 26 byte log entry
0812 19:24:54.225347 (+301698us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:54.225392 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:55.054372 (+828980us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b5400363b54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:55.054437 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:55.054516 (+    79us) raft_consensus.cc:1671] finished
0812 19:24:55.054534 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:55.054850 (+   316us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28630,"raft.queue_time_us":37531,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":2782,"spinlock_wait_cycles":639459712,"thread_start_us":301392,"threads_started":1,"wal-append.queue_time_us":432805}
I20260812 19:24:55.070339  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.041858 16498 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.050848 16958 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.052522 16258 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.054642 16812 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.053840 16996 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.072698 16764 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.080348 16812 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.078969 16958 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:55.095636 16696 consensus_meta.cc:287] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.747s	user 0.008s	sys 0.005s
I20260812 19:24:55.096184 16525 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.096556 17010 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.096720 16525 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:55.091928 17004 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260812 19:24:55.100356 16764 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.100936 16812 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.102263 16958 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:55.180954 16958 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:55.183655 16833 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.184036 16588 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:55.184859 16709 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.185065 16588 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.187646 16446 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.180855 17010 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:55.183669 16958 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.192360 16283 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.192075 16835 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.193337 16947 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.193254 16283 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.194599 16947 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.186265 16709 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.194272 16835 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.188889 17010 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.190060 16833 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.202724 16947 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.203773 16437 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.188854 16588 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.208262 16833 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.209237 16588 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.210083  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:55.210554 17010 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:55.214576  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:55.211544  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2599) took 1865 ms. Trace:
I20260812 19:24:55.215591 16835 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.215444  6359 rpcz_store.cc:276] 0812 19:24:53.345968 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.346121 (+   153us) service_pool.cc:227] Handling call
0812 19:24:53.346522 (+   401us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:54.792695 (+1446173us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:55.210628 (+417933us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54002d05d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:55.211276 (+   648us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3323740544}
I20260812 19:24:55.210085 16833 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.219760 16833 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.225790  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:55.227222  7599 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 11.
I20260812 19:24:55.228696 16835 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.213050 16709 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:55.184798 16906 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.751s	user 0.013s	sys 0.009s
I20260812 19:24:54.260550  6232 rpcz_store.cc:276] 0812 19:24:53.074796 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.110060 (+ 35264us) service_pool.cc:227] Handling call
0812 19:24:53.110430 (+   370us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:53.110724 (+   294us) raft_consensus.cc:1520] Early marking committed up to index 12
0812 19:24:53.859902 (+749178us) log.cc:842] Serialized 14 byte log entry
0812 19:24:54.238772 (+378870us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:54.238892 (+   120us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:24:54.238973 (+    81us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:54.254376 (+ 15403us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:54.255418 (+  1042us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":558444,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":548,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":11057,"thread_start_us":1127004,"threads_started":2}
I20260812 19:24:55.239558 16842 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.240564 16842 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.242376  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:55.243144 15800 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.241406 16819 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.244112 15800 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.244808 16813 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.245227 16819 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.245604 16835 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.245765 16813 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.248169 16819 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.248090 16814 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.249547 16814 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.251194  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2943) took 2787 ms. Trace:
I20260812 19:24:55.243330  6232 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:55.244891 16958 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:55.249178 16835 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.251827  6242 rpcz_store.cc:276] 0812 19:24:52.463857 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:52.464001 (+   144us) service_pool.cc:227] Handling call
0812 19:24:52.464363 (+   362us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:52.937759 (+473396us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:52.937792 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:52.938262 (+   470us) log.cc:842] Serialized 26 byte log entry
0812 19:24:53.205705 (+267443us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:53.205747 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:53.205830 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:55.183477 (+1977647us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:55.250562 (+ 67085us) raft_consensus.cc:1671] finished
0812 19:24:55.250590 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:55.250949 (+   359us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":472982,"raft.queue_time_us":473399,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":26564,"spinlock_wait_cycles":72851840,"thread_start_us":267164,"threads_started":1,"wal-append.queue_time_us":454362}
I20260812 19:24:55.259513  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.260751  6242 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:55.261179 16525 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.249372 16818 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.266606 15800 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.268535 16893 consensus_queue.cc:1225] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260812 19:24:55.270282  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 1.23161e+06us
I20260812 19:24:55.271174  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 995) took 1677 ms. Trace:
I20260812 19:24:55.271711  6464 rpcz_store.cc:276] 0812 19:24:53.593273 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.830914 (+237641us) service_pool.cc:227] Handling call
0812 19:24:53.831284 (+   370us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:53.831533 (+   249us) raft_consensus.cc:1520] Early marking committed up to index 13
0812 19:24:54.050026 (+218493us) log.cc:842] Serialized 14 byte log entry
0812 19:24:55.218400 (+1168374us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b1800346ae0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f47d34ca 00007f98fdea8f99 00007f98f4697990 00007f98f4859864 00007f98f4859155 00007f98f77703d0 00007f98f7782576 00007f98f77930d7 00007f98f7793058
0812 19:24:55.231569 (+ 13169us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:55.236019 (+  4450us) raft_consensus.cc:1631] Marking committed up to 13
0812 19:24:55.259071 (+ 23052us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:55.265149 (+  6078us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:55.270867 (+  5718us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":206026,"prepare.queue_time_us":277370,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":1159650,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":307,"spinlock_wait_cycles":39942528}
W20260812 19:24:55.273316 17012 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.565s	user 0.000s	sys 0.004s
I20260812 19:24:55.274331 16842 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.264844 16818 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.277529  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.278679 16818 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:55.280929 17023 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260812 19:24:55.282017  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.283481 16814 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.284358  7599 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:55.285684  7599 raft_consensus.cc:595] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 22 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:55.282395  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.288021  6242 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:55.289234  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.290119  6242 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
W20260812 19:24:55.291038 17034 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
I20260812 19:24:55.291241  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.292579  6230 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 19: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:55.293668  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.252563 16813 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.299890 16833 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.300035  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:55.304615  6230 raft_consensus.cc:2396] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260812 19:24:55.306886  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:55.285519 17024 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.208s	user 0.003s	sys 0.000s
W20260812 19:24:55.278352 17022 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.229s	user 0.000s	sys 0.002s
I20260812 19:24:55.313458 16813 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.314250 16977 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.314442 16813 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.315330 16977 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.319314 16842 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.319479  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.319617  6417 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:55.320405 16842 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.321990  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.322608 16813 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.323365 16818 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.324369 16818 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.327093 16955 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.328136 16955 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.330020 16807 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:55.330966 16807 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.332271 16814 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.333168 16814 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:55.333793 16976 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.985s	user 0.000s	sys 0.009s
I20260812 19:24:55.334074 16807 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:55.337109 16814 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.337723 16824 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.338100 16795 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:55.339109  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.342411  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.342335  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.343223  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2970) took 1912 ms. Trace:
I20260812 19:24:55.343650  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:55.345080 16955 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.345605 16847 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 19:24:55.346475  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.348691 16813 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:55.288139 16992 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.607s	user 0.002s	sys 0.000s
I20260812 19:24:55.346607  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:55.349620 16314 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.359124  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.355276  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.382892  6242 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:24:55.384451  6230 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:24:55.387280  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.388212  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:51762 (request call id 4) took 1588 ms. Trace:
I20260812 19:24:55.388386  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:55.388687  6228 rpcz_store.cc:276] 0812 19:24:53.799208 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.895696 (+ 96488us) service_pool.cc:227] Handling call
0812 19:24:55.387645 (+1491949us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54000fe954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777e7c5 00007f98fc6baf39 00007f98f5db2704 00007f98f5db2692 00007f98f5db25c1 00007f98f5db253c 00007f98f5db17f2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:55.387950 (+   305us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1589503232}
I20260812 19:24:55.389209  7591 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:55.389945  7591 raft_consensus.cc:595] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:55.390506  6229 raft_consensus.cc:2396] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260812 19:24:55.318522 16977 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.357589  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.389204  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.354910 16184 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:24:55.364763  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.365507  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.390596  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.387239  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.378449  6224 rpcz_store.cc:276] 0812 19:24:53.430765 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.702410 (+271645us) service_pool.cc:227] Handling call
0812 19:24:53.703058 (+   648us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:54.352978 (+649920us) raft_consensus.cc:1520] Early marking committed up to index 8
0812 19:24:54.353025 (+    47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:54.353077 (+    52us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:54.353118 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:55.342695 (+989577us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b5400191c54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:55.342781 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:55.343024 (+   243us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":210,"raft.queue_time_us":3788,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":4653,"spinlock_wait_cycles":1493772160}
I20260812 19:24:55.361894 15800 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.412300 15959 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:55.412701  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2456) took 1744 ms. Trace:
I20260812 19:24:55.413024  6347 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:24:55.413307 16853 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.409185  7599 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:55.418468  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.400228 16847 raft_consensus.cc:686] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:55.383585 16955 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.400341 16184 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:55.391510 16819 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:55.413944  7607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:55.423516  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:55.423573  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:55.415180 16842 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:55.434377  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 88024.9us
I20260812 19:24:55.413060 16314 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:55.406792 16807 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:55.436357  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:55.440086  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Leader has not yet committed an operation in its own term
I20260812 19:24:55.440415  6298 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:55.442472 16340 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260812 19:24:55.431170  7607 raft_consensus.cc:595] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:55.442955 16340 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:55.443470 16340 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:55.437650 16993 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:55.447356 16993 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:55.447503  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:24:55.447818 16993 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:55.448177 16797 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:55.449148 16797 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.450883  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.452651  6353 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 18: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:55.423578 16184 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:55.453953  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.447525  6464 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:24:55.427938 16818 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.365130 16824 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.451195 16807 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.416848  6352 rpcz_store.cc:276] 0812 19:24:53.667944 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.668389 (+   445us) service_pool.cc:227] Handling call
0812 19:24:53.704962 (+ 36573us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:53.949657 (+244695us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:53.949705 (+    48us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:53.996075 (+ 46370us) log.cc:842] Serialized 52 byte log entry
0812 19:24:54.313939 (+317864us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:54.314080 (+   141us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:54.314342 (+   262us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:55.286876 (+972534us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:55.396425 (+109549us) raft_consensus.cc:1671] finished
0812 19:24:55.396459 (+    34us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:55.412481 (+ 16022us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":74495,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":9553,"spinlock_wait_cycles":50658048,"thread_start_us":546472,"threads_started":2,"wal-append.queue_time_us":534218}
I20260812 19:24:55.462677  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.421113 16814 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:55.465296 16252 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:55.467654  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.468688  6349 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:55.470852  6350 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:55.455387 16853 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.477207  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2978) took 1045 ms. Trace:
I20260812 19:24:55.472718  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:55.477658  6241 rpcz_store.cc:276] 0812 19:24:54.431970 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:54.432187 (+   217us) service_pool.cc:227] Handling call
0812 19:24:54.588570 (+156383us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:54.589591 (+  1021us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:24:54.838756 (+249165us) log.cc:842] Serialized 14 byte log entry
0812 19:24:54.978210 (+139454us) log.cc:842] Serialized 14 byte log entry
0812 19:24:55.002623 (+ 24413us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:55.007917 (+  5294us) log.cc:842] Serialized 26 byte log entry
0812 19:24:55.008122 (+   205us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:55.008172 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:55.008258 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:55.279634 (+271376us) spinlock_profiling.cc:243] Waited 8.65 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:55.399795 (+120161us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b180041d4c0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c764 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:24:55.474259 (+ 74464us) raft_consensus.cc:1671] finished
0812 19:24:55.474284 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:55.477016 (+  2732us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5341,"prepare.queue_time_us":881464,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":3418,"raft.queue_time_us":29816,"raft.run_cpu_time_us":499,"raft.run_wall_time_us":37896,"spinlock_wait_cycles":24010368,"thread_start_us":321958,"threads_started":2,"wal-append.queue_time_us":190845}
I20260812 19:24:55.480518  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:55.467020 16968 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.484207 16718 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:55.484073 16252 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.484731 16718 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:55.484846 16968 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.485184 16833 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.486908 16833 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.487747  6179 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:24:55.488534  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 63647.8us
I20260812 19:24:55.488636 16709 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:55.489108 16709 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:55.489538 16709 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:55.489674 16483 raft_consensus.cc:979] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:24:55.491087 16483 raft_consensus.cc:1067] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Signalling peer bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:24:55.492100 16853 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.493049 16252 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:55.477953  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2969) took 2107 ms. Trace:
I20260812 19:24:55.493795  6342 raft_consensus.cc:1203] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 14.9->[16.10-16.10]   Dedup: 16.10->[]
I20260812 19:24:55.470427 15800 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.485196 16718 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:55.493749  6236 rpcz_store.cc:276] 0812 19:24:53.370352 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.681394 (+311042us) service_pool.cc:227] Handling call
0812 19:24:53.681775 (+   381us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:24:53.903492 (+221717us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:53.903536 (+    44us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:24:53.923148 (+ 19612us) log.cc:842] Serialized 52 byte log entry
0812 19:24:54.291751 (+368603us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:54.300768 (+  9017us) log.cc:842] Serialized 14 byte log entry
0812 19:24:54.301133 (+   365us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:55.055560 (+754427us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b1800250900. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9
0812 19:24:55.337750 (+282190us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b1800250900. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:24:55.465816 (+128066us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b540001de54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:24:55.465880 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:55.469120 (+  3240us) raft_consensus.cc:1671] finished
0812 19:24:55.469146 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:55.477788 (+  8642us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2783,"prepare.queue_time_us":15470,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":14690,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":27181,"spinlock_wait_cycles":524133760,"thread_start_us":290232,"threads_started":1,"wal-append.queue_time_us":451136}
I20260812 19:24:55.465982 15959 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.496403 15800 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.496515 16819 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.499245 16819 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:55.500115 16807 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.501428 16797 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:55.501506 16709 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.503208  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2971) took 2068 ms. Trace:
I20260812 19:24:55.503043 16847 consensus_queue.cc:237] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.503607  6238 rpcz_store.cc:276] 0812 19:24:53.434793 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:53.704216 (+269423us) service_pool.cc:227] Handling call
0812 19:24:53.752479 (+ 48263us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:53.899346 (+146867us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:53.899385 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:53.899900 (+   515us) log.cc:842] Serialized 26 byte log entry
0812 19:24:55.195733 (+1295833us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b1800448060. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:24:55.238336 (+ 42603us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:55.238422 (+    86us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:55.238511 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:55.502676 (+264165us) raft_consensus.cc:1671] finished
0812 19:24:55.502703 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:55.503018 (+   315us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":134178,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7237,"spinlock_wait_cycles":18350336,"thread_start_us":186174,"threads_started":2,"wal-append.queue_time_us":1517701}
I20260812 19:24:55.505059  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:55.506268 16709 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:55.507014  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.498972 15959 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.511651  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:24:55.511826 16283 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.516347  6464 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260812 19:24:55.517482  6235 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:24:55.518918  6342 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260812 19:24:55.426952 16795 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.526948  6232 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:55.489432 16833 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.528250  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.467988 16955 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.487495 16968 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.576831  6229 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:55.476364 16813 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.585489  6359 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:55.585983  6055 catalog_manager.cc:5495] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:55.583909  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:24:55.608809  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.544076 16814 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.623234  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.626739  6470 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:55.634183  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.638386  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.642778  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.643710  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.645758 16847 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.646371 16847 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.649005 16847 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.649576 16847 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.650449 16252 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:55.651396 16252 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.655316  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:55.659603  6477 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:24:55.660173 16525 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:55.649981  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:55.641026  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:55.660779  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:55.646389  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:55.670969  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:55.671417  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:55.672317  6477 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:55.674242  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:55.650130 16847 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.675269  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:55.674891  6235 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:24:55.666678  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:55.682284  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:55.687162  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:55.697402  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 47537.8us
I20260812 19:24:55.698509 16258 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:24:55.699065 16258 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:55.699445 16258 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:24:55.711058  6224 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:55.721424  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:55.730716  6470 raft_consensus.cc:2396] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260812 19:24:55.732057  6232 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260812 19:24:55.741257  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.744024  6349 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:24:55.716228  6055 catalog_manager.cc:5495] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 11 to 14, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 14 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:55.749181  6224 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:55.749902  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.660802 16525 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.721153 16252 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:55.753170  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:55.762152 16847 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.768302 16819 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.769074 16819 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:55.771667 17044 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260812 19:24:55.773801 16340 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.775197 16819 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.775441 15959 raft_consensus.cc:979] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:55.776046 15959 raft_consensus.cc:1067] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:55.776119 16340 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:55.783911 16833 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:55.784641 16833 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.786494 16718 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:55.788087  7607 raft_consensus.cc:2379] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:55.794538 16525 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:55.786844  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:55.788905 16718 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.806447  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:55.808250  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:55.809137  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 51166.2us
I20260812 19:24:55.743376 16795 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:55.753834 16853 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.783941 16824 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.827157  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.837200  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.840276 16824 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.861783  6465 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:24:55.871681 16846 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.872328 16846 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.873345  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:55.831846 16993 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.874917 16596 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.875406 16596 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.876591 16993 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.877486 16596 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.877182 16258 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.878932 16824 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.869385  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:55.861541 15800 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:55.883577  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 529ed979cd2842acb5bc24debb151b93, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.885070 16991 raft_consensus.cc:979] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:55.886747 16795 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:55.821990 16847 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:55.896796  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 529ed979cd2842acb5bc24debb151b93, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.906144  6352 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:24:55.865471 16955 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.874188 16184 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.926533 16824 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:55.891088 16833 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:55.928501  6349 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 20: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:55.930584  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:55.906316 16283 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.907235 16968 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:55.888796 16853 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.966229  6465 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:24:55.973995  6354 raft_consensus.cc:2354] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 18. Current term is 19.
I20260812 19:24:55.975306  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:55.902709 15800 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.911405 16795 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:55.953795  6055 catalog_manager.cc:5495] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:24:55.986442  6228 raft_consensus.cc:2379] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:55.976675  6241 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:56292
I20260812 19:24:56.013049  6241 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:56.015766  6241 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:56.019266  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:56.017797 16483 raft_consensus.cc:979] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:56.024406  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.022908  6470 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:24:56.025122  6477 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:55.977682 16814 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:56.024631 16483 raft_consensus.cc:1067] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 22 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:56.038610 16592 raft_consensus.cc:1067] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:56.039155 16971 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260812 19:24:56.039909 16973 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:56.040717  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 2983) took 1035 ms. Trace:
I20260812 19:24:56.043385  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.085755  6242 rpcz_store.cc:276] 0812 19:24:55.005433 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:55.410526 (+405093us) service_pool.cc:227] Handling call
0812 19:24:55.469059 (+ 58533us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:55.599150 (+130091us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:55.599195 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:55.642755 (+ 43560us) log.cc:842] Serialized 26 byte log entry
0812 19:24:55.871168 (+228413us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:55.890350 (+ 19182us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:55.890495 (+   145us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:56.040437 (+149942us) raft_consensus.cc:1671] finished
0812 19:24:56.040462 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:56.040631 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":18607,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":8444,"thread_start_us":135092,"threads_started":1,"wal-append.queue_time_us":349660}
I20260812 19:24:56.045955 16813 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:24:56.055182 17051 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.190s	user 0.004s	sys 0.000s
I20260812 19:24:56.056474 16184 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:56.062414 16853 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:56.062916  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:56.070551  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.022346 16283 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:56.073182  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.074877  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.110535  6470 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:24:56.110736  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.075445  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:56.076290  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:55.976097 16847 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:56.094224 16973 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:56.114145 16283 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:56.114524 16847 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:56.077435  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.115295  6475 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:56.116258  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:24:56.116442  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 104563us
I20260812 19:24:56.116925  6475 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:24:56.117911  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:55.973593 16968 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:56.079270 17046 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.210s	user 0.000s	sys 0.002s
I20260812 19:24:56.072992 16258 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:56.092517  7607 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:56.092844  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.093343  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:56.101140  6474 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:24:56.109237  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:56.112440  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:56.123606  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:56.116195  6465 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
W20260812 19:24:56.133755  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 58612.3us
I20260812 19:24:56.133769  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.133905  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:56.135165  7600 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:56.116856 16971 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:56.118615  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:56.147173  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.147925  6470 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
W20260812 19:24:56.151616  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 93caa3d3062a45cbad94ff4ba511f2e0, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:56.151994  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 93caa3d3062a45cbad94ff4ba511f2e0, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:56.155296  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:56.156522  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.151988  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.120415 16968 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:56.164002  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.165278  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.171898  7600 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 12.
I20260812 19:24:56.175513  6470 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260812 19:24:56.176115 15800 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:56.176849  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.177663  6470 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:56.120185 16846 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:56.183641  6475 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260812 19:24:56.184929  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.166422  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:56.159298  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.189863  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.158149  6465 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:56.159216  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.131803 16847 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:56.144225 16283 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:56.190374  6483 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:24:56.194967  6482 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 18: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:56.197587 16847 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:56.198326 16709 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:24:56.201666  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.202915 16795 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:56.212013  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:56.212992  6242 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:56292
I20260812 19:24:56.217465  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.218216  6242 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:56.212141  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:56.186419  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.215265  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.220348  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:56.219337  6242 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:24:56.159878 16592 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:56.223685  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:56.224629  6354 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:56.227929  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:56.229102 16807 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:56.229847 16807 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:56.187789 16971 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:56.231261 16807 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:56.231765 16971 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:56.209415 16283 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:56.236685 16283 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:56.238267  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:56.239069 16795 consensus_queue.cc:1046] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:24:56.240305 16795 raft_consensus.cc:3032] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:56.240741 16795 raft_consensus.cc:729] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:56.220790  6483 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:24:56.252565  6470 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260812 19:24:56.253669  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:56.250460  6475 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:24:56.258212  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:56.241855 16795 consensus_queue.cc:260] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:56.266531  6470 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:33386
I20260812 19:24:56.267763  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:56.269716  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 53824.7us
I20260812 19:24:56.220031 16973 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:56.288321  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:56.277299 16592 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:56.299263 16592 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:56.298410  6055 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:56.301573 16592 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:56.303315  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:56.294426  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:56.306967  6235 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.005s	sys 0.012s
W20260812 19:24:56.309432  6235 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.005s	sys 0.012s
I20260812 19:24:56.301229  6055 catalog_manager.cc:5495] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260812 19:24:56.318233  6464 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.001s	sys 0.017s
I20260812 19:24:56.305218 16795 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:56.322556 16679 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:56.323171 16679 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:56.318606  6464 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.001s	sys 0.017s
I20260812 19:24:56.323567 16679 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
W20260812 19:24:56.328783  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet fa4336f7dd434c238a9022aa16490450, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:56.329239  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet fa4336f7dd434c238a9022aa16490450, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:56.321244  6352 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:24:56.310060 16592 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:24:56.342051 16592 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:56.342545 16592 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:56.331223 16818 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:56.343467 16818 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:56.352411  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet b6ca6db9aa4e4bdd829dc087e97096a0, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:56.353242  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet b6ca6db9aa4e4bdd829dc087e97096a0, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:56.365020 16483 raft_consensus.cc:979] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: : Instructing follower bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:24:56.365607 16483 raft_consensus.cc:1067] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Signalling peer bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:24:56.386198  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:56.369756 16818 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:56.406756  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:56.407615  6473 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260812 19:24:56.355019 16814 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260812 19:24:56.399533  6055 catalog_manager.cc:5495] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 8 to 15, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 15 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:24:56.414568  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:56.411895  6242 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:56.417580  6238 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260812 19:24:56.419180  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:56.420014  6473 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:56.422254 16703 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:56.423455 16814 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:24:56.432874  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:56.417989  6238 pending_rounds.cc:76] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 8
I20260812 19:24:56.440516  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:56.441309  6477 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:24:56.442843  6242 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:56.439527  6238 pending_rounds.cc:97] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260812 19:24:56.449410  6238 raft_consensus.cc:2866] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:56.451601  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:56.443528  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:56.452306  6224 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 19
I20260812 19:24:56.458573  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:56.462810  6475 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 17
I20260812 19:24:56.471540  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:56.472466  7591 raft_consensus.cc:3032] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 22 LEADER]: Stepping down as leader of term 22
I20260812 19:24:56.472889  7591 raft_consensus.cc:729] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:56.438912 16814 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:56.499096  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:56.499980  6232 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:24:56.495995  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:56.501601  6236 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:56.493590  7591 consensus_queue.cc:260] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:56.505512  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 267358us
W20260812 19:24:56.510993  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 92597.7us
I20260812 19:24:56.471963 16847 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:56.514801  6241 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:56.517954  6055 catalog_manager.cc:5495] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:56.549386  6228 raft_consensus.cc:1226] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:56.462173 16958 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260812 19:24:56.579610  6235 pending_rounds.cc:76] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 8
I20260812 19:24:56.580156  6235 pending_rounds.cc:97] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260812 19:24:56.580469  6235 raft_consensus.cc:2866] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:56.585273 16283 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:56.588300 16973 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:56.590329 16258 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:56.590965 16258 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:56.590337 16592 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:56.595305  7591 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:24:56.595397 16592 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:56.596668 16258 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:56.552328  6241 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:56.600363  6241 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:53178
I20260812 19:24:56.601046  6241 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:56.601447  6241 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:56.520167 16818 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:56.551585  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:56.554471 16984 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.005s	sys 0.023s
I20260812 19:24:56.555522  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:56.571127 16814 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:56.618927  7600 raft_consensus.cc:3032] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:56.625770  7600 raft_consensus.cc:729] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:56.620770  6473 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
W20260812 19:24:56.635805  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 88365.4us
I20260812 19:24:56.643190  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:56.625065 16984 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.006s	sys 0.023s
I20260812 19:24:56.608726 16818 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:24:56.651511  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 103023us
I20260812 19:24:56.643190  7600 consensus_queue.cc:260] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:56.654837  7600 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:56.645725 16596 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:56.665776  6475 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:56.671821  6477 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:24:56.666167  6055 catalog_manager.cc:5495] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:24:56.683158  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3026) took 1023 ms. Trace:
I20260812 19:24:56.696920  6464 rpcz_store.cc:276] 0812 19:24:55.659936 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:55.672103 (+ 12167us) service_pool.cc:227] Handling call
0812 19:24:55.672574 (+   471us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:55.672910 (+   336us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:55.672938 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:55.673660 (+   722us) log.cc:842] Serialized 26 byte log entry
0812 19:24:56.323948 (+650288us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:24:56.323989 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:56.324059 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:56.682877 (+358818us) raft_consensus.cc:1671] finished
0812 19:24:56.682907 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:56.683084 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":649903,"threads_started":1,"wal-append.queue_time_us":994632}
I20260812 19:24:56.699493  7600 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:24:56.700882  6179 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:56.702013  6241 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:56.655577 16818 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:56.680693  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:24:56.708729  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 90319.2us
I20260812 19:24:56.690207  6236 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:56.715042  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:56.715898  6241 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:56.666139 16984 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:56.703418 16814 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:56.728122  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:56.730228  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:56.736317  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:56.749313 16971 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260812 19:24:56.756913 16679 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:56.763789 16813 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:56.772164  6055 catalog_manager.cc:5495] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 10 to 20. New cstate: current_term: 20 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260812 19:24:56.783342  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 49288.8us
I20260812 19:24:56.787609  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:56.792276  6055 catalog_manager.cc:5495] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 17 to 18, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 18 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:24:56.795413  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 407416us
I20260812 19:24:56.796352  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:56.839584  6232 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:24:56.791450 16813 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:56.791599 16833 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:56.850126  6055 catalog_manager.cc:5495] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 9 to 10, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 10 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:24:56.851287 15841 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:56.852558 16971 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:56.852362  6055 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 13 to 16, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 16 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:24:56.853108 16971 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:56.854259  6232 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:56.855031 17095 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:56.855386 16971 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:56.855597 17095 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:56.856112 17095 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:56.863368 17093 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260812 19:24:56.795351 16283 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:56.882628  6298 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:56.886866 16258 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader election won for term 12
I20260812 19:24:56.887835 16258 raft_consensus.cc:686] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:56.785480 17099 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260812 19:24:56.892745  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2441) took 1018 ms. Trace:
I20260812 19:24:56.894243 17102 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:56.893266  6465 rpcz_store.cc:276] 0812 19:24:55.874151 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:56.222898 (+348747us) service_pool.cc:227] Handling call
0812 19:24:56.259413 (+ 36515us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:56.286449 (+ 27036us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:56.286497 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:56.314562 (+ 28065us) log.cc:842] Serialized 26 byte log entry
0812 19:24:56.594870 (+280308us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:56.594910 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:56.594993 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:56.889209 (+294216us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:24:56.892345 (+  3136us) raft_consensus.cc:1671] finished
0812 19:24:56.892381 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:56.892680 (+   299us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3280,"raft.queue_time_us":13196,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":2803,"spinlock_wait_cycles":29384960,"thread_start_us":227878,"threads_started":1,"wal-append.queue_time_us":447512}
I20260812 19:24:56.894812 17102 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:56.895254 17102 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:56.850485 16679 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:56.845494 16807 raft_consensus.cc:2741] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260812 19:24:56.909559  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2440) took 1035 ms. Trace:
I20260812 19:24:56.910215  6482 rpcz_store.cc:276] 0812 19:24:55.873847 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:56.218499 (+344652us) service_pool.cc:227] Handling call
0812 19:24:56.252669 (+ 34170us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:56.263658 (+ 10989us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:56.263700 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:56.278435 (+ 14735us) log.cc:842] Serialized 26 byte log entry
0812 19:24:56.623848 (+345413us) raft_consensus.cc:1631] Marking committed up to 6
0812 19:24:56.623888 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:56.623958 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:56.909267 (+285309us) raft_consensus.cc:1671] finished
0812 19:24:56.909296 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:56.909472 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":13143,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"thread_start_us":320838,"threads_started":1,"wal-append.queue_time_us":604285}
W20260812 19:24:56.951364  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 143484us
I20260812 19:24:56.952500  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:56.953528 16955 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:24:56.955271  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:56.958971  6482 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:33386
I20260812 19:24:56.959668  6482 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:56.960032  6482 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:56.960947  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:56.952876 16258 consensus_queue.cc:237] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:56.964313  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:24:56.974907  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 178689us
I20260812 19:24:56.975925  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:56.976972 16984 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:24:56.977515 16984 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:56.977672  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:56.977982 16984 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:56.981187 16971 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260812 19:24:56.986924  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 286098us
I20260812 19:24:56.995940  6228 raft_consensus.cc:1226] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 22. Current term is 23. Ops: []
I20260812 19:24:56.998842  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:24:57.009353  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 294375us
W20260812 19:24:57.020433  6224 consensus_meta.cc:287] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.008s
W20260812 19:24:57.020628  6483 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.022s	sys 0.051s
W20260812 19:24:57.021147  6483 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.022s	sys 0.051s
I20260812 19:24:57.022032  6470 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:57.022521  6470 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:57.021039  6224 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:24:57.002681  7591 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
I20260812 19:24:57.025230  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:57.026093  7607 raft_consensus.cc:2379] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 23: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:57.023258  6482 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:57.031080  6464 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:57.033432  6179 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:57.033926  7606 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:57.036180  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:57.038867 17138 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:57.039280 17099 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:24:57.039891 17099 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:57.039592 17138 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.040951 17099 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:57.042022 17138 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:24:57.045478  6053 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 241) took 27221 ms (client timeout 15000 ms). Trace:
I20260812 19:24:57.045572  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:57.046759  6178 leader_election.cc:398] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 18. Current term is 19.
I20260812 19:24:57.047153  6178 leader_election.cc:401] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:24:57.047902 17138 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 18. Current term is 19.
I20260812 19:24:57.051191 16818 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:56.994280 16984 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.052726  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:57.054728  7598 raft_consensus.cc:2379] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:57.056651  6482 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:57.000890 16955 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260812 19:24:57.070686  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 115499us
I20260812 19:24:57.072031  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:57.086302  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:57.089448  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:57.069255 17137 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260812 19:24:57.096657  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 119208us
I20260812 19:24:57.089001  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:57.078692 16795 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:57.110630  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:57.092355 16955 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:57.076105 16813 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260812 19:24:57.095753 17137 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:57.115483 16795 raft_consensus.cc:2741] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260812 19:24:57.117712  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:57.118553  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.122104  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:57.103941 16596 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:57.109481 16847 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:57.136587  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.137765 17118 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:57.138017  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:57.138239 17118 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:57.138710  6350 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:24:57.140400 17138 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:57.141199 17138 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.130594 16971 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:57.143432 16971 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.140435  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:57.146060  6344 raft_consensus.cc:3032] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:57.146484  6344 raft_consensus.cc:729] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:57.134929 16596 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:57.156101  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:57.157446  6354 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:57.124053 17137 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:57.154914  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:57.160027  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:57.148839 17118 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:57.156250 16596 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:57.162348 16795 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260812 19:24:57.235208  6178 connection.cc:232] RPC call timeout handler was delayed by -1.0227290680631995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260812 19:24:57.202131 16833 raft_consensus.cc:686] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:57.236434 17149 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:57.237090 17149 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:57.238214 16807 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:57.238917 16807 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.239323 17149 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:57.241144 16807 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:57.221112  6353 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:24:57.244021  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.242475  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.245375  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.245993  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:57.046234  6053 rpcz_store.cc:269] 0812 19:24:29.823547 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:29.823897 (+   350us) service_pool.cc:227] Handling call
0812 19:24:30.411723 (+587826us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b5400000910. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824d92 00007f98fd7697c9 00007f98fd701c36 00007f98fd6d2c28 00007f98fd7ccc3e 00007f98fbadefb4 00007f98fbadef42 00007f98fbadee71 00007f98fbadedec
0812 19:24:57.045138 (+26633415us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:24:50.294637 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:24:50.517954 (+223317us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:24:50.554929 (+ 36975us) write_op.cc:435] Acquired schema lock
0812 19:24:50.562439 (+  7510us) tablet.cc:660] Decoding operations
0812 19:24:50.718130 (+155691us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:24:50.718235 (+   105us) write_op.cc:641] Partition lock acquired for write op
0812 19:24:50.718287 (+    52us) tablet.cc:683] Acquiring locks for 32 operations
0812 19:24:50.720709 (+  2422us) tablet.cc:699] Row locks acquired
0812 19:24:50.720748 (+    39us) write_op.cc:260] PREPARE: finished
0812 19:24:50.720950 (+   202us) write_op.cc:270] Start()
0812 19:24:50.721113 (+   163us) write_op.cc:276] Timestamp: P: 1786562690720883 usec, L: 0
0812 19:24:50.721157 (+    44us) op_driver.cc:331] REPLICATION: starting
0812 19:24:50.926469 (+205312us) log.cc:842] Serialized 12345 byte log entry
0812 19:24:51.655477 (+729008us) op_driver.cc:444] REPLICATION: finished
0812 19:24:51.798755 (+143278us) write_op.cc:301] APPLY: starting
0812 19:24:51.798866 (+   111us) tablet.cc:1365] starting BulkCheckPresence
0812 19:24:52.469395 (+670529us) tablet.cc:1368] finished BulkCheckPresence
0812 19:24:52.500823 (+ 31428us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:24:54.227769 (+1726946us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:24:54.303506 (+ 75737us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=64,key_file_lookups=64,delta_file_lookups=0,mrs_lookups=0
0812 19:24:54.303579 (+    73us) write_op.cc:312] APPLY: finished
0812 19:24:54.304206 (+   627us) log.cc:842] Serialized 276 byte log entry
0812 19:24:54.589623 (+285417us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:24:54.732788 (+143165us) write_op.cc:454] Released schema lock
0812 19:24:54.773960 (+ 41172us) write_op.cc:341] FINISH: Updating metrics
0812 19:24:54.774337 (+   377us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:24:54.774382 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":104255,"reported_tablets":52,"spinlock_wait_cycles":13101952,"child_traces":[["op",{"apply.queue_time_us":128379,"apply.run_cpu_time_us":83788,"apply.run_wall_time_us":2997128,"cfile_cache_hit":130,"cfile_cache_hit_bytes":138079,"num_ops":32,"prepare.queue_time_us":594270,"prepare.run_cpu_time_us":21968,"prepare.run_wall_time_us":893725,"raft.queue_time_us":81024,"raft.run_cpu_time_us":13659,"raft.run_wall_time_us":118532,"replication_time_us":927850,"thread_start_us":792810,"threads_started":5,"wal-append.queue_time_us":576991,"wal-append.run_cpu_time_us":24951,"wal-append.run_wall_time_us":2775256}]]}
I20260812 19:24:57.157137  6344 consensus_queue.cc:260] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.247562  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.263794  6344 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:57.246621  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.248543  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:57.226015 17125 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260812 19:24:57.225947  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 97907.4us
I20260812 19:24:57.237650 16833 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:57.249840  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.257450  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.248869  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.247184  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.264153  6224 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:57.276700  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.277290  6224 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:57.278045  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.279292  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.280083  6224 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:57.280732  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.275446  6345 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:57.281878  6350 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
I20260812 19:24:57.223119  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:57.283703  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60789.5us
I20260812 19:24:57.274437  6230 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:57.198963 16989 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:57.289072  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:57.182982 16709 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:57.291394  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.286881  6228 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:57.287098  6232 raft_consensus.cc:2379] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 15: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:57.294349  6349 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 18. Current term is 19. Ops: [18.7-18.7]
I20260812 19:24:57.246093 17102 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.299870  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.301234  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.303833  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.289633 16989 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:57.306407  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.274847 16984 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:57.309304  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.271184 16971 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:57.286615 16818 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:57.327706  6230 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:57.314220  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.332074  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.333791  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.334147  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.313237 16483 consensus_queue.cc:1046] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260812 19:24:57.335501  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.314965  6232 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:57.274035 16807 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260812 19:24:57.317663  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.307713  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.318621 17102 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:57.320863  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:57.313715  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.522s (SENT) [suppressed 23 similar messages]
I20260812 19:24:57.327275 17138 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:57.307559 16709 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.327929 16818 consensus_queue.cc:1046] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:24:57.290143 16679 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:57.317147  6235 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:57.339375  6350 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
W20260812 19:24:57.333793 16814 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.599s	user 0.015s	sys 0.000s
I20260812 19:24:57.370745  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.341797  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.313401  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.373631  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.372403  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.375488  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.350088  6354 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:57.351054  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.352897  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.377660  6224 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:24:57.315927 16989 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:57.336054 16960 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:24:57.382877  6235 raft_consensus.cc:2354] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17.
I20260812 19:24:57.399484  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.405836  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:57.406467  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:57.406741  6482 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:57.409657  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.416417  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:57.417582  6483 raft_consensus.cc:2396] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260812 19:24:57.382198 16184 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:57.407354  6464 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:57.383622 16960 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:57.426965  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:57.432134  6474 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:57.428519  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:57.432943  6465 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:57.439728  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.441197  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.442523  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:57.444875  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:57.445632  6477 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:24:57.454576  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:57.436024 16960 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:57.463011  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3016) took 1030 ms. Trace:
I20260812 19:24:57.479558  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:57.484867  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.485899  6345 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:24:57.491748  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.492645  6235 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:24:57.463097 16709 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:57.501399  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.488180 16818 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:57.506129  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:57.503492 17095 consensus_meta.cc:287] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.647s	user 0.014s	sys 0.000s
I20260812 19:24:57.522133  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3018) took 1088 ms. Trace:
I20260812 19:24:57.531929  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.531989  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3024) took 1027 ms. Trace:
W20260812 19:24:57.530898  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 228981us
I20260812 19:24:57.532752  6345 raft_consensus.cc:2354] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17.
I20260812 19:24:57.532864  6241 rpcz_store.cc:276] 0812 19:24:56.505071 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:56.760510 (+255439us) service_pool.cc:227] Handling call
0812 19:24:56.799292 (+ 38782us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:56.799575 (+   283us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:24:57.171109 (+371534us) log.cc:842] Serialized 14 byte log entry
0812 19:24:57.531581 (+360472us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:57.531650 (+    69us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:57.531719 (+    69us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:57.531787 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:57.531925 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10083,"prepare.queue_time_us":85757,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":36,"thread_start_us":645975,"threads_started":2}
I20260812 19:24:57.524439  6470 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:57.522862  6482 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:24:57.505017 17102 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:57.544895  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:57.547631  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:24:57.554976  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 232113us
I20260812 19:24:57.558949  6345 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 11. Current term is 12. Ops: []
I20260812 19:24:57.594411  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.606959  7597 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260812 19:24:57.608351  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.610915  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:57.531416  6242 rpcz_store.cc:276] 0812 19:24:56.433579 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:56.575010 (+141431us) service_pool.cc:227] Handling call
0812 19:24:56.575428 (+   418us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:56.575787 (+   359us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:24:57.093883 (+518096us) log.cc:842] Serialized 14 byte log entry
0812 19:24:57.521785 (+427902us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:57.521851 (+    66us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:24:57.521892 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:57.521957 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:57.522076 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":62763,"prepare.queue_time_us":310094,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":16545,"thread_start_us":837624,"threads_started":2}
I20260812 19:24:57.536324 17095 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:57.624744  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 81492.5us
W20260812 19:24:57.624140  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 310433us
I20260812 19:24:57.633119  6342 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 18. Current term is 19. Ops: []
W20260812 19:24:57.620155 17146 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.212s	user 0.001s	sys 0.001s
I20260812 19:24:57.637233  6482 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 18. Current term is 19. Ops: []
I20260812 19:24:57.649326  6235 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:57.562093 17102 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.652107  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.655215  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:57.657786  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:57.569854 17118 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:57.660718  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:24:57.649138 17141 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260812 19:24:57.663543 17137 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.664484  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.665017 16813 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:57.665550  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.668982  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:24:57.662743 17158 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260812 19:24:57.675028 16814 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:57.675575 16814 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:57.675836 17159 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260812 19:24:57.678619  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:57.679917  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:57.676074 16814 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:57.682408  6350 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260812 19:24:57.672914 16818 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:57.705868 16818 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:57.706278 16818 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:57.667208 17163 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:57.684221  6354 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:57.684669  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3023) took 1198 ms. Trace:
I20260812 19:24:57.707436  6236 rpcz_store.cc:276] 0812 19:24:56.486480 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:56.751547 (+265067us) service_pool.cc:227] Handling call
0812 19:24:56.762439 (+ 10892us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:24:57.162310 (+399871us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:24:57.162382 (+    72us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:24:57.196069 (+ 33687us) log.cc:842] Serialized 26 byte log entry
0812 19:24:57.514397 (+318328us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:57.514437 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:57.514508 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:24:57.684446 (+169938us) raft_consensus.cc:1671] finished
0812 19:24:57.684468 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:57.684614 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":132830,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"thread_start_us":670131,"threads_started":2,"wal-append.queue_time_us":332188}
I20260812 19:24:57.685024 17186 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260812 19:24:57.709959  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 53254.1us
I20260812 19:24:57.687091 16184 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:57.476886  6238 rpcz_store.cc:276] 0812 19:24:56.433029 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:56.521212 (+ 88183us) service_pool.cc:227] Handling call
0812 19:24:56.547521 (+ 26309us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:24:56.552864 (+  5343us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:24:57.019793 (+466929us) log.cc:842] Serialized 14 byte log entry
0812 19:24:57.462541 (+442748us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:24:57.462618 (+    77us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:24:57.462702 (+    84us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:24:57.462790 (+    88us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:24:57.462939 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":332500,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":29377,"thread_start_us":787597,"threads_started":2}
I20260812 19:24:57.716221  6474 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:57.689976  6344 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
W20260812 19:24:57.723418  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 71350.7us
I20260812 19:24:57.673813  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:57.691558  7606 raft_consensus.cc:3032] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Stepping down as leader of term 14
W20260812 19:24:57.709837 17161 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.078s	user 0.001s	sys 0.001s
I20260812 19:24:57.694597  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:57.694989  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:57.748821  6342 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:57.696019 16814 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.700515  6470 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:57.627910 17149 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.042s
I20260812 19:24:57.702118 17095 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:57.702431 17137 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:57.702883  6230 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:57.757519  6464 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:57.757717  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:57.760905  7591 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260812 19:24:57.703758 17102 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:57.673267 16813 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:57.725004  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 51222.2us
I20260812 19:24:57.724457  7606 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:57.752508  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:57.756503  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:33386 (request call id 1004) took 1624 ms. Trace:
I20260812 19:24:57.757907  6464 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:57.686583 17118 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:57.746817 17163 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:57.774268  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:57.767073  6470 rpcz_store.cc:276] 0812 19:24:56.152417 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:56.253903 (+101486us) service_pool.cc:227] Handling call
0812 19:24:57.699320 (+1445417us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54001045d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f776fda7 00007f98fc6bbee0 00007f98f5db9784 00007f98f5db9712 00007f98f5db9641 00007f98f5db95bc 00007f98f5db8872 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:24:57.753098 (+ 53778us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1728055040}
I20260812 19:24:57.775573  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:57.753412 16795 raft_consensus.cc:3032] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Stepping down as leader of term 11
I20260812 19:24:57.783610  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:57.709906 16596 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.783440  6465 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
W20260812 19:24:57.792814  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 141796us
I20260812 19:24:57.784379  7606 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:57.787868  6464 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.768884 16813 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:57.803411  6464 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:57.803560  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45989.8us
I20260812 19:24:57.804194  7606 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:57.781366 16709 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:57.753824 16703 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260812 19:24:57.809602  6242 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:57.811424 16703 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:24:57.799177 17118 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260812 19:24:57.811933 16703 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:57.812815 17173 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:57.813227 17173 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:57.812996 16703 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:57.788630 16795 raft_consensus.cc:729] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:57.814180 17173 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:57.815447 16795 consensus_queue.cc:260] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:57.815905 16814 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:57.816677 16795 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 11 FOLLOWER]: Advancing to term 12
I20260812 19:24:57.796725 17163 consensus_queue.cc:1046] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.022s
I20260812 19:24:57.820052 16596 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:57.829612 16847 raft_consensus.cc:3032] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:24:57.830045 16847 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:57.830933 16847 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.831554  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:57.833185  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:57.834088 16709 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:57.834497 16709 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:57.835098 16709 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:57.835271 17149 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:57.786588 16483 consensus_queue.cc:1046] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260812 19:24:57.842893  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:57.846709 17149 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:24:57.847115 17149 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:57.847512 17149 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:57.849213  6342 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:57.850692  6350 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:57.860908 16960 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.862629  6345 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:24:57.823272 16703 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:57.867882  7598 raft_consensus.cc:3032] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:24:57.868225  7598 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:57.868577 16960 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:57.869025  7598 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:57.870097  7598 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Advancing to term 19
W20260812 19:24:57.876322  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 110704us
I20260812 19:24:57.877686  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:57.881021  6464 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:24:57.883013  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:57.889279  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:57.860523 16989 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:57.892374  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 57700.3us
W20260812 19:24:57.888310 16955 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260812 19:24:57.895882  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:57.894016  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:57.888453 16984 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:24:57.900249 17185 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:24:57.900822 17185 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:57.901775 17185 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.894062 16814 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:57.903054 16814 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:57.903441 16814 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:57.903963 17149 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.905416 16984 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:57.906365 16984 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.910497  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:57.911911  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:57.912671 17138 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:57.913028  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:57.913058 17138 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:57.913700 17138 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:57.914146 16833 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:57.914829 16833 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:57.915163 16833 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:57.915478 16833 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:57.875483 16818 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.922482 17138 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.925079 16818 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:57.898618 15841 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:57.926046 15841 raft_consensus.cc:686] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:57.927197 15841 consensus_queue.cc:237] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.927897  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:57.928696 16596 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:57.929881  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:57.930570 16596 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:57.931922 17149 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:57.934881 16596 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:57.935966 17102 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:24:57.936545 17102 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:57.935922  7591 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:57.937691 17102 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.938799 17102 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:57.935524 16847 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:57.887511 16813 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.948843 16813 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:57.936923 16989 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:57.949446 16709 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.951681 16814 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:57.936542  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:24:57.982532  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 46079.9us
W20260812 19:24:57.966526  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 74756.8us
I20260812 19:24:57.985721  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:24:57.972440  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 195149us
I20260812 19:24:57.980954  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:57.987177  6416 leader_election.cc:398] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17.
I20260812 19:24:57.987490  6416 leader_election.cc:401] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:24:57.981487  7606 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:57.993141  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:57.994498  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:57.996188  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:58.003183  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:58.002933  6235 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:58.018888  7598 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:24:58.021606  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:58.021646  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:58.021875  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:58.023461  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:58.024084  6477 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:58.020533  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:58.022241  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:58.025594  6230 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:24:58.025995  6232 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 19: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:58.026888  6482 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 19: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:58.028405  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:57.972007 16955 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:57.952311 16709 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:58.025043 16795 consensus_queue.cc:1046] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260812 19:24:58.035876  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260812 19:24:58.019744 16718 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
W20260812 19:24:58.028258 16483 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260812 19:24:58.018121 16818 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:58.076097  6477 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:57.935488 17138 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:57.953728 16814 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:58.023303 17102 raft_consensus.cc:2741] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260812 19:24:58.018054 17210 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17.
I20260812 19:24:58.056886  6482 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260812 19:24:58.099210  6482 pending_rounds.cc:76] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 10
I20260812 19:24:58.041829 16813 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:24:58.002629 16989 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:58.080102  6464 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
W20260812 19:24:58.087880  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45913.5us
I20260812 19:24:58.099522  6482 pending_rounds.cc:97] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260812 19:24:58.040609 16955 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:58.100477  6482 raft_consensus.cc:2866] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:24:58.079106  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 49199.3us
I20260812 19:24:58.106022  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:58.046626  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:57.981657 16833 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:58.111526  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 64997.5us
I20260812 19:24:58.117000  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:58.077916 16818 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:58.119254 16818 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:58.035907 16596 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260812 19:24:58.125407  6417 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:58.127640  7591 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260812 19:24:58.040948 16184 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260812 19:24:58.088966 17163 raft_consensus.cc:3032] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:24:58.116976 16955 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:58.104741 16813 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:58.140829 16258 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:58.122875 17186 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:58.141985 17210 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:58.141649 17163 raft_consensus.cc:729] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:58.148262 16813 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:24:58.161262  6417 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:58.157805  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:58.175829  7598 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:58.124310 16989 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:58.186337  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:58.187007  6482 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:58.190488  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:58.191762  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:58.144935 17102 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260812 19:24:58.175279 17173 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:58.201006  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 197874us
I20260812 19:24:58.203339  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:58.207927  6481 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260812 19:24:58.208472  6481 pending_rounds.cc:76] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 9
I20260812 19:24:58.208750  6481 pending_rounds.cc:97] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260812 19:24:58.209038  6481 raft_consensus.cc:2866] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:24:58.212157 17237 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:58.213093  6473 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260812 19:24:58.215308  6232 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:58.187310 17210 raft_consensus.cc:686] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:58.212931 17237 consensus_queue.cc:1046] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 19:24:58.223484  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:58.196717 16971 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:24:58.194443 17202 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:24:58.199767 16814 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:24:58.210460  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:58.198254 17193 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:24:58.185268 17185 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260812 19:24:58.232036  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:58.234115  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:24:58.234869  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 80017.1us
I20260812 19:24:58.237457  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:58.253592  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:58.237356  6353 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:58.255609  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:58.256078  7599 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
W20260812 19:24:58.269317 17221 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260812 19:24:58.269496  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:58.270833  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:58.271296  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:58.260718  6482 raft_consensus.cc:2396] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 19 because replica has last-logged OpId of term: 18 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 6.
I20260812 19:24:58.264024  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.231432 16596 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:58.217010 17194 consensus_queue.cc:1046] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260812 19:24:58.261488 17095 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:58.230743 16718 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:24:58.266366  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:58.280649  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:58.283318  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:58.263250 17137 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:24:58.288278  6241 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:58.291448 17210 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:58.298605  6353 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:24:58.235574 17163 consensus_queue.cc:260] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:58.299607 17163 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:58.267038  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:58.312819  6232 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:58.316316  6477 raft_consensus.cc:2396] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260812 19:24:58.324005  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:58.281646 16833 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:58.256036 17225 consensus_queue.cc:1046] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.087s
I20260812 19:24:58.333441 17138 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.006s
I20260812 19:24:58.334246 17138 consensus_queue.cc:1225] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer bdfa5579d4534c618c00db6b4a841c81 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260812 19:24:58.340338  6353 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:58.340971  6353 raft_consensus.cc:595] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:58.321187 16818 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.326252 17118 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:58.289260 17137 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:58.313419 17095 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:24:58.363551 16833 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:58.381527  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:58.375806 17095 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:58.380260 16709 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:58.387168 16955 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:58.372632 17218 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.134s	user 0.003s	sys 0.001s
I20260812 19:24:58.391775  6232 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
I20260812 19:24:58.374151 17137 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:24:58.400966  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:24:58.402240  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 138347us
I20260812 19:24:58.403421  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.390611 17225 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:58.394249 17095 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:58.390754 16833 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:58.394375 17102 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:58.373840 17118 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:58.403385 16989 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:58.401891 17149 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:58.428974 17149 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:58.432372 17149 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:58.408259 16703 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:58.432557  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:58.433120 16703 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:58.433568 16703 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:58.408601 16709 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.439761 16709 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:58.407181 16814 raft_consensus.cc:686] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 19 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:58.441284 17244 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:24:58.441767 17244 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:24:58.442219 17238 log.cc:924] Time spent T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260812 19:24:58.425429 17237 consensus_queue.cc:1046] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:24:58.443470 17237 raft_consensus.cc:3032] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:24:58.443796 17237 raft_consensus.cc:729] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:58.444649 16795 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:58.444780  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.445010 17137 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.423745 16833 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:58.445654 16795 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:58.446641  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.489167  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.447434 16814 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:58.497532 17250 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:58.448614 17118 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:58.450837 17102 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.500168 17102 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:58.455389 17244 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.500696 16795 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:58.501721  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:58.502969 17244 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:58.503373  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.505152  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.505729 16847 raft_consensus.cc:3032] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:58.505934 16795 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:58.506770 16795 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:58.507957  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:58.509857 17239 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.210s	user 0.001s	sys 0.004s
I20260812 19:24:58.510941 17201 raft_consensus.cc:3032] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:58.511348 17201 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:58.512115 17201 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:58.513454 16813 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.506323 16847 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:58.515161 16795 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:58.515712 16847 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.516508  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:58.517333 16847 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:58.513398 17201 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:58.521407 16795 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:58.452502 17095 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.441030 16818 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:58.444669 17237 consensus_queue.cc:260] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:58.523758 17237 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:58.522855  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.532084 17095 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:58.533126 16818 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:24:58.534463  6416 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:58.540220 16955 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:58.541069  6416 leader_election.cc:398] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17.
I20260812 19:24:58.542354  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.556031 17244 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:58.563232  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.564316 17244 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:58.564798  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.572139  6481 raft_consensus.cc:2354] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20.
I20260812 19:24:58.576380 16813 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:58.566260  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.589046  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:24:58.604820  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 280871us
I20260812 19:24:58.605888  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:58.603171 16813 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260812 19:24:58.625805  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 233445us
I20260812 19:24:58.608784 17237 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:24:58.619436 17095 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260812 19:24:58.636204  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 235271us
I20260812 19:24:58.562330 16703 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:58.638818  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:58.641728  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:58.645133  6232 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:58.650559  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:58.651070  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:58.651477  6241 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:58.651697  6230 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:24:58.657464 17245 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:58.645192 17246 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:58.658310 17245 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:58.658599 17246 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.661062 17246 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:58.633384 17244 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:58.642807 17250 raft_consensus.cc:2741] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Leader pre-election decision vote started in defunct term 14: won
I20260812 19:24:58.665053 16833 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.667552 16833 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:58.669476 16703 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:58.673118 17187 raft_consensus.cc:979] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:58.673698 17187 raft_consensus.cc:1067] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:24:58.674858 17185 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:58.675390 17185 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.676486  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:58.661325 17245 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:58.677347 17201 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:24:58.677528 17185 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:58.677960  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:24:58.680894  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:58.681569  6235 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:58.682176  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:58.683008  6464 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:24:58.654449  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:58.685916  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:58.676819  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:58.688109  6473 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
I20260812 19:24:58.688194  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.689487  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.691306  6477 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:58.694052  6224 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260812 19:24:58.695093  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:58.695204  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.698201  6475 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:24:58.702859  6236 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:58.703533  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:58.706336  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:58.708495  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:58.709357  6481 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:58.714190  6224 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
W20260812 19:24:58.768793  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 73672.3us
I20260812 19:24:58.769326  6241 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:24:58.769702  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.719345  6238 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
W20260812 19:24:58.770467  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 53809us
I20260812 19:24:58.772744  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:58.773273  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:58.773433  6475 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260812 19:24:58.706969 17237 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:58.702407 16813 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:24:58.776266  6464 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:58.776953  6473 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260812 19:24:58.778482  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:58.779680  7597 raft_consensus.cc:2379] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 16: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:58.783241  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:58.788308  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:58.789731  6229 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: []
I20260812 19:24:58.793416  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:58.795178  6475 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:24:58.773778  6238 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:24:58.796833  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:58.796904  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:58.797603  6345 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:24:58.797305  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:58.801105  6350 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:58.793493  6224 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:53178
I20260812 19:24:58.803269  6224 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:24:58.803581  6224 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:58.702455 17192 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:24:58.707280 16833 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:58.805943  6241 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:58.806635  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:58.702598 16709 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:24:58.715440 17163 raft_consensus.cc:2741] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 19 LEADER]: Leader pre-election decision vote started in defunct term 18: won
I20260812 19:24:58.707266 17245 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:58.823901  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:58.716609 17149 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:24:58.825942  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:58.836042  6416 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:58.776803 16814 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:58.826701  6232 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:24:58.848732  6242 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:58.804301 17192 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:58.859251  6224 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.860781  6224 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:58.792399 16596 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:58.851219  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:58.868382  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:24:58.872750  6350 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:58.886106  6350 raft_consensus.cc:595] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:58.886492  6350 raft_consensus.cc:603] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:58.826977 16718 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:24:58.827250 16833 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:58.877954  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:24:58.824146 16813 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:24:58.862478 17192 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
W20260812 19:24:58.876012 17240 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.011s
W20260812 19:24:58.891721  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 118512us
I20260812 19:24:58.853084 17210 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:24:58.847709 17246 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:24:58.925383  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:58.863858 16709 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:58.927711 16709 raft_consensus.cc:686] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:58.928774 16709 consensus_queue.cc:237] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.861999 17138 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:24:58.925199 17210 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:58.932147 17210 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:58.923307  7591 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260812 19:24:58.852356 17260 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:58.937093 17260 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.939288 17260 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:58.847746 17149 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:58.939851 17149 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:58.940160 17261 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:24:58.941690 16596 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:58.942963  7597 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e"
dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:44858
I20260812 19:24:58.948171  7597 raft_consensus.cc:595] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:58.948688  7597 raft_consensus.cc:603] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:58.900763 16813 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:58.952927 16718 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:58.953424 16718 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:58.901041 16847 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:24:58.892729 17137 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:58.950510 16813 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:58.960899 17225 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:58.897593 16960 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:58.961676 16960 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:58.961509 17225 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.962069 16960 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:58.963832 17225 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:58.963495 16718 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:58.966048  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:58.968380 17095 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:58.968842 16596 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:58.968945 17095 raft_consensus.cc:686] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:58.969810 16596 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260812 19:24:58.972267  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:58.972743  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.973109  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:58.975368  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:58.976166  6465 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:58.976606  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:58.977025  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:58.978190  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:58.979019  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:58.979648  6342 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:58.980312 16971 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:58.981419 16971 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:58.981729 16971 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:58.982172  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:58.983035  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:58.983764  6464 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:58.983894  6354 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260812 19:24:58.984304  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:58.984228 17250 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:24:58.985210  6475 raft_consensus.cc:2396] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260812 19:24:58.985899 16847 raft_consensus.cc:686] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:58.986452  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:58.987357  6242 raft_consensus.cc:2396] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260812 19:24:58.986888 16847 consensus_queue.cc:237] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.987528 17205 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:58.989054 17260 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:24:58.990901  6354 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:58.970268 17095 consensus_queue.cc:237] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.993738  6464 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260812 19:24:58.995054  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:58.995347 17261 raft_consensus.cc:3032] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:24:58.995819 17261 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:58.996757 17261 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.997512  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:58.998376  6473 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:58.998790 17261 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:58.999102  6481 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:24:59.036000  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:58.998384  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:58.982551 16971 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:58.999127  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:59.003005  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:59.003814  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:59.037984  6464 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:59.038609  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:59.038715  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.030915  6474 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:24:59.041869  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:59.002964  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:58.947810  6230 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:24:59.046633  6342 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:24:59.006458  6483 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18. Ops: [15.11-17.12]
W20260812 19:24:59.006487  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 59545.5us
I20260812 19:24:59.005779  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:59.010802  6477 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:24:58.918787 16833 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:24:59.009049  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet ff48be70624f412e9bf485b5e489adf3, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:59.075755  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet ff48be70624f412e9bf485b5e489adf3, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.022920  6345 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:24:59.005776  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:59.048698  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:59.049022  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:59.049840  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:59.052803  6473 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:59.053138  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:59.013849  6235 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:24:59.053455  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:59.059873  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:59.073719  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:24:59.116303  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 62936.8us
I20260812 19:24:59.116664  6464 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:59.076455  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:59.037487 17248 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:59.112253  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:59.053434 16703 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:24:59.118122  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:59.128337  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:59.052333 17255 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:59.135363  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:59.141687  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:59.145416  7598 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:24:59.049219 17102 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260812 19:24:59.150704 17173 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:59.151286 17173 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:59.153307 17173 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:59.154999 16483 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:59.155556 16483 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:59.118058 17163 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:24:59.158496 17163 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:59.159611 17163 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.163067  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:59.157879 16483 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:59.166208  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:59.168818  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 181969us
I20260812 19:24:59.133801 16718 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:59.168280  6464 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:24:59.183718  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:59.190515  6353 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260812 19:24:59.142807 16703 raft_consensus.cc:686] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:59.190124  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.198074  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:59.201025  6477 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:24:59.198074  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:59.159804 17210 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:59.210592  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:59.211377  6345 raft_consensus.cc:3032] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:24:59.211854  6345 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:59.207405  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:59.188375 16596 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:59.188619 16184 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:59.221526  6345 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.209205 16258 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:24:59.224385  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:59.238013  6345 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:59.133598 17248 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:59.263602 17149 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:59.194381 17202 consensus_queue.cc:1046] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260812 19:24:59.256565  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 142938us
I20260812 19:24:59.205066 17250 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260812 19:24:59.267455  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.270001  6477 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:24:59.275434  6353 raft_consensus.cc:2379] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:24:59.275854  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:59.273027  6345 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:24:59.227398 16596 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.249993 17260 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:59.236469 16184 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.276051 17194 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:59.280050 17262 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:24:59.301462  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:59.297044  6297 leader_election.cc:398] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20.
I20260812 19:24:59.302366  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:59.303092  6297 leader_election.cc:401] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260812 19:24:59.303493  6345 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
W20260812 19:24:59.305426  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 7e0797ad50cb46cfb10b4a38cc815917, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:24:59.305750  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 7e0797ad50cb46cfb10b4a38cc815917, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.309746  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.308223 17177 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:24:59.315016 17177 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:59.323787  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:59.324859  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:59.325445 17303 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:59.325815 17297 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:59.326115 17303 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:59.327102 17277 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260812 19:24:59.330433 17277 consensus_queue.cc:1225] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer bdfa5579d4534c618c00db6b4a841c81 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260812 19:24:59.330677 17303 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.329243 17297 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:24:59.335819 17290 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
I20260812 19:24:59.337082 17187 raft_consensus.cc:3032] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:59.339013 16960 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.300768 17201 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:24:59.307291 17102 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260812 19:24:59.344141  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.355746 17138 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:24:59.356582  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:59.357722 17138 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:24:59.275878 16703 consensus_queue.cc:237] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:59.322793 16483 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:24:59.341485 17149 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:59.317595 17262 raft_consensus.cc:686] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 13 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:24:59.316579 17200 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20.
I20260812 19:24:59.300424 17260 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.374526  6354 raft_consensus.cc:595] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:59.369751  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:59.375012  6354 raft_consensus.cc:603] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:59.366737  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:59.375852  6235 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
W20260812 19:24:59.372407  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet d0976a98f9404c3d8150d0de9a8b385c, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.352415 17250 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:24:59.377041  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet d0976a98f9404c3d8150d0de9a8b385c, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.378196  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:24:59.379436  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 250472us
I20260812 19:24:59.360363 17187 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:59.368496 17202 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:59.376232 17201 consensus_queue.cc:1046] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260812 19:24:59.317262 17194 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:59.368145 16483 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:59.317795 17192 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.361042 15841 consensus_queue.cc:1046] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260812 19:24:59.406163  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.410077  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:59.370231 17138 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:59.408281  6179 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:24:59.370891 16818 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:59.425542 16596 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:59.425683 17192 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:59.410137 17248 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:59.426808  6350 raft_consensus.cc:2396] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260812 19:24:59.427158 16184 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:59.427726 17177 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:59.419559 17210 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:59.428378 16960 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:59.428996 17262 consensus_queue.cc:237] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:59.426016 16818 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:59.389267 17250 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.432580 16818 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:59.418984 16483 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:24:59.424249 17297 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.425048 17309 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:59.427837 16184 raft_consensus.cc:3032] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:24:59.432622 17250 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:59.450934  7598 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 13 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:59.426227 16596 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260812 19:24:59.424575 17300 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260812 19:24:59.435715  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:59.409888 17225 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:59.471172  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:24:59.441457  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:59.441303  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:59.473414  6344 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:24:59.374027 16847 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:59.433386 16971 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:59.460209  6353 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:59.475178  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:59.476542  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:59.481530  7607 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 18: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:59.483243  6416 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:59.443581 16184 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:59.484928  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:59.487254  6417 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:59.481595 16847 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.491294 16847 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:59.491883 16847 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:24:59.492415 16847 raft_consensus.cc:686] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:24:59.493389 16847 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:59.455118 17187 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.497846 17194 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:24:59.498225 17187 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:59.501001 17260 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:59.507419 16184 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.509151 16184 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:24:59.461544 17277 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:59.511581 17277 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.514092 17277 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:59.471519 17225 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:59.514954 17225 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:24:59.516047 17287 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.253s	user 0.002s	sys 0.000s
I20260812 19:24:59.519399 17138 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.525444 16833 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.526724  6236 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:24:59.487352 17248 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:24:59.527662 17248 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:59.528004 17248 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:24:59.412516 17202 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.485399 17210 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:59.536921  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 184334us
W20260812 19:24:59.536955  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 115431us
I20260812 19:24:59.576010  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.577503  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.544556 17250 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:24:59.588613  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 105465us
I20260812 19:24:59.589932  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:59.591091  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:24:59.593190  6352 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260812 19:24:59.593422  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:24:59.581895 16813 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.622s	user 0.012s	sys 0.001s
I20260812 19:24:59.596701  6228 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260812 19:24:59.580276 17095 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election won for term 17
W20260812 19:24:59.597025  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 109883us
I20260812 19:24:59.598390  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.598753  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:59.600854  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:59.546603 17210 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.603262  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:59.608525  6349 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:24:59.594990 17302 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:24:59.597522 17277 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:59.612246 17250 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260812 19:24:59.613049  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:59.595706 17325 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:24:59.613519 17333 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260812 19:24:59.597505 17255 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:24:59.602869 17309 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:59.602344 16813 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.631582  6354 raft_consensus.cc:3032] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
W20260812 19:24:59.650089  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 176571us
I20260812 19:24:59.654860  6354 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:24:59.652873  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 107401us
I20260812 19:24:59.658387 16813 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:59.660522 17177 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:59.661131 17177 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.648530 17075 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:59.661928 17187 consensus_queue.cc:1046] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:59.662257 17075 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:59.662850 17187 consensus_queue.cc:1225] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer f4ef77b3328a44e8a21dd902b370e25a log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260812 19:24:59.646739  6235 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:24:59.664165  6228 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260812 19:24:59.618465 17302 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:24:59.679579 17187 raft_consensus.cc:3032] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
W20260812 19:24:59.652379 17291 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.394s	user 0.000s	sys 0.004s
I20260812 19:24:59.631939 16818 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:59.681140 17202 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:59.634222 16795 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:59.646001 17293 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:24:59.630827 17330 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:24:59.666389  6354 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.739027  7598 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 13 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:24:59.739076  6354 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:24:59.666283 16833 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:59.726153  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:24:59.632673 17095 raft_consensus.cc:686] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:24:59.732920  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 67478us
I20260812 19:24:59.734596  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:24:59.685117  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:59.747181  6349 raft_consensus.cc:595] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
W20260812 19:24:59.725766  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 127422us
I20260812 19:24:59.689121 17302 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:59.743057  7597 raft_consensus.cc:2379] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 13: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:24:59.689368 17187 raft_consensus.cc:729] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:24:59.749680  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.751085  7606 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260812 19:24:59.736424 17325 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:59.765061  6354 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260812 19:24:59.768481  6477 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260812 19:24:59.733680 16795 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:24:59.736256 17293 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:59.771485  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:59.779924  6481 raft_consensus.cc:2379] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 18: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:59.781258  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:59.782155  6224 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:24:59.736913 17250 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:59.653465 17319 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260812 19:24:59.783262  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:59.784662  6238 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260812 19:24:59.785547  6475 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 18: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:59.793378  6470 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260812 19:24:59.787358  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.789359  6230 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: []
W20260812 19:24:59.791070  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 126192us
I20260812 19:24:59.795298  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:59.795637  6229 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:24:59.795662  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:59.798712  6482 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260812 19:24:59.799253  6230 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260812 19:24:59.796566  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:59.796867  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:24:59.802001  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:59.802707  6474 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:24:59.803668  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.804142  6241 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:59.805092  6477 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 19: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:24:59.804898  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.738042 17321 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260812 19:24:59.814314  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:24:59.814484  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.737857 16818 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.780653 16795 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:59.816363  6345 raft_consensus.cc:595] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:24:59.777271 17205 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:24:59.743573 17194 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260812 19:24:59.818562  6345 raft_consensus.cc:603] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:24:59.740613 16483 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:59.823706  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.826370  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:59.773741 17202 consensus_queue.cc:1046] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260812 19:24:59.796422 17336 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:24:59.810077 17149 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:24:59.803503 16813 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:59.801657 17200 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:59.808879 17177 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:59.838375  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:59.847819  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:24:59.824512 17138 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:24:59.849195  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:59.824355 17205 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:24:59.797477 17250 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.864445  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:24:59.878996  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 66981.2us
I20260812 19:24:59.825631 17337 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:59.777853 17325 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.875991  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260812 19:24:59.876504  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:59.892654  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:24:59.867071  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:59.893464  6470 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:24:59.884490  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:59.888713  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:24:59.894076  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:59.894439  6230 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:24:59.894766 17325 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:59.857332 17200 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.896551 17250 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:59.896802 17200 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:59.897171 17250 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:24:59.869134  7599 raft_consensus.cc:2354] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17.
I20260812 19:24:59.898801 16703 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:59.899144  6464 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:24:59.899212 17338 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:24:59.876776 16709 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:24:59.866046 17303 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:24:59.900403 17303 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:24:59.900705 17335 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:24:59.901257 17335 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.876324 17205 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:24:59.903193  6230 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:24:59.903481 17335 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:59.904911  6232 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:24:59.906317  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:59.878077 17210 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:24:59.865839 16813 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.908964  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:59.909265  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:59.910261  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:59.914609  6224 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:24:59.877096 17202 consensus_queue.cc:1225] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer f4ef77b3328a44e8a21dd902b370e25a log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260812 19:24:59.919239  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:59.908958  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:59.877924 17309 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:24:59.917068 17345 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:24:59.924455  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 74408us
I20260812 19:24:59.898219 17333 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260812 19:24:59.927245  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:24:59.868256 17185 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
W20260812 19:24:59.935325  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 85102.1us
I20260812 19:24:59.936853  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:24:59.938201  6470 raft_consensus.cc:2396] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260812 19:24:59.898576 17250 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:59.915244 17335 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:24:59.827828 17293 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.7, Last appended by leader: 7, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.945431  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:59.942574  6347 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:24:59.899398 16703 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:59.949364  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:59.942977  6353 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18. Ops: []
I20260812 19:24:59.928759 17075 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:59.881088 17177 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260812 19:24:59.947284  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:24:59.828151 17095 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:24:59.952082  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:24:59.943114  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:24:59.953588 17347 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:24:59.953822 16818 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:59.958539  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 112973us
W20260812 19:24:59.977455 17331 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260812 19:24:59.929847 17345 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:24:59.979477 16813 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:24:59.980206 17341 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260812 19:24:59.981171 17340 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260812 19:24:59.983474 17349 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:24:59.946276 17250 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:59.984510 16703 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:24:59.986059 17302 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:24:59.996562 17225 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:24:59.998085  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 50925.3us
I20260812 19:25:00.022562  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:00.019546 17349 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 19 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:00.023828  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:00.023998 17349 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.026559  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:00.026854 16818 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:00.027452 16818 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:24:59.999037 17357 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:00.028515 17357 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:00.028913 17357 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:00.020721 17347 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:00.003877 16483 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:00.032132 17225 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:00.032380 17347 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:00.008483 16795 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.009248 17248 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.091715  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:00.010880 17337 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:00.034035 16258 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:24:59.957541  6353 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260812 19:25:00.037740  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:00.039490  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:00.121259  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:00.121848  6345 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:00.039549  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:00.041091  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:00.041380  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:00.042520  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:25:00.091884  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 46075.2us
I20260812 19:25:00.018898 17345 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:00.093513  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 50101.1us
I20260812 19:25:00.094213  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:00.105679 17205 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.108404  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:00.112324 16989 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:00.112938 17163 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.012s	sys 0.024s
W20260812 19:25:00.112785  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 188908us
I20260812 19:25:00.116954  6474 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18. Ops: [15.11-17.12]
I20260812 19:25:00.021930 17293 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:00.127580  6228 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 18: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:00.127776  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:00.137528  6477 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:00.128436  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:00.129751  6473 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:00.134081  6483 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 18. Current term is 20. Ops: []
I20260812 19:25:00.135998  6241 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 15: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:00.138486  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:00.141084  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:00.142086  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:00.139447  6349 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 12.
I20260812 19:25:00.142086  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:00.142942  6477 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:25:00.145552  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:00.146085  6342 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:00.147732  6224 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260812 19:25:00.151382  6417 leader_election.cc:398] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17.
I20260812 19:25:00.093578 17244 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:00.133515 17192 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260812 19:25:00.151135  6345 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:00.161796  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:00.156535  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:00.156827  6473 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:25:00.157395  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:00.158236  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:00.158677  6465 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260812 19:25:00.134970 17163 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.012s	sys 0.024s
I20260812 19:25:00.164548  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:00.166335 17333 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:00.167055 17138 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:00.171002 17335 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:00.171867 17250 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:00.161371 17261 consensus_queue.cc:1046] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260812 19:25:00.174425 17261 raft_consensus.cc:3032] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:25:00.136155 16971 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260812 19:25:00.174926 17261 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:00.175593 16971 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:00.176005 16971 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:00.176434 17205 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:00.176072 17261 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.177665 17075 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:00.178102 17260 raft_consensus.cc:3032] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:25:00.178280 17075 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:00.178916 17075 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:00.183907  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:00.187795  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 2503) took 1210 ms. Trace:
I20260812 19:25:00.018438 17303 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.136855 16989 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:00.056579 16960 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.094s
I20260812 19:25:00.188239  6347 rpcz_store.cc:276] 0812 19:24:58.976960 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:58.998106 (+ 21146us) service_pool.cc:227] Handling call
0812 19:25:00.187616 (+1189510us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b5400350554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:00.187711 (+    95us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2082700544}
I20260812 19:25:00.191207  6349 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260812 19:25:00.194943  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:25:00.199543  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2491) took 1190 ms. Trace:
I20260812 19:25:00.200014  6483 rpcz_store.cc:276] 0812 19:24:59.009264 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:59.518600 (+509336us) service_pool.cc:227] Handling call
0812 19:24:59.518996 (+   396us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:00.139062 (+620066us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:00.199289 (+ 60227us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54000735d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:00.199478 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1414028672}
I20260812 19:25:00.201397 17328 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.065s
I20260812 19:25:00.194543 17261 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:00.159144 17225 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:00.176887 16971 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.215178  6342 raft_consensus.cc:2454] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:25:00.178584 17260 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:00.219928  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:00.228350  6347 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:25:00.228891  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:00.220320  6342 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: []
I20260812 19:25:00.221977 17361 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260812 19:25:00.222167  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:00.183801 17338 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260812 19:25:00.197904  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:00.223272 17302 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:00.223430  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:00.221431  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:00.229753  6345 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:00.225687 16795 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:00.230803  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:00.208932 17102 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260812 19:25:00.268143  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 46940.9us
W20260812 19:25:00.215611 17360 log.cc:924] Time spent T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260812 19:25:00.270697  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:00.215955 17335 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:00.180802 17244 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:00.281523  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60144.7us
I20260812 19:25:00.278237  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:00.282626  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:00.274567  7598 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:25:00.280907  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:00.130259 17337 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:00.287139  6055 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 122) took 15030 ms (client timeout 15000 ms). Trace:
I20260812 19:25:00.295137  6345 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:00.207935 17187 consensus_queue.cc:260] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:00.300978  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:00.231369 17336 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:00.290773 16258 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260812 19:25:00.281188 17202 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260812 19:25:00.239230 17328 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:00.297870 17095 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:25:00.312604 17337 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:00.312908 17244 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:00.287107 16971 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:00.300755 17250 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:00.271571 17102 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:00.360280  6349 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260812 19:25:00.353886  6345 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:00.354110  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:00.361709  6342 raft_consensus.cc:2379] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:00.271916 16813 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:25:00.280923 17330 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:00.337285  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:00.238900 17194 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
W20260812 19:25:00.358862  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 86066.6us
W20260812 19:25:00.289252  6055 rpcz_store.cc:269] 0812 19:24:45.309763 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:45.310387 (+   624us) service_pool.cc:227] Handling call
0812 19:25:00.275433 (+14965046us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:24:57.255010 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:24:57.255851 (+   841us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:24:57.255923 (+    72us) write_op.cc:435] Acquired schema lock
0812 19:24:57.255958 (+    35us) tablet.cc:660] Decoding operations
0812 19:24:57.257516 (+  1558us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:24:57.257636 (+   120us) write_op.cc:641] Partition lock acquired for write op
0812 19:24:57.257703 (+    67us) tablet.cc:683] Acquiring locks for 12 operations
0812 19:24:57.330919 (+ 73216us) tablet.cc:699] Row locks acquired
0812 19:24:57.330954 (+    35us) write_op.cc:260] PREPARE: finished
0812 19:24:57.331158 (+   204us) write_op.cc:270] Start()
0812 19:24:57.331326 (+   168us) write_op.cc:276] Timestamp: P: 1786562697331082 usec, L: 0
0812 19:24:57.331356 (+    30us) op_driver.cc:331] REPLICATION: starting
0812 19:24:57.332163 (+   807us) log.cc:842] Serialized 4678 byte log entry
0812 19:24:57.810851 (+478688us) op_driver.cc:444] REPLICATION: finished
0812 19:24:58.037796 (+226945us) write_op.cc:301] APPLY: starting
0812 19:24:58.037908 (+   112us) tablet.cc:1365] starting BulkCheckPresence
0812 19:24:58.459193 (+421285us) tablet.cc:1368] finished BulkCheckPresence
0812 19:24:58.459342 (+   149us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:24:58.934276 (+474934us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:24:58.934640 (+   364us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0812 19:24:58.934716 (+    76us) write_op.cc:312] APPLY: finished
0812 19:24:58.935216 (+   500us) log.cc:842] Serialized 113 byte log entry
0812 19:24:59.150626 (+215410us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:24:59.150816 (+   190us) write_op.cc:454] Released schema lock
0812 19:24:59.150893 (+    77us) write_op.cc:341] FINISH: Updating metrics
0812 19:24:59.151310 (+   417us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:24:59.151350 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":895602,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":224364,"apply.run_cpu_time_us":71901,"apply.run_wall_time_us":1114041,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54359,"num_ops":12,"prepare.queue_time_us":217381,"prepare.run_cpu_time_us":26209,"prepare.run_wall_time_us":302122,"raft.queue_time_us":88309,"raft.run_cpu_time_us":134596,"raft.run_wall_time_us":193561,"replication_time_us":472854,"thread_start_us":734261,"threads_started":5,"wal-append.queue_time_us":619470,"wal-append.run_cpu_time_us":17180,"wal-append.run_wall_time_us":2143721}]]}
I20260812 19:25:00.288266 17335 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.299605 16795 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:00.355125  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:00.276116 17163 consensus_queue.cc:1046] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260812 19:25:00.323319  6474 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260812 19:25:00.354597  6347 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:00.364459  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:00.369203  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:00.323817 17277 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:00.374068  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:00.375597  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:00.371325  6352 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:25:00.351071 17356 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:00.380163 17356 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.382220  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:00.382997  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:00.355535 17255 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:25:00.415596  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:00.424593  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:00.417732  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:00.387838  7553 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:00.363899 16813 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:00.365264 17102 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:00.424276  6483 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260812 19:25:00.470485  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 91647.9us
I20260812 19:25:00.425209  6241 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260812 19:25:00.471899  6417 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:00.427175  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:00.428642 17358 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260812 19:25:00.461439  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 79467.1us
I20260812 19:25:00.370047 17095 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:00.476233  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 51718.7us
I20260812 19:25:00.378307 17361 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:25:00.413060 16258 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election won for term 19
W20260812 19:25:00.485184  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 102262us
I20260812 19:25:00.432117 16813 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:25:00.386734 17248 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:00.359131 17297 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260812 19:25:00.412873 17118 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:00.322593 17359 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.121s
I20260812 19:25:00.414774 17205 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:00.366953 17302 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260812 19:25:00.323851 17336 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.512364  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:00.359599 17319 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260812 19:25:00.337146 17328 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.365454 17250 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.338227 17260 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.503243 17361 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:00.505947 17244 raft_consensus.cc:3032] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:25:00.531852  6465 raft_consensus.cc:1226] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:00.419485 17277 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.490899 17358 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:00.414314 17137 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.121s
I20260812 19:25:00.606990 17358 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:00.378531 16795 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.610227 16795 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:00.543514 17248 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:00.615365 17248 raft_consensus.cc:686] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:00.616636 17248 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.622164 17118 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:00.623018 17118 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:00.542763  6475 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:25:00.527120  6473 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260812 19:25:00.534538  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:00.631938  6352 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:25:00.516693 17255 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:25:00.632453  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:00.632769 17255 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:00.633168 17255 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
W20260812 19:25:00.635392 17371 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260812 19:25:00.509521 17095 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:00.637501 17370 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260812 19:25:00.638767 17095 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:00.570024  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:00.641858 17328 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:00.537261 17205 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:00.642426 17328 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:25:00.643023 17328 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:00.643452 17328 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.644012 17205 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:00.570607 17194 raft_consensus.cc:3032] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:00.571488 17260 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:00.644639 17194 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:00.646015 17335 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:00.646628 17335 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:00.647076 17335 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:00.647413 17335 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:00.561812 17361 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:25:00.575145 17356 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:00.651026 17356 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:00.651648 17356 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:00.652395 17211 raft_consensus.cc:2781] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:25:00.653168 17211 raft_consensus.cc:686] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:00.576500 17333 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:25:00.652426 17255 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.586948  6345 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260812 19:25:00.657819 17205 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:00.588913  7599 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:00.658567 17205 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.660967 17255 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:00.415093 17337 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.093s
I20260812 19:25:00.645588 17194 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.667240  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:00.667621 17194 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:00.655208 17333 raft_consensus.cc:465] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Not starting pre-election -- already a leader
I20260812 19:25:00.578529 16833 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260812 19:25:00.578846 17373 log.cc:924] Time spent T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260812 19:25:00.672926 17336 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:00.377825 17330 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.676487 17330 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:00.562455 17244 raft_consensus.cc:729] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:00.678490 17244 consensus_queue.cc:260] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:00.679859 17244 raft_consensus.cc:3037] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:00.537261 16258 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:00.654386 17211 consensus_queue.cc:237] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:00.682432 16258 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.661105 17205 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:00.591989  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:00.707333  6349 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:00.704268  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:25:00.710331  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 286084us
I20260812 19:25:00.654281 17356 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:00.634445 16989 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:00.715502  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:00.717124  6464 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
I20260812 19:25:00.654616 16679 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260812 19:25:00.713389 17262 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260812 19:25:00.722297 17357 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.004s
W20260812 19:25:00.722074 17374 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
W20260812 19:25:00.720166 17225 consensus_meta.cc:287] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.006s
I20260812 19:25:00.718101 17118 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:00.709746 16703 consensus_queue.cc:1046] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260812 19:25:00.721608 17325 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:00.771981 17177 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:00.778605  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:00.780514 16984 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:25:00.784917 17328 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:00.757675 17262 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:00.800264  6347 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:25:00.772941 17225 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:00.785449 17277 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:00.785907 17325 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:00.816397 17250 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:00.820109 17205 consensus_queue.cc:1046] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260812 19:25:00.822368  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 350555us
I20260812 19:25:00.764026 17357 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.805368 17262 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:00.824303  6417 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:00.802287 17118 raft_consensus.cc:3032] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:00.834232  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:00.824452  6179 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:00.830817  6347 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:00.836915  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:00.838147  6232 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 19: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:25:00.824656 17293 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.679s	user 0.012s	sys 0.000s
I20260812 19:25:00.844015  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:00.845188  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:00.848846  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:00.850697  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 137523us
I20260812 19:25:00.851019  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:00.854480  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:00.856606  6342 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:25:00.864962  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:00.823766 17386 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:00.869899  6481 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:00.869645  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:00.878185  6230 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:00.872902  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:00.801963 17177 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:00.840070 17261 consensus_meta.cc:287] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.001s
I20260812 19:25:00.837901 17225 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:00.834131 17118 raft_consensus.cc:729] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:00.839335 17337 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:00.890107  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:00.893674  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:00.898376  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:00.837754 16984 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260812 19:25:00.908892 16984 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:00.909322 16984 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:00.908999 17118 consensus_queue.cc:260] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:00.910571 17118 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:00.916440 17201 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:00.917009 17201 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:00.888854 17325 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.922721 17325 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:00.836289 17102 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.928568 17102 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:00.939009  7597 raft_consensus.cc:1226] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: []
I20260812 19:25:00.881927 17384 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:00.892063 17385 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260812 19:25:00.907371 17075 consensus_meta.cc:287] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.713s	user 0.007s	sys 0.006s
I20260812 19:25:00.961705 17075 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:00.903175 17293 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260812 19:25:00.976238 17357 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:00.951578 17384 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:00.979190 17384 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:00.918090 17201 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:00.957230 16813 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:00.940624 17337 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:00.984674 17075 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:00.985564  7598 raft_consensus.cc:2354] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18.
I20260812 19:25:00.942257 16703 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260812 19:25:00.940013 16971 consensus_meta.cc:287] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.005s
I20260812 19:25:00.948873  6230 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:01.013859  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:01.038236  6228 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:00.910192 16984 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.028856  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:01.045346  6342 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 18
I20260812 19:25:00.957587  6349 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:01.030416  6482 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:25:00.991204 17201 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:00.940475 17095 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
W20260812 19:25:01.052953  6470 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.000s	sys 0.021s
W20260812 19:25:01.061069  6470 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.000s	sys 0.021s
I20260812 19:25:01.018525  6352 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:25:01.058684  6477 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260812 19:25:01.031817 17244 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.083160  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:01.084339  6464 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:01.086961  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.088413  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:01.057777 16709 raft_consensus.cc:3032] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:01.089236  6477 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:25:01.093020  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.095932  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:01.069921  6342 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
I20260812 19:25:01.100561  6229 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:01.106637  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:25:01.099941  6224 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.015s	sys 0.015s
I20260812 19:25:01.108215  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.104771  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:25:01.108211  6224 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.015s	sys 0.015s
I20260812 19:25:01.115427  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.116791  6464 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:01.117576  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.117718  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:01.120138  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.120849  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.118454  6477 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:01.122339  6342 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:01.124658  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.125470  6236 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:25:01.128222  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.128865  6352 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:25:01.129097  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.131898  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.133482  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:01.136710  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:01.139832 17389 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.140626 17389 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.143877 17389 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:01.145562 17389 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.146158 17389 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.148352  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:01.097137 16709 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:01.147718 17361 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:01.153913  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:01.158257  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 285434us
I20260812 19:25:01.158056  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:01.159407  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:01.162572  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:01.164014  6229 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:01.122740 17075 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:01.119146 16813 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:01.170025  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 296028us
I20260812 19:25:01.178872  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:01.183053  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:01.162312 16847 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:01.085719 17244 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.188231  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:01.186244  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:01.189092  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:01.177471 17390 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:01.221747  6228 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
I20260812 19:25:01.191390  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:01.221652  6298 leader_election.cc:398] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18.
I20260812 19:25:01.227397  6298 leader_election.cc:401] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:25:01.182328 16813 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:01.232390  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:01.202698 17379 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260812 19:25:01.200225 17335 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.552s	user 0.012s	sys 0.000s
I20260812 19:25:01.246971  6241 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260812 19:25:01.196933 17411 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260812 19:25:01.205168 17358 consensus_meta.cc:287] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.597s	user 0.013s	sys 0.000s
I20260812 19:25:01.241434  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:01.172976 16971 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:25:01.245471  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:01.234524  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45518.8us
I20260812 19:25:01.262884  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:01.263698  6464 raft_consensus.cc:2379] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:01.263625  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:01.264417  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.237458  7598 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:01.265071  6344 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
W20260812 19:25:01.235069  6415 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.009s	sys 0.021s
I20260812 19:25:01.265549  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:01.265834  6415 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.009s	sys 0.022s
I20260812 19:25:01.265924  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.246850 17297 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:01.266572  6224 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:01.269290  6298 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:01.269857  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.270500  6347 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:01.270674  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.237490 17379 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.207515 17244 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:01.249177  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:01.197144 17075 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:01.190788 17177 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:01.204164 17386 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:01.208807 17225 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:01.247447 16847 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:01.208235 17389 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:01.290607 17244 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.291049 17389 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.291239 17244 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.154327 17337 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:01.291646 17389 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.293664 17244 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:01.293771 17389 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:01.261641  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:01.275168 16971 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:01.294960 16971 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:01.295295 16971 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:01.267382  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:01.296316  6465 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:01.288509 16960 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:25:01.297946 16960 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:01.275310 16833 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:01.298844 16960 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:01.299340 16847 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 18.7, Last appended by leader: 7, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.300139 16960 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:01.284341 17225 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:01.303566 17225 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:01.247766 16709 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.306558 16709 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:01.250629 17335 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.196194 17205 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:25:01.271286  6344 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:01.253139 16258 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18.
I20260812 19:25:01.269073  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:01.271689  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2508) took 1052 ms. Trace:
I20260812 19:25:01.275745  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.276221  6347 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260812 19:25:01.317852  6241 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:25:01.276558  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2507) took 1058 ms. Trace:
I20260812 19:25:01.278149  7606 raft_consensus.cc:2379] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:25:01.279394  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:01.260165 17361 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:01.252764 17415 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:01.282191 17075 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:01.283416 17210 raft_consensus.cc:465] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 19 LEADER]: Not starting pre-election -- already a leader
I20260812 19:25:01.269002 17261 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:01.285236  6464 raft_consensus.cc:1261] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260812 19:25:01.328716  6464 pending_rounds.cc:76] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 12
I20260812 19:25:01.329069  6464 pending_rounds.cc:97] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260812 19:25:01.329375  6464 raft_consensus.cc:2866] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:01.288437 17388 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.269502 17297 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.280011 17102 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260812 19:25:01.337880 17309 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.283963 17400 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.225808 17192 raft_consensus.cc:3032] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:01.275647 17379 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:01.267336  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:01.318953  6483 rpcz_store.cc:276] 0812 19:25:00.218581 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:00.245055 (+ 26474us) service_pool.cc:227] Handling call
0812 19:25:00.245579 (+   524us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:00.479983 (+234404us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:01.273212 (+793229us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400272754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:01.276492 (+  3280us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":410150656}
I20260812 19:25:01.316794  6474 rpcz_store.cc:276] 0812 19:25:00.219296 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:00.219859 (+   563us) service_pool.cc:227] Handling call
0812 19:25:00.264747 (+ 44888us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:00.370604 (+105857us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:01.271439 (+900835us) spinlock_profiling.cc:243] Waited 51 ms on lock 0x7b5400272254. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:01.271609 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":117304192}
W20260812 19:25:01.320402  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 51394.2us
I20260812 19:25:01.320760  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:01.261765 17358 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.313969 17095 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.316704 17205 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:25:01.339597  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60280.8us
I20260812 19:25:01.321120 16795 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.341746 17400 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.339282 17388 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.324151 16258 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:01.384104  6236 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260812 19:25:01.338475 17309 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.351466  6465 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:01.309190 17262 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:01.339031 17297 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:01.336580 17210 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.367058  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.410764  6232 raft_consensus.cc:2354] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18.
I20260812 19:25:01.369710  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.373389  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:01.343681 17255 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:01.347124 17138 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.358188 16813 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:01.347205 17192 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:01.343990 17336 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:01.350788  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 83533.2us
I20260812 19:25:01.434643  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:01.386443  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:01.397610  6230 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:01.436470  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:01.398670  6229 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:01.402351 17262 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:01.352212 17293 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.406512  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:01.355374 16703 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:25:01.361541 17205 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:25:01.411917  6235 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:25:01.361567 17095 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:01.377658 16795 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.432117  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.440986  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:01.442889  6229 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:01.413830 16258 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.423908 16184 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:01.422626  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:01.436997 17419 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260812 19:25:01.414039 17255 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.454144  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:01.432116 17248 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.439927 17345 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:01.423563 16813 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.445883  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:01.444443 16847 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:01.430912 17369 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:01.464682  6232 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:01.449220 17356 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.476738  6229 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:25:01.437155 17390 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260812 19:25:01.477331  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 54871.4us
I20260812 19:25:01.377816 16989 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260812 19:25:01.496327  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:01.497591 16718 consensus_queue.cc:1035] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:25:01.490198 17369 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:01.501325 17369 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:01.502775 17445 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260812 19:25:01.509037 17303 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:01.488667 17192 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.511240 16795 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:01.511780 17192 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
W20260812 19:25:01.513253  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 67491.1us
I20260812 19:25:01.431993 17138 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.514076  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:01.515159 17187 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:25:01.515743 17138 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:01.516388 17321 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:25:01.516505 17177 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:01.517102 17321 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 19:25:01.468700 16258 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.475255 17392 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:01.519510 17392 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:01.519889 17392 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:01.520568 16258 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:01.471041 17255 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:01.523463 17388 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:01.527168 17102 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:25:01.527706 17102 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.528095 17102 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:01.529114 17194 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.472321 16184 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.529640 17194 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:01.494138 17335 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:01.531812 16184 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:01.478444 16813 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:01.532821  6359 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260812 19:25:01.534297 17400 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:01.483043 17248 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.534895 17356 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.536569  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 1029) took 1626 ms. Trace:
I20260812 19:25:01.537066 17356 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:01.465775 17244 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260812 19:25:01.536957  6359 rpcz_store.cc:276] 0812 19:24:59.907834 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:59.907998 (+   164us) service_pool.cc:227] Handling call
0812 19:24:59.908306 (+   308us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:01.533263 (+1624957us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:01.534400 (+  1137us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54002b5a54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:01.534596 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3735185664}
I20260812 19:25:01.539615 17194 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:01.543304  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.546990  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:01.548848 17358 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:01.428779 17210 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.557786  6473 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:01.559577  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:01.467698  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:01.455796 17389 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:25:01.449731 17293 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.564244 17293 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:01.440662 17336 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.536939 17248 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:01.570792  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 103152us
I20260812 19:25:01.574258  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.574469  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.576761  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.579926  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.575122  6347 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:25:01.488052 17337 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:01.596876  6353 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260812 19:25:01.596088  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:01.561630 17390 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:01.560102 17385 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:01.628536 17390 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:01.626552 17413 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.631747 17390 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:01.632179 17413 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.635883 17309 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:01.591390 17383 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.636843 17383 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.638595 17137 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:01.591624 17293 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:25:01.590299 16833 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:01.596714 16984 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:01.560547 17369 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
W20260812 19:25:01.647192  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 131072us
I20260812 19:25:01.580678 17358 consensus_queue.cc:1046] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260812 19:25:01.651430  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:01.658026  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.668233  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.653898 17413 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:01.705072  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.672468  6297 leader_election.cc:398] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18.
I20260812 19:25:01.630996 17385 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.675956 17205 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:01.677039  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.713179  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.713932  6354 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:01.677345  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:01.677683 16971 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:01.683524 17210 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:01.693432 17255 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.696398  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.727252  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.662433 17336 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:01.700140  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.701189 17225 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.734926 16971 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:01.735757 17225 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:01.736755  6474 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:01.733557  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.707819  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:01.654901 17293 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:01.716073  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.738540  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:01.739362  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:01.739590  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.739954  7606 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:01.725989  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.730196  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.741751  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.730099  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.732679  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:01.733472 17383 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:01.747067  6345 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:25:01.747437  6229 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 20: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:01.734004  6232 raft_consensus.cc:2396] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260812 19:25:01.709437 16184 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.759707  6230 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:01.761605  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:01.770002  7606 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:01.771596  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:01.775553  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.776746  6298 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:01.724777 17389 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.778800  6350 raft_consensus.cc:2396] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
W20260812 19:25:01.779448  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 74104.5us
I20260812 19:25:01.778255  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:01.784170  6345 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:25:01.731524 17095 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:01.786861  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:01.736683 17137 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.786501  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.754865 17321 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:01.800925 17244 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:01.816969  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:01.817638  6473 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:25:01.802022 17389 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.805190  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:01.806028  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:01.820505  6235 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:01.781466 17400 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:01.805783 17379 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.779889 17248 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:01.889072  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:01.889971  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:01.890699  6473 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:01.787900 17335 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260812 19:25:01.798518 17325 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260812 19:25:01.810052 17210 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:01.815294  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:01.820327 17384 consensus_meta.cc:287] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.840s	user 0.014s	sys 0.000s
W20260812 19:25:01.781965 17380 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260812 19:25:01.815086  6229 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:25:01.804075 16813 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:01.806339 17451 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260812 19:25:01.829749  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:01.816589 17244 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:01.828179  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:01.755395 17386 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260812 19:25:01.813354 16960 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:01.893106  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:01.894927  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:01.817126 17137 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:01.816056 17321 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:01.929033  6235 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:01.931046  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:02.026960  6464 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:02.027351  6473 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:01.825315  6224 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 18 index: 7. Preceding OpId from leader: term: 20 index: 8. (index mismatch)
W20260812 19:25:01.964100 17457 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260812 19:25:01.771116 16184 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.930888 17210 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.983011  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:01.964665 17293 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:01.986922 17205 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:01.987884  6465 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:01.989229 17464 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.989918 16709 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.781502 17297 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:01.990790  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 161014us
I20260812 19:25:01.893784 17248 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:01.831745 17400 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:01.929509 17347 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.932893  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:25:02.007771  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 179716us
I20260812 19:25:02.018842 17396 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:02.019047 17385 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.020138 16960 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:02.079119 17464 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.008616 17358 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:01.987665 17392 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.118783 16960 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:02.120306 17392 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:02.037614  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:02.121502  7597 raft_consensus.cc:2354] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14.
W20260812 19:25:02.121747 17468 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260812 19:25:02.033516 17463 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260812 19:25:02.112651  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:02.122915  6298 leader_election.cc:398] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14.
I20260812 19:25:02.047919  6241 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260812 19:25:02.123235  6298 leader_election.cc:401] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260812 19:25:02.124392 17205 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14.
I20260812 19:25:02.124569 17356 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:25:02.125056  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:02.118785 17358 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:02.013260 17309 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:02.127007 17309 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.066398 17335 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:02.019095 17386 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:02.128536 17386 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:02.128460 17335 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.129487 17386 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.129861 17309 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:01.889217 17414 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.144s
I20260812 19:25:02.034230 17321 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:02.065325  6352 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:02.072753  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:02.114998  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 182985us
I20260812 19:25:02.117674 17202 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:02.034005 17102 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.000528 17244 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:02.127681 17358 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:02.111509 17400 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:02.123317  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:01.899968 17337 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260812 19:25:02.209209 16184 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:02.212257  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 89021.4us
I20260812 19:25:02.213744  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:02.214982 17250 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:02.215834 17102 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.216589  6242 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:25:02.131248 17347 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.220920 17347 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:02.224136 17297 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.078536 16709 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.227527 16709 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.028820 17390 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.131651  6345 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:02.120204 17464 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.078141 17248 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:01.930142 17384 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:02.168278 17202 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:02.149883 17392 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:02.151364 17396 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 20 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:25:02.184609 17471 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260812 19:25:02.175063 17356 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:02.194021 17244 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.195830 17210 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:02.197129 17414 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260812 19:25:02.130621 17335 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:02.197995 17389 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:02.200080 16984 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.000s
I20260812 19:25:02.170397 17177 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:02.170107 17386 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:02.244429  6229 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:02.265708 16795 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:02.250851 17250 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:02.222432 16813 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:02.275134  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:02.248966 17361 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:02.288371  6349 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:02.300876  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:02.323519  6470 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:25:02.302518  6236 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260812 19:25:02.305378 17255 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.266978 17202 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:02.144934  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:02.303026 17210 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:02.333841  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 120208us
W20260812 19:25:02.308854  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 230740us
I20260812 19:25:02.308718  6342 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260812 19:25:02.314941  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:02.332898  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:02.300611 17177 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:02.322254  6224 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:02.287714 17225 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:02.336637  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:02.337158  6342 pending_rounds.cc:76] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 10
I20260812 19:25:02.339079  6342 pending_rounds.cc:97] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260812 19:25:02.339427  6342 raft_consensus.cc:2866] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:02.281627 17192 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:02.347867  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:02.385159 17462 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260812 19:25:02.349397 17210 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.282021 17392 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.288875 17356 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.327785 17201 consensus_queue.cc:1046] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.109s
W20260812 19:25:02.452762  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 57497.5us
I20260812 19:25:02.346891  6230 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:25:02.310874 17187 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260812 19:25:02.482568  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:02.456043  6354 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:02.452100  6477 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:02.456670  6349 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 19.
W20260812 19:25:02.464524  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 126174us
I20260812 19:25:02.485555  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:02.482767  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 3116) took 1102 ms. Trace:
I20260812 19:25:02.486498  6474 rpcz_store.cc:276] 0812 19:25:01.366137 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:01.366287 (+   150us) service_pool.cc:227] Handling call
0812 19:25:02.468574 (+1102287us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54000749d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:02.468726 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":689949056}
I20260812 19:25:02.487934  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:02.491040  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:02.329286 17381 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:02.452847 17194 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:02.397047 16184 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260812 19:25:02.333899 17361 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:02.470431 16718 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:02.511597  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:02.406116 17225 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:02.472818 17335 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:02.488345 17347 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:25:02.495695 17464 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:02.518343 16718 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:02.551170  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 219405us
I20260812 19:25:02.528348 16833 raft_consensus.cc:3032] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:02.528578 17225 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:02.523313 17390 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:02.530057  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:02.560981  6354 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:25:02.561095  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:02.555013  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:02.563156  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:02.531410  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 1040) took 1125 ms. Trace:
I20260812 19:25:02.462953 16703 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260812 19:25:02.506109 17102 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:02.543111 17321 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.469933 17192 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.545236 17202 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.546450  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:02.569109  6477 raft_consensus.cc:2354] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14.
I20260812 19:25:02.522109 17381 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:02.551985  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:02.415820 17396 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.575418  6475 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:02.563393  6354 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260812 19:25:02.576978  6345 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:25:02.563817  6349 rpcz_store.cc:276] 0812 19:25:01.405948 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:01.406145 (+   197us) service_pool.cc:227] Handling call
0812 19:25:02.531212 (+1125067us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b5400028d54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:02.531343 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1942637824}
I20260812 19:25:02.570602  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:02.574887  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:02.568804 17187 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:02.580780 17187 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:02.581207 17381 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:02.581905 16960 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:25:02.582415 17412 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:02.582830 17210 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:02.581264 17187 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:02.586074  6353 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:02.577947  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:02.578552  6474 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:02.555174 16833 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:02.519492 17137 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.587110  6350 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:02.566416 17102 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:02.588054  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:02.605605  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:02.606544  7606 raft_consensus.cc:2354] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19.
I20260812 19:25:02.606289  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:02.607127  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:02.609141  6475 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 19.
I20260812 19:25:02.576853  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:02.513096 17194 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:02.591711  6242 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:02.592567 16833 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.593309 17202 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.593777 17138 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:02.595036 17192 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.595732  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:02.596375 17361 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.597463  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:02.570644 17244 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:02.611526  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:02.628014  6483 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
I20260812 19:25:02.628741  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3118) took 1260 ms. Trace:
I20260812 19:25:02.572152 17384 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:02.624598  6235 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:02.629181  6464 rpcz_store.cc:276] 0812 19:25:01.368653 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:01.369239 (+   586us) service_pool.cc:227] Handling call
0812 19:25:01.369540 (+   301us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:02.027543 (+658003us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:02.628507 (+600964us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b54002d2654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:02.628682 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1502911872}
I20260812 19:25:02.629739  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:02.609999  6354 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:02.613698  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:02.631083  6473 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:02.631183  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:02.611336  6229 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:02.582998 17412 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.618530  6224 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:02.619380  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:02.638830 17412 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.616070 17358 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:02.639555 17358 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:02.639945 17358 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:02.612522 17102 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:02.645615  6224 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:25:02.622000 16718 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.624778  6241 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:02.616199 17403 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:02.612093 17337 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260812 19:25:02.627202  6298 leader_election.cc:398] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19.
I20260812 19:25:02.654690  6298 leader_election.cc:401] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260812 19:25:02.628860 16258 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:25:02.629033  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:02.655439  6483 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:02.631546 16833 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:02.657357  6483 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:25:02.633483  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:02.635186  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3096) took 1263 ms. Trace:
I20260812 19:25:02.635555  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:02.659564  6238 rpcz_store.cc:276] 0812 19:25:01.371569 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:01.371710 (+   141us) service_pool.cc:227] Handling call
0812 19:25:01.372062 (+   352us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:01.565081 (+193019us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:01.565130 (+    49us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:01.565183 (+    53us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:01.565222 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:02.634966 (+1069744us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54000f4bd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:02.635016 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:02.635132 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":443322752}
W20260812 19:25:02.634642 17464 consensus_queue.cc:1159] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "54f83319db6b49929cc8f18a66a66975" responder_term: 18 status { last_received { term: 15 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18. Ops: [17.8-17.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:25:02.618577  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:25:02.621584  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:02.659660  6230 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:25:02.623406 17138 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.662405  6473 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:25:02.642583 17177 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.660823 17403 raft_consensus.cc:686] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 19 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:02.667629 17356 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:02.667399 17337 consensus_queue.cc:1225] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Peer 54f83319db6b49929cc8f18a66a66975 log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260812 19:25:02.654151 16960 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:25:02.670131 17412 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:25:02.687858 17412 raft_consensus.cc:686] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:02.688951 16960 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:02.689240 17412 consensus_queue.cc:237] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.689693 16960 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:02.670455 17201 raft_consensus.cc:3032] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:25:02.691933 16960 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:02.692142 17201 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:02.693337 17201 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.671108 17177 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:02.695552 17321 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.699517 17102 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.672032 17403 consensus_queue.cc:237] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:02.701642 17102 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:02.688019 17480 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260812 19:25:02.676614  6297 leader_election.cc:398] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 13 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 13. Current term is 14.
I20260812 19:25:02.706365  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:02.708438  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:02.676646  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2702) took 1090 ms. Trace:
I20260812 19:25:02.709654  6344 rpcz_store.cc:276] 0812 19:25:01.586260 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:01.586588 (+   328us) service_pool.cc:227] Handling call
0812 19:25:01.587040 (+   452us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:01.738011 (+150971us) raft_consensus.cc:1520] Early marking committed up to index 13
0812 19:25:01.779988 (+ 41977us) log.cc:842] Serialized 14 byte log entry
0812 19:25:01.988693 (+208705us) log.cc:842] Serialized 14 byte log entry
0812 19:25:02.032617 (+ 43924us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:02.032666 (+    49us) raft_consensus.cc:1631] Marking committed up to 13
0812 19:25:02.032709 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:02.676416 (+643707us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540003f7d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:02.676463 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:02.676589 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":97773,"prepare.queue_time_us":44841,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":87,"raft.queue_time_us":43835,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"spinlock_wait_cycles":362297472,"thread_start_us":177347,"threads_started":1,"wal-append.queue_time_us":248942}
I20260812 19:25:02.677428 17185 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:02.711961 17185 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:02.712842 17185 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.714306 17185 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:25:02.677999 17202 consensus_queue.cc:1159] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdfa5579d4534c618c00db6b4a841c81" responder_term: 20 status { last_received { term: 20 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 20 index: 10 } }
I20260812 19:25:02.678161 17138 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.669775 16971 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19.
I20260812 19:25:02.675908 17194 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:02.675282 17137 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.722913 17384 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:02.723739 17384 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:02.724104 17384 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:02.724437 17384 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:02.730089  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3089) took 1364 ms. Trace:
I20260812 19:25:02.730541  6228 rpcz_store.cc:276] 0812 19:25:01.365604 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:01.368034 (+  2430us) service_pool.cc:227] Handling call
0812 19:25:01.368400 (+   366us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:01.566089 (+197689us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:01.566120 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:01.566161 (+    41us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:01.566203 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:02.729851 (+1163648us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400179154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:02.729899 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:02.730026 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":454196608}
I20260812 19:25:02.731856  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:02.732827 17321 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:25:02.733337 17321 raft_consensus.cc:686] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:02.734251 17321 consensus_queue.cc:237] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.735062 17414 raft_consensus.cc:3032] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:02.735508 17414 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:25:02.736052 17400 consensus_meta.cc:287] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260812 19:25:02.736361 17414 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.737639 17389 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:25:02.738281 17335 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:25:02.739755 17379 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:02.740357 17194 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:02.740731 17248 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.740876 17194 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.746817  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:02.748217  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:02.746913  6235 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:02.750164  6235 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:02.755851  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:02.736495 17400 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:02.759215  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 139530us
I20260812 19:25:02.759549  6224 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:02.751247  6235 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:02.762194  6235 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:02.764992  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2703) took 1176 ms. Trace:
I20260812 19:25:02.772341  7597 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:02.765576  6347 rpcz_store.cc:276] 0812 19:25:01.588188 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:01.588870 (+   682us) service_pool.cc:227] Handling call
0812 19:25:01.589279 (+   409us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:01.589587 (+   308us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:25:01.624592 (+ 35005us) log.cc:842] Serialized 14 byte log entry
0812 19:25:02.710848 (+1086256us) spinlock_profiling.cc:243] Waited 6.61 ms on lock 0x7b180035d220. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff57b
0812 19:25:02.764527 (+ 53679us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:02.764609 (+    82us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:25:02.764674 (+    65us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:02.764766 (+    92us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:02.764917 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":53357,"prepare.queue_time_us":35451,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":2145,"spinlock_wait_cycles":15210240,"thread_start_us":32396,"threads_started":1,"wal-append.queue_time_us":157586}
I20260812 19:25:02.782959  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:02.749496 17414 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:25:02.800853  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 181025us
I20260812 19:25:02.802088  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0715e834130d426f8038cf97eecb0687"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:02.802795  6347 raft_consensus.cc:595] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:02.803092  6347 raft_consensus.cc:603] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:02.814751  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:02.767364 16984 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:02.767498 17389 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:25:02.669641  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 51152.6us
I20260812 19:25:02.820003  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:02.770273 17347 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:02.787307 17386 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:02.827693 17413 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:02.822209  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:02.796134 16258 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:02.827457 16679 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:02.826910 16703 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:02.867241 16971 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:02.879436 17392 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:02.930836 16258 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.933219 16258 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:02.934540 17458 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.950s	user 0.003s	sys 0.010s
I20260812 19:25:02.935945  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 1041) took 1385 ms. Trace:
I20260812 19:25:02.851284 17187 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.874513 17384 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.850427  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:02.841954  6235 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260812 19:25:02.840354 17413 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.941483 17413 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.906126 17358 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:02.941783 17384 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.943635 17358 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:02.943769 17384 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:02.944341 17384 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:02.849252  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 331506us
I20260812 19:25:02.829034 17321 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:02.830329 17347 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:02.841555 17137 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:02.832520 17386 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.818492 17248 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:02.817664 17201 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:02.828331 17194 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.883003 17389 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:02.922780  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 100673us
I20260812 19:25:02.982170  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:02.984591 17277 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:02.985010 17277 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:02.985378 17277 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:02.924837 16679 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:02.986230 16679 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:02.986774 17384 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:02.925987  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2692) took 1794 ms. Trace:
I20260812 19:25:02.926424 16833 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:02.993673 16833 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:02.993566  6342 rpcz_store.cc:276] 0812 19:25:01.131867 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:01.132025 (+   158us) service_pool.cc:227] Handling call
0812 19:25:01.132306 (+   281us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:02.351984 (+1219678us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:02.925685 (+573701us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002d05d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:02.925920 (+   235us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2704315264}
I20260812 19:25:02.928480 16971 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:02.994951  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:02.995592  6342 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:02.996014 16971 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.939193  6235 pending_rounds.cc:76] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 12
I20260812 19:25:02.996400 17400 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:02.996630  6235 pending_rounds.cc:97] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260812 19:25:02.997133  6235 raft_consensus.cc:2866] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:02.998267  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:03.000694 17383 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260812 19:25:02.996615  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:03.004004 17465 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.041s	user 0.005s	sys 0.007s
I20260812 19:25:02.936434  6359 rpcz_store.cc:276] 0812 19:25:01.550764 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:01.550896 (+   132us) service_pool.cc:227] Handling call
0812 19:25:01.551222 (+   326us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:01.551557 (+   335us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:01.551579 (+    22us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:01.552014 (+   435us) log.cc:842] Serialized 26 byte log entry
0812 19:25:01.736967 (+184953us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:01.737048 (+    81us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:01.737115 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:02.934205 (+1197090us) spinlock_profiling.cc:243] Waited 8.69 ms on lock 0x7b240013cb08. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f46b4cf4 00007f98f46b2dfb 00007f98f4741559 00007f98f47411e5 00007f98f474082d 00007f98f73e346e 00007f98f73fac0c 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551
0812 19:25:02.935547 (+  1342us) raft_consensus.cc:1671] finished
0812 19:25:02.935579 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:02.935874 (+   295us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":5745,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":20511,"spinlock_wait_cycles":19983104,"thread_start_us":184524,"threads_started":1,"wal-append.queue_time_us":263811}
I20260812 19:25:03.005282  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:02.947985  6353 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 20 index: 8. (index mismatch)
I20260812 19:25:02.951629  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.006721  6242 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:02.952279  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:25:02.934562 17475 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.445s	user 0.001s	sys 0.002s
I20260812 19:25:02.955170  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.006801  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:02.955915  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:02.956113  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:03.007711  6353 raft_consensus.cc:2354] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20.
I20260812 19:25:03.007798  6354 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:03.008708  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:02.939695  6347 raft_consensus.cc:595] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:02.958432  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:02.960251  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:02.961417  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:02.962381  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2522) took 1151 ms. Trace:
I20260812 19:25:02.964797  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:02.964891 17321 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:02.966367  6229 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260812 19:25:02.958470 17335 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:02.967451  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:02.969378 17347 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:02.961030 17137 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.024701  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:03.026147 17137 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:03.026789  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2705) took 1312 ms. Trace:
I20260812 19:25:02.976802 17187 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:02.958669 17392 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:03.027654 17392 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.027164  6232 rpcz_store.cc:276] 0812 19:25:01.714714 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:01.749782 (+ 35068us) service_pool.cc:227] Handling call
0812 19:25:01.750233 (+   451us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:01.750719 (+   486us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:01.750806 (+    87us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:01.965639 (+214833us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b2c0006c608. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:25:01.984932 (+ 19293us) log.cc:842] Serialized 26 byte log entry
0812 19:25:02.279094 (+294162us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:02.279157 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:02.279259 (+   102us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:02.933732 (+654473us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:25:03.026557 (+ 92825us) raft_consensus.cc:1671] finished
0812 19:25:03.026580 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:03.026732 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16258,"raft.queue_time_us":2744,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":27569,"spinlock_wait_cycles":96497408,"thread_start_us":293752,"threads_started":1,"wal-append.queue_time_us":348239}
I20260812 19:25:02.994165 16833 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:03.007230  6238 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:03.032104 17321 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:03.032966 17335 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:03.035185 17335 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:03.038100  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:03.038976  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:03.039960  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:03.041132 17392 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:03.041153  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 2567) took 1364 ms. Trace:
I20260812 19:25:03.042038  6352 rpcz_store.cc:276] 0812 19:25:01.676917 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:01.725751 (+ 48834us) service_pool.cc:227] Handling call
0812 19:25:03.040988 (+1315237us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b540025ec54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:03.041096 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":741827968}
I20260812 19:25:03.041900  6344 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:03.043156  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:25:02.946486  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 178883us
I20260812 19:25:03.045790  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.048487  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:03.049124  6465 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 20
I20260812 19:25:03.051074  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.053543  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:03.054266  6483 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:03.010245  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:03.010885  6481 rpcz_store.cc:276] 0812 19:25:01.811326 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:01.812583 (+  1257us) service_pool.cc:227] Handling call
0812 19:25:01.812869 (+   286us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:02.069511 (+256642us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:02.069564 (+    53us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:02.069626 (+    62us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:02.069676 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:02.962084 (+892408us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b5400271854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:02.962149 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:02.962314 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":589508992}
I20260812 19:25:03.011761  6236 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 18: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:03.012112  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.010377  6349 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:03.015959  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:03.056434  6345 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 18: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:03.057739  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.017369  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:03.017697  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:03.056514  6353 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:03.058041  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:02.957870  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:03.075268  6465 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:03.078116  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:25:03.016677  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 188924us
I20260812 19:25:03.077023  6477 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:25:03.082998  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.060243  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:03.084188  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 126450us
I20260812 19:25:03.084497  6352 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:03.085042  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:03.057273  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.085925  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:03.057811  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.087193  6228 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:03.087440  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:03.018251  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:03.078019  6347 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:02.996071 17386 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:03.090613  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:25:03.091006  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:03.143944  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.090790  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:03.146616  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:03.095222  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.148346  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.149359  6242 raft_consensus.cc:2396] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 19 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260812 19:25:03.095307  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:03.057469  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.016469 17358 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:03.150269  6481 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:03.098121  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.099928  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.102308  7599 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260812 19:25:03.103003  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:03.107184  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:03.109447  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:25:03.112010  6475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33386 (request call id 1052) took 1709 ms (client timeout 2238 ms). Trace:
W20260812 19:25:03.152740  6475 rpcz_store.cc:269] 0812 19:25:01.402969 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:02.286591 (+883622us) service_pool.cc:227] Handling call
0812 19:25:03.111784 (+825193us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54003ef8d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:03.111936 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":547414912}
I20260812 19:25:03.121834 16833 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.122700 17347 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:03.125077  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:03.129321 17250 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:25:03.130061  6416 leader_election.cc:398] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20.
I20260812 19:25:03.130916 17400 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 19:25:03.131590 16795 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 19:25:03.056842 17514 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:03.133148  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.164979  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:03.133162  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:03.166051  6345 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:03.164546  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:03.141680  6238 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:03.146873  6347 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:03.091698  6354 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:03.154605  6416 leader_election.cc:401] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:25:03.156939  6344 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:25:03.160283  6353 raft_consensus.cc:2379] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 19: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:25:03.151106  6236 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:03.163842  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:03.175032  6228 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:03.175940  6344 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260812 19:25:03.179679  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 49768.6us
I20260812 19:25:03.184296  6224 raft_consensus.cc:2354] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21.
W20260812 19:25:03.185422  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 167254us
I20260812 19:25:03.186854  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:03.186884  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:03.160108 17392 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:03.185422  6416 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:03.190917  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:03.185652  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:03.183655 17075 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:03.204020  6347 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:25:03.207542  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:03.209439  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:03.162956 17358 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.180666 17514 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.211493 17303 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:03.212723 17358 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:03.212978  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:03.212731  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:03.169334 17353 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:03.222203  6345 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
W20260812 19:25:03.213936  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 04c512eaceae43d2a378065361eb4854, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.184808 17250 raft_consensus.cc:686] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:03.228140  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:03.223807  6241 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:03.230573  6483 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:03.221371  6342 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
W20260812 19:25:03.248595  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 04c512eaceae43d2a378065361eb4854, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.223415  6228 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:03.190007 17335 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20.
I20260812 19:25:03.254788  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:03.255030  6342 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260812 19:25:03.198915 17347 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:03.256052  6353 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:03.264345  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:03.202044 17330 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:03.270494 17330 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:03.256006  6342 pending_rounds.cc:76] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 10
I20260812 19:25:03.272572  6342 pending_rounds.cc:97] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260812 19:25:03.212846 17386 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:03.272953  6342 raft_consensus.cc:2866] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:03.273284 17386 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:03.275092 17330 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:03.258509  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:03.277029  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:03.278395 17347 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:03.278587  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:03.279346 17506 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:03.280398 17347 raft_consensus.cc:686] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:03.281436 17244 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:25:03.212809 17514 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:03.262599  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:03.282227 17347 consensus_queue.cc:237] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.274631 17386 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.258462  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:03.206943 17464 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:03.256575  6298 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:03.283104  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:03.298190  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.224131 17504 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260812 19:25:03.306438  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 48078us
I20260812 19:25:03.301822  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:03.250082 17337 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:03.303324  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.304104  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.311004  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:03.311214  6477 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:25:03.304587  6464 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:03.256302 17138 raft_consensus.cc:2741] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260812 19:25:03.287837 17358 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:03.255988 17225 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:03.282189 17244 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:03.305632  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:03.305338  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 48856.6us
I20260812 19:25:03.314364  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:03.318321  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.316531  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.206687 17392 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.322865  6475 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:03.317229  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:03.322074  6481 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:03.314397  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:03.325634  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:03.326562  6474 raft_consensus.cc:2354] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 15. Current term is 16.
I20260812 19:25:03.252118 17353 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.301368 17464 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:03.288391 16184 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260812 19:25:03.350806 16984 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:25:03.332703  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:03.332001  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:03.352598 17260 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:03.352648  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:03.333043 17225 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:03.334905  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:03.355217  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:03.356628 17309 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:25:03.356004 17330 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.357187 17309 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:03.358107 17309 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:03.358776 17330 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:03.359898 17413 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:03.360365 17413 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:03.360793  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:03.361181 17413 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.362634  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:03.362839 16960 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:03.363613 17506 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:03.316494 17335 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:03.370630  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:03.371697  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:03.372512  6470 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:03.308985 16795 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election won for term 20
W20260812 19:25:03.338258 17512 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260812 19:25:03.332265 17476 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:03.339682  6475 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260812 19:25:03.317382 17514 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260812 19:25:03.342087  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.401934  6474 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:03.334623 17455 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:03.344190 17353 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:03.328703 17194 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:03.316891 17325 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:03.415124 17325 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:03.415238  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.415714 17325 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:03.416920  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.417670  6475 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:25:03.351140  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:03.306852 17504 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:03.353997  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:03.316658 17205 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:03.356058  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:25:03.440167  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 84176.9us
I20260812 19:25:03.366237  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:03.313344 17384 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:03.316569 17358 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:03.363500 17250 consensus_queue.cc:237] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:03.362839 17389 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:03.389439 17335 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:03.354223 17225 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.391494 17400 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 19:25:03.343052  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.449793  6477 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:25:03.367334 17464 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:03.411187  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.432124  6465 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
W20260812 19:25:03.437741  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 83824.6us
I20260812 19:25:03.392416 17506 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:03.398180 17476 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:03.457533  6474 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:25:03.437080 16833 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:03.447789 17277 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:03.473933 17519 log.cc:924] Time spent T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260812 19:25:03.475384  6230 raft_consensus.cc:2354] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20.
I20260812 19:25:03.438969 17504 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:03.467561  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:03.446806 17358 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:03.446018 17396 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:03.443506 17361 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:03.439124 17455 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:03.451889 17205 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:03.491385  6228 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:03.496114  6359 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:03.452090 17244 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.450817 17400 consensus_queue.cc:1225] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 17.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260812 19:25:03.506258  6465 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:03.501981  6470 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:25:03.486871  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.534863  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.573310  6241 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:25:03.574581  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:03.536077 17396 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:03.472941 17476 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
W20260812 19:25:03.509040 17516 log.cc:924] Time spent T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260812 19:25:03.507479 16258 raft_consensus.cc:979] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:25:03.590288 17260 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:03.591741  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 208852us
I20260812 19:25:03.509398 17384 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:03.627414  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:03.630398  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:03.587538 17177 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260812 19:25:03.601549 16679 consensus_meta.cc:287] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.003s
I20260812 19:25:03.599148 17396 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:03.606364 16184 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:25:03.628921 17510 raft_consensus.cc:1067] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Signalling peer bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:25:03.572569 17361 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:03.633571 17384 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:25:03.644475  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 200275us
I20260812 19:25:03.665895  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:03.666399  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:03.666783  6359 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:03.667135 17347 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:03.669519  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:03.670099  6350 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260812 19:25:03.670881 17517 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260812 19:25:03.663709 17309 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260812 19:25:03.643028 16679 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:03.677083  6359 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:03.668006 17347 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:03.689944 17347 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:03.694944 17347 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:03.693531 17361 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:03.655124 17205 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.633239 17260 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.659228 17384 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:03.677214 16679 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:03.645157 17277 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:03.717352  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 497721us
I20260812 19:25:03.748979  6350 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260812 19:25:03.752334  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:03.753212  6350 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:25:03.640470 16795 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:03.757437  6352 raft_consensus.cc:595] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:03.759155  6352 raft_consensus.cc:603] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:03.717820 17392 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:03.759634  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:03.769381  6241 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 19
I20260812 19:25:03.742524 16679 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260812 19:25:03.773859 17260 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:03.784889  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:03.789014  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:03.693609 17464 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.760653 17335 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:03.788218 17392 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:03.806740 16703 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:25:03.826040  6241 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 19.
W20260812 19:25:03.827593  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 197314us
I20260812 19:25:03.829170  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:03.829573  6465 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260812 19:25:03.831300  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 206156us
I20260812 19:25:03.832226  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:03.805512 17361 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260812 19:25:03.830322  7553 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:03.833032  6474 raft_consensus.cc:3037] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:03.833137  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.819736 17504 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.820604 17400 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:03.836750 17400 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.837930 17504 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:03.823634 17541 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:03.822299 17392 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.839051 17541 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.840708 17392 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:03.841233 17541 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:03.844079 17510 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 19:25:03.845880 17510 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:25:03.846195 17514 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:03.846678 17514 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:03.838873 17400 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:03.831248 16813 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:03.847499 17514 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.848773 17514 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:03.851379 17325 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.853480 17325 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:03.848722  6241 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:03.859769 17361 raft_consensus.cc:2781] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:03.860355 17361 raft_consensus.cc:686] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 19 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:03.861079  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.861460 17361 consensus_queue.cc:237] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:03.864571 17347 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.872864  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:03.873865  6359 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:03.822589 16703 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:03.881541  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:03.882843  6344 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:03.879830  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.888882  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.890010  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:03.892597  6344 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 18: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:03.895493  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.901947  6241 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:03.902870  6238 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:25:03.906332  6235 raft_consensus.cc:1203] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 11.5->[13.6-18.9]   Dedup: 15.7->[16.8-18.9]
I20260812 19:25:03.924391  6235 pending_rounds.cc:76] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 7
I20260812 19:25:03.924757  6235 pending_rounds.cc:97] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260812 19:25:03.925050  6235 raft_consensus.cc:2866] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:03.908515  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:03.926369  6344 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:03.927371  6359 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:25:03.889065 16703 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:03.939990  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:03.940748  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.941984  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:03.945158 17474 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.474s	user 0.000s	sys 0.008s
I20260812 19:25:03.946376 17464 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:03.946619 17539 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260812 19:25:03.832015 16795 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.948616  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2523) took 2137 ms. Trace:
I20260812 19:25:03.949416 17396 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:03.951243 17536 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260812 19:25:03.952055 17414 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:25:03.952999 17476 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:03.954042 16971 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 19:25:03.891333 17347 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:03.957123  6232 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 19: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:03.957351  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:03.958643  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:03.960949  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:03.962276  6477 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:25:03.962366  6473 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:25:03.959945  6474 raft_consensus.cc:2454] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 19.
W20260812 19:25:03.936187 17529 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260812 19:25:03.949080  6482 rpcz_store.cc:276] 0812 19:25:01.811636 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:01.812003 (+   367us) service_pool.cc:227] Handling call
0812 19:25:01.812335 (+   332us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:01.812681 (+   346us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:01.812709 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:01.813211 (+   502us) log.cc:842] Serialized 26 byte log entry
0812 19:25:02.249137 (+435926us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:25:02.249180 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:02.249319 (+   139us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:03.805901 (+1556582us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:25:03.948218 (+142317us) raft_consensus.cc:1671] finished
0812 19:25:03.948244 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:03.948519 (+   275us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":455,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":153951488,"thread_start_us":435600,"threads_started":1,"wal-append.queue_time_us":503702}
I20260812 19:25:03.970818  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:03.972235  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:03.973292  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:03.974572  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:03.975008  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:03.975634  6353 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:03.976145  6344 raft_consensus.cc:2396] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 21 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260812 19:25:03.976447  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:03.976537  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:03.979372  6416 leader_election.cc:398] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21.
I20260812 19:25:03.979526  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:03.980703  6344 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 18: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:03.980660  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:03.981722  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:03.982008  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:03.977798  6474 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:03.984109  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:03.984191  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.985222  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.985982  6238 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 21: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:03.987298  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:03.985759  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:03.988145  6238 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:03.988620  6242 raft_consensus.cc:2354] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19.
I20260812 19:25:03.990010  6242 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:03.992204  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:03.957647 17194 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:04.000053  6242 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260812 19:25:04.009167  6475 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 15. Current term is 16. Ops: []
I20260812 19:25:04.010095  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:04.008584  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 55935.2us
I20260812 19:25:03.966589 17347 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:25:04.011106  6474 raft_consensus.cc:2379] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:03.980559 17544 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:25:03.968614 17551 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:04.005002 17250 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:03.998095 17541 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:04.040333 17551 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:03.997854 17542 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:25:04.032151 17553 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:04.050056 17551 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:04.069653  6241 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:04.072880 17192 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:04.072307 17551 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.076915 17551 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:04.004621 17400 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260812 19:25:04.040932 17347 raft_consensus.cc:686] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:04.044812 17476 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:04.094571 17484 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 1.492s	user 0.007s	sys 0.000s
I20260812 19:25:04.097867  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2594) took 1077 ms. Trace:
I20260812 19:25:04.027472 17194 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.098388  6354 rpcz_store.cc:276] 0812 19:25:03.020739 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:03.172404 (+151665us) service_pool.cc:227] Handling call
0812 19:25:03.172653 (+   249us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:03.351802 (+179149us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:25:03.601914 (+250112us) log.cc:842] Serialized 14 byte log entry
0812 19:25:03.814834 (+212920us) log.cc:842] Serialized 14 byte log entry
0812 19:25:03.819773 (+  4939us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:03.819843 (+    70us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:25:03.819901 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:04.096856 (+276955us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b180038b480. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9
0812 19:25:04.097556 (+   700us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540009ecd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:04.097612 (+    56us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:04.097795 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3758,"prepare.queue_time_us":309602,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":6868,"spinlock_wait_cycles":431716224,"thread_start_us":457303,"threads_started":2,"wal-append.queue_time_us":272819}
I20260812 19:25:04.103957  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:04.104859  6473 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:04.049046 17544 raft_consensus.cc:686] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:04.039522 17384 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:04.114305  6474 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:38150
I20260812 19:25:04.117148  6474 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:25:04.119660  6474 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:04.121641  6353 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:04.125029  6473 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260812 19:25:04.149936  6349 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260812 19:25:04.153040  6241 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:04.157838  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:04.156569 17118 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260812 19:25:04.152413 16718 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:04.169715 16718 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:04.172094 16718 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:04.152441 17192 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:04.172853 17192 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.177475  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:04.179126  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:04.149688 17396 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:04.181111  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 188978us
I20260812 19:25:04.181685  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:04.175071 17192 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:04.187039  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:04.176529 16184 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:04.207525  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:04.125664 16703 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:04.187887 17205 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:04.216637  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:04.221045  6416 leader_election.cc:398] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19.
I20260812 19:25:04.221467  6416 leader_election.cc:401] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260812 19:25:04.221225  6474 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:04.224687 17403 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:04.224983  6474 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:04.209575 16184 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:04.214102 17187 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:04.175402 17576 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260812 19:25:04.239243  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:25:04.239923 17569 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260812 19:25:04.240000  7594 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:04.247617 17586 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:04.189392  6049 catalog_manager.cc:5495] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 13 to 15, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 15 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:04.249387  6049 catalog_manager.cc:5495] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 16, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 16 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
W20260812 19:25:04.251389 17581 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260812 19:25:04.184223 17347 consensus_queue.cc:237] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.252349  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2710) took 1302 ms. Trace:
W20260812 19:25:04.253036  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet f4ae22a8efcc4f26bdc2d4cc4266111a, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:04.253394  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet f4ae22a8efcc4f26bdc2d4cc4266111a, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:04.255510 17358 consensus_meta.cc:287] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.680s	user 0.013s	sys 0.000s
I20260812 19:25:04.255980 17358 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.257941  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49464 (request call id 94) took 1071 ms. Trace:
I20260812 19:25:04.258337  6352 rpcz_store.cc:276] 0812 19:25:03.186284 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:03.186640 (+   356us) service_pool.cc:227] Handling call
0812 19:25:04.257731 (+1071091us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b540003fcd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7772bc3 00007f98fc6bc81a 00007f98f5dbbd04 00007f98f5dbbc92 00007f98f5dbbbc1 00007f98f5dbbb3c 00007f98f5dbadf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:04.257856 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1307793280}
I20260812 19:25:04.258965  6229 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 20: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:04.255532 17504 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260812 19:25:04.209028 17544 consensus_queue.cc:237] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.261955  6228 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:25:04.262372 16703 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:04.267395  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 89d6b10f5ff448f592a41c3a77692cfe, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:04.267513 17563 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.225s	user 0.002s	sys 0.000s
W20260812 19:25:04.267885  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 89d6b10f5ff448f592a41c3a77692cfe, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.269567 17384 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:04.271183  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:04.272056 17389 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:04.272477 17389 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:04.272876 17389 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
W20260812 19:25:04.234455 17554 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.194s	user 0.001s	sys 0.001s
I20260812 19:25:04.272478  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:04.276899 17541 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:04.231280 17551 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:04.229260 17386 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260812 19:25:04.278415  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:04.259867  6242 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260812 19:25:04.252768 17400 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 20.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.029s
I20260812 19:25:04.278882 17177 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:04.283245 17551 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:04.283665 17551 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:04.233560 16184 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:04.278252  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:04.287786  6232 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 20: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:04.282104 17177 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:25:04.283937  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 46216.6us
I20260812 19:25:04.277570 17358 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:04.297525 17201 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:04.236315 17187 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:04.252751  6230 rpcz_store.cc:276] 0812 19:25:02.949473 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:02.952724 (+  3251us) service_pool.cc:227] Handling call
0812 19:25:04.252117 (+1299393us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54002fd854. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:04.252258 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1047494016}
I20260812 19:25:04.300305 17321 raft_consensus.cc:3032] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:04.304949  6347 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260812 19:25:04.305938  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:04.331832  6344 raft_consensus.cc:3032] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:25:04.307078  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:04.332351  7597 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 14. Current term is 15. Ops: []
I20260812 19:25:04.332446  6345 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:04.308198  6354 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260812 19:25:04.251299 17194 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:04.262349  6228 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:04.282517  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:04.341104  6350 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:04.315176  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:04.341976  6352 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:04.345650  6347 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:04.346587  6347 raft_consensus.cc:595] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
W20260812 19:25:04.316828  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.653s (SENT)
I20260812 19:25:04.319772  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:04.356045  6232 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260812 19:25:04.358973  6481 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260812 19:25:04.361718  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:04.363516  6344 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:04.363816  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:04.364785  6344 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:04.366582  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:04.369313  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:04.373152  6416 leader_election.cc:398] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20.
I20260812 19:25:04.376102  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:04.340015  6228 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.377285  6228 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:04.319072 16795 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:25:04.383515  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:04.331650 17187 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:04.325064 17201 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:04.416823  6475 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260812 19:25:04.399276  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:04.330899 17321 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:04.324810 17464 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:04.438817 16795 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:25:04.452536  6342 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260812 19:25:04.448705 17201 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.450295 17250 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:04.475276  7594 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
W20260812 19:25:04.483197  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 95726.4us
I20260812 19:25:04.416801 17293 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:04.471781  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:04.501186  6474 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:04.388206 17542 consensus_queue.cc:1046] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260812 19:25:04.500155  6417 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:04.506636 17542 raft_consensus.cc:3032] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:25:04.507056 17542 raft_consensus.cc:729] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:04.507932 17542 consensus_queue.cc:260] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:04.509240 17542 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:04.515028  6353 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 15. Current term is 16. Ops: []
I20260812 19:25:04.517035  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:04.505434  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:04.557646  6342 raft_consensus.cc:595] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
W20260812 19:25:04.522362  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 305489us
I20260812 19:25:04.558187  6342 raft_consensus.cc:603] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:04.559497  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:04.560854  6242 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:04.564002  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:04.567843  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:04.497843 17464 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.576025 17464 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:04.560410 17250 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:25:04.501374 17321 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.579327  6473 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260812 19:25:04.579685 17321 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
W20260812 19:25:04.580502  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 66764.4us
I20260812 19:25:04.582154 17414 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:04.582756 17414 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.584901 17414 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:04.585480 17250 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:04.586650 17250 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:04.581365  6049 catalog_manager.cc:5495] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 11 to 12, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 12 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:04.591490  6049 catalog_manager.cc:5495] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:04.595760  6347 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:25:04.564970  6242 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:25:04.599443  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:04.603252  6345 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:04.604657  6352 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:25:04.614737  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:04.615453  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260812 19:25:04.616760  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 241671us
I20260812 19:25:04.617448  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:25:04.618285  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:04.622920  6474 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:04.628310  6350 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:04.630311  6228 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260812 19:25:04.631613  6228 pending_rounds.cc:76] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 8
I20260812 19:25:04.633071  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:04.631942  6228 pending_rounds.cc:97] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260812 19:25:04.634123  6228 raft_consensus.cc:2866] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:04.635180  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:04.636194  6475 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
W20260812 19:25:04.610895 17335 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.016s	sys 0.024s
I20260812 19:25:04.644759  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:04.600196 17201 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:04.647226  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:04.593062 16703 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260812 19:25:04.606849 17586 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19.
I20260812 19:25:04.658809  7594 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
W20260812 19:25:04.644773 17335 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.016s	sys 0.025s
W20260812 19:25:04.676947 17599 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260812 19:25:04.652963 17602 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:04.512086 17293 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:04.640378 17389 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.637712 17205 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:04.632409 17075 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:25:04.690428  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:04.652819 17577 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:04.695398  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:04.696941  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 380122us
I20260812 19:25:04.698689  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:04.691963  6232 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260812 19:25:04.720865  6465 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260812 19:25:04.656960 16960 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:04.642830 16184 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.734261  6350 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260812 19:25:04.632673 17177 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.744745  6354 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:04.749953  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:04.734972  6232 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:04.644963 17576 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260812 19:25:04.701879 17602 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:04.762024  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:04.763298  6345 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:04.727527 16960 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:04.722357 16971 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:04.744156 17400 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:04.706997 17586 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260812 19:25:04.709219 17353 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260812 19:25:04.713318 17244 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260812 19:25:04.820194 17177 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:04.821527 17244 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:04.823583  7607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 828) took 1053 ms. Trace:
I20260812 19:25:04.824107  7607 rpcz_store.cc:276] 0812 19:25:03.781041 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:03.787951 (+  6910us) service_pool.cc:227] Handling call
0812 19:25:03.806709 (+ 18758us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:03.809894 (+  3185us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:03.809932 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:04.382317 (+572385us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b2c0005cf38. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:25:04.418749 (+ 36432us) log.cc:842] Serialized 26 byte log entry
0812 19:25:04.649753 (+231004us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:04.649790 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:04.649855 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:04.823100 (+173245us) raft_consensus.cc:1671] finished
0812 19:25:04.823136 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:04.823501 (+   365us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3383,"raft.queue_time_us":4690,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":3690,"spinlock_wait_cycles":5388544,"thread_start_us":168057,"threads_started":1,"wal-append.queue_time_us":285310}
I20260812 19:25:04.790479 17330 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:04.715471 17356 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260812 19:25:04.803191 16184 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:04.791090 16971 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.838032 17187 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.839609  6359 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260812 19:25:04.839449 16971 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:04.807950 17293 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:04.783802 16960 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:04.843221 17187 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:04.830358 17598 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.352s	user 0.000s	sys 0.002s
I20260812 19:25:04.809494  6481 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:04.810205 17400 raft_consensus.cc:686] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:25:04.853961 17591 log.cc:924] Time spent T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260812 19:25:04.854249 17400 consensus_queue.cc:237] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.779958 17337 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:04.780304 17542 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260812 19:25:04.779639 17602 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:04.685596  6049 catalog_manager.cc:5495] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 10 to 16, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 16 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:04.858996  6049 catalog_manager.cc:5495] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:25:04.814234 17551 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.005s
I20260812 19:25:04.865892 17551 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.861409  6049 catalog_manager.cc:5495] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 18 to 19, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 19 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:04.867767  6464 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 18: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:04.815321 17389 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:04.799284 17502 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.020s
W20260812 19:25:04.869635  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 160884us
I20260812 19:25:04.912904  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:04.919947  6224 raft_consensus.cc:2379] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 19: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:04.822387 17244 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:04.921703  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 142227us
I20260812 19:25:04.922914 17389 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 19:25:04.924332 17586 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:04.924645  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:04.924759 17586 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:04.925993 17586 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:04.927644 17586 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:04.928779  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:04.929582  6224 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 21: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:25:04.932993  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 171076us
I20260812 19:25:04.934432  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:04.869063 17551 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:04.932576  6350 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:04.948243  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:04.958230  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:04.962302  6224 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:04.966296  6178 leader_election.cc:398] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 15. Current term is 16.
I20260812 19:25:04.986718  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:04.987574  6473 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:04.989215  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:04.994117  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:04.957567 17464 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:25:05.009330  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:05.011797  6236 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:05.010157  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:05.018167  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:05.021751  6465 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 19: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:05.022472  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:05.012843  6224 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:04.938421 17337 consensus_queue.cc:1046] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.067s
I20260812 19:25:05.053246  6473 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:05.038115  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:05.109170  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 82694us
I20260812 19:25:05.112771  6236 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
W20260812 19:25:05.114535  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 76513.7us
W20260812 19:25:05.121495  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 118879us
I20260812 19:25:05.145347  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:05.153910  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:04.868822  6049 catalog_manager.cc:5495] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 10 to 16, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 16 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:05.007748 16184 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:05.007827 17358 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:05.160844  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:05.173280  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:25:05.153270 17570 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260812 19:25:05.043457 17075 raft_consensus.cc:686] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 15 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:05.173905  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:05.112720 17277 raft_consensus.cc:2741] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260812 19:25:05.177270 16984 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:05.103132 17293 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260812 19:25:05.152446 17396 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:05.147765 17260 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:05.167543 17484 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260812 19:25:05.213021  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 277521us
I20260812 19:25:05.146610 17541 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260812 19:25:05.223932  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 47592.6us
I20260812 19:25:05.191390 17383 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:25:05.213454 16971 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:05.174906 16184 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:05.177944 17358 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:05.296486  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 151240us
I20260812 19:25:05.261503 17514 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:05.279881 17383 raft_consensus.cc:3032] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:25:05.212625 17577 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
W20260812 19:25:05.319682  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 209648us
W20260812 19:25:05.300868 17597 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260812 19:25:05.274063 17335 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:05.245520 17260 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:05.349324 17623 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
I20260812 19:25:05.324632 17194 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:05.337731 17244 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:05.338433 17383 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:05.344802 17661 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:05.360738  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 54030.7us
W20260812 19:25:05.379505 17625 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.123s	user 0.001s	sys 0.001s
W20260812 19:25:05.381739 17584 log.cc:924] Time spent T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.899s	user 0.005s	sys 0.003s
I20260812 19:25:05.278671  6049 catalog_manager.cc:5495] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:05.388276 17358 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:05.344763 17514 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:05.399101 16184 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:05.365263 17541 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:05.365985 17335 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:05.400053 17383 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:05.402987 17624 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.380s	user 0.002s	sys 0.000s
I20260812 19:25:05.358459 17602 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:05.323137 17075 consensus_queue.cc:237] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:05.405620 16971 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:25:05.433645 17597 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260812 19:25:05.408020 16984 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:05.374958 17194 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:05.468333 17506 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:05.493552 17657 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:05.608850 17576 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:05.689611 17506 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:05.405820 17661 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:05.696549 17400 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.000s	sys 0.027s
I20260812 19:25:05.646742 17586 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:05.662714 17383 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:05.494702 17541 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:05.542985 17358 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.206s
I20260812 19:25:05.709473 17576 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:05.720770 17321 consensus_meta.cc:287] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.141s	user 0.010s	sys 0.006s
I20260812 19:25:05.721254 17514 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:05.722118 17602 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:05.717108 17400 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.000s	sys 0.031s
W20260812 19:25:05.731557 17635 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.529s	user 0.001s	sys 0.000s
I20260812 19:25:05.691937 17657 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:05.749722 17661 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:05.727586 17586 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:05.793754  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260812 19:25:05.796217  6232 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.051s	sys 0.043s
W20260812 19:25:05.867034  6232 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.052s	sys 0.044s
W20260812 19:25:05.796036  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 349239us
I20260812 19:25:05.798236  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3169) took 1107 ms. Trace:
I20260812 19:25:05.868198 17506 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.8, Last appended by leader: 8, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:05.799149  6230 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.003s	sys 0.003s
W20260812 19:25:05.870435  6230 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.003s	sys 0.003s
I20260812 19:25:05.870159  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:05.801765  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 456298us
W20260812 19:25:05.807219  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.002s	sys 0.010s
I20260812 19:25:05.664110 16971 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:05.811772  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2607) took 1531 ms. Trace:
W20260812 19:25:05.712332 17201 consensus_meta.cc:287] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.028s	user 0.006s	sys 0.009s
I20260812 19:25:05.615088  6344 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:05.833989 16984 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:05.834645 17541 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:05.874676  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.003s	sys 0.011s
W20260812 19:25:05.952035  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 701405us
I20260812 19:25:05.869544  6229 rpcz_store.cc:276] 0812 19:25:04.690462 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:04.690598 (+   136us) service_pool.cc:227] Handling call
0812 19:25:04.720165 (+ 29567us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:04.761308 (+ 41143us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:04.761348 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:04.761856 (+   508us) log.cc:842] Serialized 26 byte log entry
0812 19:25:04.912316 (+150460us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:04.912359 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:05.389367 (+477008us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b540013ea54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:05.389423 (+    56us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:05.797085 (+407662us) raft_consensus.cc:1671] finished
0812 19:25:05.797177 (+    92us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:05.797852 (+   675us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18963,"raft.queue_time_us":19670,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":14820,"spinlock_wait_cycles":49875328,"thread_start_us":150126,"threads_started":1,"wal-append.queue_time_us":430471}
I20260812 19:25:05.870643 17506 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:05.881084 16971 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:05.881412  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.012s	sys 0.023s
W20260812 19:25:05.956233  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.013s	sys 0.023s
I20260812 19:25:05.881268  6359 rpcz_store.cc:276] 0812 19:25:04.280561 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:04.294793 (+ 14232us) service_pool.cc:227] Handling call
0812 19:25:04.295193 (+   400us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:04.840271 (+545078us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:05.810812 (+970541us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b540025f154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:05.811453 (+   641us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1251391232}
W20260812 19:25:05.956723  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 724714us
I20260812 19:25:05.957973  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:05.813881  6049 catalog_manager.cc:5495] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 9 to 16, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 16 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:05.960180  6049 catalog_manager.cc:5495] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 8 to 12, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 12 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:05.806140  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 2618) took 1426 ms. Trace:
I20260812 19:25:05.889127 17358 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:05.962808  6354 rpcz_store.cc:276] 0812 19:25:04.379214 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:04.406447 (+ 27233us) service_pool.cc:227] Handling call
0812 19:25:05.805495 (+1399048us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400410fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:05.805868 (+   373us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":553211264}
I20260812 19:25:05.822045 17499 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:05.827739 17277 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:25:05.964272 17499 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:05.831681 17260 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:05.832352  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 2563) took 1463 ms. Trace:
I20260812 19:25:05.966192  6474 rpcz_store.cc:276] 0812 19:25:04.368609 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:04.368819 (+   210us) service_pool.cc:227] Handling call
0812 19:25:05.831781 (+1462962us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54003eeed4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:05.832088 (+   307us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":298273664}
I20260812 19:25:05.965934 17499 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:05.832829 17194 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:05.967470 17499 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:05.963660 17358 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:05.958037 17330 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:05.852190 17335 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:05.971233 17330 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:05.893771  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:05.973803 17330 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:05.974924 17194 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260812 19:25:05.975085  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 81601.5us
I20260812 19:25:05.976224  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:05.976759  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:05.974478 17277 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:25:05.978369 17277 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:05.894374 17668 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:05.758541 17657 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:05.979456 17668 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:05.981199 17668 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:05.894723 17602 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:05.983753 17602 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:05.894812 16184 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:05.987639 16184 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:05.895213 17386 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:05.895622 17622 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:05.992280 17386 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:05.874748  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:05.914690 17576 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:05.892221 17586 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:05.993984  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 121473us
I20260812 19:25:05.994575 17586 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:05.979060 17138 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260812 19:25:05.995383 17386 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:05.924358  6342 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260812 19:25:05.999897  6232 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:05.990319 16184 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:05.986604 17602 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:05.992286 17622 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.001637  6354 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:05.946715 17476 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:06.002770 17476 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:06.003202 17622 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:06.004166  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:06.001119 17586 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:05.969440  6049 catalog_manager.cc:5495] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:05.895133 17683 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:06.008293 17194 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election won for term 18
W20260812 19:25:06.023559  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 44945.3us
I20260812 19:25:06.018249 17683 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.004191 17476 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.017556 17358 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:06.030593 17683 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:06.033295 17138 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:06.040637 17194 raft_consensus.cc:686] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:06.051476 17476 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:06.047762 17260 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:06.066797 17138 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:06.091598  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.093009  6354 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
W20260812 19:25:06.085455 17544 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.004s	sys 0.018s
I20260812 19:25:06.090449  6344 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
W20260812 19:25:06.116547  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 139988us
I20260812 19:25:06.120355 17335 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:06.121402 16960 consensus_meta.cc:287] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.219s	user 0.024s	sys 0.020s
I20260812 19:25:06.122206 16960 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.124184 17464 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:06.125049 17464 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:06.125733  6350 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 18: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:06.127756  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2763) took 1134 ms. Trace:
I20260812 19:25:06.128196  6350 rpcz_store.cc:276] 0812 19:25:04.993663 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:04.993840 (+   177us) service_pool.cc:227] Handling call
0812 19:25:06.127450 (+1133610us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002d0fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:06.127677 (+   227us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2599767936}
I20260812 19:25:06.125039 16960 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:06.053313  6049 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 13 to 15, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 15 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:06.124191  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:06.138875  6344 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2750) took 1830 ms (client timeout 1615 ms). Trace:
W20260812 19:25:06.142867  6344 rpcz_store.cc:269] 0812 19:25:04.305557 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:04.305683 (+   126us) service_pool.cc:227] Handling call
0812 19:25:05.490470 (+1184787us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b580098dbb0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f76f3f63 00007f98f7757aba 00007f98f776f3af 00007f98f7770b4e 00007f98f777c228 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c
0812 19:25:06.119488 (+629018us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":524771072}
I20260812 19:25:06.090363 17260 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.154937 17612 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.155928 17612 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.156478  6228 raft_consensus.cc:1261] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260812 19:25:06.157831  6483 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 15. Current term is 16. Ops: []
I20260812 19:25:06.158946 17260 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:06.160127  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2558) took 1806 ms. Trace:
I20260812 19:25:06.160521  6483 rpcz_store.cc:276] 0812 19:25:04.353542 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:04.356084 (+  2542us) service_pool.cc:227] Handling call
0812 19:25:04.356480 (+   396us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:06.158309 (+1801829us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:06.159788 (+  1479us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b5400022954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:06.160051 (+   263us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4125314304}
I20260812 19:25:06.170368  6470 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17. Ops: []
I20260812 19:25:06.164796  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.172719 17358 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:06.170249 17657 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:06.177805 17657 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:06.178864  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:06.180858  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.181939  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:06.182819 17248 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:06.183378 17683 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:06.183683 17248 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:06.172381  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3176) took 1600 ms. Trace:
I20260812 19:25:06.191701  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.192996 17358 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.193872 17358 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.195144  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.196018  6344 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:06.196983 17358 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:06.191324  6470 rpcz_store.cc:276] 0812 19:25:04.571749 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:04.572456 (+   707us) service_pool.cc:227] Handling call
0812 19:25:04.572777 (+   321us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:06.171136 (+1598359us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:06.172030 (+   894us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54004457d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:06.172302 (+   272us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3546238720}
I20260812 19:25:06.202543 17541 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:06.203377 17541 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.204952 17551 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.205873 17541 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.206311 17244 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:06.205832 17551 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.207113 17244 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:06.208220 17347 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.208472 17551 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.209113 17551 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.209335 17244 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:06.208977 17347 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.209760 17551 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.211534 17347 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.204703 17657 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:06.213320 17542 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:06.214463 17541 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:06.214159 17542 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.215401 17541 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.216734 17542 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.166325  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2752) took 1185 ms. Trace:
I20260812 19:25:06.217257  6230 rpcz_store.cc:276] 0812 19:25:04.981278 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:04.982707 (+  1429us) service_pool.cc:227] Handling call
0812 19:25:05.020890 (+ 38183us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:05.021109 (+   219us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:25:05.871156 (+850047us) log.cc:842] Serialized 14 byte log entry
0812 19:25:06.118544 (+247388us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:06.137518 (+ 18974us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:06.141321 (+  3803us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:06.147680 (+  6359us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:06.166251 (+ 18571us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8264,"prepare.queue_time_us":391317,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":6245,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":18483,"thread_start_us":939511,"threads_started":2}
I20260812 19:25:06.219645  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3173) took 1652 ms. Trace:
I20260812 19:25:06.220036  6482 rpcz_store.cc:276] 0812 19:25:04.567490 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:04.567617 (+   127us) service_pool.cc:227] Handling call
0812 19:25:04.579796 (+ 12179us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:25:04.588111 (+  8315us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:04.588147 (+    36us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:25:05.655927 (+1067780us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b2c000cda88. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:25:05.656716 (+   789us) log.cc:842] Serialized 52 byte log entry
0812 19:25:06.088882 (+432166us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:25:06.094716 (+  5834us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:06.116133 (+ 21417us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:06.219169 (+103036us) raft_consensus.cc:1671] finished
0812 19:25:06.219191 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:06.219468 (+   277us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7886,"raft.queue_time_us":8325,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":12064000,"thread_start_us":264615,"threads_started":1,"wal-append.queue_time_us":319263}
I20260812 19:25:06.223531 17527 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:06.224574 17527 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:06.205955 17553 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.158358 17612 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.218840 17541 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.226402 17617 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.144613 17586 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.234941  6049 catalog_manager.cc:5495] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 13 to 16, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 16 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:06.232441 17553 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.237937  6228 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:06.230012 17138 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:06.239831  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 115802us
I20260812 19:25:06.165020 17194 consensus_queue.cc:237] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.241118 17361 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:06.241657  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.241880 17347 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.130954 17335 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:06.255187  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 72521.6us
I20260812 19:25:06.186571 17248 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:06.273522  6242 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:06.281276 17347 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.282752 17260 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:06.283488 17260 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.284787 17347 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.285609 17260 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:06.285956 17202 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:06.286976 17361 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:06.289592 17361 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:06.292439 17551 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.292956  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.295398 17527 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:06.298872 17617 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:06.302805  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:06.302271  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 71618.8us
I20260812 19:25:06.304749 17335 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.304575 17527 consensus_queue.cc:1035] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:25:06.305150  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:06.309126 17464 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:06.310340  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:06.311211  7594 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:06.312672  6179 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:06.315946  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:06.317780  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:06.318481  7594 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:25:06.318930  6049 catalog_manager.cc:5495] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 11 to 14, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 14 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:06.320595  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:06.321415  6229 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:06.321548  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:06.320958  6049 catalog_manager.cc:5495] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 11 to 13, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 13 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:06.323202  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.301777 17617 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.286731 17202 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:06.277524  6477 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.004s	sys 0.013s
I20260812 19:25:06.276978 16984 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:06.338423  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.273613 17612 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:06.340615  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:06.345258  6477 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.004s	sys 0.014s
I20260812 19:25:06.336228 17464 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:06.340289 17506 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:06.345293  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.346912  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.358075  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.359638  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:06.363394  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3175) took 1793 ms. Trace:
I20260812 19:25:06.364343  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.328750 17358 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260812 19:25:06.365646  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.366350 17358 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:06.366415  6224 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:06.367834  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.367336  6049 catalog_manager.cc:5495] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 11 to 18, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 18 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:06.368572  6224 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:06.369557  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:06.370779  6224 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 18: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:06.373189 17260 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:06.375921  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:06.366866 17358 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:06.389926  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.402222  6229 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:06.357400 17248 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:06.427491  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.369974  6049 catalog_manager.cc:5495] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 12 to 15, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 15 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:06.430449 16813 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.363816  6477 rpcz_store.cc:276] 0812 19:25:04.569585 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:04.569730 (+   145us) service_pool.cc:227] Handling call
0812 19:25:04.570213 (+   483us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:04.570698 (+   485us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:04.570740 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:05.489620 (+918880us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x7b2c000cda88. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:25:05.490102 (+   482us) log.cc:842] Serialized 26 byte log entry
0812 19:25:06.362830 (+872728us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:06.362887 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:06.362990 (+   103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:06.363054 (+    64us) raft_consensus.cc:1671] finished
0812 19:25:06.363064 (+    10us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:06.363316 (+   252us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":9595,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":106774272,"thread_start_us":855398,"threads_started":1,"wal-append.queue_time_us":659334}
I20260812 19:25:06.442127  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.435711  6235 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:06.445230 17248 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:06.446025 17631 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.447414 17392 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:06.451930 16960 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:06.452805  6353 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260812 19:25:06.452998  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:06.440965  6242 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:06.457096 17553 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.378720 16984 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.428838 17335 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:06.476672 17335 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.406868 17506 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.475629  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:06.393982 17612 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:06.463156  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.407402 17260 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.471575  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.493155 17612 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:06.493485  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 84081.2us
I20260812 19:25:06.495479 17506 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.466969 17683 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:06.496625 17335 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.512219  7594 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260812 19:25:06.498136 17662 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:06.444075 17464 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.518623  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:06.519338  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 66426.5us
I20260812 19:25:06.520745  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.523712  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:06.483873 17383 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:06.508865  6298 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:06.500785 17553 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.524415  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.552867  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:06.523444 17353 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:06.472826 16960 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:06.532598 17383 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:25:06.601032  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 74735.2us
I20260812 19:25:06.571486 17353 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:06.591709 17683 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:06.591243 17194 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:06.509636 16813 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.519917 17392 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.649595 17626 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.650440  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.650727 17293 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.650861 17506 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:06.654616  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:06.650210  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.533514 17662 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.536381 17631 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.623232 17353 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:06.596099 17383 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:06.578908 17464 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.674368  6342 raft_consensus.cc:2396] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260812 19:25:06.680816 17696 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:06.681986  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:06.686244 16984 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:06.686074  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.692930  6482 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 19
I20260812 19:25:06.643189 17683 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:06.597275 17553 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.699204  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:06.670379 17586 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:06.715602  6483 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:25:06.717329  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.606271 17358 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.697796 17330 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:06.724574  6359 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260812 19:25:06.704584 17683 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:06.704504 17626 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:06.776592 17392 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.777153 17626 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:06.734664 17260 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:06.793700  6482 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:06.738699  6477 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:25:06.704038 17293 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.739013 17527 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:06.741391  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.743002  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.743258 17464 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:06.796341  6347 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:06.692199 17277 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:06.698323 17202 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:06.710306 17506 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:06.759493 17724 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260812 19:25:06.764083 17553 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.765808 17662 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:06.561239  6049 catalog_manager.cc:5495] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:06.771098 17248 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:06.771615 16960 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:06.819500  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.829197  6228 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
W20260812 19:25:06.840245 17714 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260812 19:25:06.772195 17586 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:06.843623 17586 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.845906  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:06.773518 17330 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:06.848084 17337 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:06.848636 17330 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:06.733927  6344 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:06.779740  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:06.780107 16813 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.700794 17696 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:06.778158  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:06.851385 17631 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.852048 17696 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:06.851591  6049 catalog_manager.cc:5495] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 11 to 17, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 17 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:06.783582  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:06.786983  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 263354us
I20260812 19:25:06.853206  6465 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
W20260812 19:25:06.778169 17713 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260812 19:25:06.807192  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 223892us
W20260812 19:25:06.807934  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 92415.8us
I20260812 19:25:06.854288 17277 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.856902 17358 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:06.854274  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:06.857173  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:06.782415  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:06.858366  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:06.859272 17662 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:06.858919 17527 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:06.859865 17662 raft_consensus.cc:686] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:06.860831 17662 consensus_queue.cc:237] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.861686 17541 consensus_queue.cc:1046] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:25:06.862912  6470 raft_consensus.cc:2396] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260812 19:25:06.863421 17202 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:06.863879 17202 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:06.863932 17248 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:06.864305 17202 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:06.864550 17248 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.865087 17248 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:06.857167 17277 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:06.867272  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:06.861258 17527 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.871012  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:06.878355  6482 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:06.886003 17631 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:25:06.886993  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:06.814955 17361 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:06.874629 16960 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:06.899360 16960 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:06.899796 16960 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:06.902010 17361 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:06.848646 17337 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:06.908931  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:06.912333  6470 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:06.919032  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.919585  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.936489  6350 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260812 19:25:06.920231  6242 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:06.937533  6229 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 21: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:06.939996  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.903869 17506 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:06.941720  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.949798  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:06.950003  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:06.954910  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:06.959806  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 45164.2us
I20260812 19:25:06.954336  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.965996  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:06.965257  6224 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:25:06.970161  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:06.966866  6482 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:25:06.971554  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:06.975466 17657 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:25:06.976824 17464 raft_consensus.cc:3032] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:25:06.977299 17464 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:06.983469  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.984607  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.986356  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.987072  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:06.987785  6359 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:06.989676  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.910120 17353 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.003762  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:07.004374  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:07.006462  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 506544us
I20260812 19:25:07.007294  6298 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:07.007400 17293 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:07.011650  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.011122 17361 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:07.020543 17353 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:07.021660  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.022378  6236 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:07.023154  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:07.023897  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.025648  6238 raft_consensus.cc:1261] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260812 19:25:07.023388  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.035647  6236 raft_consensus.cc:2396] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260812 19:25:07.036474  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 44433.6us
I20260812 19:25:07.037710  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:07.044090  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.044970  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.047875  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.050478  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.055832  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.065647  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:06.961014 17337 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:06.987146 17330 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260812 19:25:07.063053  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.055111 17622 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:07.066596  6238 raft_consensus.cc:2379] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 19: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:07.057375  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:07.085371 16960 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.089340  6347 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260812 19:25:07.119699  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.120471 16960 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:07.090991  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.121649  6342 raft_consensus.cc:2396] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260812 19:25:07.122380 17392 raft_consensus.cc:3032] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:07.122916 17392 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:07.122859 17248 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.124953 17330 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:07.125497 17330 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.125989  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.066761 17075 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:07.127063 17075 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:07.127173  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.127578 17075 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:07.128482  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.129637  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.130399  6235 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 18: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:07.056357 17464 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.056519 17277 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:07.131047  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.131347 17277 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:07.131795 17277 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:07.132385  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.090508  6353 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260812 19:25:07.120841  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.095335  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.111387  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:07.112810  6298 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:07.116302  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.111159  6474 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:07.131091  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.117605  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.124339 17392 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.169865  6236 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 20: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:25:07.164297  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 48647.2us
I20260812 19:25:07.180822 17330 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:07.182853 17742 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:07.183434 17742 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.185730 17742 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:07.187503  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 74837.2us
I20260812 19:25:07.190187 17187 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:07.131101 17464 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:07.190838 17187 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:07.191316 17187 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.193593 17187 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:07.193666  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.196138  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.200335  6350 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:25:07.201103  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.202181  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.196921  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.197917  6342 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:07.203356  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.204159  6359 raft_consensus.cc:2354] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21.
I20260812 19:25:07.173516 17683 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.198393 17617 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:07.197516  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:07.206525 17248 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:07.207283  6353 raft_consensus.cc:2354] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20.
I20260812 19:25:07.207584  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:07.209374 17696 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:07.202363  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.210536  6347 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:07.201220  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.211405  6350 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:25:07.210038 17696 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:07.179585  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:07.213526 17075 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:07.215893 17075 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:07.220450  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:07.220183 17277 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:07.223330 17383 consensus_meta.cc:287] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.003s
I20260812 19:25:07.224402 17277 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:07.223938 17383 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:07.226397 17383 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:07.228129  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:07.233530  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:07.109839 17622 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:07.235059 17622 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:07.236327  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:07.238410  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:07.239717 17696 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:25:07.174377 17202 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.245277 17202 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:07.247184  6349 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260812 19:25:07.248939  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:07.250691  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:07.180887 17392 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:07.264006  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:07.266469  6347 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260812 19:25:07.269089  6354 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.025s	sys 0.049s
W20260812 19:25:07.269649  6354 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.025s	sys 0.049s
W20260812 19:25:07.285949  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 129901us
I20260812 19:25:07.291448  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:07.288820 17683 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:07.302490  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:07.303190  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:07.303445  6465 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:07.308979  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:07.310111  6483 raft_consensus.cc:2379] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 18: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:07.311210  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:07.312037  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:07.312779  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:07.313170  6474 raft_consensus.cc:2396] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260812 19:25:07.314488 17248 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:07.315079 17248 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:07.318277  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:07.319063  6242 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
W20260812 19:25:07.283733 17551 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.014s	sys 0.031s
I20260812 19:25:07.330876  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:07.333485  6228 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260812 19:25:07.333997  6228 pending_rounds.cc:76] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 10
I20260812 19:25:07.336350  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.337802  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.332399  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.331784  7594 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:07.341420  6179 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:07.343317  6359 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:07.334264  6228 pending_rounds.cc:97] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260812 19:25:07.343955  6228 raft_consensus.cc:2866] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 19:25:07.333048 17386 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.018s	sys 0.034s
I20260812 19:25:07.340181  6349 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
W20260812 19:25:07.330427 17551 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.014s	sys 0.031s
W20260812 19:25:07.353515  6232 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.028s	sys 0.058s
W20260812 19:25:07.370263  6232 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.028s	sys 0.058s
I20260812 19:25:07.373276 17383 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:07.373792  6236 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:07.375655  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3197) took 1013 ms. Trace:
W20260812 19:25:07.370445 17386 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.018s	sys 0.034s
I20260812 19:25:07.379992  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:07.382227  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.386696  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:07.387377  6238 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:07.387467  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:07.380919  6232 rpcz_store.cc:276] 0812 19:25:06.362696 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:06.392551 (+ 29855us) service_pool.cc:227] Handling call
0812 19:25:06.414377 (+ 21826us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:06.450585 (+ 36208us) raft_consensus.cc:1520] Early marking committed up to index 12
0812 19:25:06.697656 (+247071us) log.cc:842] Serialized 14 byte log entry
0812 19:25:07.375119 (+677463us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:07.375190 (+    71us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:07.375399 (+   209us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:07.375477 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:07.375596 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2967,"prepare.queue_time_us":410858,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":3189,"thread_start_us":887171,"threads_started":2}
I20260812 19:25:07.400025  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:07.400882  6474 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 21
I20260812 19:25:07.404281 17248 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:07.406322  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:07.408977  6232 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260812 19:25:07.390460 17383 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:07.411610 17383 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:07.379499 17657 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260812 19:25:07.421881  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:07.422712  6477 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:25:07.423791  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:07.425163  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:07.425781  6465 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 19
I20260812 19:25:07.426776  6464 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260812 19:25:07.429473  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:07.430091  6235 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:07.430208  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:07.430845  6481 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 20
I20260812 19:25:07.438720  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:07.438975  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.439460  6229 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:25:07.439689  6349 raft_consensus.cc:2354] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19.
I20260812 19:25:07.448542  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:07.393734 17330 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:07.402740 16960 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:07.495283  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:07.502044 17277 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:07.502869 17277 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.506290  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.488534 16960 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:07.507506 16960 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:07.520859 17749 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260812 19:25:07.494518  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:07.505549 17277 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:07.539656  6242 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:07.475212 17464 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:07.559275  6481 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:07.573865  6238 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:07.472504 17358 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.110s
I20260812 19:25:07.555126 17202 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:07.558697 17742 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:07.583720  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:07.605069  7594 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:25:07.566910 17464 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:07.492786  6465 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
W20260812 19:25:07.609728  6344 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.012s	sys 0.014s
W20260812 19:25:07.630085  6344 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.012s	sys 0.014s
W20260812 19:25:07.611302  6345 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.011s	sys 0.019s
W20260812 19:25:07.632087  6345 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.011s	sys 0.020s
I20260812 19:25:07.609269  6474 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
W20260812 19:25:07.634958  6352 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.012s	sys 0.020s
W20260812 19:25:07.635491  6352 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.012s	sys 0.020s
W20260812 19:25:07.639240  6416 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.016s	sys 0.032s
I20260812 19:25:07.583523 17683 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
W20260812 19:25:07.639853  6416 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.016s	sys 0.032s
W20260812 19:25:07.640480  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 552571us
I20260812 19:25:07.611780 17742 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:07.655454 17742 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:07.623190 17464 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:07.635140 17353 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:07.666996  6235 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
W20260812 19:25:07.667835 17586 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.007s	sys 0.003s
W20260812 19:25:07.643525 17662 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.008s	sys 0.022s
I20260812 19:25:07.671046  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:25:07.673772  6224 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.000s	sys 0.012s
I20260812 19:25:07.604892 17202 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:07.721109  6224 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.001s	sys 0.013s
I20260812 19:25:07.737428 17202 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:07.739496  6473 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
W20260812 19:25:07.723349 17662 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.008s	sys 0.022s
W20260812 19:25:07.739503  6230 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.039s	sys 0.037s
W20260812 19:25:07.745128  6230 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.040s	sys 0.037s
I20260812 19:25:07.740235  6473 pending_rounds.cc:76] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 9
I20260812 19:25:07.746865  6473 pending_rounds.cc:97] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260812 19:25:07.639118  6359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:07.769032  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:07.747325  6473 raft_consensus.cc:2866] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:07.786530  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3200) took 1410 ms. Trace:
I20260812 19:25:07.787375  6359 raft_consensus.cc:595] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:07.787851  6359 raft_consensus.cc:603] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:07.744910 17277 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:07.787144  6230 rpcz_store.cc:276] 0812 19:25:06.376073 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:06.395049 (+ 18976us) service_pool.cc:227] Handling call
0812 19:25:06.457365 (+ 62316us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:06.535193 (+ 77828us) raft_consensus.cc:1520] Early marking committed up to index 13
0812 19:25:06.962094 (+426901us) log.cc:842] Serialized 14 byte log entry
0812 19:25:07.745930 (+783836us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:07.785919 (+ 39989us) raft_consensus.cc:1631] Marking committed up to 13
0812 19:25:07.785992 (+    73us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:07.786272 (+   280us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:07.786454 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":304979,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":107,"thread_start_us":1118853,"threads_started":2}
I20260812 19:25:07.715688 17622 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:07.734637 16971 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:25:07.746923 17586 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.008s	sys 0.004s
W20260812 19:25:07.802150  6241 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.007s	sys 0.010s
I20260812 19:25:07.730962 17187 consensus_queue.cc:1046] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
I20260812 19:25:07.786233 17668 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:07.741438 17353 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:07.813609  6474 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260812 19:25:07.801276 17330 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:25:07.824386  6470 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.000s	sys 0.018s
W20260812 19:25:07.824877  6470 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.000s	sys 0.019s
W20260812 19:25:07.817288  6241 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.007s	sys 0.011s
I20260812 19:25:07.816587 17741 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:07.842959  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:07.843644  6474 raft_consensus.cc:2362] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19. Re-sending same reply.
I20260812 19:25:07.802959 17277 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:07.848527  7597 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.031s	sys 0.070s
W20260812 19:25:07.854135  7597 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.031s	sys 0.071s
I20260812 19:25:07.804230 16960 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.818984 16971 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.836302 17358 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:07.878583  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:07.865906 17586 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:07.900602 17742 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.908998  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:07.864625 17075 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:07.932314  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:07.932736  6359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:07.933357  6359 raft_consensus.cc:595] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:07.865424 17392 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:07.936244  6483 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260812 19:25:07.845065 17330 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.933143  6473 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:07.939680  6483 pending_rounds.cc:76] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 10
I20260812 19:25:07.847930 17741 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:07.943553  6483 pending_rounds.cc:97] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260812 19:25:07.947522  6483 raft_consensus.cc:2866] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:07.960184  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:07.953455 17757 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260812 19:25:07.972692  6473 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:07.994563  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2779) took 1087 ms. Trace:
I20260812 19:25:07.934303 17358 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:08.012661  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 380063us
I20260812 19:25:07.947032 17392 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:07.949069 17353 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:08.020846  6178 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.653s (SENT)
I20260812 19:25:08.014703  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2777) took 1124 ms. Trace:
I20260812 19:25:08.022547  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2778) took 1115 ms. Trace:
I20260812 19:25:08.024832  6353 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "545108632fab48129db7f032619a1e55"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:08.025650  6353 raft_consensus.cc:595] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:07.972579 17736 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:07.986858 17749 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:07.943778 17586 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:08.016136 17779 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.275s	user 0.001s	sys 0.001s
I20260812 19:25:08.016671 17576 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260812 19:25:08.021562 17754 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260812 19:25:07.997871 17386 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:08.009500 17622 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:07.995198  6345 rpcz_store.cc:276] 0812 19:25:06.907577 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:06.907764 (+   187us) service_pool.cc:227] Handling call
0812 19:25:06.915713 (+  7949us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:06.942077 (+ 26364us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:25:06.989020 (+ 46943us) log.cc:842] Serialized 14 byte log entry
0812 19:25:07.994142 (+1005122us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:07.994198 (+    56us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:25:07.994245 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:07.994375 (+   130us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:07.994501 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":548,"prepare.queue_time_us":66901,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":94833,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":7882,"thread_start_us":974361,"threads_started":2,"wal-append.queue_time_us":801235}
I20260812 19:25:08.024492  6344 rpcz_store.cc:276] 0812 19:25:06.890426 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:06.890634 (+   208us) service_pool.cc:227] Handling call
0812 19:25:06.902473 (+ 11839us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:06.902723 (+   250us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:25:06.903073 (+   350us) log.cc:842] Serialized 14 byte log entry
0812 19:25:08.009202 (+1106129us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:08.009263 (+    61us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:08.009339 (+    76us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:08.013489 (+  4150us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:08.014347 (+   858us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1879,"prepare.queue_time_us":759,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":40197,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":50742,"thread_start_us":1103460,"threads_started":2,"wal-append.queue_time_us":898235}
I20260812 19:25:08.024510  6352 rpcz_store.cc:276] 0812 19:25:06.907134 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:06.907287 (+   153us) service_pool.cc:227] Handling call
0812 19:25:06.916091 (+  8804us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:06.951899 (+ 35808us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:25:07.636023 (+684124us) log.cc:842] Serialized 14 byte log entry
0812 19:25:08.022200 (+386177us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:08.022257 (+    57us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:08.022302 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:08.022367 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:08.022489 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":38741,"prepare.queue_time_us":59768,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":19705,"thread_start_us":949392,"threads_started":2}
I20260812 19:25:08.022679 17742 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.027333 17202 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:08.060319  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.024612 17662 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:08.024742 17602 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:25:08.068603 17764 log.cc:924] Time spent T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
W20260812 19:25:08.068813 17759 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
W20260812 19:25:08.086114  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 74307us
I20260812 19:25:08.095881  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:08.101648 17756 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.355s	user 0.000s	sys 0.002s
W20260812 19:25:08.103163 17778 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.304s	user 0.002s	sys 0.000s
I20260812 19:25:08.103528  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2629) took 1419 ms. Trace:
I20260812 19:25:08.104202  6354 rpcz_store.cc:276] 0812 19:25:06.684491 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:06.686792 (+  2301us) service_pool.cc:227] Handling call
0812 19:25:06.715997 (+ 29205us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:06.740194 (+ 24197us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:06.740229 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:06.740684 (+   455us) log.cc:842] Serialized 26 byte log entry
0812 19:25:07.270132 (+529448us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:07.270193 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:07.270290 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:08.103251 (+832961us) raft_consensus.cc:1671] finished
0812 19:25:08.103279 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:08.103447 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":529041,"threads_started":1,"wal-append.queue_time_us":895654}
I20260812 19:25:08.105276 17683 raft_consensus.cc:3032] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:25:08.105736 17683 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:08.034785 17749 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.091784 16960 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.107585 17602 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.113138 17358 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.062266 17386 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:08.116392 17386 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:08.106621 17075 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:25:08.107035  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:08.116979 17075 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:08.086275 17662 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.116392 17749 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.120875 17662 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.111913 16971 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.124394 17602 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:08.128216 17775 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.168s	user 0.003s	sys 0.000s
I20260812 19:25:08.129897 17277 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:08.133968 17769 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.146s	user 0.003s	sys 0.002s
W20260812 19:25:08.134825 17766 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260812 19:25:08.139273 17576 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:08.159857 17576 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:08.154259  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1010) took 1338 ms. Trace:
I20260812 19:25:08.162874  6241 rpcz_store.cc:276] 0812 19:25:06.815814 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:06.826863 (+ 11049us) service_pool.cc:227] Handling call
0812 19:25:06.827312 (+   449us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:06.885497 (+ 58185us) raft_consensus.cc:1520] Early marking committed up to index 13
0812 19:25:06.885532 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:06.886116 (+   584us) log.cc:842] Serialized 26 byte log entry
0812 19:25:07.827305 (+941189us) raft_consensus.cc:1631] Marking committed up to 13
0812 19:25:07.827563 (+   258us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:08.151002 (+323439us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b5400191754. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:08.151076 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:08.151150 (+    74us) raft_consensus.cc:1671] finished
0812 19:25:08.151171 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:08.154150 (+  2979us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1778,"raft.queue_time_us":12909,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":6801,"spinlock_wait_cycles":95809280,"thread_start_us":940733,"threads_started":1,"wal-append.queue_time_us":1142302}
I20260812 19:25:08.166308  7597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 745) took 1125 ms. Trace:
I20260812 19:25:08.166777  7597 rpcz_store.cc:276] 0812 19:25:07.041211 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:07.041870 (+   659us) service_pool.cc:227] Handling call
0812 19:25:07.043859 (+  1989us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:07.066913 (+ 23054us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:07.066966 (+    53us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:07.067512 (+   546us) log.cc:842] Serialized 26 byte log entry
0812 19:25:07.854639 (+787127us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:07.854716 (+    77us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:07.854842 (+   126us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:08.133286 (+278444us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:25:08.165948 (+ 32662us) raft_consensus.cc:1671] finished
0812 19:25:08.165973 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:08.166216 (+   243us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":19410,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":15398,"spinlock_wait_cycles":33461504,"thread_start_us":786661,"threads_started":1,"wal-append.queue_time_us":858505}
W20260812 19:25:08.169477  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 96666.6us
I20260812 19:25:08.174855  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:08.175601  6342 raft_consensus.cc:595] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:08.175964  6342 raft_consensus.cc:603] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:08.176278 17187 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:08.176832 17187 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:08.177579 17760 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260812 19:25:08.178023  6483 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:08.179136  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.187160  6464 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 20. Current term is 21. Ops: [18.10-20.11]
I20260812 19:25:08.190028  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.059577 17736 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.073237 17202 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.192293  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.220773  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:08.221532  6342 raft_consensus.cc:595] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:08.221889  6342 raft_consensus.cc:603] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:08.224418  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.225487 17392 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:08.225675  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:25:08.228322  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:25:08.237960  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3204) took 1062 ms. Trace:
W20260812 19:25:08.240898  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 361370us
W20260812 19:25:08.243835  6242 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.034s	sys 0.064s
W20260812 19:25:08.246016  6242 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.035s	sys 0.065s
I20260812 19:25:08.216692 17330 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.252962  6482 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260812 19:25:08.155581 17683 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:08.242954 17741 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.262109  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:08.267347 17586 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:08.267560  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.289641  6473 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:08.267759 17202 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:08.271272 17464 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.004s
I20260812 19:25:08.245833 17187 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:08.276975  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet f1b6d90aaa384b5fb66f3320981f1aa0, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:08.277485 17783 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260812 19:25:08.295713  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:08.296502 17793 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:08.296948 17793 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:08.297338 17793 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:08.297735  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:08.281309  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.283128  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.300441 17622 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:08.301148 17622 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:08.301509 17622 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:08.301880 17622 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:08.303714  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:08.284574  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.285971  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:25:08.290944  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet f1b6d90aaa384b5fb66f3320981f1aa0, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.300652  6464 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260812 19:25:08.310964  6464 pending_rounds.cc:76] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 10
I20260812 19:25:08.311272  6464 pending_rounds.cc:97] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260812 19:25:08.311570  6464 raft_consensus.cc:2866] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:08.311600 17386 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:08.314189  6464 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260812 19:25:08.314728  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.315095  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.316349 17464 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.316895  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.306368 17683 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:08.307753 17736 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.308099 17576 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.238686  6470 rpcz_store.cc:276] 0812 19:25:07.175174 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:07.175310 (+   136us) service_pool.cc:227] Handling call
0812 19:25:07.213091 (+ 37781us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:07.213427 (+   336us) raft_consensus.cc:1520] Early marking committed up to index 11
0812 19:25:07.825334 (+611907us) log.cc:842] Serialized 14 byte log entry
0812 19:25:08.237440 (+412106us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:08.237506 (+    66us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:08.237658 (+   152us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:08.237726 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:08.237885 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2747,"prepare.queue_time_us":463769,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"thread_start_us":958912,"threads_started":2}
I20260812 19:25:08.325047  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:08.325898  6345 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:08.328469  6347 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260812 19:25:08.330173  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 339627us
I20260812 19:25:08.335677  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.336606  6473 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:08.360891  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.367686  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:08.369033  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.369155  6349 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260812 19:25:08.369184  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:08.368523  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:08.329480  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:08.374284  6350 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:08.371063  6342 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:25:08.370496  6482 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
W20260812 19:25:08.381835  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 78200.8us
I20260812 19:25:08.382998  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:08.385653  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:08.387945  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:08.397658 17576 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.360351 17464 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:08.408432  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 121636us
W20260812 19:25:08.414887  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 85497.2us
I20260812 19:25:08.392755 17742 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:08.419605  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:08.338001 17075 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:08.428180  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:08.436272  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:08.436952  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:08.413823 17248 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:08.419773 17811 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:08.441051  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:08.447275  7591 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:08.447604  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:08.431447  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:08.443234  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:08.449311  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:08.451182  6350 raft_consensus.cc:2379] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:08.427860 17742 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:08.450577  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:08.455754  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:08.439822 17576 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:08.460421  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:08.437742 17821 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:25:08.464666  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:08.444731 17248 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:08.465014 17749 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:08.462294 17576 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:08.475064 17576 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:08.463294 17736 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:08.475688 17736 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:08.476061 17736 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:08.479177 17248 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:08.455516 17791 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:08.455725 17187 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:08.461798 17696 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:08.459542 17742 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:08.481769  6416 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:08.469673  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:08.488551  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 7e0797ad50cb46cfb10b4a38cc815917, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:08.490577  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 7e0797ad50cb46cfb10b4a38cc815917, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.462075 17386 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:08.465703 17353 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:08.494824 17361 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
W20260812 19:25:08.503273 17819 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260812 19:25:08.505453 17392 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:08.490571 17187 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:08.506891 17187 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:08.507005 17248 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.507965 17187 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.509327 17248 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:08.488562 17202 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:08.498840  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:08.467473 16960 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.031s
I20260812 19:25:08.528302  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:08.452116 17811 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.493232 17277 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
W20260812 19:25:08.530463  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 64471us
I20260812 19:25:08.538599  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:08.540472  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:08.542018  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.544299  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:08.544580  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.546962  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:08.548532  6235 raft_consensus.cc:2396] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260812 19:25:08.548406  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.549962  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:08.550679  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:08.551047  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:08.551313  6232 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:08.552714  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:08.553514  6482 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:08.554311  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.555934  6238 raft_consensus.cc:2379] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:08.556032  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.556870  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.557511  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:08.559509  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.533902 17202 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:08.568140 17202 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.497418 17821 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260812 19:25:08.565586 17804 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:08.577446 17804 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:08.577878 17804 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:08.543434 17337 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:08.578925 17337 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:08.579352 17337 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:08.585682  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:08.565673  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:08.552235 17293 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
I20260812 19:25:08.585817 17821 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:08.587965 17821 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.590210 17821 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.591145  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:25:08.591203 17813 log.cc:924] Time spent T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260812 19:25:08.562099  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:08.599679  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.600489  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:08.603883  6475 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:08.604274  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:08.604607  6473 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260812 19:25:08.604945  6236 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:08.605698  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:08.605688  6235 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 19: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:25:08.608311  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 95d32ece4a8c43b6a779d59f9981db43, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:08.608665  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 95d32ece4a8c43b6a779d59f9981db43, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.596458  6229 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:08.606364  6241 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:08.634996  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:08.642110 17741 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:08.645692  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:08.543493 17622 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.642877 17741 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.606900 17293 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:08.654824  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 545108632fab48129db7f032619a1e55, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:08.660148  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 545108632fab48129db7f032619a1e55, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.677754  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:08.685734  6342 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:08.652864 17075 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.684491  6298 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:08.656870 17383 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:08.615721 17742 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.699150  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:08.709245  6359 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:25:08.694290  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 212582us
I20260812 19:25:08.705780  6236 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:08.706723  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:08.655995 17576 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.729894  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:25:08.739172  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 54756us
I20260812 19:25:08.740655  6298 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:08.743192 17796 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:08.736275  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:08.671126 17293 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:08.753003 17830 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.246s	user 0.001s	sys 0.001s
W20260812 19:25:08.754668 17827 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260812 19:25:08.700941 17662 consensus_queue.cc:1046] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260812 19:25:08.748262 17248 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:08.707100 16984 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260812 19:25:08.771796  6482 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:25:08.770535  6232 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
W20260812 19:25:08.785658 17826 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.284s	user 0.000s	sys 0.006s
I20260812 19:25:08.724649 17187 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:25:08.715059 17386 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:08.799592  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 103607us
I20260812 19:25:08.747723 17551 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:08.807340  6416 leader_election.cc:398] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21.
I20260812 19:25:08.807798  6416 leader_election.cc:401] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:25:08.712383 17383 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.804467  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:08.794176 17248 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:08.800889 17696 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:08.806252 17551 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:08.824777 17551 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:08.801005 17392 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260812 19:25:08.827327 17576 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.818778 17811 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.806190 17386 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
W20260812 19:25:08.844018  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 47681us
I20260812 19:25:08.799940 17793 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:08.817093 17248 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
W20260812 19:25:08.847368  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 160737us
I20260812 19:25:08.856639  6416 leader_election.cc:398] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20.
I20260812 19:25:08.857004  6416 leader_election.cc:401] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:25:08.858292 17293 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.863353  6352 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: []
I20260812 19:25:08.846769 17602 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:25:08.844151 17785 consensus_queue.cc:1046] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.134s
I20260812 19:25:08.866062 17741 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:08.866546 17842 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260812 19:25:08.868302  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:08.832878 17736 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.871546 17791 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:08.836043 17696 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:08.862538 17622 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.875036 17742 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:08.879446 17858 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:08.922005 17838 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21.
I20260812 19:25:08.923087 17742 raft_consensus.cc:979] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:25:08.923643 17742 raft_consensus.cc:1067] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
W20260812 19:25:08.926389 17857 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260812 19:25:08.933606  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 216138us
W20260812 19:25:08.938352 17844 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.113s	user 0.000s	sys 0.010s
I20260812 19:25:08.939528  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:08.940007  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:08.940564  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:08.940835  6350 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:08.941401  6342 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:08.940274  6352 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:25:08.942344  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:08.942967  6349 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:08.943464 17741 consensus_queue.cc:1046] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:25:08.944830 17741 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:25:08.945988  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:08.946197 17741 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:25:08.946704 17741 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:08.947697 17741 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:08.950678 17811 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:08.951062 17811 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:08.954698 17626 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:08.949216 17741 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:08.951323  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:08.959854  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:25:08.969197  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 68947.8us
I20260812 19:25:08.970083  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:08.883041 17602 raft_consensus.cc:686] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:08.951370 17811 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:08.984709  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:08.947885 17657 raft_consensus.cc:3032] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:08.994326  6347 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:09.000933 17849 raft_consensus.cc:3032] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:09.001477 17849 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:09.002499 17849 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:09.011119 17845 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:08.971990 17791 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:09.013312  6352 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: []
I20260812 19:25:08.882794 17804 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:09.030833  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 172490us
I20260812 19:25:09.026456 17586 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20.
I20260812 19:25:09.039100 17602 consensus_queue.cc:237] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:08.995388 17293 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:09.058132  6359 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
I20260812 19:25:08.997205 17736 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:09.060137  6349 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
W20260812 19:25:09.156260  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 106764us
I20260812 19:25:08.999186 17657 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:09.161496  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:09.161883 17736 consensus_queue.cc:1046] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:25:08.966807 17626 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:09.163952 17736 consensus_queue.cc:1046] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 19:25:09.164429 17626 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:09.165035 17626 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:09.166159  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:09.167533  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:09.168397 17662 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:09.169931 17742 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:09.170369 17742 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:09.170908 17742 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:09.172766 17749 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:09.173264 17749 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:09.173704 17749 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:09.165572 17626 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:09.183907  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:09.190956  6238 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 19: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:09.188702  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:09.190840  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:09.195474  6352 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
W20260812 19:25:09.195645  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 339139us
I20260812 19:25:09.204902  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:09.196640  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:09.218972  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:09.230762  6241 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260812 19:25:09.162074 17657 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:09.223877  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 56782.1us
I20260812 19:25:09.244445  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:09.245330 17864 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:09.235940  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:09.061982 16971 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:09.245852 17864 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:09.247128 17864 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:09.249106 17785 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:09.229326  6236 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:53178
I20260812 19:25:09.263482  6236 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:25:09.263950  6236 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:09.253345  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:09.253345  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:09.265983  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:09.266219 17626 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:09.267418  6475 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260812 19:25:09.268059 17657 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:09.268759 17551 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:09.270900 17551 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:09.221675 17854 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:09.170369 17793 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:09.272236 17854 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:09.258028  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:09.199429 17796 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:09.242574 17464 raft_consensus.cc:3032] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:25:09.258690  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:09.155686 17293 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:25:09.249217  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 52605.5us
I20260812 19:25:09.296466  6470 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:09.284538  6236 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:09.299324  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:09.283821 17785 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:25:09.329711  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 270750us
I20260812 19:25:09.280548 17383 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:09.319680  6236 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:09.351018  6416 leader_election.cc:398] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19.
I20260812 19:25:09.351497  6416 leader_election.cc:401] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:25:09.306134 17293 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:09.297408 17464 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:09.238443 17386 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:09.308300 17796 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:25:09.502312  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 151430us
I20260812 19:25:09.502862  6342 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:09.332654 17785 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:09.506099  6241 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:25:09.346359 17383 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:09.540064  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 294193us
I20260812 19:25:09.546367  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:09.345880 17551 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.188s
I20260812 19:25:09.547176  6359 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:09.540688 17696 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:09.291790 17854 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:09.574172 17839 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260812 19:25:09.346156 17868 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.219s
I20260812 19:25:09.578382  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:09.580844  6347 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: []
W20260812 19:25:09.564002 17337 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.984s	user 0.008s	sys 0.005s
I20260812 19:25:09.577217  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:09.626938  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:09.631771  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:09.632470  6353 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:09.657588  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:09.632830  6353 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:09.543891 17383 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:09.755707  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:09.737527  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:09.752178  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:09.755113  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:09.777359  6350 raft_consensus.cc:2354] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18.
I20260812 19:25:09.507535 17796 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:09.580492 17875 raft_consensus.cc:3032] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:09.745455  6353 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:09.790975  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:09.786304  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:09.623852 17877 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:09.617933 17804 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:09.792333  6345 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
W20260812 19:25:09.805919 17879 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260812 19:25:09.806578  6224 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:09.808243  6224 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:09.861013  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:09.861961  6350 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:09.789762 17875 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:09.864187 17863 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19.
I20260812 19:25:09.872354 17875 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:09.873973 17875 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:09.880750 16984 raft_consensus.cc:979] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:25:09.881450 16984 raft_consensus.cc:1067] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:25:09.788558 17386 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:09.568560 17464 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:09.906906  6238 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 3238) took 1358 ms (client timeout 1601 ms). Trace:
I20260812 19:25:09.910435  6232 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:09.902249  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:09.914806  6238 rpcz_store.cc:269] 0812 19:25:08.548771 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:08.556773 (+  8002us) service_pool.cc:227] Handling call
0812 19:25:09.906666 (+1349893us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b540017a554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:09.906821 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1360361216}
W20260812 19:25:09.816295 17742 consensus_meta.cc:287] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.004s
I20260812 19:25:09.908527 17464 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:09.965597  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:09.733614 17337 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:09.967132  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:25:09.906334 17872 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.684s	user 0.002s	sys 0.008s
I20260812 19:25:09.831053 17902 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:10.010681  6238 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:09.918113 17622 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:10.019222  6228 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:25:10.037706  6172 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.014s	sys 0.047s
W20260812 19:25:10.038307  6172 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.014s	sys 0.047s
W20260812 19:25:10.051383  6465 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.022s	sys 0.072s
W20260812 19:25:10.055951  6465 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.022s	sys 0.072s
I20260812 19:25:10.051911  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:09.894615 17383 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:09.825587 17877 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:10.041127 17885 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:10.105412 17662 consensus_meta.cc:287] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.936s	user 0.009s	sys 0.004s
I20260812 19:25:10.144404 17895 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:10.144678  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:25:10.157159  6416 connection.cc:232] RPC call timeout handler was delayed by -1.2889469219371676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260812 19:25:10.180806  6416 connection.cc:232] RPC call timeout handler was delayed by -1.2403469220735133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260812 19:25:10.181202  6416 connection.cc:232] RPC call timeout handler was delayed by -1.1665469219442457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260812 19:25:10.181520  6416 connection.cc:232] RPC call timeout handler was delayed by -1.1080469219014049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
W20260812 19:25:10.181902  6416 connection.cc:232] RPC call timeout handler was delayed by -1.1071469220332801s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260812 19:25:10.182255  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0945469220168889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260812 19:25:10.182607  6416 connection.cc:232] RPC call timeout handler was delayed by -1.0027469219639897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
I20260812 19:25:10.183445  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:10.185039  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:10.186362  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:10.187613  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:10.190207  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 45627.1us
I20260812 19:25:10.190007 17885 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:10.190025 17895 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.193140 17868 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:10.193655 17868 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:10.194165 17868 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:10.194543 17895 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:10.197155  6241 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:25:10.199546 17895 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:10.199743  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:10.200356 17895 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:25:10.200702  7594 raft_consensus.cc:2379] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:25:10.201350 17895 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:10.198511 17877 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:10.196715 17885 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:10.181103 17896 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:10.204319 17896 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:10.207468 17896 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:10.209261  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.041s	sys 0.060s
I20260812 19:25:10.027531 17742 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.112087 17626 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:10.210079 17897 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.006s	sys 0.003s
W20260812 19:25:10.211341  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.041s	sys 0.060s
W20260812 19:25:09.885800 17248 consensus_meta.cc:287] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.022s	user 0.010s	sys 0.000s
I20260812 19:25:10.136212 17845 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:10.054832 17622 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:10.244263  6229 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.020s	sys 0.031s
W20260812 19:25:10.220434 17749 consensus_meta.cc:287] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.046s	user 0.014s	sys 0.000s
I20260812 19:25:10.251909  6347 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
W20260812 19:25:10.189018 17811 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.175s	user 0.012s	sys 0.001s
W20260812 19:25:10.239238  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 933403us
I20260812 19:25:10.013077 17902 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.213140 17662 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260812 19:25:10.239934 17897 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.006s	sys 0.003s
I20260812 19:25:10.279341  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3251) took 1050 ms. Trace:
I20260812 19:25:10.285789  6229 rpcz_store.cc:276] 0812 19:25:09.229320 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:09.229448 (+   128us) service_pool.cc:227] Handling call
0812 19:25:09.265448 (+ 36000us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:09.265645 (+   197us) raft_consensus.cc:1520] Early marking committed up to index 11
0812 19:25:09.636056 (+370411us) log.cc:842] Serialized 14 byte log entry
0812 19:25:10.278955 (+642899us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:10.279018 (+    63us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:10.279072 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:10.279149 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:10.279274 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":51012,"prepare.queue_time_us":247871,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":25517,"thread_start_us":923599,"threads_started":2}
I20260812 19:25:10.202059 17895 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.079s
W20260812 19:25:10.286473  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.007s	sys 0.012s
W20260812 19:25:10.293587  6235 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.085s	sys 0.139s
W20260812 19:25:10.311846  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.007s	sys 0.012s
W20260812 19:25:10.311944  6235 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.085s	sys 0.139s
I20260812 19:25:10.277802 17277 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:10.293176 17847 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:10.319708 17847 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.241739 17626 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.244433 17248 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.330232  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:10.309957 17906 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:10.347354  6232 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "545108632fab48129db7f032619a1e55"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:53178
I20260812 19:25:10.284324 17811 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:10.349304 17905 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260812 19:25:10.351112  6232 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:25:10.356374  6232 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:25:10.278515 17749 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:10.312655  6178 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.125s (SENT) [suppressed 13 similar messages]
I20260812 19:25:10.353720  6470 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260812 19:25:10.273871 17845 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.353780  6235 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260812 19:25:10.355214  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:10.355610  6473 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:25:10.361665  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:10.362370  6475 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:10.350152 17906 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:10.364677 17906 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:25:10.372588  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 183294us
I20260812 19:25:10.353753 17337 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:10.374493  6230 raft_consensus.cc:2354] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22.
I20260812 19:25:10.322875 17386 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260812 19:25:10.379141  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:10.330255 17277 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.388175  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:10.391961 17845 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:10.388725 17838 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:10.400697  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3243) took 1182 ms. Trace:
I20260812 19:25:10.401131  6481 rpcz_store.cc:276] 0812 19:25:09.218304 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:09.218429 (+   125us) service_pool.cc:227] Handling call
0812 19:25:09.218769 (+   340us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:09.218992 (+   223us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:09.219015 (+    23us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:09.280427 (+ 61412us) log.cc:842] Serialized 26 byte log entry
0812 19:25:09.630205 (+349778us) raft_consensus.cc:1631] Marking committed up to 8
0812 19:25:09.630385 (+   180us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:09.630558 (+   173us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:10.400391 (+769833us) raft_consensus.cc:1671] finished
0812 19:25:10.400415 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:10.400611 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":284255,"threads_started":1,"wal-append.queue_time_us":963556}
I20260812 19:25:10.404016 17586 raft_consensus.cc:3032] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:10.404449 17586 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:10.406688 17883 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:10.407860 17626 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:10.409751 17861 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.431s	user 0.000s	sys 0.012s
W20260812 19:25:10.410482  7552 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.010s	sys 0.054s
I20260812 19:25:10.411684  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3236) took 1814 ms. Trace:
I20260812 19:25:10.412201  6464 rpcz_store.cc:276] 0812 19:25:08.597119 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:08.597288 (+   169us) service_pool.cc:227] Handling call
0812 19:25:08.597610 (+   322us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:08.597994 (+   384us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:08.598022 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:08.598459 (+   437us) log.cc:842] Serialized 26 byte log entry
0812 19:25:08.849724 (+251265us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:25:08.849767 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:08.849839 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:10.408857 (+1559018us) spinlock_profiling.cc:243] Waited 8.01 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:25:10.411296 (+  2439us) raft_consensus.cc:1671] finished
0812 19:25:10.411324 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:10.411592 (+   268us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2950,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":28425,"spinlock_wait_cycles":18428672,"thread_start_us":214716,"threads_started":1,"wal-append.queue_time_us":250287}
I20260812 19:25:10.414887 17749 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:10.416857 17277 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:10.419719 17908 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260812 19:25:10.422394 17902 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:10.405313 17657 consensus_meta.cc:287] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.137s	user 0.012s	sys 0.001s
W20260812 19:25:10.412011 17891 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.549s	user 0.002s	sys 0.012s
I20260812 19:25:10.439072  6475 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
W20260812 19:25:10.440311  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 52235.2us
I20260812 19:25:10.442256  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:10.448968  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:10.448040  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 256716us
I20260812 19:25:10.450538  6232 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.478787  6235 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:25:10.477130  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:10.476006 17929 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:10.487847  6232 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:10.492278  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:10.472805 16984 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:10.488106 17939 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:10.495074 17794 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:10.494848 16984 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.495786 17794 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:10.496681 17794 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.8, Last appended by leader: 8, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.497273 16984 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:10.476544 17892 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:10.435011 17811 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:10.493852  6242 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:10.498112  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3247) took 1271 ms. Trace:
I20260812 19:25:10.437018 17742 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:10.501389 17785 consensus_meta.cc:287] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.953s	user 0.010s	sys 0.003s
I20260812 19:25:10.494764 17622 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:10.500499 17863 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:10.501650  6465 rpcz_store.cc:276] 0812 19:25:09.226757 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:09.238239 (+ 11482us) service_pool.cc:227] Handling call
0812 19:25:09.238740 (+   501us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:25:09.319571 (+ 80831us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:25:10.056447 (+736876us) log.cc:842] Serialized 14 byte log entry
0812 19:25:10.387671 (+331224us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:25:10.388356 (+   685us) log.cc:842] Serialized 52 byte log entry
0812 19:25:10.388515 (+   159us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:10.389043 (+   528us) log.cc:842] Serialized 14 byte log entry
0812 19:25:10.389335 (+   292us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:10.389410 (+    75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:10.497831 (+108421us) raft_consensus.cc:1671] finished
0812 19:25:10.497862 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:10.498036 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":45246,"prepare.queue_time_us":976235,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":78,"raft.queue_time_us":35403,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":12342,"spinlock_wait_cycles":2016896,"thread_start_us":873970,"threads_started":2,"wal-append.queue_time_us":360041}
W20260812 19:25:10.595747  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 283102us
I20260812 19:25:10.599109  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2676) took 1955 ms. Trace:
W20260812 19:25:10.593879 17293 consensus_meta.cc:287] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.086s	user 0.014s	sys 0.000s
W20260812 19:25:10.601709  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 111483us
I20260812 19:25:10.601143  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:10.603960  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:10.604588  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:10.607271  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:10.608134  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:10.610152  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:10.612977  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:10.599695  6354 rpcz_store.cc:276] 0812 19:25:08.643891 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:08.644128 (+   237us) service_pool.cc:227] Handling call
0812 19:25:08.668104 (+ 23976us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:25:08.794485 (+126381us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:08.794537 (+    52us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:25:08.809901 (+ 15364us) log.cc:842] Serialized 52 byte log entry
0812 19:25:09.029011 (+219110us) raft_consensus.cc:1631] Marking committed up to 14
0812 19:25:09.029386 (+   375us) log.cc:842] Serialized 14 byte log entry
0812 19:25:09.060374 (+ 30988us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:09.060477 (+   103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:10.411600 (+1351123us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b240013c9e8. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f46b4cf4 00007f98f46b2dfb 00007f98f4741559 00007f98f47411e5 00007f98f474082d 00007f98f73e346e 00007f98f73fac0c 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551
0812 19:25:10.598685 (+187085us) raft_consensus.cc:1671] finished
0812 19:25:10.598820 (+   135us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:10.599024 (+   204us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":40550,"prepare.queue_time_us":388,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":159836,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":214,"spinlock_wait_cycles":3065088,"thread_start_us":232895,"threads_started":2,"wal-append.queue_time_us":994877}
I20260812 19:25:10.611261  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:10.594028 17785 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.593389 17337 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:10.605243 17248 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:10.609054 17863 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:10.609109 17811 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:10.616843 17626 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:10.631078 17626 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:10.631527 17626 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:10.638346 17877 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:10.623458 17847 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:10.639256 17847 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:10.639073 17877 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.639820 17847 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:10.640378 17576 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:10.640966 17576 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:10.641340 17877 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:10.607605 17293 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.642014  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:10.642822  6224 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: []
I20260812 19:25:10.643823 17293 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:10.614948 17940 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:10.642036 17847 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:10.652952  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:10.646824 17811 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:10.657018 17863 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:25:10.657416  6354 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260812 19:25:10.657860 17929 consensus_queue.cc:1046] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 19:25:10.658197  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:10.663208 17576 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:10.620913 17892 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:10.620777 17943 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:25:10.620252 17935 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:10.677497  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:10.677904  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:10.680223  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:10.650503 17622 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:10.678289  6465 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:10.685302  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:10.680928  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:10.686467  6470 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 12.
I20260812 19:25:10.626477 17337 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:10.666620 17838 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:25:10.688359  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:10.695006  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:10.687443  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:10.696595  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:10.685393  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:10.682834  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:10.681043  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:10.652441 17877 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.036s
I20260812 19:25:10.710105  6349 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:10.675568 17935 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:10.650318 17392 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260812 19:25:10.715127  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:10.720070  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:25:10.692072 17464 consensus_meta.cc:287] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.718s	user 0.012s	sys 0.001s
I20260812 19:25:10.715857  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:10.710981  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:10.716519  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:10.713505  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:10.717947  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 95234.8us
I20260812 19:25:10.671651 17939 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260812 19:25:10.681011 17847 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
W20260812 19:25:10.847383  6242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 3246) took 1643 ms (client timeout 1791 ms). Trace:
W20260812 19:25:10.971383  6242 rpcz_store.cc:269] 0812 19:25:09.204328 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:09.204540 (+   212us) service_pool.cc:227] Handling call
0812 19:25:10.847175 (+1642635us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001644d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:10.847317 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2800420224}
I20260812 19:25:10.797377  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:10.759841  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:10.760819  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:10.901432  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2687) took 1904 ms. Trace:
I20260812 19:25:10.720749  6470 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:10.758275  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:10.805572  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:10.776597  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:10.830554  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 43649.8us
I20260812 19:25:10.888677  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:10.975976  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2811) took 1179 ms. Trace:
I20260812 19:25:10.700999 17940 raft_consensus.cc:3032] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:10.979804  6345 raft_consensus.cc:3032] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:25:10.722467  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:10.986121  6345 raft_consensus.cc:729] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:10.857622  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:10.722734  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:10.718385 17796 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:25:10.981853  6347 rpcz_store.cc:276] 0812 19:25:09.796552 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:09.797893 (+  1341us) service_pool.cc:227] Handling call
0812 19:25:09.798699 (+   806us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:10.271594 (+472895us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:10.975718 (+704124us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b5400180454. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:10.975915 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1028952832}
I20260812 19:25:10.706341 17622 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:10.796244 17929 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:10.866443 17248 raft_consensus.cc:3032] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:10.984326 17277 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:10.899839  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.034371  6235 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:25:10.865531  6228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 3233) took 2325 ms (client timeout 1698 ms). Trace:
I20260812 19:25:10.980171  6342 rpcz_store.cc:276] 0812 19:25:08.997323 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:08.997474 (+   151us) service_pool.cc:227] Handling call
0812 19:25:08.997765 (+   291us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:09.503370 (+505605us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:10.901164 (+1397794us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54001cd9d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:10.901341 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1155757952}
I20260812 19:25:10.865927  6236 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:25:11.044986  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:25:10.985527  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 272056us
I20260812 19:25:10.987468  6482 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:10.989301  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.029821 17929 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:11.051954  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:11.052604  6482 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
W20260812 19:25:11.038077  6228 rpcz_store.cc:269] 0812 19:25:08.540122 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:08.540257 (+   135us) service_pool.cc:227] Handling call
0812 19:25:10.865248 (+2324991us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540013f454. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:10.865424 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3398481152}
I20260812 19:25:11.054266  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:10.988955  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:10.992127  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:10.992990 17866 raft_consensus.cc:3032] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:11.061977 17866 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:11.061985 17896 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:11.062801 17896 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:11.063300 17622 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:11.063045 17866 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.720072 17935 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:11.064397 17866 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:11.065079 17896 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:10.717355 17877 consensus_queue.cc:1225] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer bdfa5579d4534c618c00db6b4a841c81 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260812 19:25:10.801312 17873 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:11.067088 17873 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:10.854331 17541 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:11.069049 17541 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:11.068652 17929 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.069360 17873 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:10.891885 17906 consensus_meta.cc:287] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260812 19:25:11.069995 17541 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:10.830075 17392 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:10.995532  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:10.996325  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:10.996474  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:11.074254  6477 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:10.998863  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:10.761435 17742 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:10.757992 17916 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:10.710988 17868 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:10.803341 17956 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260812 19:25:10.965039 17864 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.714s	user 0.004s	sys 0.016s
W20260812 19:25:10.905407 17875 consensus_meta.cc:287] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.030s	user 0.016s	sys 0.003s
I20260812 19:25:10.872550 17785 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:10.985872 17940 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:10.761286 17811 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.005635  6345 consensus_queue.cc:260] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.091182  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:11.091456  6345 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:25:11.006862  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:25:11.007818  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 150285us
I20260812 19:25:11.092967  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:11.008378 17939 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:25:11.011546 17954 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:25:11.013142 17293 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:11.015058 17741 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:11.103225 17741 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.105366 17741 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:11.017604  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:11.108721 17940 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.110327 17940 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:11.020615  6470 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:11.021965  6229 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:11.023980 17626 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.028053  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:11.126930  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:11.127648  6470 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:10.789657 17863 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:11.131472 17863 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.029917  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:11.132855  6349 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:11.136075 17626 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:11.136348 17867 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.592s	user 0.004s	sys 0.000s
I20260812 19:25:11.138162  6350 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260812 19:25:10.868680 17337 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:11.031244  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 43630.5us
I20260812 19:25:11.051538  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:11.031167 17960 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260812 19:25:11.060932 17845 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:11.061379  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:25:11.062254  6230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 3247) took 1845 ms (client timeout 1739 ms). Trace:
W20260812 19:25:11.151903  6230 rpcz_store.cc:269] 0812 19:25:09.216937 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:09.217099 (+   162us) service_pool.cc:227] Handling call
0812 19:25:11.062035 (+1844936us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002931d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:11.062179 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2464703872}
I20260812 19:25:11.063555  6353 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:10.786023 17921 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:10.994966 17736 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260812 19:25:11.075809  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 77046.8us
I20260812 19:25:11.076795  6464 raft_consensus.cc:2379] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:11.156436  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2795) took 1363 ms. Trace:
I20260812 19:25:11.156831  6224 rpcz_store.cc:276] 0812 19:25:09.792639 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:09.808856 (+ 16217us) service_pool.cc:227] Handling call
0812 19:25:09.809122 (+   266us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:10.643187 (+834065us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:11.156213 (+513026us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b5400163fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:11.156381 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1916929280}
I20260812 19:25:11.156478  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:11.159781  6347 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:11.161763  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:11.164544  6347 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:11.165716  6347 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:11.150695  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3241) took 1934 ms. Trace:
I20260812 19:25:11.172103  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:11.137005 17954 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:11.070096 17906 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:11.070009 17929 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:11.050872 17849 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:11.087036  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:11.089648  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:11.093257  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:25:11.186143  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 92955.9us
W20260812 19:25:11.085522 17864 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.835s	user 0.005s	sys 0.016s
I20260812 19:25:11.074365 17838 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:11.086593 17793 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:11.118214 17886 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:11.119123  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:11.083508 17916 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:11.120040 17868 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:11.085773 17541 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:11.079025 17873 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:11.121336  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:11.095031 17796 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260812 19:25:11.208894 17916 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:11.078418 17392 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.192168 17838 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.211354 17392 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:11.123076  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2787) took 1559 ms. Trace:
I20260812 19:25:11.140030  6342 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:25:11.141670  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:11.145834  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:11.212065  6236 rpcz_store.cc:276] 0812 19:25:09.563599 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:09.563760 (+   161us) service_pool.cc:227] Handling call
0812 19:25:10.865729 (+1301969us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:11.043842 (+178113us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:11.122879 (+ 79037us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540013f450. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:11.123013 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2993530752}
I20260812 19:25:11.213323  6470 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:11.149850  6482 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:25:11.214757 17873 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:11.215366 17873 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:11.154232  6349 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:11.149372  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:11.174252  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:11.031785 17248 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:11.180276  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:11.169332 17337 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:11.189774 17883 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260812 19:25:11.191004  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 72009.6us
I20260812 19:25:11.195483  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2677) took 2538 ms. Trace:
I20260812 19:25:11.195574  7591 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:11.182215 17741 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:11.195230 17353 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:11.198130 17793 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:11.213850  6465 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:11.214885 17586 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:11.078553 17742 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:11.189646  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:11.166970 17921 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.225355 17248 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:11.226410  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:11.228048 17337 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260812 19:25:11.228192  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 54029.9us
I20260812 19:25:11.284360  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:11.228945  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:11.233701 17386 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:11.234448  6353 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
W20260812 19:25:11.286273  6353 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 2693) took 1709 ms (client timeout 1624 ms). Trace:
I20260812 19:25:11.286463  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:11.241197  6470 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:11.241334  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 1101) took 2195 ms. Trace:
I20260812 19:25:11.288518 17293 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:25:11.287618  6483 rpcz_store.cc:276] 0812 19:25:09.045702 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:09.045844 (+   142us) service_pool.cc:227] Handling call
0812 19:25:09.191882 (+146038us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:09.192265 (+   383us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:09.192295 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:09.192774 (+   479us) log.cc:842] Serialized 26 byte log entry
0812 19:25:10.803144 (+1610370us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b180047e5a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:25:11.040518 (+237374us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:11.117754 (+ 77236us) log.cc:842] Serialized 14 byte log entry
0812 19:25:11.117998 (+   244us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:11.118642 (+   644us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:11.239334 (+120692us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b180047e5a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:25:11.241111 (+  1777us) raft_consensus.cc:1671] finished
0812 19:25:11.241134 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:11.241258 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":213140,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":187,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":55755,"spinlock_wait_cycles":34470016,"thread_start_us":265760,"threads_started":2,"wal-append.queue_time_us":1823139}
I20260812 19:25:11.288944 17293 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:11.289069 17248 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:11.289402 17293 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:25:11.290324 17886 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:25:11.286691  6353 rpcz_store.cc:269] 0812 19:25:09.577335 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:09.578101 (+   766us) service_pool.cc:227] Handling call
0812 19:25:10.863848 (+1285747us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b180000cb40. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f77b3856 00007f98f7705f7e 00007f98f776f367 00007f98f7770b4e 00007f98f777c228 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c
0812 19:25:11.063374 (+199526us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5800a244b0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f76f3f63 00007f98f7757aba 00007f98f776f3af 00007f98f7770b4e 00007f98f777c228 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c
0812 19:25:11.286202 (+222828us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2805233280}
I20260812 19:25:11.290815 17886 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:11.291846 17906 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:11.248732  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:11.293052  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44407.7us
I20260812 19:25:11.293356 17793 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:11.248417  6344 rpcz_store.cc:276] 0812 19:25:08.650701 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:08.650912 (+   211us) service_pool.cc:227] Handling call
0812 19:25:08.668957 (+ 18045us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:08.684910 (+ 15953us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:08.684951 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:08.710100 (+ 25149us) log.cc:842] Serialized 26 byte log entry
0812 19:25:09.018751 (+308651us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:09.018844 (+    93us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:09.018952 (+   108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:11.135635 (+2116683us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:25:11.184543 (+ 48908us) raft_consensus.cc:1671] finished
0812 19:25:11.184565 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:11.189333 (+  4768us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2955,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":14172,"spinlock_wait_cycles":7397760,"thread_start_us":271715,"threads_started":1,"wal-append.queue_time_us":599873}
I20260812 19:25:11.260618  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
W20260812 19:25:11.273659  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 84104.5us
I20260812 19:25:11.271222 17353 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:11.295125  6297 leader_election.cc:398] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22.
W20260812 19:25:11.295589  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:11.295877  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.295372 17353 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.297598  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:11.298918  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.298799 17386 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.299816  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:11.300542  6483 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 20: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:11.301028  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:11.301389 17386 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:11.254129 17741 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:11.311749  6359 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:11.273649 17602 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:11.293917 17793 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:11.332360  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:11.333201  6465 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:11.334180  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:11.303047  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:11.303817  6416 leader_election.cc:398] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18.
I20260812 19:25:11.334935 17622 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:11.336223  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:11.334997  6344 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:11.327203 17194 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260812 19:25:11.338603 17602 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.340775 17602 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:11.304421 17921 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:11.244309 17838 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:11.343789 17785 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:25:11.344074  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:11.345508 17838 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:11.346947  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.348349  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.306241  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:11.307087  6482 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:11.349488  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:11.351390  6230 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 17
I20260812 19:25:11.312757  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:11.360603  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 54427.3us
I20260812 19:25:11.361768  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:11.308683  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:11.313669  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.313931  6229 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260812 19:25:11.314370  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:11.315454  6481 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:11.364199  6235 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:11.316473  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.317464 17845 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:11.282570  6350 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260812 19:25:11.276468 17586 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:11.275691 17883 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:11.328791  6345 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:25:11.327437 17741 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:11.264256 17954 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:11.331863  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:11.336341  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:11.350494 17838 consensus_queue.cc:1046] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:25:11.322508 17383 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:11.308179  6241 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:25:11.284759 17863 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:11.171645  6474 rpcz_store.cc:276] 0812 19:25:09.216838 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:09.216991 (+   153us) service_pool.cc:227] Handling call
0812 19:25:09.217384 (+   393us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:09.230873 (+ 13489us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:09.230905 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:09.231350 (+   445us) log.cc:842] Serialized 26 byte log entry
0812 19:25:10.905105 (+1673755us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b18004b9580. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:25:11.074115 (+169010us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:25:11.074157 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:11.074490 (+   333us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:11.142782 (+ 68292us) raft_consensus.cc:1671] finished
0812 19:25:11.142805 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:11.150584 (+  7779us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":21832,"raft.queue_time_us":13173,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":21418,"spinlock_wait_cycles":25720576,"thread_start_us":168817,"threads_started":1,"wal-append.queue_time_us":1844556}
I20260812 19:25:11.312870 17796 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:11.417127  6241 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:11.418061  6229 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:25:11.313432  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.354290 17916 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:11.363046  6238 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:11.365978 17464 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:11.367623  6228 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260812 19:25:11.364174  6344 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:25:11.371094  6483 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 12. Current term is 13. Ops: []
I20260812 19:25:11.375502  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:11.375859  6352 raft_consensus.cc:595] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:11.378240  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:11.426620  6352 raft_consensus.cc:603] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:11.409941  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:25:11.426959  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 48833.4us
I20260812 19:25:11.432829  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:11.433096  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:11.429251  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:11.439440  6359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2801) took 1863 ms (client timeout 1654 ms). Trace:
W20260812 19:25:11.439891  6359 rpcz_store.cc:269] 0812 19:25:09.576093 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:09.579665 (+  3572us) service_pool.cc:227] Handling call
0812 19:25:11.439266 (+1859601us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54001ba154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:11.439370 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3779385216}
I20260812 19:25:11.442054  6345 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:25:11.445415  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.453275  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:25:11.456552  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 81156.8us
I20260812 19:25:11.406805 17939 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260812 19:25:11.460626  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:11.468266 17383 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:11.436754 17921 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:11.433671 17863 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:11.455889 17622 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:11.492218 17622 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:11.492755 17622 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:11.493170  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.496584  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:11.498488 17617 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:25:11.499166 17617 raft_consensus.cc:686] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:11.494545  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:11.446931 17337 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260812 19:25:11.510926  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 52340.9us
I20260812 19:25:11.512633  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:11.516093  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:11.502009  6235 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:11.528028  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:11.425828 17796 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.531836 17785 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:11.532382 17796 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:11.534408 17742 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:11.541409 17863 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:11.543166 17863 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.485317 17847 consensus_queue.cc:1046] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260812 19:25:11.504901 17935 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.507728 17617 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:11.553332 17916 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:11.557547  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:11.558310  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:11.530222  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:11.560652  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.558775  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:11.590698  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:11.590137  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.599968  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:11.591765  6229 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:11.606925  6232 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 20: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:25:11.609562  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 93536.6us
I20260812 19:25:11.612144  6477 raft_consensus.cc:2396] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
W20260812 19:25:11.615708  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 85589.7us
I20260812 19:25:11.467849 17886 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:11.619292  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 155075us
I20260812 19:25:11.623620 17935 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:11.626811 17921 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:11.651095  6229 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:11.652704  6235 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: []
I20260812 19:25:11.664214  6230 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:25:11.610885 17916 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:11.673723  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:11.650135 17929 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:25:11.641980 17622 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.683128  6464 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:25:11.684643 17883 raft_consensus.cc:3032] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:11.689929 17838 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:11.711508  6482 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 15. Current term is 16. Ops: []
I20260812 19:25:11.690260 17921 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:11.692282  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 89d6b10f5ff448f592a41c3a77692cfe, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.693300  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:11.715878  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 89d6b10f5ff448f592a41c3a77692cfe, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.707047  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:11.717240  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:11.699424  6230 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:11.724009  6474 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:11.725260  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.729532  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:11.730463  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:11.729979  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.733774  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:11.734241  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.735047  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:11.734135  6344 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:11.737128  6344 raft_consensus.cc:595] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:11.737581  6344 raft_consensus.cc:603] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:11.738451  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:11.731206  6232 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:11.745760  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:11.749747  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:11.750177  6342 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 19: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:11.751332  6232 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:11.752379  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:11.761751  6483 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:11.752199 17736 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:11.757156  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:11.738871 17916 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:11.760303  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:11.698443 17935 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:11.763401  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:11.766268  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:11.719919 17838 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:11.714712 17883 raft_consensus.cc:729] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:25:11.757685 17541 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.004s
I20260812 19:25:11.753101 17626 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:25:11.774917  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:11.756465 16960 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:11.752985 17383 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:11.783799  6344 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:11.765913 17736 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:11.824867 17736 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:11.748956 17337 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:25:11.705417 17940 consensus_queue.cc:1046] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260812 19:25:11.786017  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:11.787797  6465 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:11.709137 17248 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260812 19:25:11.791325 17741 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.829679 17877 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:25:11.831211 17741 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:11.755926 17929 consensus_queue.cc:1046] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260812 19:25:11.832140  6236 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:11.795708 17883 consensus_queue.cc:260] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.838155  6344 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:25:11.839821 17622 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:11.841272 17972 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260812 19:25:11.841854 17248 consensus_queue.cc:1225] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260812 19:25:11.842046 17939 raft_consensus.cc:3032] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:11.842476 17248 raft_consensus.cc:3032] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:25:11.842617 17939 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:11.842999 17248 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:11.842747 16960 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:11.843902 17248 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.843912 17939 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.804173 17838 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.765583 17935 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:11.847812  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:11.817713  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:11.845161 16960 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:11.845757 17929 raft_consensus.cc:3032] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:25:11.803085  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:11.816272 17886 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:11.859700 17939 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
W20260812 19:25:11.788290 17873 consensus_meta.cc:287] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.572s	user 0.012s	sys 0.004s
I20260812 19:25:11.855685 17935 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:11.861531 17551 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:11.802320 17793 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260812 19:25:11.854146 17293 consensus_meta.cc:287] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.564s	user 0.015s	sys 0.000s
I20260812 19:25:11.864188 17929 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:11.872915  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 1109) took 1392 ms. Trace:
I20260812 19:25:11.869920 17873 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.845175 17248 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:11.892838  6475 rpcz_store.cc:276] 0812 19:25:10.480290 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:10.480490 (+   200us) service_pool.cc:227] Handling call
0812 19:25:10.480890 (+   400us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:11.841274 (+1360384us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:11.841320 (+    46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:11.841374 (+    54us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:11.841407 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:11.872722 (+ 31315us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54004457d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:11.872764 (+    42us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:11.872865 (+   101us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":44908,"raft.queue_time_us":45496,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"spinlock_wait_cycles":3024181504}
I20260812 19:25:11.937589  6238 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:11.870592 17551 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:11.887151 17293 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:11.963088 17551 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:11.902024 17960 consensus_queue.cc:1046] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260812 19:25:11.941890 17785 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:11.973922  6241 raft_consensus.cc:1226] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 12. Current term is 13. Ops: []
I20260812 19:25:11.956086 17877 raft_consensus.cc:686] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:25:11.977325  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 243921us
I20260812 19:25:12.000332  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:11.967303 17626 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:12.002593  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:11.974789 17983 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260812 19:25:12.014138 17464 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.004s
I20260812 19:25:11.952689 17929 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.005527 17886 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:12.036056  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:11.970830 17785 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.014787 17464 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:12.051146  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:12.051630  6238 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:25:12.055936  6224 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:12.056823  6236 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 19: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:12.059051  6229 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:12.060474  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:12.061038  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:12.070547  6352 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:12.012939 17551 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260812 19:25:12.083524  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:12.086256  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 2611) took 1400 ms. Trace:
I20260812 19:25:12.090638  6477 rpcz_store.cc:276] 0812 19:25:10.685989 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:11.120921 (+434932us) service_pool.cc:227] Handling call
0812 19:25:12.086039 (+965118us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5400364a54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:12.086192 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":933782400}
I20260812 19:25:12.087497  6481 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
I20260812 19:25:12.091958  6481 pending_rounds.cc:76] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 10
I20260812 19:25:12.092289  6481 pending_rounds.cc:97] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 21.11
I20260812 19:25:12.092566  6481 raft_consensus.cc:2866] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:12.056138 17796 raft_consensus.cc:3032] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:12.066203 17929 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
W20260812 19:25:12.108704  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 9e38bc4707784979b4d00b45879a8f0b, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:12.113101  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 9e38bc4707784979b4d00b45879a8f0b, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:12.089216 17985 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260812 19:25:12.112143  6297 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:12.118516  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:25:12.112512  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 355413us
I20260812 19:25:12.122485  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:12.104699 17849 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:12.094363 17845 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:12.103295 17796 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:12.124694  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:12.102425 17873 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:12.149986  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:12.151316  6353 raft_consensus.cc:1226] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
W20260812 19:25:12.136705  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 108186us
I20260812 19:25:12.139643  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:12.152137  6344 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:25:12.120520 17793 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:12.160699  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:12.162926  6352 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:12.164000  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:12.163177  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet d1275ccc06f94fcdaa82a73420569651, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:12.164717  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet d1275ccc06f94fcdaa82a73420569651, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.123356 17953 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:12.174543  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:12.146916 17353 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:12.168817  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:12.185642  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:12.186513  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:12.195353  6352 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:12.186537  6475 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:12.197176  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:12.082149 17877 consensus_queue.cc:237] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.147760 16960 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:12.118603 17736 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.207571  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:12.209580  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 49004.8us
I20260812 19:25:12.211396  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:12.153472 17741 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:12.165916 17873 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:12.215215  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:12.153573 17551 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:12.205350  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:12.177657 17985 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260812 19:25:12.169152 17383 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:12.166296 17194 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:12.167214 17293 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:12.170588 17849 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260812 19:25:12.283371  6235 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:12.217303  6477 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 18: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:12.234440  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:12.242966  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:12.156766 17847 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260812 19:25:12.233018  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:12.212637 17586 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:12.230994 17602 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:12.275821  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 335384us
I20260812 19:25:12.238366 16960 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:12.217861 18023 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:25:12.238937 17994 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:12.313051  6352 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: []
W20260812 19:25:12.317796  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 74960.1us
I20260812 19:25:12.275285  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:25:12.324085 18013 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260812 19:25:12.331049  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:12.283485 17886 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:12.364599  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:12.287358 17541 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260812 19:25:12.312314  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 79428us
I20260812 19:25:12.219928 17626 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.101s
I20260812 19:25:12.353374  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3266) took 1037 ms. Trace:
I20260812 19:25:12.219189 17742 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260812 19:25:12.340692  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:12.357970  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:12.386143  6483 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 19: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:12.362222  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:12.232735 17953 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260812 19:25:12.367693  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:12.315807 17293 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:12.275098 17551 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:12.218796 17940 consensus_queue.cc:1046] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.116s
I20260812 19:25:12.370148  6481 rpcz_store.cc:276] 0812 19:25:11.315531 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:11.364754 (+ 49223us) service_pool.cc:227] Handling call
0812 19:25:12.086998 (+722244us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:12.093078 (+  6080us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:12.353121 (+260043us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400364a50. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:12.353306 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1568045952}
W20260812 19:25:12.373833 17992 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260812 19:25:12.375082 17626 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:12.376185 17785 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:12.377174 17736 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:12.436143  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 68523.5us
I20260812 19:25:12.352128 17392 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:12.330013 17194 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260812 19:25:12.381256 18015 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260812 19:25:12.357370 18010 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260812 19:25:12.356755 17990 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.250s	user 0.001s	sys 0.001s
W20260812 19:25:12.355346 18014 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260812 19:25:12.356218 18004 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260812 19:25:12.383882 17383 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 20.8, Last appended by leader: 8, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.365473  6475 raft_consensus.cc:2362] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20. Re-sending same reply.
I20260812 19:25:12.397480  6482 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: [15.11-19.13]
I20260812 19:25:12.340190 17586 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:25:12.422762  6353 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:12.470077  6353 raft_consensus.cc:595] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:12.470438  6353 raft_consensus.cc:603] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:12.364187 16960 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:25:12.376214 17935 consensus_meta.cc:287] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
I20260812 19:25:12.435108  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3277) took 1116 ms. Trace:
I20260812 19:25:12.237247 17796 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.444597  6481 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260812 19:25:12.337289 17602 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.463169  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:25:12.464859  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 257371us
I20260812 19:25:12.480835  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:12.426398 17847 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260812 19:25:12.426328 17626 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:12.468240  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:12.384999 17886 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.471951  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:12.490711  6482 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:12.474023  6230 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260812 19:25:12.476536  6229 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260812 19:25:12.454162 17194 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:12.445819 18022 raft_consensus.cc:2741] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260812 19:25:12.364576 17994 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:12.486745 17939 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.603s	user 0.013s	sys 0.000s
I20260812 19:25:12.477298  6242 rpcz_store.cc:276] 0812 19:25:11.318211 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:11.368463 (+ 50252us) service_pool.cc:227] Handling call
0812 19:25:11.368817 (+   354us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:11.369167 (+   350us) raft_consensus.cc:1520] Early marking committed up to index 9
0812 19:25:11.369480 (+   313us) log.cc:842] Serialized 14 byte log entry
0812 19:25:11.659152 (+289672us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:11.665993 (+  6841us) log.cc:842] Serialized 26 byte log entry
0812 19:25:11.666123 (+   130us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:25:11.666158 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:11.666231 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:12.434842 (+768611us) raft_consensus.cc:1671] finished
0812 19:25:12.434876 (+    34us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:12.435035 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":594,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":451,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":4989,"thread_start_us":289153,"threads_started":1,"wal-append.queue_time_us":397019}
I20260812 19:25:12.482304  6236 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:12.483249  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:12.459175 17248 consensus_meta.cc:287] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.004s
I20260812 19:25:12.453975 17916 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 20 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:12.512072 17916 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.446544 17996 consensus_queue.cc:1046] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260812 19:25:12.516959  6464 raft_consensus.cc:2396] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260812 19:25:12.517519 17994 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:12.518360 16960 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.496040 17626 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.457106 17392 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.502300  6353 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:12.501993  6475 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:12.536193  6353 raft_consensus.cc:595] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:12.536720  6353 raft_consensus.cc:603] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:12.503214  6481 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:12.486122  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:12.498221 17194 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:12.497036 17886 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:12.526356 17793 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:12.526612 17551 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:12.488673 17586 raft_consensus.cc:3032] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:25:12.481540 17935 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:12.531810  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 48670.3us
I20260812 19:25:12.531692  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:12.539341  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 53310.9us
I20260812 19:25:12.573385  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:12.493152 17849 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:12.547274  6482 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:12.549556  6238 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:12.555287  6470 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260812 19:25:12.576385  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:25:12.577425  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45830.1us
I20260812 19:25:12.579489  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:12.580773  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:12.604274  6236 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:12.606671  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1040) took 1287 ms. Trace:
I20260812 19:25:12.607414  6353 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:12.554044 17293 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:12.615113  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:12.618587  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:12.609135  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:12.639256  6241 rpcz_store.cc:276] 0812 19:25:11.319030 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:11.426069 (+107039us) service_pool.cc:227] Handling call
0812 19:25:11.426400 (+   331us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:11.974502 (+548102us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:12.606306 (+631804us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b5400212fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:12.606578 (+   272us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1258473728}
I20260812 19:25:12.570159 17586 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:12.559171 17847 raft_consensus.cc:3032] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:12.603477 17742 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:12.651986  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:12.558197 17996 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:12.655656  6178 leader_election.cc:334] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 2.418s (SENT)
I20260812 19:25:12.606900 17626 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:12.580466 17662 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:12.651150  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:25:12.654749  7554 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.010s	sys 0.022s
W20260812 19:25:12.676653  7554 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.011s	sys 0.023s
I20260812 19:25:12.607847 17868 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:12.668473  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:12.658161 17999 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:12.678795 17999 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:12.678917 18025 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:12.679260 17999 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:12.641404 17248 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:12.642642 18024 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:12.681694 18024 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:12.682274 18024 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:12.672168 17586 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:12.675372 17989 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.719s	user 0.006s	sys 0.000s
I20260812 19:25:12.604993 17741 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:25:12.655032 17847 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:12.715559 17847 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.716974 17847 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:12.717025  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53178 (request call id 3270) took 1405 ms. Trace:
I20260812 19:25:12.717566  6224 rpcz_store.cc:276] 0812 19:25:11.311437 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:11.311586 (+   149us) service_pool.cc:227] Handling call
0812 19:25:12.716862 (+1405276us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b5400179654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:12.716965 (+   103us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1464882048}
I20260812 19:25:12.642336 18001 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:12.658356 17873 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:12.719027 17873 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.719506 17353 raft_consensus.cc:3032] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:12.719974 17353 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:12.720861 17353 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.722317 17353 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:12.721200 17873 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:12.725975 17883 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:12.717190 17741 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:12.734402 17741 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:12.735508  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 117046us
I20260812 19:25:12.726779 17954 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260812 19:25:12.727859  6354 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2817) took 1919 ms (client timeout 1948 ms). Trace:
W20260812 19:25:12.747681  6354 rpcz_store.cc:269] 0812 19:25:10.808081 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:10.988693 (+180612us) service_pool.cc:227] Handling call
0812 19:25:12.726599 (+1737906us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b54001b8354. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:12.727790 (+  1191us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2179718016}
I20260812 19:25:12.748595 17551 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:25:12.749709 17551 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:12.751328 17935 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:12.728327  6344 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: []
W20260812 19:25:12.727895 18006 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260812 19:25:12.731501 17868 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:12.660233 17921 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260812 19:25:12.739518  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:12.741509  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:12.654034 17602 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:12.742276  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:12.743528  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:12.750224 17551 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:12.660687 18055 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:12.702137 17996 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.776729 17940 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:12.780490 17940 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.781144 17996 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:12.781745  6353 raft_consensus.cc:595] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:12.747174 18050 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:25:12.784016  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3274) took 1076 ms. Trace:
I20260812 19:25:12.755206  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:12.782150  6353 raft_consensus.cc:603] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:12.784490  6474 rpcz_store.cc:276] 0812 19:25:11.707221 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:11.742907 (+ 35686us) service_pool.cc:227] Handling call
0812 19:25:11.743260 (+   353us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:11.754825 (+ 11565us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:11.754873 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:11.755440 (+   567us) log.cc:842] Serialized 26 byte log entry
0812 19:25:12.087197 (+331757us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:12.087255 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:12.087348 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:12.783767 (+696419us) raft_consensus.cc:1671] finished
0812 19:25:12.783791 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:12.783945 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10943,"raft.queue_time_us":11206,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":8984,"thread_start_us":305872,"threads_started":1,"wal-append.queue_time_us":725298}
I20260812 19:25:12.782553 17940 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:12.787456  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:12.782403 17194 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.800787 17194 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:12.801265 17796 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:12.802541  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3281) took 1481 ms. Trace:
I20260812 19:25:12.802981  6228 rpcz_store.cc:276] 0812 19:25:11.321417 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:11.456255 (+134838us) service_pool.cc:227] Handling call
0812 19:25:11.456638 (+   383us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:11.456986 (+   348us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:11.457012 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:11.757220 (+300208us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b1800386b60. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a
0812 19:25:12.235912 (+478692us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b2c0006c608. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:25:12.283204 (+ 47292us) log.cc:842] Serialized 26 byte log entry
0812 19:25:12.479372 (+196168us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:12.479403 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:12.479472 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:12.802298 (+322826us) raft_consensus.cc:1671] finished
0812 19:25:12.802322 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:12.802472 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4940,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6546,"spinlock_wait_cycles":63231488,"thread_start_us":120558,"threads_started":1,"wal-append.queue_time_us":447898}
I20260812 19:25:12.805965 17392 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:12.769075 17939 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:12.807148 17939 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.808243 17864 raft_consensus.cc:3032] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:25:12.808835 17864 raft_consensus.cc:729] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:12.809297 17939 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:12.809930 17864 consensus_queue.cc:260] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:12.811695 17864 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:12.813337  6055 catalog_manager.cc:5495] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:12.813352  6352 raft_consensus.cc:2354] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20.
I20260812 19:25:12.781472 18024 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:12.757227  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:12.759161  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:12.759346  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:12.759936  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:12.818334  6235 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:12.820013 18055 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.769132  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:12.713163  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:12.825073  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 1100) took 1575 ms. Trace:
I20260812 19:25:12.825243 17921 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260812 19:25:12.825448  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 112377us
I20260812 19:25:12.827941  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:12.771682  6342 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:12.744959  6347 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260812 19:25:12.773869  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:12.834223  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 60486.8us
I20260812 19:25:12.836551  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:12.775635  6232 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260812 19:25:12.772527 17868 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
W20260812 19:25:12.780193 18062 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260812 19:25:12.842553  6347 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260812 19:25:12.825525  6349 rpcz_store.cc:276] 0812 19:25:11.249246 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:11.250188 (+   942us) service_pool.cc:227] Handling call
0812 19:25:11.436278 (+186090us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:25:11.442298 (+  6020us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:11.442333 (+    35us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:25:11.442989 (+   656us) log.cc:842] Serialized 52 byte log entry
0812 19:25:11.888232 (+445243us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b180038a7c0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:25:12.086211 (+197979us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:12.086252 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:12.086326 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:12.717053 (+630727us) raft_consensus.cc:1671] finished
0812 19:25:12.717077 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:12.824898 (+107821us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540036d650. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:12.825011 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":6573,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":10770,"spinlock_wait_cycles":471347840,"thread_start_us":197740,"threads_started":1,"wal-append.queue_time_us":1102629}
I20260812 19:25:12.845623  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:25:12.846093  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 90992us
I20260812 19:25:12.848573  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:12.848693  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:12.805845 17866 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:25:12.852389  6232 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260812 19:25:12.855077  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:12.855509  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:12.856859  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:12.828987 18009 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:12.859799  6474 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: []
I20260812 19:25:12.858865  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:12.866909  6241 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: []
I20260812 19:25:12.874819  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:12.884869  6470 raft_consensus.cc:1226] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 15. Current term is 16. Ops: []
I20260812 19:25:12.869127  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:12.885210  6236 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:12.867165  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:12.866552  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:12.886747  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:12.888000  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:12.889196  6474 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:12.844630 17392 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:12.890419  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:12.864363  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:12.868618  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:12.892817  6475 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:12.892890  6228 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260812 19:25:12.895905  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:12.850576 17939 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:12.896857  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:12.897382  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:12.828212 17996 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260812 19:25:12.897917  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:12.900797  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:12.852187 17866 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:12.860217 18022 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:12.834235 17845 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260812 19:25:12.901890  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:12.958191  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:25:12.961251  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 59453.7us
I20260812 19:25:12.891542 17696 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:12.866016  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:12.901319 17541 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:12.904599  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:12.887264  6342 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:12.771922 17999 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.909248 18027 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:12.909108 18064 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:25:12.911099 17075 consensus_queue.cc:1046] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:12.875252 18024 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:12.861171 17873 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:12.941015  6474 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260812 19:25:12.956586  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:12.947446  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:13.026165  6475 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:12.896211 18050 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:12.896528  6228 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:12.887131 17916 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:12.963481  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:13.043628  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 80210.3us
I20260812 19:25:13.045131  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:12.903699 17939 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:13.046983  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 90481us
I20260812 19:25:13.048692  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:13.050153  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:12.962242 17940 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:12.964865 17866 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.971730 17248 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:12.973640 17996 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:12.976092  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:12.977238 17386 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 19:25:12.980190 17953 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 19:25:12.980952 17793 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:25:12.987658 17551 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:12.898998 18009 raft_consensus.cc:686] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:25:12.994006 17929 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.878s	user 0.008s	sys 0.003s
I20260812 19:25:12.996975 18055 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:12.903852  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:12.905844 17811 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:12.917199 18022 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:13.082708 18034 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:13.083115 18022 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:13.066433 18023 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:25:13.083402 18034 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:13.064131 17248 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:13.084393 17248 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:13.085747 18034 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:12.945209 17935 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:25:13.090119 17849 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260812 19:25:13.091427 18078 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260812 19:25:13.053014  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:13.054699 17877 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:13.059486 17939 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:13.055904  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:13.056694 17464 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:13.003058 17662 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260812 19:25:13.028275 17883 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:13.074270 17541 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:13.008469 16960 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260812 19:25:13.038224 18027 raft_consensus.cc:2741] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 20 LEADER]: Leader pre-election decision vote started in defunct term 19: won
I20260812 19:25:13.011041 17696 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:13.100106  6228 raft_consensus.cc:2379] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 13: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:13.099591  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:13.155848 17696 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:13.092585 17793 consensus_queue.cc:1225] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 22.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260812 19:25:13.156581  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 57116.9us
I20260812 19:25:13.157665  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:13.062338 17996 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:13.064508 17940 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:12.963093 17926 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.083s
W20260812 19:25:13.106009  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 62000.5us
I20260812 19:25:13.092164 18052 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:13.058684 17916 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.101800  6475 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:13.042354 17886 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260812 19:25:13.127106 18076 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260812 19:25:13.105896 17464 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.125149 17929 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:13.141665  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3282) took 1372 ms. Trace:
I20260812 19:25:13.100915 17935 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260812 19:25:13.149077 18080 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
W20260812 19:25:13.149580 18063 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.400s	user 0.010s	sys 0.000s
I20260812 19:25:13.150300 17838 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:13.091646 18009 consensus_queue.cc:237] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.151768 17868 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:13.154052 18079 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260812 19:25:13.154531  6235 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260812 19:25:13.157811 17999 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:13.112591  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 125439us
I20260812 19:25:13.180588  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:25:13.158813 17392 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:13.207260  6465 rpcz_store.cc:276] 0812 19:25:11.768908 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:11.880724 (+111816us) service_pool.cc:227] Handling call
0812 19:25:11.881139 (+   415us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:11.961723 (+ 80584us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:25:12.224869 (+263146us) log.cc:842] Serialized 14 byte log entry
0812 19:25:12.553411 (+328542us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:12.553472 (+    61us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:12.553522 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:13.141396 (+587874us) spinlock_profiling.cc:243] Waited 80.3 ms on lock 0x7b5400073ad4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:13.141448 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:13.141599 (+   151us) inbound_call.cc:173] Queueing success response
0812 19:25:13.145949 (+  4350us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
Metrics: {"prepare.queue_time_us":107992,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":134,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"spinlock_wait_cycles":199909248,"thread_start_us":493693,"threads_started":2,"wal-append.queue_time_us":431043}
I20260812 19:25:13.220350  6353 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: []
I20260812 19:25:13.222505  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:13.181993 18061 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.435s	user 0.002s	sys 0.002s
I20260812 19:25:13.238718  6232 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260812 19:25:13.239044  6475 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260812 19:25:13.181509 17858 raft_consensus.cc:3032] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Stepping down as leader of term 12
I20260812 19:25:13.160799 18025 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:13.158993 17293 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 19:25:13.166360 17586 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:13.235292  6417 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:13.210285 18052 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:13.244069  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:13.251971  6474 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:13.245814  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:25:13.254082  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:13.255656  6353 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260812 19:25:13.241834  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:13.245292  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:13.247560  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:13.249441  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:13.259572  6228 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:13.223299 17811 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:13.262782  6229 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:13.159570 17383 consensus_queue.cc:1046] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260812 19:25:13.171808 17248 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.277777  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:13.244845 17337 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:13.243566 17858 raft_consensus.cc:729] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:13.247997 17866 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:13.271946  6474 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:13.253623 18052 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:13.281810  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:13.290140  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:13.291184  6352 raft_consensus.cc:1261] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260812 19:25:13.294164  6342 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 19.
I20260812 19:25:13.291782  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:13.221984 17929 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.253648 18076 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:13.273622 18025 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:13.264124 17527 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260812 19:25:13.310933 17873 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:13.266054 18050 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:13.311895 18050 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.314015 18050 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:13.266340 17541 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:13.263942 17996 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 21.9, Last appended by leader: 9, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.305234  6482 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260812 19:25:13.273329 16960 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:13.315457 17996 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:13.304220  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:13.247949 18022 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.323518  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:13.319712  6349 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 19.
W20260812 19:25:13.347155  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 64698.2us
I20260812 19:25:13.283190 17337 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:13.349185  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:13.350044  6465 raft_consensus.cc:1261] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260812 19:25:13.357185  6474 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:25:13.354945  6229 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:13.359663  6474 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260812 19:25:13.363865  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:13.307093 18001 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:13.370762  6470 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260812 19:25:13.371250  6470 pending_rounds.cc:76] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 9
I20260812 19:25:13.371515  6470 pending_rounds.cc:97] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260812 19:25:13.371822  6470 raft_consensus.cc:2866] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:13.373014  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:13.375142  6416 leader_election.cc:398] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20.
I20260812 19:25:13.375479  6416 leader_election.cc:401] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260812 19:25:13.369184  6482 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 8. Preceding OpId from leader: term: 22 index: 9. (index mismatch)
I20260812 19:25:13.262895 18023 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
W20260812 19:25:13.347674 18061 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260812 19:25:13.376901  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:13.315457 16960 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:25:13.378399  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 49662.7us
I20260812 19:25:13.291679 17845 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.071s
I20260812 19:25:13.356855 17541 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:13.358456 17849 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:13.400941  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:13.405735  6241 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 21: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:13.378330 18053 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:13.403535  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:13.319219 18027 consensus_queue.cc:1046] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260812 19:25:13.380399 17883 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20.
I20260812 19:25:13.438877  6352 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:13.439498  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:13.441562 17868 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:13.445097  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 49452.7us
I20260812 19:25:13.447690 17793 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:13.450119  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:13.461550  6235 raft_consensus.cc:2379] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 22: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:13.356150 17811 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
W20260812 19:25:13.397840 17864 consensus_meta.cc:287] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.586s	user 0.013s	sys 0.000s
I20260812 19:25:13.382786 17361 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:13.393392 16960 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:13.392031 18050 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:25:13.382447 18001 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:13.457981  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2641) took 1299 ms. Trace:
I20260812 19:25:13.396512 18051 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:13.458454  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:13.347889 18076 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:13.405332 17849 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:13.407759 18053 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:13.396085 17383 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
W20260812 19:25:13.458282 18073 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260812 19:25:13.437422 18059 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:13.496778  6477 rpcz_store.cc:276] 0812 19:25:12.158309 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:12.433784 (+275475us) service_pool.cc:227] Handling call
0812 19:25:12.466770 (+ 32986us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:12.483918 (+ 17148us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:12.483945 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:12.484333 (+   388us) log.cc:842] Serialized 26 byte log entry
0812 19:25:12.578312 (+ 93979us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:12.607883 (+ 29571us) log.cc:842] Serialized 14 byte log entry
0812 19:25:12.608152 (+   269us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:12.608233 (+    81us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:12.734939 (+126706us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b180049d2c0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f47d34ca 00007f98fdea8f99 00007f98fb620bcf 00007f98f485c7b6 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d
0812 19:25:13.181165 (+446226us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:25:13.457706 (+276541us) raft_consensus.cc:1671] finished
0812 19:25:13.457739 (+    33us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:13.457917 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26047,"prepare.queue_time_us":28636,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":64295,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":20577,"spinlock_wait_cycles":25123840,"thread_start_us":91706,"threads_started":1,"wal-append.queue_time_us":201675}
I20260812 19:25:13.506057  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:13.392915 17662 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.073s
W20260812 19:25:13.508584  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 121988us
I20260812 19:25:13.459156 17464 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:13.464051 17883 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:13.513435 18088 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260812 19:25:13.514272 18105 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260812 19:25:13.545019 18059 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:13.515156 18110 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260812 19:25:13.516410 18090 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260812 19:25:13.552831 18059 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:13.522198  6465 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:25:13.555215 18022 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:13.407598 17541 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.503262 17916 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:13.557190 17541 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:13.510962 18051 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.557245 18001 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.558736 17248 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:13.559289 18051 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:13.561164 18076 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:13.563663 17849 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.510864 17999 consensus_queue.cc:1046] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260812 19:25:13.565822 17999 raft_consensus.cc:3032] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:13.566228 17999 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:13.566095 16960 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:13.528398  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 125797us
I20260812 19:25:13.468667 17361 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:13.467880 17793 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.503607 17940 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:13.507915 18106 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:13.615095 18106 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:13.615442  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:13.616456  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:13.616261 18106 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.617138  6354 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:13.385099 17858 consensus_queue.cc:260] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:13.614708  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:13.619021  6242 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260812 19:25:13.548640 17353 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 19:25:13.548847 17883 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.544461 17662 consensus_queue.cc:1225] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer bdfa5579d4534c618c00db6b4a841c81 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260812 19:25:13.499454 17886 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:13.254935  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:13.573287  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:13.525138 18053 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:13.583581 17337 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.586795 18076 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:13.590682 17361 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:13.597033 17293 raft_consensus.cc:3032] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:25:13.544950 17742 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:13.606981 17849 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:13.612914  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:13.619397  6347 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:25:13.619830  6228 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:13.615129  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:13.642131  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:13.662919  6055 catalog_manager.cc:5495] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 15 to 17, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 17 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:13.653424  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:13.660367  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:13.624428 17845 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:13.640597 17929 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:13.644155 17940 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:13.684898  6352 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
W20260812 19:25:13.655117  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 299647us
W20260812 19:25:13.688938  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 46926.9us
I20260812 19:25:13.651140  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:13.692517 17845 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.694792 17248 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:13.684721 17293 raft_consensus.cc:729] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:13.567349 17999 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.657723 17886 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.590484 17939 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.703682  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:13.705662  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:13.706462  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:13.706835  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:13.659806 17392 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:13.732043  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:13.733119  6473 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:25:13.734246 17939 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:13.729679  6224 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:25:13.646142 17796 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260812 19:25:13.728843  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:13.700695 17868 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:13.678714 17602 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:13.688841 17953 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:13.688552 18051 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:13.742250  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:13.745119  6352 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:25:13.747121  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:13.737740 17929 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:13.751633 17868 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:13.777087  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica a1541d11be514114966dc1e92a345298 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:13.779578  6354 raft_consensus.cc:1226] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 16. Current term is 17. Ops: []
I20260812 19:25:13.780381  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:13.690624 18076 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.758384 17953 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.787500  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:13.788319  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:13.788609  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:13.788837  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:13.727586 17940 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.793534  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:13.865960  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:13.752353 17551 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:13.795400  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:13.735754 17248 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:13.778985 17929 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:13.924125  6477 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260812 19:25:13.796265 17811 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260812 19:25:13.764927 18051 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.791867 18009 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:13.755254 17999 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:13.794088 17293 consensus_queue.cc:260] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.931768 17741 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260812 19:25:13.932453  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 139139us
I20260812 19:25:13.933178 18142 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260812 19:25:13.934060  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 145283us
I20260812 19:25:13.929569 17953 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:13.886258 16960 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:13.738667 17392 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.925375  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:13.958945  6345 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:13.936152 17940 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:13.791489 17868 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
W20260812 19:25:14.000777  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet f4ae22a8efcc4f26bdc2d4cc4266111a, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:14.022398  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet f4ae22a8efcc4f26bdc2d4cc4266111a, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:13.791585 17954 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:25:13.744854 17847 consensus_queue.cc:1159] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a1541d11be514114966dc1e92a345298" responder_term: 18 status { last_received { term: 18 index: 11 } last_committed_idx: 10 last_received_current_leader { term: 18 index: 11 } }
I20260812 19:25:14.004791  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:14.007535  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:13.923981  6464 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:13.958077 17551 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:13.755062 17602 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:13.968227 17929 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:14.026142  6241 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
W20260812 19:25:14.002460 18052 consensus_meta.cc:287] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.694s	user 0.008s	sys 0.004s
I20260812 19:25:14.097960  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:13.999409 17741 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:14.015426 17996 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.699s	user 0.016s	sys 0.000s
W20260812 19:25:14.029299 18062 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260812 19:25:14.119099  6242 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:14.027272 16960 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:14.029709 17551 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:14.121806  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:14.120725  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:14.160568  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:14.119875 17741 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:14.008997 18009 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:14.191368  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 70747us
I20260812 19:25:14.198215  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:14.205269  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:14.211616  6349 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 21 index: 9. Preceding OpId from leader: term: 22 index: 9. (term mismatch)
I20260812 19:25:14.212289  6349 pending_rounds.cc:76] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 8
I20260812 19:25:14.212563  6349 pending_rounds.cc:97] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 21.9
I20260812 19:25:14.212872  6349 raft_consensus.cc:2866] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:14.022956 18022 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.105s
I20260812 19:25:14.106097 18096 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:14.040380 17906 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:14.029129 17793 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:14.096048 17940 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:14.040684 17883 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:14.243022  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:14.264067  6228 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:14.035478 17954 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:14.223899 18085 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.013s	sys 0.028s
I20260812 19:25:14.199141 17939 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:14.118232 18108 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:14.278123 18108 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.279277  6481 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 13.
I20260812 19:25:14.279637 18087 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:14.280184 18087 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.281484 18096 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.282210 18087 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:14.283624 18138 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:14.284350 18138 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:14.170576 18052 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.284798 18138 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:14.285444  6464 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 20: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:14.272089 17940 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:14.288520 18152 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260812 19:25:14.284375 17883 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:14.265499 17906 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:14.188751 16960 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.291626 18076 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:14.292727 16960 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:14.293111 18156 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260812 19:25:14.294432 18085 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.014s	sys 0.031s
I20260812 19:25:14.295521 18052 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:14.297739 18108 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:14.299502  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:14.300503  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:14.300724  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:14.201051 17845 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:14.307483 17602 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:14.308257 17940 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:14.310343 17906 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:14.283802 18096 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:14.312101 17248 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:14.312306 18009 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:14.313769 18051 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:14.317224 18053 consensus_meta.cc:287] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.635s	user 0.003s	sys 0.008s
I20260812 19:25:14.317771 18053 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:14.319983 18053 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:14.321117 17939 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:14.323348 17392 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:14.214692 17541 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:14.324296 17939 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:14.329514  7607 raft_consensus.cc:1226] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20. Ops: []
W20260812 19:25:14.290710 18148 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260812 19:25:14.346212  6224 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:14.129419 18064 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:14.362696  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:14.279656 17954 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:14.350628 17886 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:14.372234  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:14.349334 17586 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:14.374394  6228 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:14.379892  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:14.370000  6344 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:25:14.413580  6465 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
W20260812 19:25:14.441442  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:14.441962  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.447100  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:14.448084  6344 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:14.461103  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:14.467939  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:14.468266  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:14.468647  7606 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
W20260812 19:25:14.479568  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 306771us
W20260812 19:25:14.480373  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet f1b6d90aaa384b5fb66f3320981f1aa0, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:14.480845  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet f1b6d90aaa384b5fb66f3320981f1aa0, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.395674 18085 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:14.485150  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:14.487669  7594 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
W20260812 19:25:14.534552 18050 consensus_meta.cc:287] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.030s	user 0.011s	sys 0.002s
I20260812 19:25:14.535168 18050 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:25:14.487231 18085 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:14.540079 17337 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:14.539546 18085 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.531033 17886 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:14.543054 18085 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:14.543150 17886 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.545434 17886 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:14.548101  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 56999.8us
W20260812 19:25:14.550442 17999 consensus_meta.cc:287] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.003s
I20260812 19:25:14.551570  6359 raft_consensus.cc:2396] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260812 19:25:14.473196 18053 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:14.553844 18053 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:14.556146 18053 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:14.556015 18138 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.559463 18138 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:14.562139  6482 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 21: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:14.568327  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:14.579327 18163 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:25:14.579797 18163 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:25:14.590741  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.043s	sys 0.060s
I20260812 19:25:14.438351 18064 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:14.591162  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.043s	sys 0.060s
W20260812 19:25:14.592828  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 586798us
I20260812 19:25:14.461174 17586 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:14.599388  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:14.602804 17811 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260812 19:25:14.603608  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:14.606608  6228 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:14.591894 18163 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:25:14.613411  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:14.614831  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:14.625273  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 8b1f6c5d06f046a1818f453d9b609502, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.611080  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:14.653880  6482 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:25:14.613308  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:14.655171  6465 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
W20260812 19:25:14.607581  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 402413us
I20260812 19:25:14.615577  6238 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:14.657074  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:14.604429 16960 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election won for term 20
W20260812 19:25:14.658094  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 8b1f6c5d06f046a1818f453d9b609502, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.659319  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:14.660808  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:14.661623  6482 raft_consensus.cc:2396] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260812 19:25:14.655916  6229 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:14.665138  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:14.660163  6465 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:14.665894  6482 raft_consensus.cc:2379] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:14.666860  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:14.674067  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:14.678004  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:14.674088 17877 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:14.679461  6238 raft_consensus.cc:2396] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260812 19:25:14.679421 17337 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:25:14.679877 17877 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.676144 17886 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:14.676389 17939 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:14.687271 17939 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.689612 17939 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:14.679497  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:14.695741  6236 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:14.697642  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:14.678026  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:14.702749  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2738) took 1372 ms. Trace:
I20260812 19:25:14.703245  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:14.704041  6482 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:14.705111  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:14.705631  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:14.705914  6238 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:14.706470  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:14.703155  6349 rpcz_store.cc:276] 0812 19:25:13.330152 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:13.330277 (+   125us) service_pool.cc:227] Handling call
0812 19:25:13.366851 (+ 36574us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:14.213406 (+846555us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:14.702458 (+489052us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b540034f654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:14.702683 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1941546240}
I20260812 19:25:14.707511  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:14.707712  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:14.708360  6228 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 20: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:14.710089  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:14.710922  6481 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:14.707114  6229 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:14.715317  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:14.716925  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:14.717060  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:14.718277  6224 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:14.719079  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:14.719590  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2852) took 1105 ms. Trace:
I20260812 19:25:14.720160  6359 rpcz_store.cc:276] 0812 19:25:13.613957 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:13.615207 (+  1250us) service_pool.cc:227] Handling call
0812 19:25:14.719336 (+1104129us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b540009f6d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:14.719509 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2150632320}
I20260812 19:25:14.674430 17921 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:14.721793  6236 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260812 19:25:14.695119 18050 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:25:14.726919  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:14.734169  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:14.734534  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:14.735615  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:14.708240 17849 consensus_meta.cc:287] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 1.017s	user 0.013s	sys 0.000s
I20260812 19:25:14.730587  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3305) took 1485 ms. Trace:
I20260812 19:25:14.730309  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:14.737416  6350 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:14.737434  6481 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260812 19:25:14.735442  6229 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
I20260812 19:25:14.736770  6475 rpcz_store.cc:276] 0812 19:25:13.244919 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:13.245646 (+   727us) service_pool.cc:227] Handling call
0812 19:25:13.246035 (+   389us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:13.329269 (+ 83234us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:13.329350 (+    81us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:13.356795 (+ 27445us) log.cc:842] Serialized 26 byte log entry
0812 19:25:13.565952 (+209157us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b180033d480. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:25:13.742262 (+176310us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:25:13.742311 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:14.730165 (+987854us) spinlock_profiling.cc:243] Waited 82.8 ms on lock 0x7b54001040d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:14.730238 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:14.730308 (+    70us) raft_consensus.cc:1671] finished
0812 19:25:14.730327 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:14.730511 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":18506,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":10241,"spinlock_wait_cycles":196978304,"thread_start_us":176097,"threads_started":1,"wal-append.queue_time_us":755348}
I20260812 19:25:14.615231 18146 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260812 19:25:14.741297  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:14.714437 17383 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260812 19:25:14.743816  6473 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.020s	sys 0.014s
I20260812 19:25:14.745620  6224 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:14.749828  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:14.709285 17337 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:14.748078  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:14.748370  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:14.749828  6473 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.020s	sys 0.014s
I20260812 19:25:14.750623  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:25:14.738267 17622 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.009s	sys 0.024s
I20260812 19:25:14.754196  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:14.755383  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:14.752514  6359 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:14.732659 17916 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:14.761299  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:14.729967 16960 raft_consensus.cc:686] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:14.775002  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:14.762355 18055 raft_consensus.cc:465] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 20 LEADER]: Not starting pre-election -- already a leader
I20260812 19:25:14.771138  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:14.772362  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:14.743919 18153 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:14.777593  6482 pending_rounds.cc:76] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 10
I20260812 19:25:14.785102  6482 pending_rounds.cc:97] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260812 19:25:14.785461  6482 raft_consensus.cc:2866] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:14.785648  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:14.787468  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:14.748425 17602 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260812 19:25:14.756590 17622 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.010s	sys 0.024s
I20260812 19:25:14.746331 18050 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:14.762876 18099 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:14.791910  6483 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260812 19:25:14.788365  6359 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:25:14.765239 17916 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:14.763418 17849 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:14.749768 17383 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:14.787899 17953 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:14.732963 17921 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.784451 17939 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:14.847237  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:14.816207  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:14.788975 18153 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:14.789517 18138 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:14.848084 17622 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:14.789690 18009 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:14.793929 17602 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:14.784117 17796 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260812 19:25:14.941140 17921 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:14.832773 18099 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:14.942338 18099 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
W20260812 19:25:14.943621  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.034s	sys 0.050s
W20260812 19:25:14.944074  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.035s	sys 0.050s
I20260812 19:25:14.845047 17849 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:14.951751  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:14.884414  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:14.834236 18142 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:14.927119 18027 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:14.933107 17622 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.934015 17602 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:14.934453 18009 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.852007 17383 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:25:14.944449  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 765058us
I20260812 19:25:14.874778  6055 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:14.851325 17916 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:14.943854 18051 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:14.946542  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 130454us
I20260812 19:25:14.861312  6353 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
I20260812 19:25:14.855875 17953 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:14.851837 17847 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:14.876389 18064 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:14.875452 17586 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:14.881807 17939 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:25:15.046590  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.020s	sys 0.056s
W20260812 19:25:15.049530  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 165201us
I20260812 19:25:14.871825 17353 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.163s
I20260812 19:25:14.947438 18138 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:14.947225 18153 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:14.984042 17541 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:15.055042  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:15.211875  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:15.212642  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.024s	sys 0.080s
W20260812 19:25:15.214395  6347 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.005s	sys 0.031s
I20260812 19:25:15.073331  6055 catalog_manager.cc:5495] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 16 to 19, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 19 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:25:15.250077  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 757528us
W20260812 19:25:15.250684  6347 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.006s	sys 0.031s
I20260812 19:25:15.250586  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:15.131126 17868 consensus_meta.cc:287] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.039s	user 0.011s	sys 0.008s
I20260812 19:25:15.253378  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:14.869845 18050 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:14.871145 16960 consensus_queue.cc:237] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.062868 18024 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:15.147710 17858 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:25:15.130384 17464 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:15.191350 18176 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:15.190889 17940 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:15.068333 17886 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:15.224740 17953 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:14.955065 17849 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:15.269033  6417 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:15.248476 18129 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:15.225087 18146 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:15.224969 17337 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:15.248677 18064 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:15.270496  6298 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:15.202765 17248 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:15.250171 17541 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:15.223781 18138 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:25:15.258694 17551 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.042s	user 0.013s	sys 0.000s
I20260812 19:25:15.248980 17617 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:15.044070 18142 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:15.278517  6241 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.008s	sys 0.016s
W20260812 19:25:15.316679  6241 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.008s	sys 0.016s
I20260812 19:25:15.257908 17194 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:15.047008 18027 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:15.317286  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:15.282322  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:15.284919  6473 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.005s	sys 0.015s
I20260812 19:25:15.258970 17622 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:15.272403 17864 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:15.056249 18167 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:15.316181 17541 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:15.209257 17939 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:15.268225 17868 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.251474 18051 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:15.284090 17741 consensus_meta.cc:287] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.070s	user 0.006s	sys 0.016s
I20260812 19:25:15.301862  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:15.294098 18163 consensus_meta.cc:287] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.619s	user 0.013s	sys 0.000s
I20260812 19:25:15.279727 18024 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.248498 17847 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.303539 18129 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:15.315140 17353 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:15.309799 17337 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.306998 18146 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:15.292975 17886 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
W20260812 19:25:15.280344  6232 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.012s	sys 0.011s
W20260812 19:25:15.319305  6349 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.014s	sys 0.009s
I20260812 19:25:15.252345 17586 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:15.318449  6241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3319) took 1209 ms. Trace:
W20260812 19:25:15.384531  6232 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.013s	sys 0.011s
W20260812 19:25:15.321072  6473 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.005s	sys 0.015s
I20260812 19:25:15.387734  6342 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:15.295743 17877 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:15.294891 18022 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:15.315706 17248 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.332775  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:15.286933 17464 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.318274 17811 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260812 19:25:15.395522  6482 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.001s	sys 0.020s
W20260812 19:25:15.396788  6482 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.002s	sys 0.020s
W20260812 19:25:15.328486 17361 consensus_meta.cc:287] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 1.626s	user 0.011s	sys 0.006s
I20260812 19:25:15.340390  6359 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:25:15.327414 17921 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:15.327201 17864 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:15.309531 18064 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.317493 17551 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:15.338289 18053 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.028s	sys 0.037s
I20260812 19:25:15.330962 18049 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:15.293704 18176 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.342006 18009 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:15.387137  6241 rpcz_store.cc:276] 0812 19:25:14.109250 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:14.109447 (+   197us) service_pool.cc:227] Handling call
0812 19:25:14.118566 (+  9119us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:14.118832 (+   266us) raft_consensus.cc:1520] Early marking committed up to index 10
0812 19:25:14.653181 (+534349us) log.cc:842] Serialized 14 byte log entry
0812 19:25:15.317222 (+664041us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:15.317301 (+    79us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:15.317360 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:15.318212 (+   852us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:15.318382 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":928440,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":48,"thread_start_us":1130583,"threads_started":2}
I20260812 19:25:15.373677 18163 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.320861  6465 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
W20260812 19:25:15.386190  6297 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.009s	sys 0.026s
W20260812 19:25:15.438447  6297 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.010s	sys 0.027s
I20260812 19:25:15.318020 17617 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:15.394579 17845 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.001s	sys 0.019s
I20260812 19:25:15.293522 17940 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.420686 17864 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:15.382417 18171 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:15.383998 18001 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.021s	sys 0.012s
I20260812 19:25:15.377822 17353 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:15.389955 18177 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:15.372678 17741 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:25:15.384742  6349 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.014s	sys 0.009s
I20260812 19:25:15.396497 18022 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:15.438853  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 582861us
I20260812 19:25:15.460997  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:15.423939 18053 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.028s	sys 0.037s
I20260812 19:25:15.443799  6345 raft_consensus.cc:2379] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:15.444675 18163 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:15.410266  6229 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.011s	sys 0.046s
W20260812 19:25:15.453320  6296 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.024s	sys 0.013s
W20260812 19:25:15.468400  6296 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.025s	sys 0.013s
W20260812 19:25:15.442354 17845 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.001s	sys 0.019s
I20260812 19:25:15.421232 17921 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.396236 17877 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260812 19:25:15.457525  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 207853us
W20260812 19:25:15.450635 18001 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.022s	sys 0.013s
I20260812 19:25:15.469508  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:15.392293 17586 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:15.417259 17361 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:15.447155 18167 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260812 19:25:15.477731  6230 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:15.480648  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:15.454505 17353 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:15.503355  6359 raft_consensus.cc:2379] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 16: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:25:15.466152 17929 consensus_meta.cc:287] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.367s	user 0.014s	sys 0.000s
I20260812 19:25:15.471490 18205 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260812 19:25:15.490492  6229 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.011s	sys 0.047s
I20260812 19:25:15.495281  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:15.517627  7591 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:15.516250  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:15.472662  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 144718us
I20260812 19:25:15.500996  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:15.463195 17793 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:15.508307  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:15.519004  6236 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:15.519696  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:15.522931  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:15.525405  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:15.524151  6465 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
W20260812 19:25:15.528575  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 259634us
I20260812 19:25:15.533030  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:15.533967  6465 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:25:15.501368 17847 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:15.504371 17940 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:15.538151  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:15.506697 18001 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:15.474335 18009 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260812 19:25:15.539999  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:15.611770  6465 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:15.454093 18171 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.511121 17929 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.522620 18142 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:15.512581 18027 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:15.561276 18189 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260812 19:25:15.563375 18206 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260812 19:25:15.564304 18195 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260812 19:25:15.565619 18186 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260812 19:25:15.531556 17793 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:15.517531 18096 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:15.554292 17940 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:15.575179  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:15.726807  6238 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:15.575968 17586 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:15.576223 18001 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.576483  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:15.734334  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 218786us
I20260812 19:25:15.577951  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:15.459782 18177 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.574254  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:15.522454 17868 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:15.588390 17361 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:15.589672 17617 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:15.590167 17337 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:15.716679 17921 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:15.537945 17954 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:15.592418 18170 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:15.594264  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:15.556238 18129 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:15.548254 17392 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260812 19:25:15.596935 18193 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260812 19:25:15.560952 18169 consensus_queue.cc:1046] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:25:15.616183  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:15.627017  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:15.558108 18051 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:15.614346 17622 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:15.778570  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:25:15.778551  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 151637us
W20260812 19:25:15.723994  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 394447us
I20260812 19:25:15.779663  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:15.669525 18064 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:15.744020  6475 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:25:15.682375 17551 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:15.732939 18153 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.761335 18170 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:15.704741 17248 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:15.531785 17877 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:15.728812 18142 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260812 19:25:15.765204  6353 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2849) took 2145 ms (client timeout 1797 ms). Trace:
W20260812 19:25:15.794832  6416 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.2:39969 timed out after 1.797s (SENT) [suppressed 4 similar messages]
W20260812 19:25:15.795270  6353 rpcz_store.cc:269] 0812 19:25:13.612004 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:13.612657 (+   653us) service_pool.cc:227] Handling call
0812 19:25:15.756881 (+2144224us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540025f154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:15.756997 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2436596480}
I20260812 19:25:15.795866  6475 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:25:15.750792  6349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2863) took 1042 ms. Trace:
I20260812 19:25:15.765767  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2744) took 1999 ms. Trace:
I20260812 19:25:15.776075  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2834) took 2144 ms. Trace:
I20260812 19:25:15.769870  6359 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
W20260812 19:25:15.760960 18099 consensus_meta.cc:287] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.818s	user 0.015s	sys 0.002s
I20260812 19:25:15.706965  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 1140) took 1762 ms. Trace:
I20260812 19:25:15.628448 18146 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:15.750351 17586 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:15.785636 17996 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260812 19:25:15.749332  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 264400us
I20260812 19:25:15.730255 18096 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:15.786904  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:15.704948 18203 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.140s
I20260812 19:25:15.738282 17940 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:15.785480  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:15.768754 18176 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:15.766626 17741 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:15.760464 18050 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:15.820060  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:15.771643 17954 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:15.785775 18106 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.012s	sys 0.039s
I20260812 19:25:15.746235 18022 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:15.797928  6232 rpcz_store.cc:276] 0812 19:25:13.625247 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:13.625417 (+   170us) service_pool.cc:227] Handling call
0812 19:25:13.639095 (+ 13678us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:13.643792 (+  4697us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:13.643831 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:14.579535 (+935704us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b18002981e0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a
0812 19:25:14.723620 (+144085us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b2c0006c608. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:25:14.731090 (+  7470us) log.cc:842] Serialized 26 byte log entry
0812 19:25:15.387443 (+656353us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:15.387482 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:15.387556 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:15.769637 (+382081us) raft_consensus.cc:1671] finished
0812 19:25:15.769662 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:15.769800 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4276,"raft.queue_time_us":6882,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":28092,"spinlock_wait_cycles":20698240,"thread_start_us":619591,"threads_started":1,"wal-append.queue_time_us":696263}
I20260812 19:25:15.785426 17921 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:15.855855 17921 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:15.856045 18213 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:15.856333 17921 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:15.857203  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3329) took 1080 ms. Trace:
I20260812 19:25:15.857606 18229 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:15.858238 18229 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:15.859054  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:15.859819  6353 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 19.
I20260812 19:25:15.860452 18223 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:15.860810  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:15.860946 18223 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.797196  6347 rpcz_store.cc:276] 0812 19:25:13.766423 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:13.766585 (+   162us) service_pool.cc:227] Handling call
0812 19:25:13.767022 (+   437us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:13.767566 (+   544us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:13.767605 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:14.564460 (+796855us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b1800412a80. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a
0812 19:25:14.564995 (+   535us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b2c00012928. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:25:14.565583 (+   588us) log.cc:842] Serialized 26 byte log entry
0812 19:25:15.254579 (+688996us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:15.254637 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:15.254756 (+   119us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:15.765494 (+510738us) raft_consensus.cc:1671] finished
0812 19:25:15.765525 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:15.765692 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":10538,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":8220,"spinlock_wait_cycles":36185728,"thread_start_us":688606,"threads_started":1,"wal-append.queue_time_us":809032}
I20260812 19:25:15.857573  6482 rpcz_store.cc:276] 0812 19:25:14.776683 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:14.776848 (+   165us) service_pool.cc:227] Handling call
0812 19:25:14.777297 (+   449us) raft_consensus.cc:1457] Updating replica for 4 ops
0812 19:25:14.867375 (+ 90078us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:14.867416 (+    41us) raft_consensus.cc:1525] Triggering prepare for 4 ops
0812 19:25:14.868345 (+   929us) log.cc:842] Serialized 104 byte log entry
0812 19:25:15.398326 (+529981us) raft_consensus.cc:1631] Marking committed up to 13
0812 19:25:15.434192 (+ 35866us) log.cc:842] Serialized 14 byte log entry
0812 19:25:15.754182 (+319990us) log.cc:842] Serialized 14 byte log entry
0812 19:25:15.855371 (+101189us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b18004dc6e0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f47d34ca 00007f98fdea8f99 00007f98fb620bcf 00007f98f485c7b6 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d
0812 19:25:15.855947 (+   576us) log.cc:842] Serialized 14 byte log entry
0812 19:25:15.856759 (+   812us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:15.856939 (+   180us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:15.856979 (+    40us) raft_consensus.cc:1671] finished
0812 19:25:15.856989 (+    10us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:15.857139 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":170704,"prepare.queue_time_us":43490,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2715,"raft.queue_time_us":356888,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":6068,"spinlock_wait_cycles":14958592,"thread_start_us":844107,"threads_started":2,"wal-append.queue_time_us":578549}
I20260812 19:25:15.818251  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:15.862802  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:15.800197  6473 rpcz_store.cc:276] 0812 19:25:13.945018 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:13.945522 (+   504us) service_pool.cc:227] Handling call
0812 19:25:13.945849 (+   327us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:13.946044 (+   195us) raft_consensus.cc:1520] Early marking committed up to index 14
0812 19:25:14.753625 (+807581us) log.cc:842] Serialized 14 byte log entry
0812 19:25:15.706383 (+952758us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:15.706461 (+    78us) raft_consensus.cc:1631] Marking committed up to 14
0812 19:25:15.706533 (+    72us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:15.706642 (+   109us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:15.706880 (+   238us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":82638,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":353482,"spinlock_wait_cycles":8351488,"thread_start_us":1759587,"threads_started":3,"wal-append.queue_time_us":673711}
W20260812 19:25:15.823706 17916 consensus_meta.cc:287] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.571s	user 0.012s	sys 0.000s
I20260812 19:25:15.863760 17916 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.865701 17916 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:15.856643 18213 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:15.824872 18024 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:15.827312 18188 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260812 19:25:15.827486  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2861) took 1150 ms. Trace:
I20260812 19:25:15.827773 18001 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:15.830870 17929 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:15.835858 18171 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:15.836732 17793 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:15.837886 17602 consensus_meta.cc:287] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.782s	user 0.017s	sys 0.003s
I20260812 19:25:15.839310 18153 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:15.839526 18050 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:15.841472 17383 consensus_meta.cc:287] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.768s	user 0.009s	sys 0.005s
W20260812 19:25:15.842113 17858 consensus_meta.cc:287] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.000s
I20260812 19:25:15.805009 18099 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.842957 17741 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 19:25:15.806988 17996 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:25:15.843689 17541 consensus_meta.cc:287] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.002s
W20260812 19:25:15.843905 17849 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.535s	user 0.008s	sys 0.003s
I20260812 19:25:15.843976 18034 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:15.785360 17622 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.821707 17662 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:15.811017 17586 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.847329 17940 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:15.803385 17877 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.802951 17868 consensus_queue.cc:1046] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
W20260812 19:25:15.926469  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 114837us
I20260812 19:25:15.799813 18142 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:25:15.850703 17939 consensus_meta.cc:287] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.004s
I20260812 19:25:15.853274 18096 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:15.807451 18138 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.859143  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:15.817386  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:15.797079  6349 rpcz_store.cc:276] 0812 19:25:14.707989 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:14.708329 (+   340us) service_pool.cc:227] Handling call
0812 19:25:14.725760 (+ 17431us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:14.725952 (+   192us) raft_consensus.cc:1520] Early marking committed up to index 12
0812 19:25:15.457118 (+731166us) log.cc:842] Serialized 14 byte log entry
0812 19:25:15.750360 (+293242us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:15.750424 (+    64us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:15.750485 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:15.750572 (+    87us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:15.750716 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":720447,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":2597,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8294,"thread_start_us":995654,"threads_started":2,"wal-append.queue_time_us":333918}
I20260812 19:25:15.863343  6342 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:15.846424 17954 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:15.872509  6344 rpcz_store.cc:276] 0812 19:25:14.677331 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:14.677716 (+   385us) service_pool.cc:227] Handling call
0812 19:25:15.827286 (+1149570us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003b15d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:15.827427 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2539631488}
I20260812 19:25:15.874744  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3328) took 1099 ms. Trace:
I20260812 19:25:15.875906  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2862) took 1178 ms. Trace:
I20260812 19:25:16.202883  6345 rpcz_store.cc:276] 0812 19:25:14.697209 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:14.697354 (+   145us) service_pool.cc:227] Handling call
0812 19:25:15.875655 (+1178301us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54001b9c54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:15.875837 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1713801472}
I20260812 19:25:15.877177  6347 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260812 19:25:15.877755  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:15.879397  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:16.206075  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:15.838518 17194 consensus_meta.cc:287] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.005s
I20260812 19:25:15.883838  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:25:15.878611 18106 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.012s	sys 0.039s
I20260812 19:25:16.201200  6481 rpcz_store.cc:276] 0812 19:25:14.775108 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:14.775283 (+   175us) service_pool.cc:227] Handling call
0812 19:25:14.775629 (+   346us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:14.775868 (+   239us) raft_consensus.cc:1520] Early marking committed up to index 11
0812 19:25:15.343267 (+567399us) log.cc:842] Serialized 14 byte log entry
0812 19:25:15.798385 (+455118us) log.cc:842] Serialized 14 byte log entry
0812 19:25:15.874391 (+ 76006us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:15.874446 (+    55us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:15.874492 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:15.874569 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:15.874690 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":137141,"prepare.queue_time_us":95519,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":265651,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":23665,"thread_start_us":907426,"threads_started":3,"wal-append.queue_time_us":446736}
I20260812 19:25:15.900113  7594 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
I20260812 19:25:15.893476  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:16.204135  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:16.214061  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 320679us
W20260812 19:25:15.906256  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 111869us
I20260812 19:25:16.215207 17858 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:16.215406  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:16.215706  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:16.215736 17858 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:16.216446 17858 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:16.217555  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:15.910396  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:15.888746 18241 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:16.218935 18203 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:16.219199 18241 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.219507 18203 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.221714 18241 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:16.222330 18085 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:16.228510 18085 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.905658 17996 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:16.231621 17622 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.233495  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:15.927413  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:15.927886  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 392584us
I20260812 19:25:16.083962  6241 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 21: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:15.896971 17602 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.899452 17383 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.907845 17541 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.137364 18213 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:16.188833 18223 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:15.927238 18208 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:15.910720 17849 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.929304 18142 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:16.230516 18085 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.199999  6354 raft_consensus.cc:2379] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 21: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:16.255641  6350 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:16.210494  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:16.213646 17906 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:15.899425 18024 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:16.223838 17194 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:16.225919 18234 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:16.225528 17858 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.227655 18254 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260812 19:25:16.141117 17953 consensus_meta.cc:287] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.837s	user 0.011s	sys 0.001s
I20260812 19:25:15.919611 17662 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:16.188359 18230 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:16.190580 16960 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:15.930315 17939 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:15.914639 18034 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:16.142371 18229 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:16.246821 18241 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:16.206312 18207 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:16.238379 17864 consensus_meta.cc:287] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.783s	user 0.006s	sys 0.005s
I20260812 19:25:16.256378 18250 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:16.259474 17877 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.253448 17622 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:25:16.352348 18133 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:16.353876 17602 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.292279 18250 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.288486 17921 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:16.191272  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 185869us
I20260812 19:25:16.211534  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:16.244913  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 317606us
I20260812 19:25:16.247177  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:16.235510  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:16.345395 16960 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.277256 17383 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.272688 17541 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:16.264572 17906 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.242528  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:16.285820 18230 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.263381  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:16.393194 17361 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:16.282681 17662 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:16.395025 18146 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:16.396134 18146 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.400019  6232 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:16.401484  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:16.402436 18229 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:16.405858 18230 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:16.406975  6481 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:16.407459 18237 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:16.408545 18235 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:16.408485 18237 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.409588 18235 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.411058 18022 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:16.411419 18237 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.411965 18022 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.413393  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:16.416041 18239 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:16.273667 17858 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:16.266286 18024 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.419102  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:16.420207  6482 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:16.420462 18024 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.423158  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:16.424055  6482 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:16.424922  7606 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:16.427290  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:16.429913  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:16.286443 18034 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:16.292524 18050 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:16.278966 17586 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:16.272574 17464 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.274952 17849 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:16.271338 17886 consensus_meta.cc:287] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.875s	user 0.011s	sys 0.001s
I20260812 19:25:16.451603 17886 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.277884 18099 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.456506 18146 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.282882 17953 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.297927 18138 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:16.271517 18203 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:16.305706 18231 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.471s	user 0.024s	sys 0.056s
I20260812 19:25:16.459702  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:16.265833 18234 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:16.473395  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:16.473788 18234 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:16.474529  6474 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
W20260812 19:25:16.258824 18240 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
W20260812 19:25:16.279583 18247 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260812 19:25:16.353785 18133 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.358631 18250 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:16.358594 17921 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.291139 18207 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.367094  6344 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:16.370318 17939 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:16.251077 17353 consensus_meta.cc:287] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.733s	user 0.007s	sys 0.003s
I20260812 19:25:16.489535  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:16.290721 17864 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.491499  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:16.492338 17864 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.383347  6345 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260812 19:25:16.492720  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:16.494131  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:16.386250 17622 raft_consensus.cc:686] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:16.496137 17622 consensus_queue.cc:237] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.507326 17392 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:16.386776 17541 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:16.415755  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:16.260782 17293 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:16.430783  6224 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:25:16.434967  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:16.436617  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 193871us
I20260812 19:25:16.436990  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:16.437331  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 131166us
I20260812 19:25:16.441076 17383 consensus_queue.cc:1046] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260812 19:25:16.446578  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:16.446717  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:16.448307  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:16.450017  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:16.437029 18022 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.465371 17886 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:16.255756 18208 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.561466  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:25:16.562973  6350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2866) took 1823 ms (client timeout 1856 ms). Trace:
I20260812 19:25:16.563823 18099 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:16.564734 18099 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.564877 18170 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.565889  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:16.488003 17877 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:16.569558  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 1128) took 1081 ms. Trace:
I20260812 19:25:16.569886  6475 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:16.489187 17353 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.571714  6359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2877) took 1047 ms. Trace:
I20260812 19:25:16.571931  6236 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:16.572191  6359 rpcz_store.cc:276] 0812 19:25:15.524186 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:15.525083 (+   897us) service_pool.cc:227] Handling call
0812 19:25:16.571354 (+1046271us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54001ce3d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:16.571504 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":532480256}
I20260812 19:25:16.573462  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:16.573880 17353 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:16.576087  6347 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 18: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:16.577354  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:16.579005  6347 raft_consensus.cc:2396] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260812 19:25:16.580729  6347 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:16.581362  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:16.560127 17541 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.494516  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:16.583210  6344 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 16.
I20260812 19:25:16.514912  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:16.518603  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:16.584781 17541 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:16.585179  6241 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:16.526465  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:16.527878  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:16.587277  6465 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 19: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:16.537233  6481 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:16.508140 17392 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:16.589564 18138 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:16.591048  7591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 894) took 2491 ms. Trace:
I20260812 19:25:16.591058  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:16.591507  7591 rpcz_store.cc:276] 0812 19:25:14.099069 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:14.105750 (+  6681us) service_pool.cc:227] Handling call
0812 19:25:14.127479 (+ 21729us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:15.518712 (+1391233us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:16.590461 (+1071749us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b540019b254. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:16.590826 (+   365us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3196580224}
I20260812 19:25:16.563526 18208 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.538585  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:16.592849  6477 raft_consensus.cc:2354] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18.
I20260812 19:25:16.543426 18022 raft_consensus.cc:3032] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:16.599598  6470 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 20: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:16.543948 17953 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.610482  7607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:16.546758 18207 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.547310 17940 raft_consensus.cc:3032] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:16.612136 17940 raft_consensus.cc:729] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:16.553231 18133 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:16.612884  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:16.613399 17906 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.613706 17940 consensus_queue.cc:260] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.614626  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:16.554853  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:16.556413  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:16.557184 17939 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:16.559863 17886 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:16.560575 18250 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:16.561712 17742 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:16.481273 18235 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.384768 16960 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:16.587088  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 47003.7us
I20260812 19:25:16.563318  6342 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 20.
I20260812 19:25:16.627220  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:16.631798  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:16.632398  6342 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:16.633831 18099 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.634891 18182 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:16.584842  6228 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:16.543007  6464 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:16.544083  6238 raft_consensus.cc:2379] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 18: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:16.639405 18142 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.602491 18170 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:16.642313 18142 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:16.606923 18249 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.769s	user 0.010s	sys 0.002s
I20260812 19:25:16.606977  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:16.609163  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:25:16.563436  6350 rpcz_store.cc:269] 0812 19:25:14.739872 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:14.740111 (+   239us) service_pool.cc:227] Handling call
0812 19:25:16.562522 (+1822411us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540036d154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:16.562723 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3445108480}
I20260812 19:25:16.599677 18022 raft_consensus.cc:729] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:16.570158  6352 rpcz_store.cc:276] 0812 19:25:15.487676 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:15.489134 (+  1458us) service_pool.cc:227] Handling call
0812 19:25:15.489507 (+   373us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:15.742033 (+252526us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:15.742081 (+    48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:15.742138 (+    57us) raft_consensus.cc:1631] Marking committed up to 14
0812 19:25:15.742195 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:16.568902 (+826707us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b540036d654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:16.568990 (+    88us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:16.569312 (+   322us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":580145024}
I20260812 19:25:16.610405 17741 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:16.626899 17939 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.627345  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:16.627076 17886 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.628257  6473 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:16.628885 17742 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.635576 18182 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:16.605080  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 66769.5us
I20260812 19:25:16.651065  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:16.650903 18250 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.652810 17996 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.653350 18177 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.695243  6344 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:16.628899  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3321) took 2500 ms. Trace:
I20260812 19:25:16.695454  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:16.696004  6230 rpcz_store.cc:276] 0812 19:25:14.128583 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:14.128734 (+   151us) service_pool.cc:227] Handling call
0812 19:25:14.129020 (+   286us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:15.502325 (+1373305us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:16.628360 (+1126035us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540035eb54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:16.628660 (+   300us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3101314816}
W20260812 19:25:16.654048  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 72944.3us
I20260812 19:25:16.699817  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:16.701465 17541 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:16.654912  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:15.901433  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:16.662565 18235 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260812 19:25:16.703224  6347 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:16.695304  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:16.664165  6055 catalog_manager.cc:5495] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 12 to 15, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 15 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:16.668254  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:16.669379  6179 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:16.670970 16960 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:16.675217  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:16.708282 17742 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.681129 18022 consensus_queue.cc:260] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.708473 18099 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:16.709053 18099 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:16.709400 18022 raft_consensus.cc:3037] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:16.700099  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:16.711696  6242 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:16.681596  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:16.712598  6224 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:16.714200  6347 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 20.
I20260812 19:25:16.693535 17886 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:16.693650 18250 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:16.678050  6228 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:16.715205  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:16.706591 18182 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:16.708643  6474 raft_consensus.cc:3037] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:25:16.716730  6049 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 198) took 26260 ms (client timeout 15000 ms). Trace:
I20260812 19:25:16.717744  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:16.718827 18250 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:25:16.719261 18250 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:16.719624 18250 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:25:16.707566  6055 catalog_manager.cc:5495] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:16.682513  7593 raft_consensus.cc:2379] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:25:16.723066 17996 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.703274 17939 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:16.724084  6349 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 21: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:16.723583  6055 catalog_manager.cc:5495] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 14 to 17, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 17 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:16.710047 18099 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.726953 18099 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:16.679522 17741 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:16.728245 17741 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
W20260812 19:25:16.717273  6049 rpcz_store.cc:269] 0812 19:24:50.456519 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:50.456777 (+   258us) service_pool.cc:227] Handling call
0812 19:24:51.593467 (+1136690us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b5400002dd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fdaf0 00007f98f7780f2a 00007f98fd6d2d6c 00007f98fd7ccc3e 00007f98fbadefb4 00007f98fbadef42 00007f98fbadee71 00007f98fbadedec 00007f98fbade0a2 00007f98f5bae94c 00007f98f5badd86
0812 19:25:16.716368 (+25122901us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:08.034319 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:08.094397 (+ 60078us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:08.094450 (+    53us) write_op.cc:435] Acquired schema lock
0812 19:25:08.094484 (+    34us) tablet.cc:660] Decoding operations
0812 19:25:08.146382 (+ 51898us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:08.146490 (+   108us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:08.146538 (+    48us) tablet.cc:683] Acquiring locks for 20 operations
0812 19:25:08.148367 (+  1829us) tablet.cc:699] Row locks acquired
0812 19:25:08.148401 (+    34us) write_op.cc:260] PREPARE: finished
0812 19:25:08.148630 (+   229us) write_op.cc:270] Start()
0812 19:25:08.148803 (+   173us) write_op.cc:276] Timestamp: P: 1786562708148547 usec, L: 0
0812 19:25:08.148842 (+    39us) op_driver.cc:331] REPLICATION: starting
0812 19:25:08.149722 (+   880us) log.cc:842] Serialized 7766 byte log entry
0812 19:25:08.309122 (+159400us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f483e5fe 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb
0812 19:25:08.749906 (+440784us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:25:09.279358 (+529452us) op_driver.cc:444] REPLICATION: finished
0812 19:25:10.416436 (+1137078us) write_op.cc:301] APPLY: starting
0812 19:25:10.416546 (+   110us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:10.662989 (+246443us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:10.663042 (+    53us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:10.846238 (+183196us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:10.846641 (+   403us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=0,mrs_lookups=0
0812 19:25:10.966503 (+119862us) write_op.cc:312] APPLY: finished
0812 19:25:11.137756 (+171253us) log.cc:842] Serialized 180 byte log entry
0812 19:25:11.277049 (+139293us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:11.350145 (+ 73096us) write_op.cc:454] Released schema lock
0812 19:25:11.350231 (+    86us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:11.350555 (+   324us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:11.350583 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10596,"reported_tablets":52,"spinlock_wait_cycles":493056768,"child_traces":[["op",{"apply.queue_time_us":1136708,"apply.run_cpu_time_us":62107,"apply.run_wall_time_us":934653,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87847,"num_ops":20,"prepare.queue_time_us":492693,"prepare.run_cpu_time_us":31312,"prepare.run_wall_time_us":396115,"raft.queue_time_us":412225,"raft.run_cpu_time_us":10659,"raft.run_wall_time_us":1011918,"replication_time_us":1130393,"spinlock_wait_cycles":104047744,"thread_start_us":1856679,"threads_started":5,"wal-append.queue_time_us":559258,"wal-append.run_cpu_time_us":16773,"wal-append.run_wall_time_us":2660843}]]}
I20260812 19:25:16.723686 17886 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:16.735213 17886 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:16.735713 17886 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:16.666179 17662 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.727531  6055 catalog_manager.cc:5495] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 20 to 23, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 23 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:16.743611  6342 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:25:16.748808  6474 raft_consensus.cc:2454] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:25:16.706159 18234 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.755203  6473 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:16.756536  6224 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:16.741984 17940 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:16.675372 17392 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:16.762428  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 46060.4us
W20260812 19:25:16.758988  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 89919us
W20260812 19:25:16.765472  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 73760.8us
I20260812 19:25:16.773079  6475 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260812 19:25:16.774087 17337 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:16.783213  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:16.783382 17337 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:16.783205 18169 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260812 19:25:16.784865 17337 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.777876  6354 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:16.785722 18169 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Stepping down as leader of term 17
W20260812 19:25:16.792309  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 74731.2us
I20260812 19:25:16.788250  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:16.797819  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:16.798787 17337 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:16.798902 18207 consensus_queue.cc:1046] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260812 19:25:16.801559  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:16.801852 18272 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260812 19:25:16.790402 18169 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:16.810739 18177 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:16.795612 18235 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:16.805202 18142 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:16.818822  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:16.821448  6342 raft_consensus.cc:1226] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:16.825075  7553 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:16.822201  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:16.825882  6354 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:16.827877  6347 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:16.831317  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:16.834789 18207 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:16.834636 17811 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.003s
I20260812 19:25:16.830087 17662 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.833748 17906 raft_consensus.cc:2781] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:25:16.842737  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:16.835300 18207 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:16.845764 18177 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.846045 18169 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.847002 17392 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:16.847623 18169 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:16.848336 18207 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:16.849742  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:16.846046 17906 raft_consensus.cc:686] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:16.851351 18133 raft_consensus.cc:3032] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:25:16.848341 18177 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:16.851814 18133 raft_consensus.cc:729] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:16.852089 17906 consensus_queue.cc:237] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.852847 18133 consensus_queue.cc:260] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.854199 18133 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:25:16.841284 17996 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:16.854935 17996 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:16.855414 17996 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:16.858803 18234 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:16.861398  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:16.861706 18208 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:16.862159 18208 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:16.862305 18177 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:25:16.863405 18177 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:16.863211 18208 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.864045 18177 raft_consensus.cc:3032] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:16.864454 18177 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:16.864646 18208 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:16.865463 18177 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:16.875401  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 74709.5us
I20260812 19:25:16.875550  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:16.878762  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:16.872578  6235 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
W20260812 19:25:16.880553 18279 log.cc:924] Time spent T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260812 19:25:16.880707  6235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2839) took 3193 ms (client timeout 2543 ms). Trace:
W20260812 19:25:16.881067  6235 rpcz_store.cc:269] 0812 19:25:13.687273 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:13.688040 (+   767us) service_pool.cc:227] Handling call
0812 19:25:14.772211 (+1084171us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b5800001898. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:25:16.880424 (+2108213us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b540017a054. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:16.880582 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4837837824}
I20260812 19:25:16.878319  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:16.845281 17916 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:25:16.882283 18217 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:16.838696 18235 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.892158  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:16.885532 18177 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:16.893152  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:16.890810  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:16.885792 17916 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:16.891692 17877 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:16.900925 17916 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:25:16.914407 18167 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:16.911720  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:16.905190 17877 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:16.903982 17662 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:16.933518  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:16.916057 18099 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:16.916028 18167 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:16.935947  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:16.924628 17662 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:16.941064  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:16.941085 17662 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:16.924408 17877 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:16.950253 17886 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.895094 18217 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:16.937860 18099 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:16.938562 18167 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:16.955965  7593 raft_consensus.cc:2379] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 20: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:25:16.953691 18234 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:16.961577  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:16.957126 18099 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:16.967154 18235 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.969009 18217 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:16.976133  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:16.976909  6353 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:25:16.974400  7593 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:16.983585  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:16.987123  6238 raft_consensus.cc:2454] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 20.
I20260812 19:25:16.960299 18250 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:16.986372  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:25:16.992600  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 84852.6us
I20260812 19:25:16.995604  6345 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:16.998718  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:16.999822 18204 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:17.000427 18204 raft_consensus.cc:686] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:17.005923 17793 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:25:17.007364 17793 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:17.007745 17793 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:17.008704 17793 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:17.010351 17793 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:16.989861 17741 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.011780 17886 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:17.014983  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:17.014263 17996 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.016028 18217 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:17.016696 18239 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:17.023770  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:17.035005  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:17.035975 18234 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:25:17.036867 18234 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:17.036321 18217 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:17.032106 18034 consensus_meta.cc:287] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.009s
I20260812 19:25:17.048002  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.048842  7553 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:17.032115 18239 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:17.051307  6238 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:25:17.054592 17741 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.047215 17392 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:17.059274 17392 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.061439 17392 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:17.040680 18234 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:25:17.062480 18287 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260812 19:25:17.063436 18234 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.068137  6235 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:17.071185  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.077766  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.033504 18207 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.088140  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.073045 18239 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:17.090104  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.092340  6238 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:17.091552  6236 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:17.090230  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.095029  6477 raft_consensus.cc:2354] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17.
I20260812 19:25:17.097142  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.087613 18235 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:17.102370 18235 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.104573 18235 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.085278 17622 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:17.082947 17337 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:17.106428 17337 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.107076  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.107270  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.108482 17337 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.108975  6473 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:17.078531 18217 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.111526  6298 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:17.113035  6298 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:17.114264  6298 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:17.114849 18182 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:17.115614  6464 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260812 19:25:17.115417 18182 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.116118 17361 raft_consensus.cc:2781] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:17.116703 17293 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:17.117244 17293 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.117854  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.118873 17742 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:17.119040  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.119402 17293 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.119541 17742 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:17.119679  6230 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:17.120276  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.120779 17877 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.122044  6242 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 21: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:17.123100 17622 raft_consensus.cc:686] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:17.124289 17622 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.129140 18207 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.129873 17877 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.104740  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.116748 17361 raft_consensus.cc:686] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 20 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:17.131644 17361 consensus_queue.cc:237] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:17.132265  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:17.133067  6345 raft_consensus.cc:595] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:17.139155 18250 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:17.024425 18204 consensus_queue.cc:237] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.140401 17996 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.143914  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.144912  6347 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 18: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:17.147047  6230 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:17.156461  6238 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:17.122424  6417 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:17.160010  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:17.160485  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 46308.1us
I20260812 19:25:17.160849  6230 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:25:17.166127  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.168016  6298 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:17.170585  6347 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:17.168203  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.170785  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.174120  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.180703  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:17.180888  6242 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:17.180812  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.180918  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.182369  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.170817  6473 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:17.073261 18034 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:17.183234  6238 raft_consensus.cc:2396] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260812 19:25:17.189733  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.181404  6345 raft_consensus.cc:595] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:17.188704  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.194257  6349 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:17.195827 18170 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:17.196305 18170 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:17.196691 18170 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:17.198814  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.199703  6473 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:17.200764  6470 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:17.207015  6477 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 18: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:17.211740 18250 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:25:17.213161  6473 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:17.218998  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.219928  6344 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:17.219844  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.220177  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.220777  6347 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 20: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:17.220845  6359 raft_consensus.cc:3037] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:17.222083  6350 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
W20260812 19:25:17.223049  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 100840us
I20260812 19:25:17.226271 18034 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.220888  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.216987  6470 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:17.214032 18170 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:17.229557 17916 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:17.230918  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.231389  6236 raft_consensus.cc:2379] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:17.231635  6359 raft_consensus.cc:2454] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:17.234259 17916 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:17.234831 17392 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:17.235137  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.236204  6473 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 13.
I20260812 19:25:17.235935 18099 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.236779  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:17.237640  7593 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:25:17.241768  6232 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:17.189133  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.249467  6352 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:17.166430 17996 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:17.255030  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.254911 17662 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.256316  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.257012  6238 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 20: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:17.257143 17662 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.262451  6353 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:17.254251  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.168335 18182 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.250806  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.238361 18099 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.268672  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.270171  6353 raft_consensus.cc:2354] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21.
I20260812 19:25:17.270558  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.252537  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:17.174774 18235 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:17.272053  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:17.236676 18170 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:17.281867  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:17.209825 18167 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.310844  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c59df69987ce4bc38077cd7681552414"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:17.311213  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.311496  6345 raft_consensus.cc:595] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:17.311935  6344 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:17.312580 18167 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.279080 18235 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.294045  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.302807 18208 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:17.268736 17392 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.307278  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.307647  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:17.308101  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 55685.4us
I20260812 19:25:17.308775  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.324216  6235 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 22
I20260812 19:25:17.325441  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:17.309471  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.309741  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.310386  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.327466 18182 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:17.310463  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.328042 18182 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:17.328552 18182 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:17.327411  6349 raft_consensus.cc:2362] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22. Re-sending same reply.
I20260812 19:25:17.332512  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:17.327477  6359 raft_consensus.cc:3037] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:17.315549  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.307336  6232 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:17.337638  6242 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:17.337694  6235 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
I20260812 19:25:17.347640 18099 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:25:17.353825  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:17.361291  6359 raft_consensus.cc:2454] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
I20260812 19:25:17.367038 18099 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:17.374879 18099 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:17.375403 18099 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:17.376049 18239 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.377869  6224 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 18: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:17.377714  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.378868  6235 raft_consensus.cc:2379] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 20: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:17.380584  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.381403  6354 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 18: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:17.368428  6297 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:17.372756  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.383199 17996 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:17.384701 18239 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.383316  6238 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:17.289058 17916 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:17.387724 17916 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:17.388147 17916 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:17.388504  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.386722 18235 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.391224  6236 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:17.396960  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.397810  6350 raft_consensus.cc:2379] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 17: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:25:17.400540 17996 raft_consensus.cc:2726] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:17.404762  6354 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:17.413409  6354 raft_consensus.cc:595] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:17.413792  6354 raft_consensus.cc:603] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:17.413918 17916 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.410959  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.415021  6345 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
W20260812 19:25:17.415190  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 46889.5us
I20260812 19:25:17.419691  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.420297  6354 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:17.420868 18167 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:17.421379 18167 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.422919  6232 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:17.291706 18170 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:17.424391  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:17.424963 18208 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:17.425047  6342 raft_consensus.cc:595] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:17.425527  6342 raft_consensus.cc:603] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:17.424515 18170 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:17.426327 18170 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:17.425993 18208 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.429054  6354 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:17.431030  6242 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:17.431752  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:25:17.432928 17916 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.433773  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:25:17.440582  6345 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
I20260812 19:25:17.441622  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.443663  7593 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:25:17.445363  6352 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:17.451673 18087 raft_consensus.cc:979] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:25:17.454137 17392 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:17.455883  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.459610  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:17.464890  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.465309  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.479844  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.480865  6242 raft_consensus.cc:2379] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:17.483023  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.484409  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:17.465562  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.486085  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.487901  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.485428  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:17.485675 18235 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:17.515702  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.519126  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:25:17.524159  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 48122.7us
I20260812 19:25:17.525511  6352 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:17.513695 17293 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:17.526933 17293 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:17.527887 17293 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.530730  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.487006  6230 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:17.530315  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.489780  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.533586  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.535737  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.536266  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.537123  6342 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:17.533891  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:17.495952  6179 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:25:17.541117  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 45295.5us
W20260812 19:25:17.543706  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 369960us
I20260812 19:25:17.436832 18099 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.513312 18235 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:17.530270 18239 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:17.461687 17662 raft_consensus.cc:1067] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Signalling peer bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:25:17.560361  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.565768  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:17.544945 17742 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260812 19:25:17.481544  6416 connection.cc:232] RPC call timeout handler was delayed by -1.1718634669668972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2543s for a response
I20260812 19:25:17.545619 18169 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader election won for term 14
I20260812 19:25:17.575531  6352 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:17.563042 18167 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.569283 17742 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:17.573401 18239 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:17.602008  6344 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:17.602028 17742 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:17.605540 18235 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.610239 18239 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.593883 18169 raft_consensus.cc:686] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:17.623271  6470 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260812 19:25:17.624387  6474 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260812 19:25:17.592917 17940 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:17.630801  6297 leader_election.cc:398] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18.
I20260812 19:25:17.625864  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.638089  6297 leader_election.cc:401] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260812 19:25:17.638556  6483 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 18: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:17.640206  6482 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260812 19:25:17.642187  6473 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260812 19:25:17.628556  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.652673  6477 raft_consensus.cc:2354] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22.
W20260812 19:25:17.657940  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 63061.5us
I20260812 19:25:17.637255 17906 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader election won for term 20
W20260812 19:25:17.674211 18302 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260812 19:25:17.675426 18300 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260812 19:25:17.675518 18182 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:17.677532  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 111917us
I20260812 19:25:17.669385 17921 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18.
I20260812 19:25:17.671331 18170 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.681097 18170 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.682046 17906 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 20 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:17.683411 17906 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:17.685348  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:17.687227 18099 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.690579  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:25:17.651369 17361 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.009s	sys 0.034s
W20260812 19:25:17.721043 17361 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.009s	sys 0.035s
I20260812 19:25:17.691768  6349 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:17.693209  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:17.723292  7594 raft_consensus.cc:2379] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 14: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:17.691769 18182 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:17.695575  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:17.724232  7597 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:17.696329  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.726778  6477 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 13.
W20260812 19:25:17.726857  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 58520.6us
I20260812 19:25:17.727599  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:17.727778  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.728438 17996 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:17.728963 17996 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:17.729059  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.729722  6477 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
W20260812 19:25:17.703045  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica a1541d11be514114966dc1e92a345298 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:17.703099  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:17.705792  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.706164  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.706918  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.707047  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.707579  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.730604  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.734359  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.735111  6352 raft_consensus.cc:2354] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 16. Current term is 17.
W20260812 19:25:17.735013  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 181392us
I20260812 19:25:17.707650  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.709637  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.710011  6350 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260812 19:25:17.714779 18169 consensus_queue.cc:237] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:17.664419 17940 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:17.735246  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:17.735903  6481 raft_consensus.cc:2354] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 16. Current term is 17.
I20260812 19:25:17.708253  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.738406  6475 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 21: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:17.729924 17996 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.746276  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.741884  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.748387  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.748528  6473 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:17.749788  6475 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:17.750093  6297 leader_election.cc:398] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17.
I20260812 19:25:17.750392  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.751169  6297 leader_election.cc:401] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260812 19:25:17.751686  6470 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:17.752811  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.759270  6483 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 19: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:17.760613  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.765980  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:17.767102  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.744923 17864 raft_consensus.cc:2741] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260812 19:25:17.775969  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.777112  7553 leader_election.cc:398] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 16. Current term is 17.
I20260812 19:25:17.777401  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.776058 17742 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.779506 18217 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:25:17.780737 18217 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:17.777485  7553 leader_election.cc:401] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260812 19:25:17.781108 18217 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:17.782409  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:17.783138  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.784041  6465 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 18: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:17.769927  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:17.785434  6350 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:17.786571  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.782092 18217 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.791131  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.793226  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.786077  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.799255  6482 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:17.801600  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.734683 18170 consensus_queue.cc:1046] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260812 19:25:17.809981  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:17.800209  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.807193  6481 raft_consensus.cc:2379] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:17.807368  6483 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 19: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:17.784842 17916 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:17.792476 17921 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 16. Current term is 17.
I20260812 19:25:17.819821  6470 raft_consensus.cc:2379] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 18: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:17.826031  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.819473  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:17.821503  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.829072  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:17.830399  6474 raft_consensus.cc:2396] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260812 19:25:17.829360  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.833742  6465 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:25:17.837180  6483 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:17.758930 18099 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260812 19:25:17.839637  6470 raft_consensus.cc:1261] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260812 19:25:17.840672  6350 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:17.807243 16960 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:17.841933  6481 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 13. Current term is 14. Ops: []
W20260812 19:25:17.844699  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 54674.4us
I20260812 19:25:17.824906 17916 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:17.852362  6352 raft_consensus.cc:1261] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260812 19:25:17.853442  7553 leader_election.cc:398] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 16. Current term is 17.
I20260812 19:25:17.831198 18217 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:17.846586  6473 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:17.815490 17337 consensus_queue.cc:1046] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260812 19:25:17.864497  7597 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:17.837741 17742 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.868391  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:17.862501 17916 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:17.845273 18321 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:17.851152 18034 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:17.869125 17864 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a for earlier term 16. Current term is 17.
I20260812 19:25:17.871233 18324 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:17.873314 17662 raft_consensus.cc:979] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: : Instructing follower bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:25:17.874791 16960 raft_consensus.cc:686] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:17.882449  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:17.893038  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.893738  6224 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:17.889631  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.902496  6481 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:17.907279  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.907408  6483 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:17.908644  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.909487  6477 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 21
I20260812 19:25:17.906227  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:17.906239  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.909288  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.911231  6235 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:17.880966 18234 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:17.908613  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.916021  6238 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:17.913486  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.914567  6241 raft_consensus.cc:1261] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260812 19:25:17.910543  6470 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:17.918941  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.919857 17392 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:17.920534  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:17.920460 17392 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.869521 18322 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260812 19:25:17.922403  6483 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c59df69987ce4bc38077cd7681552414"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:38150
I20260812 19:25:17.923111  6483 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:25:17.896785 18034 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:17.923538  6483 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:17.925356 18034 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:17.917182  6241 pending_rounds.cc:76] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 7
I20260812 19:25:17.932113  6241 pending_rounds.cc:97] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260812 19:25:17.932461  6241 raft_consensus.cc:2866] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:17.932969  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:17.934199  6241 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260812 19:25:17.938629 18326 log.cc:924] Time spent T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260812 19:25:17.940466  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.941816  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.935992 18170 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:17.890864 18087 raft_consensus.cc:1067] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Signalling peer bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:25:17.947096  6230 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 17: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:25:17.948222  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 84031.2us
I20260812 19:25:17.958089  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.948899  6238 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:17.867892 18239 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 22.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260812 19:25:17.904911 17940 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:17.902064 18321 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:17.972903  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:17.903945 18324 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:17.915766 18234 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:17.974864  6470 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 22: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:17.976717  6417 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:17.880494 16960 consensus_queue.cc:237] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.962811 18167 raft_consensus.cc:3032] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:17.969636 17392 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:17.998148  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:17.998978  6352 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 20.
I20260812 19:25:17.995679  6224 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:17.999903  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:18.002512  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:17.972718 17793 raft_consensus.cc:3032] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:17.983603 18234 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:18.012253  6235 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:17.990983 18167 raft_consensus.cc:729] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:18.025228 17392 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:18.030525  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:17.995765 17940 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:18.034745 18329 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260812 19:25:18.034986 17940 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.037245 17940 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:17.975148 17916 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:17.979367 17361 consensus_queue.cc:1035] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.045s
I20260812 19:25:18.059512  6477 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:18.006538 18182 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:18.055162  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:18.007323 17793 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:18.064116  6483 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.024303 17921 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:17.985860 18309 consensus_queue.cc:1035] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260812 19:25:18.076212  6483 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:18.024572 18340 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260812 19:25:18.059041 17864 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:18.085479  6229 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 20: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:18.081540 17858 consensus_queue.cc:1046] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260812 19:25:18.090044  6475 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
I20260812 19:25:18.091178 18167 consensus_queue.cc:260] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.082857 18340 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:18.059499 17940 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:25:18.058990 17392 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:18.102542  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 56770us
W20260812 19:25:18.109045  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet f4ae22a8efcc4f26bdc2d4cc4266111a, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:18.128947  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 246543us
W20260812 19:25:18.128527  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet f4ae22a8efcc4f26bdc2d4cc4266111a, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.106323 17864 raft_consensus.cc:482] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:18.117394 18324 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.116624 18340 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:25:18.131809 18167 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:18.159361  6470 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 20.
I20260812 19:25:18.161350  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:18.084949 17921 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.164137  6297 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:25:18.154798 18338 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260812 19:25:18.143333 17864 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Advancing to term 21
W20260812 19:25:18.174768  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 7e0797ad50cb46cfb10b4a38cc815917, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.175348  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:25:18.175197  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 7e0797ad50cb46cfb10b4a38cc815917, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.084293 18321 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.180058  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:18.187768 17392 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:18.165606 18182 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260812 19:25:18.193291 17921 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:18.193912 17921 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:18.198004  6483 raft_consensus.cc:1261] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260812 19:25:18.199093 17940 raft_consensus.cc:686] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:18.200148 17940 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:18.200949  6473 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260812 19:25:18.202044  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:18.203686  6465 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:25:18.209860  6464 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:38150
I20260812 19:25:18.179358 18099 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:18.210486  6464 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:25:18.178548 18349 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:18.210981  6464 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:18.155514 18087 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260812 19:25:18.194434 17921 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:25:18.238631  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 67c9cd7e3397473ba76fb87340b6c6e0, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:18.240141  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 67c9cd7e3397473ba76fb87340b6c6e0, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.209379  6236 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:18.220713 18099 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:18.275380 18099 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.276877 18234 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.167201 17793 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.278105 17793 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:18.280797 17921 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.286847 18346 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:18.287240  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 125979us
I20260812 19:25:18.287451 18346 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.288599  6416 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:18.289639 18346 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:18.289826 18341 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:18.290222 18346 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:18.308007  6482 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
W20260812 19:25:18.307701  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 105741us
I20260812 19:25:18.294427  6464 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:18.309935  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 307508us
W20260812 19:25:18.323500  7649 heartbeater.cc:644] Failed to heartbeat to 127.3.253.62:46555 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.3.253.62:46555 timed out after 15.000s (SENT)
I20260812 19:25:18.324293 17742 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:25:18.330363  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:18.337401  6350 raft_consensus.cc:1226] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:18.338423  6464 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:18.339653  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:18.342038  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 9e38bc4707784979b4d00b45879a8f0b, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:18.342494  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 9e38bc4707784979b4d00b45879a8f0b, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.349030  6228 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 20. Current term is 21. Ops: []
W20260812 19:25:18.352783  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 64242us
I20260812 19:25:18.359690  6345 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260812 19:25:18.307154 18349 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:18.391271  6352 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260812 19:25:18.332710 18239 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:18.397301  6342 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:18.399394  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:18.400398  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:18.406580  6416 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:18.367390 18170 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:18.367828 17916 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:18.391804 17742 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:18.412595  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:18.419011  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:18.354933 18353 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260812 19:25:18.414059 18170 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:18.414511 18234 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:18.438669 18346 raft_consensus.cc:2781] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:18.453789 18346 raft_consensus.cc:686] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:18.455092 18346 consensus_queue.cc:237] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.463547 18347 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:18.464326 18347 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:18.465942 18332 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.356s	user 0.000s	sys 0.004s
I20260812 19:25:18.467695 18183 raft_consensus.cc:3032] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:25:18.468132 18183 raft_consensus.cc:729] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:18.469861  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:18.473538  7597 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260812 19:25:18.408867 18239 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:18.486163  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 47232.4us
I20260812 19:25:18.445760 18182 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:18.447973 18170 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:18.446008 18087 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260812 19:25:18.473603 17996 raft_consensus.cc:979] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:25:18.415820 17940 consensus_queue.cc:1046] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.068s
I20260812 19:25:18.498193  6473 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 13. Current term is 14. Ops: []
I20260812 19:25:18.437935 17916 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260812 19:25:18.498948  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:18.447799 18167 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260812 19:25:18.499984 17996 raft_consensus.cc:1067] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:25:18.500197 18183 consensus_queue.cc:260] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:18.501628 18368 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260812 19:25:18.496578 18234 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:18.502218 18340 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:18.504282 18239 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:18.504067 17392 consensus_queue.cc:1046] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260812 19:25:18.494066 18169 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260812 19:25:18.513852 18234 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:18.516029  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 97075.4us
I20260812 19:25:18.511070 18347 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:18.518554 18183 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:25:18.520269 18340 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:18.521020  6464 raft_consensus.cc:1226] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 13. Current term is 14. Ops: []
I20260812 19:25:18.528522 17864 raft_consensus.cc:504] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:18.529261 17392 raft_consensus.cc:3032] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:18.529703 17392 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:18.530179  7594 raft_consensus.cc:2379] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 21: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:25:18.530616 17392 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.531366 18341 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:18.531906 18341 raft_consensus.cc:686] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:18.532948 18341 consensus_queue.cc:237] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.527087 18234 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:18.526008  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:18.531956 17392 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:18.612829 18340 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:18.613477 18340 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.615820 18340 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:18.622500 16960 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Stepping down as leader of term 22
I20260812 19:25:18.623029 16960 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:18.623956 16960 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.625352 16960 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:18.493660 18034 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260812 19:25:18.497380 18349 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:18.510473 17337 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Stepping down as leader of term 22
W20260812 19:25:18.639777  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 113845us
I20260812 19:25:18.641090  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:25:18.609572  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 82136.3us
I20260812 19:25:18.643481  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:18.648063 17940 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:18.648658 17940 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:18.649365 17940 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:18.639073 17337 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:18.609529 18347 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:18.663142  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 272216us
W20260812 19:25:18.664779  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 169968us
I20260812 19:25:18.706792  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:18.706333  6236 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:53178
I20260812 19:25:18.652588 18345 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:25:18.646162 18340 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:25:18.710254  6236 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:25:18.716212  6236 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:18.710143  6482 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:18.711390  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:18.714557  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:18.719677  6232 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:18.733839  6236 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.659003 18087 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260812 19:25:18.671221 18099 consensus_queue.cc:1046] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260812 19:25:18.752490  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:18.753239  6482 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:18.735353 17864 leader_election.cc:288] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:18.721046 18347 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.666007 17337 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 22.9, Last appended by leader: 9, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.759431  6236 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:18.767863  6232 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 20. Current term is 21. Ops: [20.16-20.16]
W20260812 19:25:18.769987  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 126598us
I20260812 19:25:18.788209  6229 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:18.741608 18385 consensus_queue.cc:1046] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260812 19:25:18.789501  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:18.773092 17337 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:18.794189  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:18.795025  6224 raft_consensus.cc:2354] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20.
I20260812 19:25:18.795919  6228 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:18.777681 18183 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260812 19:25:18.809289  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:18.811574  6228 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 18: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:18.818912  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:18.813095  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:18.820732  6229 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:18.821226  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:18.822697  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: true dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:18.823320  6238 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:18.823992 18170 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.826054 18170 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:18.827852  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:18.828086  6359 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:18.840687  6238 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:18.845552  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:18.846719  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:18.847788  6232 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 20: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:18.849450  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:18.851308  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:18.851774  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:18.853878  7597 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260812 19:25:18.811151 18394 raft_consensus.cc:3032] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:25:18.859920  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:18.860965  6228 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:18.861907  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:18.809036 18388 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:18.867542  6342 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:18.842964 18239 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:18.875449  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:18.871192  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:18.845602 18389 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:18.872126  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:18.875289  6354 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:18.803925 18234 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.916796  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:18.876127  6347 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:18.888559 18239 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.896919  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:18.847334 17864 consensus_queue.cc:1046] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260812 19:25:18.967579  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:18.969048  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 97055.4us
I20260812 19:25:18.886878 18345 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:25:18.915974 18322 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 20 LEADER]: Stepping down as leader of term 20
W20260812 19:25:18.919019 18393 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.107s	user 0.000s	sys 0.003s
W20260812 19:25:18.919417 18399 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.075s	user 0.000s	sys 0.002s
I20260812 19:25:18.875684 18388 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:18.919462 18342 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.640s	user 0.003s	sys 0.000s
I20260812 19:25:18.891553  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:18.862933 18394 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:18.917120  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:18.998204  6483 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:25:18.998261  6345 raft_consensus.cc:3032] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:18.928324  6229 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:18.998819  6345 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:18.999655  6345 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.959112  6482 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 21.
W20260812 19:25:18.962827  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 111195us
I20260812 19:25:19.001243  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:19.002142 18346 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:25:19.002549  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:19.003913  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:19.004500  6482 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 20
I20260812 19:25:19.007068  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1076) took 1029 ms. Trace:
I20260812 19:25:19.007452  6230 rpcz_store.cc:276] 0812 19:25:17.977415 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:17.977621 (+   206us) service_pool.cc:227] Handling call
0812 19:25:17.978037 (+   416us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:17.978289 (+   252us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:17.978335 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:17.978784 (+   449us) log.cc:842] Serialized 26 byte log entry
0812 19:25:18.056091 (+ 77307us) raft_consensus.cc:1631] Marking committed up to 16
0812 19:25:18.056140 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:18.056230 (+    90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:18.918757 (+862527us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:25:19.006734 (+ 87977us) raft_consensus.cc:1671] finished
0812 19:25:19.006759 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:19.007007 (+   248us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":67454720,"thread_start_us":76817,"threads_started":1,"wal-append.queue_time_us":186211}
I20260812 19:25:18.985946 18347 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:19.012193 18400 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:19.012876 18400 consensus_queue.cc:1046] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 19:25:19.013608 18388 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:19.014189 17392 raft_consensus.cc:3032] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:19.014482  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:18.981156 18322 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:19.015355 18340 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:19.015774 18322 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:19.017069 18322 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:19.017328  6416 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:19.019028  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:18.976964 18170 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:19.020462 18170 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:19.020838 18170 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:18.961681  6349 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:19.029397 17940 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.998756  6473 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260812 19:25:18.873984 18341 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:18.959007 18389 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:18.980189  6464 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:18.981137  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:18.986321  6228 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260812 19:25:18.990013  6475 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260812 19:25:18.996170  6232 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260812 19:25:19.044051  6228 pending_rounds.cc:76] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 9
I20260812 19:25:19.044328  6228 pending_rounds.cc:97] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260812 19:25:18.997465  6477 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:18.995343  6352 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:19.014626 17392 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:19.000005  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:18.971833  6347 raft_consensus.cc:2396] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260812 19:25:19.036437  7553 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:19.047080  6342 raft_consensus.cc:3032] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:19.047796  6342 raft_consensus.cc:729] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:19.040903  6242 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260812 19:25:19.044636  6228 raft_consensus.cc:2866] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:19.045646  6238 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 20: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:19.038179  6482 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:19.052748  6342 consensus_queue.cc:260] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:18.859934  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260812 19:25:19.065100  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 411934us
I20260812 19:25:19.069890 18375 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:19.072630  6470 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260812 19:25:19.073943  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 56687.2us
I20260812 19:25:19.075047  6416 leader_election.cc:398] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21.
I20260812 19:25:19.075439  6416 leader_election.cc:401] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:25:19.076717 18183 raft_consensus.cc:2781] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:19.077329 18183 raft_consensus.cc:686] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 21 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:19.078223 18183 consensus_queue.cc:237] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:19.079172 17361 raft_consensus.cc:3032] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:19.079586 17361 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:19.080423 17361 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:19.083276  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:19.094321  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:19.042464 18340 raft_consensus.cc:2781] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:19.081843 17361 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:19.070497 18375 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:25:19.089179 18324 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.018s	sys 0.068s
W20260812 19:25:19.123821 18324 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.018s	sys 0.068s
I20260812 19:25:19.115130 18389 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.124225 18375 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.125116  6345 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:19.125450 18375 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:18.998598 18394 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.115885 18234 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:19.117144 17940 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:19.117750 17392 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:19.127900  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 53039.2us
I20260812 19:25:19.128757  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:19.137452  6242 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:19.139726  6228 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260812 19:25:19.146015  6238 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260812 19:25:19.132465 18346 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21.
I20260812 19:25:19.132175 18340 raft_consensus.cc:686] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:19.161265  6345 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
W20260812 19:25:19.181149  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 52484.6us
I20260812 19:25:19.161958 18345 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:19.206511  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:19.214521  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:19.180894 17662 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260812 19:25:19.226822 18424 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260812 19:25:19.211566 18412 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260812 19:25:19.237996 18340 consensus_queue.cc:237] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:19.249096  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55977.2us
I20260812 19:25:19.250041  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:19.208158 18388 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260812 19:25:19.257902  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:19.239948 18234 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:19.266232  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:19.222352 18170 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.275102  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099703c7d52b4644ae3c1098ddcc0282" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:19.275844  6354 raft_consensus.cc:3037] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:19.276137 18170 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:19.277721  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:19.279366 18208 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:19.286255  6344 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:19.289978  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:19.291932  6344 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260812 19:25:19.237926 17793 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260812 19:25:19.304095 18182 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:19.304700 18182 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:19.252238 18345 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:19.305606 18182 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.307917  6345 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260812 19:25:19.298887  6352 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 22: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:19.310431  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:19.312255  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:19.315466  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:19.316826  6354 raft_consensus.cc:2454] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 21.
I20260812 19:25:19.317365  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:19.322466 18169 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:25:19.318843 17916 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:19.318964 18133 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260812 19:25:19.272794 18427 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260812 19:25:19.324620  6354 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:19.328127  6354 raft_consensus.cc:595] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:19.328656  6354 raft_consensus.cc:603] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:19.324929  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:19.328493  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:19.267642 17940 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260812 19:25:19.330430  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 70676.7us
I20260812 19:25:19.332964  6352 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:19.335002 17916 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:25:19.338081 18442 raft_consensus.cc:2741] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election decision vote started in defunct term 22: won
I20260812 19:25:19.338860 18433 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:19.339291  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:19.320391 18208 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:19.268139 18321 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260812 19:25:19.347530  6353 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:19.426455  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:19.330440 18133 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:19.427851  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 63332.5us
I20260812 19:25:19.428457 18208 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:19.434330  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:19.296489 18234 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.272994 18349 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.154s
I20260812 19:25:19.443492  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:19.334081 17793 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
W20260812 19:25:19.501075  6178 leader_election.cc:334] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.517s (SENT)
I20260812 19:25:19.431586 18433 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:19.324841 18391 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.108s
I20260812 19:25:19.434144 18442 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:19.440234  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:19.437054 18345 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:19.438702 17940 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:19.508738  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:19.509562  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:19.440891 18400 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260812 19:25:19.514006  6352 raft_consensus.cc:595] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:19.515441  6352 raft_consensus.cc:603] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:19.431910 18133 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:19.516422  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 76272.2us
I20260812 19:25:19.437304 18208 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.518088  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:19.506044 18169 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:19.573374 18169 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:19.579088  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:19.582882 17392 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:19.584070  6342 raft_consensus.cc:3037] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:19.589542 18234 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:19.591547 18464 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260812 19:25:19.597231 18443 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260812 19:25:19.601900 17921 raft_consensus.cc:3032] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:19.602464 17921 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:19.603488 17921 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.605116 17921 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:19.516402 18442 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.608819 18442 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:19.517520 18434 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260812 19:25:19.524893 18426 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260812 19:25:19.528590 18437 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:19.611402  6483 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260812 19:25:19.514010 18433 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:19.571470  6178 leader_election.cc:334] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.548s (SENT)
I20260812 19:25:19.612895  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:19.572178 18392 raft_consensus.cc:3032] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 13 LEADER]: Stepping down as leader of term 13
I20260812 19:25:19.619113 18392 raft_consensus.cc:729] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:19.620019 18394 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:19.620436 18395 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:19.620348 18392 consensus_queue.cc:260] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:19.621210 18395 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.619104 18433 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:19.623505  6349 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:19.624308  6349 raft_consensus.cc:595] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:19.625064  6349 raft_consensus.cc:603] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:19.625255 18239 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:19.625974 18239 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:19.528985  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:19.618592  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47172.4us
W20260812 19:25:19.648095  6178 leader_election.cc:334] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.521s (SENT)
I20260812 19:25:19.648650  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:19.518924 18346 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:19.627058 18309 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260812 19:25:19.634788  6483 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260812 19:25:19.640460  6342 raft_consensus.cc:2454] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:19.642305  6228 raft_consensus.cc:1226] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
W20260812 19:25:19.669010  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 140110us
I20260812 19:25:19.669705  6483 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:19.670006  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:19.674110  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:19.674806  6477 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:19.669202  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:19.677696  6228 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:19.679539  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:19.696300  6236 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260812 19:25:19.697702  6475 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260812 19:25:19.701814  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 53775.8us
W20260812 19:25:19.703985  6178 leader_election.cc:334] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.662s (SENT)
I20260812 19:25:19.704567  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:19.716164  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:19.719575  6477 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:19.722525  6228 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:19.664628 18170 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:19.664474 18391 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:19.701550 18346 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:19.759207  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 51498.2us
I20260812 19:25:19.760695  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:19.762285  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 58342.6us
I20260812 19:25:19.679108 18437 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:19.695204 18442 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:19.763005 18167 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:19.767913 18395 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:19.699118 18347 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:19.701524 17622 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:19.774405  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 102303us
I20260812 19:25:19.779290  6224 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:25:19.781751 18208 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:19.782997  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:19.783159  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:19.784822  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:19.791719  6236 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260812 19:25:19.797482  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:19.800091  6416 leader_election.cc:302] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:19.761824 18434 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:19.822010  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:19.803009  6055 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 123) took 16580 ms (client timeout 15000 ms). Trace:
I20260812 19:25:19.822535  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:19.823493  6236 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:19.823866  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:19.830098  6178 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.750s (SENT)
I20260812 19:25:19.830726  6236 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260812 19:25:19.830679  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:19.826498  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:19.828962  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:19.833921  6224 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:19.835083  6354 raft_consensus.cc:1261] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260812 19:25:19.841053  6416 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:19.825997 18399 log.cc:924] Time spent T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260812 19:25:19.765451 18391 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.763859 18170 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.826264 18375 raft_consensus.cc:2741] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260812 19:25:19.820452 18345 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:25:19.773110 18346 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.847841  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:19.832577 18400 raft_consensus.cc:2741] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260812 19:25:19.850862  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:19.786178 18204 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260812 19:25:19.837400 17940 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:19.837755 18340 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260812 19:25:19.858611  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 341175us
I20260812 19:25:19.861654  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:19.833871 18434 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.825619 17662 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260812 19:25:19.865887  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:19.788048 17622 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.872267  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:19.885406  6481 raft_consensus.cc:2379] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:19.885847  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:19.888170  6474 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 21: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:19.845782 18208 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260812 19:25:19.891856  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:19.875420 18345 raft_consensus.cc:2781] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:19.872870  6342 raft_consensus.cc:595] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:19.902215  6342 raft_consensus.cc:603] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:19.802328 18347 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260812 19:25:19.904182 18434 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:19.904467 17622 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:19.885660 17940 raft_consensus.cc:686] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:25:19.905766 18409 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.065s	user 0.000s	sys 0.008s
W20260812 19:25:19.906770 18466 log.cc:924] Time spent T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260812 19:25:19.908595 18479 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:19.909257 18479 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.839048 18405 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260812 19:25:19.832266 18234 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260812 19:25:19.911652 18234 consensus_queue.cc:1225] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer 54f83319db6b49929cc8f18a66a66975 log is divergent from this leader: its last log entry 22.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260812 19:25:19.912330 18234 raft_consensus.cc:3032] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:19.912696 18234 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:19.879321  6482 raft_consensus.cc:2396] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260812 19:25:19.879879  6473 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:19.917802  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:19.918773  6473 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 22: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:19.919672  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:19.920238  6473 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:19.920974  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:19.921957  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:19.874540 18340 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:19.849408 18334 consensus_queue.cc:1035] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260812 19:25:19.922830 18395 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:19.923372 18395 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:19.922915 18340 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:19.906328 17940 consensus_queue.cc:237] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.913689 18234 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.932313 18234 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:19.933478 18133 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:19.901358  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:19.935519 18169 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:19.935983  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:19.937029  6481 raft_consensus.cc:2362] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18. Re-sending same reply.
I20260812 19:25:19.939517  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:19.944826  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:19.972764  6474 raft_consensus.cc:2362] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23. Re-sending same reply.
I20260812 19:25:19.947963 18346 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:19.950831 18391 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:19.946076 18345 raft_consensus.cc:686] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:19.938588 18167 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:19.924263 18395 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:19.922616  6473 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:25:19.822934  6055 rpcz_store.cc:269] 0812 19:25:03.211084 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:03.211745 (+   661us) service_pool.cc:227] Handling call
0812 19:25:19.724629 (+16512884us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:17.194786 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:17.195501 (+   715us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:17.195552 (+    51us) write_op.cc:435] Acquired schema lock
0812 19:25:17.195565 (+    13us) tablet.cc:660] Decoding operations
0812 19:25:17.196576 (+  1011us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:17.196672 (+    96us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:17.196713 (+    41us) tablet.cc:683] Acquiring locks for 8 operations
0812 19:25:17.197549 (+   836us) tablet.cc:699] Row locks acquired
0812 19:25:17.197582 (+    33us) write_op.cc:260] PREPARE: finished
0812 19:25:17.259791 (+ 62209us) write_op.cc:270] Start()
0812 19:25:17.259967 (+   176us) write_op.cc:276] Timestamp: P: 1786562717246054 usec, L: 0
0812 19:25:17.260000 (+    33us) op_driver.cc:331] REPLICATION: starting
0812 19:25:17.287853 (+ 27853us) log.cc:842] Serialized 3170 byte log entry
0812 19:25:17.919047 (+631194us) op_driver.cc:444] REPLICATION: finished
0812 19:25:18.039715 (+120668us) write_op.cc:301] APPLY: starting
0812 19:25:18.039839 (+   124us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:18.199153 (+159314us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:18.199290 (+   137us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:18.275827 (+ 76537us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:18.276139 (+   312us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0812 19:25:18.276197 (+    58us) write_op.cc:312] APPLY: finished
0812 19:25:18.276606 (+   409us) log.cc:842] Serialized 81 byte log entry
0812 19:25:18.276823 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:18.276953 (+   130us) write_op.cc:454] Released schema lock
0812 19:25:18.277014 (+    61us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:18.290591 (+ 13577us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:18.290633 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3906943,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":81736,"apply.run_cpu_time_us":15158,"apply.run_wall_time_us":272641,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37615,"num_ops":8,"prepare.queue_time_us":194892,"prepare.run_cpu_time_us":27998,"prepare.run_wall_time_us":435554,"raft.queue_time_us":223509,"raft.run_cpu_time_us":13670,"raft.run_wall_time_us":47495,"replication_time_us":658909,"thread_start_us":570864,"threads_started":4,"wal-append.queue_time_us":395242,"wal-append.run_cpu_time_us":23166,"wal-append.run_wall_time_us":1592080}]]}
I20260812 19:25:20.017200  7597 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260812 19:25:20.017839  7597 pending_rounds.cc:76] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Aborting all ops after (but not including) 15
I20260812 19:25:20.018121  7597 pending_rounds.cc:97] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260812 19:25:20.018396  7597 raft_consensus.cc:2866] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:20.008116  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:20.012723  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.022815  6481 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:20.022972  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.030112  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.002018 18346 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:20.031608  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.015589 18391 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:20.038342  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:20.041321  6481 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:25:20.039589  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 218772us
I20260812 19:25:20.043113  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.043712  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:20.046291  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.047183  6474 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 19: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:20.048327  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.048687  6482 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 16: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:20.049453  6481 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 21: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:20.052110  6473 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260812 19:25:20.032595 18347 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:20.059443  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 229345us
I20260812 19:25:20.059959  6481 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260812 19:25:20.064035  6465 raft_consensus.cc:1226] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 13. Current term is 14. Ops: []
I20260812 19:25:20.064853  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:20.040845 18170 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:20.068523  6482 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260812 19:25:20.071419  6481 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260812 19:25:20.075670  6347 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:25:20.078528  6474 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260812 19:25:20.072516  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.038525 18349 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260812 19:25:20.088354 18340 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.117302  6229 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260812 19:25:20.118027 18340 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:20.118216  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:20.119068  6483 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:20.119184  6236 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:20.077944 18495 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
W20260812 19:25:20.092410 18514 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260812 19:25:20.078142 18347 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.129335 18392 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:25:20.130270 18347 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:20.097107  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:20.099148  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:20.099675 18489 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260812 19:25:20.135485  6482 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:20.136463  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.102090  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:20.136677  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.137087  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:20.137373  6342 raft_consensus.cc:595] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:20.137578  6473 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:20.138439  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:20.139086  6342 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:20.140895 18501 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:20.141587 18501 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:20.144254 18501 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:20.076992 18479 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:20.103484  6349 raft_consensus.cc:1261] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260812 19:25:20.105778  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:20.107770  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:20.112023  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:20.112241  6344 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260812 19:25:20.112475  6350 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260812 19:25:20.115015  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:20.114873 18345 consensus_queue.cc:237] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.046141 18391 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.036235 18346 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:20.121726  6481 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260812 19:25:20.094022  6475 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260812 19:25:20.153932  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:20.161876  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:25:20.162063  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:20.162305 18495 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:20.162855  6359 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:20.163363 18495 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.164032  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:25:20.164780  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:20.155272  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.166018 18391 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:20.167539  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.166363  6473 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:20.156844  6242 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:20.157150  6344 raft_consensus.cc:1261] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260812 19:25:20.161904  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:20.137108  6482 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:20.154949  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:20.168131  6481 raft_consensus.cc:2362] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14. Re-sending same reply.
I20260812 19:25:20.156141  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.181012  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:20.160465 17921 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:20.185894  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.186515  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:20.186566  6475 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:20.188391  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:20.191592  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:20.193267  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:20.196374 18346 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:20.184708 17921 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:20.182404  6354 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
I20260812 19:25:20.198500  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:20.199834  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:20.184636 18497 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260812 19:25:20.201727  6242 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260812 19:25:20.204592  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.205286  6482 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:20.204753  6473 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260812 19:25:20.206787  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:20.209262  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:20.210310 18424 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260812 19:25:20.214308  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:20.204937 18167 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:25:20.221508  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:20.229866 18434 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:20.231189 18424 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:20.231631 18424 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:20.232015 18424 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:20.242395  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:20.230409 18434 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.244019  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:20.244578 18434 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:20.201198 18501 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:20.245597 18501 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:20.245965 18501 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:20.249419 17921 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:20.256363 17622 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 19:25:20.206348  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:20.257270 18389 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260812 19:25:20.257954  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 51603.7us
I20260812 19:25:20.258747  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:20.259254  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2916) took 1181 ms. Trace:
I20260812 19:25:20.259685  6347 rpcz_store.cc:276] 0812 19:25:19.077954 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:19.082103 (+  4149us) service_pool.cc:227] Handling call
0812 19:25:20.259075 (+1176972us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b540025f654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:20.259199 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2209629952}
I20260812 19:25:20.260327 18133 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:20.263087 18133 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.265368 18133 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:20.265409  6477 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260812 19:25:20.266332  6477 pending_rounds.cc:76] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 12
I20260812 19:25:20.266582  6477 pending_rounds.cc:97] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260812 19:25:20.266853  6477 raft_consensus.cc:2866] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:20.260789 18434 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:20.227298 18204 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:20.270839 18434 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:20.271230 18204 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:20.271349 18434 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:20.271721 18204 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:20.258963 18169 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:20.279639  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:20.280359  6230 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:20.283027  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.283757  6483 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:20.258977  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:20.285259  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:20.288753  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.292253  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:20.293990  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:20.295080  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:20.295765  7606 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
I20260812 19:25:20.296967  6470 raft_consensus.cc:2379] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:20.282805 17921 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:20.320137  6298 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:20.300495 18133 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:20.294957 18208 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:20.334532  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:20.322753 17921 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:20.344919  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:20.347762 17921 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:20.334872 17793 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260812 19:25:20.353509  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 59606.8us
I20260812 19:25:20.356443  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:20.358551 18208 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:25:20.337193 17337 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:20.362620  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:20.369529  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:20.371811  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:20.342927 18410 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260812 19:25:20.381559  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:20.346905 17662 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260812 19:25:20.389276  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:20.355283 17793 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:25:20.403956 18528 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260812 19:25:20.381045 18169 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:20.406929 17916 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:20.381210 17622 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260812 19:25:20.380707 18239 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:25:20.416276 18133 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:20.378842 18208 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:20.368753 18324 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:20.489481 18324 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:20.489981 18324 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:20.445686 17793 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 13 FOLLOWER]: Advancing to term 14
I20260812 19:25:20.383910 17337 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:20.508592 17793 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:20.513742 17793 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:20.514271  6052 catalog_manager.cc:5495] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 12 to 13, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 13 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:20.520592  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:20.530978  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:20.548930  6052 catalog_manager.cc:5495] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:20.549597 17921 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.528644 18167 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260812 19:25:20.551110  6052 catalog_manager.cc:5495] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 12 to 15, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 15 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
W20260812 19:25:20.538123  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 167606us
I20260812 19:25:20.533473 18170 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260812 19:25:20.579195  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 48303.5us
I20260812 19:25:20.580150  6416 leader_election.cc:398] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20.
I20260812 19:25:20.580474  6416 leader_election.cc:401] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:25:20.591153  6353 raft_consensus.cc:2354] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22.
W20260812 19:25:20.591585  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 202406us
I20260812 19:25:20.592530  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:20.593845  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:20.595306  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:20.603147  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:20.606765 18424 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.608481 18345 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:20.609040 18424 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:20.612464 18389 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:20.612957 18389 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.597216 18434 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.620929 18434 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:20.623262 18527 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260812 19:25:20.625017 18523 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260812 19:25:20.627441 18389 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:20.638922  7594 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 14.
W20260812 19:25:20.642521  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 58838.2us
I20260812 19:25:20.643831  6416 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:20.645133  6298 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:20.650683 17337 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:20.650797  6052 catalog_manager.cc:5495] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 14 to 17, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 17 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:20.652806  6052 catalog_manager.cc:5495] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:20.654920  6052 catalog_manager.cc:5495] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:20.595621 18503 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:20.661152  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:20.601733 18347 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260812 19:25:20.597954 18167 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260812 19:25:20.662290  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 62596.6us
I20260812 19:25:20.669679  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:20.635076 18375 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20.
I20260812 19:25:20.601392 18239 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:20.686980  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:20.695494  6242 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: []
W20260812 19:25:20.704123  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:20.704438 18340 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:20.705307 18239 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260812 19:25:20.708393 18395 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:20.713071  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:20.713905  6473 raft_consensus.cc:2379] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 14: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:20.714737  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.715798  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:20.716336  6473 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:20.716926  6052 catalog_manager.cc:5495] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:20.672451 18346 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 19:25:20.637586 18501 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.720980  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:20.721437 18170 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:20.721803 18501 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:20.721984 18170 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:20.722880 18345 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:20.723310 18345 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:20.723708 18345 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:20.724097 17921 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:20.692013 17622 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:20.724915 17622 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:20.725274 17622 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:20.726773  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:20.728199  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:20.721613  6229 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:20.739413  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:20.667728 18495 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Leader election won for term 14
W20260812 19:25:20.731091 18531 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260812 19:25:20.755888 18479 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:25:20.723305 18324 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.760628 18324 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:20.761126 18511 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 19:25:20.763301  6359 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260812 19:25:20.766505 18133 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:20.767272 18133 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:20.775004  6342 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:20.776415  6178 leader_election.cc:398] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22.
I20260812 19:25:20.776935  6178 leader_election.cc:401] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:25:20.789111  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:20.791764  6242 raft_consensus.cc:1261] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260812 19:25:20.748307  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:20.666309 18182 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260812 19:25:20.661531 18204 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.686735 17864 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:20.751484  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:20.806495  6342 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:25:20.807118  6232 raft_consensus.cc:2396] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 23 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260812 19:25:20.793751  6473 raft_consensus.cc:2396] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260812 19:25:20.796092  6352 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
W20260812 19:25:20.803994  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55817.1us
I20260812 19:25:20.753509  6470 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260812 19:25:20.804953  6229 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:20.812443  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:20.813666  6230 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:25:20.818806  6224 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 20: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:20.818769 18437 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:20.826942 18437 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.819023 17864 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:20.829365  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:20.831248  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:20.832000  6349 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:20.822494 18351 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:20.801255 18394 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:20.833564 18351 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:20.836530 18394 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.775770 18442 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260812 19:25:20.837558 18442 consensus_queue.cc:1225] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260812 19:25:20.770524 18347 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260812 19:25:20.840955  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:20.841661  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:20.842720  6342 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
I20260812 19:25:20.838402 18351 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:20.846587  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:20.847193  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:20.851455  6236 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:25:20.848191  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.796627 17622 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.810936 18346 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:20.854283  6238 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260812 19:25:20.810286 18324 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:20.801846 18495 raft_consensus.cc:686] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:25:20.852480  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 43981.7us
I20260812 19:25:20.852965  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:20.853259  6475 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
I20260812 19:25:20.818428 17916 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 22
I20260812 19:25:20.854332 18501 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:20.873368 18503 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:20.875511 18501 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:20.859028  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:20.861104  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet d1275ccc06f94fcdaa82a73420569651, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:20.876910  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet d1275ccc06f94fcdaa82a73420569651, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.876027 18501 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:20.876741 18324 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:20.880149 18324 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:20.881341 18345 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.841084 18394 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:20.863098  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:20.865813 17622 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:20.871840  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:20.917641  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 50389.6us
I20260812 19:25:20.920933  6342 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:20.840148 18204 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:20.880622  6347 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 19.
I20260812 19:25:20.876412  6470 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:25:20.830412 17864 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:20.890305 18556 log.cc:924] Time spent T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260812 19:25:20.890616 18502 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:25:20.875921 18503 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.854552 18347 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260812 19:25:20.862218 17940 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260812 19:25:20.884006 18495 consensus_queue.cc:237] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:20.860679  6052 catalog_manager.cc:5495] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 7 to 16, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 16 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:20.900830  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:20.913101  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:20.920902  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:20.926831  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:20.936962  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:20.939347  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:20.936975  7591 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:20.939424  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:20.928092 18169 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:25:20.930270 18502 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:20.960481  6298 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:20.931948 18345 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:20.924511 18442 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260812 19:25:20.941143 18234 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:25:20.965025  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:20.964530  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:20.969926  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:20.970120  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:20.971194  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:20.974128  6229 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:20.944588 17864 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:20.931291 18324 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260812 19:25:20.947682 18434 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:20.944717 18375 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:20.973695  6483 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:20.983680  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:20.979846  6349 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:20.985114  6224 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260812 19:25:20.986671  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:21.033042  6470 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:20.930351 18170 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:20.960845 18502 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:20.975133 17864 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:20.990116  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 1185) took 1027 ms. Trace:
I20260812 19:25:20.944043 18346 consensus_queue.cc:1035] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260812 19:25:20.992712  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:20.996855  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:21.002571  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:21.046849  6236 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 24
I20260812 19:25:21.047143  6473 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:20.966251 17921 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:21.028873  6230 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:20.957569 18341 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:21.034344  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:21.035458  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 96228.7us
I20260812 19:25:21.051508  6475 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:21.051836  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:21.031414  6229 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
W20260812 19:25:21.041116  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 69252.4us
W20260812 19:25:21.041302  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 80904.5us
I20260812 19:25:20.989939 18509 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:21.042479  6465 rpcz_store.cc:276] 0812 19:25:19.963208 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:20.066616 (+103408us) service_pool.cc:227] Handling call
0812 19:25:20.082836 (+ 16220us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:20.529129 (+446293us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:20.529159 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:20.529587 (+   428us) log.cc:842] Serialized 26 byte log entry
0812 19:25:20.616854 (+ 87267us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b4800110358. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fc61f7f1 00007f98fc6168e7 00007f98fc61677a 00007f98fc70a95f 00007f98fc70a627 00007f98fc71eb2c 00007f98fc71ead8 00007f98fc71ea58 00007f98fc71ea13 00007f98fc71dcbc 00007f98fb69fbe6
0812 19:25:20.663092 (+ 46238us) raft_consensus.cc:1631] Marking committed up to 15
0812 19:25:20.663134 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:20.663207 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:20.989857 (+326650us) raft_consensus.cc:1671] finished
0812 19:25:20.989877 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:20.990061 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":402160,"raft.queue_time_us":402872,"raft.run_cpu_time_us":1083,"raft.run_wall_time_us":83121,"spinlock_wait_cycles":8660608,"thread_start_us":129039,"threads_started":1,"wal-append.queue_time_us":289372}
I20260812 19:25:21.020831  6052 catalog_manager.cc:5495] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 15 to 18, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 18 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:21.039652 18375 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:21.059828  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:21.049575  6342 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:21.065467  6473 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:21.059376  6470 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:21.066421  6178 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:21.046440 17996 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:21.045447 17864 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:21.069552  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:21.051241 18434 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:21.072292 17996 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:21.078123 18437 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:21.068969 18375 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:21.066490 17940 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:25:21.093287  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:21.093961 18563 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260812 19:25:21.095551  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:21.096575  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:21.084995 17337 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:21.088699  6236 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:21.080156  6052 catalog_manager.cc:5495] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 14 to 16, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 16 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:21.104856  6465 raft_consensus.cc:2354] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22.
I20260812 19:25:21.092918 17996 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:21.094023  6475 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:21.116904 18170 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:21.126521  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:21.052070 18501 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.092414 18442 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:21.092535  6483 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:21.120165  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:21.140388  6224 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: [16.9-18.10]
I20260812 19:25:21.088382 18544 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:21.088776 18567 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260812 19:25:21.145419  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:21.128227 18561 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260812 19:25:21.122578  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:21.146102  6232 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:21.123677  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:21.087641 18349 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:21.127971  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:21.108609 17940 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:21.129825  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:21.157888  6465 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 21
I20260812 19:25:21.067242 18341 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 22 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:21.131093  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:21.150852 18544 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:21.159816 18341 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.160463  6473 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260812 19:25:21.131367  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:21.157708 18545 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:21.069734 17921 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:21.163309 17940 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.163993 18545 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.164639 17921 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.132670  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:21.165964 18389 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 19:25:21.106132 18234 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260812 19:25:21.137048  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:21.138710  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:21.090322 18434 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:21.151443  6359 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
W20260812 19:25:21.130888 18575 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260812 19:25:21.066298 17793 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:21.067592 18509 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.104863 18553 consensus_queue.cc:1046] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.198s
I20260812 19:25:21.150985 18353 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:21.219091 18208 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:21.219727 18208 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:21.219430 18353 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:21.221182 18558 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.467s	user 0.003s	sys 0.000s
I20260812 19:25:21.220901 18208 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.221937 18353 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:21.143455 17337 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:21.139300 18437 consensus_queue.cc:1035] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260812 19:25:21.095808 18581 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
W20260812 19:25:21.196183 18579 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260812 19:25:21.196544 18545 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:21.230245  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 3bc485edcf4e4bbc84bff9c14c471284, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:21.230731  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 3bc485edcf4e4bbc84bff9c14c471284, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.222456 18208 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:21.198271 17916 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22.
I20260812 19:25:21.199280  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3432) took 1111 ms. Trace:
I20260812 19:25:21.235623  6477 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:21.184217 18503 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:21.203598 18499 consensus_queue.cc:1046] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260812 19:25:21.203835 18501 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:21.174700 18239 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:21.204977 18234 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:21.207767  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:21.215986 18493 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:21.223379  6352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2920) took 1116 ms. Trace:
I20260812 19:25:21.249197  6352 rpcz_store.cc:276] 0812 19:25:20.107149 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:20.107503 (+   354us) service_pool.cc:227] Handling call
0812 19:25:21.223183 (+1115680us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b540009ddd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:21.223311 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1331565824}
I20260812 19:25:21.197202 18544 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:21.193853 17793 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:21.241648  6359 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260812 19:25:21.245002  6465 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:21.236253  6481 rpcz_store.cc:276] 0812 19:25:20.088033 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:20.174815 (+ 86782us) service_pool.cc:227] Handling call
0812 19:25:20.175206 (+   391us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:25:20.530159 (+354953us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:20.530205 (+    46us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:25:20.557699 (+ 27494us) log.cc:842] Serialized 52 byte log entry
0812 19:25:20.769252 (+211553us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:25:20.769292 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:20.769356 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:21.199021 (+429665us) raft_consensus.cc:1671] finished
0812 19:25:21.199047 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:21.199206 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":381311,"raft.queue_time_us":366056,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":15168,"thread_start_us":154385,"threads_started":1,"wal-append.queue_time_us":365744}
I20260812 19:25:21.268411  6238 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
W20260812 19:25:21.273977  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 1e69ce57e6c74dea9e207b6ae03c43b2, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:21.274386  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 1e69ce57e6c74dea9e207b6ae03c43b2, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.233299 18375 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:21.323050  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 190458us
W20260812 19:25:21.315341  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 132435us
I20260812 19:25:21.334930  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:21.312777 18437 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:21.341666  6483 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260812 19:25:21.341737  6178 leader_election.cc:398] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22.
I20260812 19:25:21.344151  6352 raft_consensus.cc:1261] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260812 19:25:21.358804  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:25:21.359488  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:21.270210 18499 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260812 19:25:21.252751 18493 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.319073 18553 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:21.369246  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:21.370092  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:21.380960  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:21.380990  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:21.373564  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:21.383173  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:21.383665  6465 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260812 19:25:21.358812 18346 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:21.389133  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:21.370066 18577 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.239s	user 0.001s	sys 0.001s
W20260812 19:25:21.403345  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 244535us
I20260812 19:25:21.339699 18234 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260812 19:25:21.312196 17337 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.425132  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:21.343307 18503 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260812 19:25:21.340468 17940 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260812 19:25:21.438064  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:21.393298 18239 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:21.394793 18346 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:21.394955 18169 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:21.357816 18437 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.448184  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:21.340741 17793 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.461738 18509 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:21.462339 18509 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:21.465523 18493 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:21.466267 18375 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:21.477666  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:21.478677  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:21.467202 18182 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:21.383466 18553 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.492327 18182 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:21.493958 18553 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:21.493623 18182 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.494768 18590 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:21.448619 18544 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election won for term 24
W20260812 19:25:21.459065 18571 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.408s	user 0.000s	sys 0.006s
I20260812 19:25:21.447813 18587 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:21.456290 18346 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:21.451719 18394 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:21.503122  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:21.498401 18493 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:21.507264  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:21.569787  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260812 19:25:21.547535 18585 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260812 19:25:21.555127 18442 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:21.604779 18167 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:21.607065 18501 raft_consensus.cc:3032] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Stepping down as leader of term 21
W20260812 19:25:21.612103 18591 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
I20260812 19:25:21.618249 17793 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:21.509552 18590 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.548977 18587 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.635811 17996 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:21.652227 18544 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:21.662631 18501 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:21.651758 18394 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:21.712889  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:25:21.698215 18502 consensus_meta.cc:287] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.647s	user 0.012s	sys 0.000s
I20260812 19:25:21.715809 18503 consensus_queue.cc:1225] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260812 19:25:21.701066 18208 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:21.665661 18167 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.753008  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:21.755193  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:21.755944  6242 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:21.756173  6359 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 22: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:21.764133  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:21.784266  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:21.763521  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 204026us
I20260812 19:25:21.873638 18503 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:21.874209 18503 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:21.875651  6359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:21.876209 18503 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:21.808269 18587 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:21.804880  6344 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:21.810786 18394 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.812116 18167 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:21.814039 18609 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:21.786197 18434 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.004s
I20260812 19:25:21.744426 18389 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:21.760461 18437 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:21.739533 18502 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:21.748212 18509 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260812 19:25:21.823159  6232 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
W20260812 19:25:21.821476 17864 consensus_meta.cc:287] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.729s	user 0.008s	sys 0.004s
I20260812 19:25:21.757706 18442 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.787474 18544 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.877977 18609 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.878265 18434 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.878399 18389 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:21.764493 18208 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.876282  6359 raft_consensus.cc:595] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:21.784474 18501 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.884125 18502 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:21.915568  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:21.930702  6353 raft_consensus.cc:2379] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 21: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:21.907459 17996 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:21.951615  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:21.920013 18610 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:21.919497 18133 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:21.929862 18590 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:21.967912  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:21.907747 17864 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:21.969911  7591 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260812 19:25:21.974412  6353 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:21.975078  6353 raft_consensus.cc:595] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:21.981626 18617 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260812 19:25:21.987552 18389 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:21.991124 18619 log.cc:924] Time spent T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260812 19:25:21.992627 18208 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:21.964768 18133 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.995096 18133 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:21.996498 18346 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:21.998334  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.017s	sys 0.044s
I20260812 19:25:21.944942 18167 consensus_queue.cc:1046] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.038s
I20260812 19:25:22.005872 17916 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:22.006395 17916 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:21.964272 18610 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:22.008580 17916 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:22.009521  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:22.010113 18610 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:22.010483  6350 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:22.012861  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:22.011075 18346 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:22.013581  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:22.014478 18133 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:22.014999 18133 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:22.015360 18133 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:22.010499  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:21.992822 18616 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260812 19:25:22.023809  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:22.020715 18204 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:22.033185 18204 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:22.035368 18204 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:22.035564  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:22.036782  7600 raft_consensus.cc:2379] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 20: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
W20260812 19:25:22.025444  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.017s	sys 0.044s
W20260812 19:25:22.037279  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 649839us
I20260812 19:25:22.037927  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:21.961546 18545 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260812 19:25:22.038885  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:22.039499  6342 raft_consensus.cc:595] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:22.038920 18609 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:21.977092 18424 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:22.042330 18424 raft_consensus.cc:686] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:22.043744  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c59df69987ce4bc38077cd7681552414"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:22.043447 18424 consensus_queue.cc:237] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:22.044304  6352 raft_consensus.cc:595] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:22.044633  6352 raft_consensus.cc:603] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:22.046850 18590 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:22.047173  6352 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:22.047487 18590 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:22.047778  6352 raft_consensus.cc:595] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:22.048264  6352 raft_consensus.cc:603] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:22.048590 18590 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:22.049424  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260812 19:25:22.047528 18375 raft_consensus.cc:3032] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:22.050395 18375 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:22.039438  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:22.051369  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260812 19:25:22.051321  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 83480.9us
I20260812 19:25:22.056011  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:22.025604  6350 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:25:22.063850  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:22.067358  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:22.062549  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:22.069164  6228 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260812 19:25:22.070442  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:22.049865 17940 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:22.072093  6241 raft_consensus.cc:2354] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 23. Current term is 24.
I20260812 19:25:22.073127  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:22.074690  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:22.071295  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:22.078264  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:22.080399  6350 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 22: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:22.081768  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:22.059209 18437 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:22.086921  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:22.082309  6352 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260812 19:25:22.082942  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:22.083205  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:22.084245  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:22.084865  6235 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:22.059319 18545 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:22.085824  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:22.144021  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:22.145430  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:22.086691  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:22.150530  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:22.148221  6465 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:25:22.151180  6241 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:22.153434  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:22.047868 18608 consensus_queue.cc:1035] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.107s
I20260812 19:25:22.156283  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:22.157444 18375 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:22.158849  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:22.165717  6228 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: [16.9-18.10]
I20260812 19:25:22.073151 18208 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:22.173138  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:22.175266  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:22.176483  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:22.081425 18503 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:22.144131 18169 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:22.182016  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:22.176083  6349 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:22.152603 18545 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:22.142985 18389 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:22.158599 18375 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:22.196563  6349 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260812 19:25:22.175472 18208 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:22.203032  6235 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260812 19:25:22.200423 18503 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:22.200359 18615 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.381s	user 0.001s	sys 0.004s
I20260812 19:25:22.214380  6416 leader_election.cc:398] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 23. Current term is 24.
I20260812 19:25:22.216123  6416 leader_election.cc:401] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:25:22.086639 17940 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:22.218009  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:22.229290  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:22.230278 18495 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:22.230813  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:22.233042  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:22.234979 18546 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:22.238253 18345 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:25:22.239859 18345 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:22.240397 18345 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:22.247550 18434 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:22.194622 18545 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:22.249505 18509 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:22.274431 18442 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 24
I20260812 19:25:22.194913 18389 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:22.259742 18501 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:22.277341  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:22.183323 18204 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260812 19:25:22.218052 18208 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:22.279399  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:22.171911 18611 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.105s
I20260812 19:25:22.225404 18391 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:22.280719 18389 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:22.291179 18587 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:22.292013 18645 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260812 19:25:22.295121  6235 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260812 19:25:22.299206  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 156035us
I20260812 19:25:22.290114  6349 raft_consensus.cc:2379] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 20: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:22.298996  6236 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:25:22.326756  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:22.335476  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:22.335834  6228 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:22.288014 18607 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:22.343031  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:22.275174 18608 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260812 19:25:22.377677  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:22.379441  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:22.280076 18509 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:22.382038  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:22.382350  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 56888.7us
I20260812 19:25:22.388597  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2754) took 1269 ms. Trace:
W20260812 19:25:22.389245  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 168397us
I20260812 19:25:22.390218  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:22.396733  6228 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:25:22.389072  6473 rpcz_store.cc:276] 0812 19:25:21.112319 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:21.161406 (+ 49087us) service_pool.cc:227] Handling call
0812 19:25:21.161724 (+   318us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:21.319377 (+157653us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:21.319412 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:21.344723 (+ 25311us) log.cc:842] Serialized 26 byte log entry
0812 19:25:21.589099 (+244376us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:21.866298 (+277199us) log.cc:842] Serialized 14 byte log entry
0812 19:25:21.869773 (+  3475us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:21.870100 (+   327us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:22.006475 (+136375us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:25:22.369290 (+362815us) raft_consensus.cc:1671] finished
0812 19:25:22.381839 (+ 12549us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:22.382008 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16695,"prepare.queue_time_us":292510,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":19080,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":21490,"spinlock_wait_cycles":6431488,"thread_start_us":585060,"threads_started":3,"wal-append.queue_time_us":366247}
I20260812 19:25:22.393913  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:22.401590  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:22.404378  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:22.405474  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:22.413324  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:22.413841 18544 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:25:22.415575 18544 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:22.416045 18544 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:22.416435 18544 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:22.421474  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:22.422921  6359 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260812 19:25:22.376574 17337 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:22.380436 18169 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:22.306051 18405 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260812 19:25:22.437969  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:22.392895 18493 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:22.388365 18167 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:22.323143 18391 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:22.368113 18587 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:22.469296  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:22.423339 17864 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:22.382242 18607 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:22.489890  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 52054us
I20260812 19:25:22.458669 17361 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:22.450953 18662 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260812 19:25:22.483712 18615 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260812 19:25:22.554925  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 116029us
I20260812 19:25:22.473905 18169 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:22.580431  6481 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260812 19:25:22.579849  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 138384us
I20260812 19:25:22.505174 18392 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader election won for term 15
W20260812 19:25:22.556675 18637 log.cc:924] Time spent T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260812 19:25:22.603390  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:22.604322  6481 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 20
I20260812 19:25:22.559783 18394 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:22.607095  6241 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:22.616730  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:22.585860 18503 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:22.642092  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:22.593116 18345 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:22.610740 18651 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260812 19:25:22.575242 18678 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:22.659795  6241 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 19: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:22.662060  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:22.670311  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:22.677919  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:22.664047 18341 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:22.569727 17361 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:22.610363 18667 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260812 19:25:22.645691 18647 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.361s	user 0.001s	sys 0.001s
I20260812 19:25:22.691980  6464 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
W20260812 19:25:22.685372  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 250935us
I20260812 19:25:22.685536  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:22.686380  6241 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260812 19:25:22.643481 18169 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:22.638542 17940 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:22.683995 18657 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
W20260812 19:25:22.680302 18650 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.386s	user 0.001s	sys 0.000s
I20260812 19:25:22.669330 18340 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:22.712028  6474 raft_consensus.cc:1226] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:22.710711  6482 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:22.680142 18503 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:22.762349  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:22.640343 18394 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:22.804222  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 167749us
I20260812 19:25:22.757656 18347 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:22.687227 18346 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:22.810259  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:22.814075  6475 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:22.680404 18345 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.113s
I20260812 19:25:22.795516 18340 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:22.803359 18678 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:22.781898 18509 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:22.793279 18495 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:22.945021  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:22.966210 18705 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:22.961741  6475 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
W20260812 19:25:22.971133 18664 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.389s	user 0.001s	sys 0.000s
W20260812 19:25:22.972018 18685 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260812 19:25:22.972635 18658 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 0.497s	user 0.000s	sys 0.001s
I20260812 19:25:22.970811 18703 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:22.817602 18347 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:22.761078 18169 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:22.939368 18204 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:22.983860  6465 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260812 19:25:23.009138  6475 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260812 19:25:23.047454  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:23.105612  6241 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
W20260812 19:25:22.920011 18442 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.000s
I20260812 19:25:22.957386 18340 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:22.794991 18662 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.197s
I20260812 19:25:22.813282 18503 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:22.966250 18670 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:22.937592 18346 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:22.973893 18587 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:23.035854 18391 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:23.093197 18389 consensus_meta.cc:287] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.721s	user 0.011s	sys 0.000s
W20260812 19:25:23.162755  6470 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.007s	sys 0.007s
I20260812 19:25:22.999856 18392 raft_consensus.cc:686] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 15 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
W20260812 19:25:23.167930  6224 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.004s	sys 0.011s
W20260812 19:25:23.102866 18544 consensus_meta.cc:287] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.686s	user 0.005s	sys 0.007s
W20260812 19:25:23.092868 18545 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.813s	user 0.011s	sys 0.000s
W20260812 19:25:23.198529  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.005s	sys 0.013s
W20260812 19:25:23.241041  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.006s	sys 0.013s
I20260812 19:25:23.035061 18607 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:23.021818 18182 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:23.205195  6241 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260812 19:25:23.048133 18509 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:23.221727  6229 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.019s	sys 0.003s
W20260812 19:25:23.320720  6229 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.019s	sys 0.003s
I20260812 19:25:23.321753  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3509) took 1030 ms. Trace:
W20260812 19:25:23.228575  6470 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.008s	sys 0.007s
W20260812 19:25:23.230358  6224 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.004s	sys 0.011s
I20260812 19:25:23.298626  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:23.324499  6352 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:23.303397  6349 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260812 19:25:23.324527  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:22.974251 18678 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:23.344905  7553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.043s	sys 0.096s
W20260812 19:25:23.345439  7553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.043s	sys 0.096s
W20260812 19:25:23.346704  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 548671us
I20260812 19:25:23.150986 18204 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:23.296861 18667 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:23.022217 18705 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:23.302111  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:23.172077 18442 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 23. Current term is 24.
I20260812 19:25:23.322213  6229 rpcz_store.cc:276] 0812 19:25:22.291677 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.291812 (+   135us) service_pool.cc:227] Handling call
0812 19:25:22.292161 (+   349us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:22.292402 (+   241us) raft_consensus.cc:1520] Early marking committed up to index 12
0812 19:25:22.292748 (+   346us) log.cc:842] Serialized 14 byte log entry
0812 19:25:23.321226 (+1028478us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:23.321325 (+    99us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:23.321394 (+    69us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:23.321495 (+   101us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:23.321682 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":637,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":94044,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":16965,"thread_start_us":1028025,"threads_started":2,"wal-append.queue_time_us":394596}
I20260812 19:25:23.305358 18170 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:25:23.325870 18607 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:23.662750 18392 consensus_queue.cc:237] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:23.664822 18723 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:23.665419 18592 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:23.665551 18723 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:23.666153 18592 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:23.612264 18646 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.413s	user 0.001s	sys 0.001s
I20260812 19:25:23.669157 18592 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:23.339221 18509 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:23.671873 18671 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.720s	user 0.000s	sys 0.001s
I20260812 19:25:23.672461 18509 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:23.674188  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2920) took 1608 ms. Trace:
I20260812 19:25:23.674710  6242 rpcz_store.cc:276] 0812 19:25:22.065427 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.066980 (+  1553us) service_pool.cc:227] Handling call
0812 19:25:22.081012 (+ 14032us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:22.144710 (+ 63698us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:22.144742 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:22.171401 (+ 26659us) log.cc:842] Serialized 26 byte log entry
0812 19:25:22.230081 (+ 58680us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b48001110d8. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fc61f7f1 00007f98fc6168e7 00007f98fc61677a 00007f98fc70a95f 00007f98fc70a627 00007f98fc71eb2c 00007f98fc71ead8 00007f98fc71ea58 00007f98fc71ea13 00007f98fc71dcbc 00007f98fb69fbe6
0812 19:25:22.455529 (+225448us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:25:22.455573 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:22.457269 (+  1696us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:23.673713 (+1216444us) raft_consensus.cc:1671] finished
0812 19:25:23.673745 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:23.674077 (+   332us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":63338,"raft.queue_time_us":67773,"raft.run_cpu_time_us":1671,"raft.run_wall_time_us":72155,"spinlock_wait_cycles":11336448,"thread_start_us":248256,"threads_started":1,"wal-append.queue_time_us":512322}
W20260812 19:25:23.677733 18655 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.506s	user 0.000s	sys 0.001s
I20260812 19:25:23.614019 18611 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:23.678635 18611 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:23.679481  6347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2842) took 1928 ms. Trace:
I20260812 19:25:23.681406 18611 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:23.682091 18613 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:23.683740  6296 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.002s	sys 0.024s
I20260812 19:25:23.673548 18509 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:23.305625  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:23.589839  6483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2760) took 1505 ms. Trace:
W20260812 19:25:23.684459 18600 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.002s	sys 0.013s
I20260812 19:25:23.682161 18611 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:23.684768  6483 rpcz_store.cc:276] 0812 19:25:22.084094 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.084216 (+   122us) service_pool.cc:227] Handling call
0812 19:25:22.084540 (+   324us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:25:22.149148 (+ 64608us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:22.149182 (+    34us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:25:22.156595 (+  7413us) log.cc:842] Serialized 52 byte log entry
0812 19:25:22.330269 (+173674us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:22.672762 (+342493us) log.cc:842] Serialized 14 byte log entry
0812 19:25:22.965298 (+292536us) log.cc:842] Serialized 14 byte log entry
0812 19:25:23.000670 (+ 35372us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:23.000768 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:23.589599 (+588831us) raft_consensus.cc:1671] finished
0812 19:25:23.589622 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:23.589773 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":163198,"prepare.queue_time_us":55879,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":6362,"raft.queue_time_us":366547,"raft.run_cpu_time_us":1046,"raft.run_wall_time_us":135579,"spinlock_wait_cycles":52223872,"thread_start_us":740069,"threads_started":3,"wal-append.queue_time_us":313048}
I20260812 19:25:23.685997 18611 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:23.694835 18675 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:23.693207 18509 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:23.695713 18675 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:23.699481 18719 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.499s	user 0.001s	sys 0.000s
I20260812 19:25:23.700996  6236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3511) took 1279 ms. Trace:
I20260812 19:25:23.701984 18611 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:23.713420 18684 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.739s
I20260812 19:25:23.049487 18703 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:23.349591 18587 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:23.238695 18389 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:23.717113  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 151523us
W20260812 19:25:23.683282  7554 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.004s	sys 0.019s
W20260812 19:25:23.752652  7554 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.005s	sys 0.020s
I20260812 19:25:23.679987  6347 rpcz_store.cc:276] 0812 19:25:21.751331 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:21.751487 (+   156us) service_pool.cc:227] Handling call
0812 19:25:21.751828 (+   341us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:21.929514 (+177686us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:21.929568 (+    54us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:21.930124 (+   556us) log.cc:842] Serialized 26 byte log entry
0812 19:25:22.203638 (+273514us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:22.203682 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:22.397572 (+193890us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54001b8354. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:22.397641 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:23.679099 (+1281458us) raft_consensus.cc:1671] finished
0812 19:25:23.679129 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:23.679404 (+   275us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3754,"raft.queue_time_us":553,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10505,"spinlock_wait_cycles":407694208,"thread_start_us":241749,"threads_started":1,"wal-append.queue_time_us":430575}
W20260812 19:25:23.684147  6296 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.002s	sys 0.024s
W20260812 19:25:23.684938 18600 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.002s	sys 0.014s
I20260812 19:25:23.752825  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:23.701458  6236 rpcz_store.cc:276] 0812 19:25:22.421842 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.422018 (+   176us) service_pool.cc:227] Handling call
0812 19:25:22.422407 (+   389us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:22.613379 (+190972us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:22.613423 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:22.627176 (+ 13753us) log.cc:842] Serialized 26 byte log entry
0812 19:25:22.796346 (+169170us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:22.796377 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:22.796437 (+    60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:23.700732 (+904295us) raft_consensus.cc:1671] finished
0812 19:25:23.700762 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:23.700926 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":49427,"raft.queue_time_us":57978,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":14223,"thread_start_us":337179,"threads_started":2,"wal-append.queue_time_us":350769}
W20260812 19:25:23.524971  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 476724us
I20260812 19:25:23.663452 18702 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:23.735873 18341 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:23.736796 18667 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:23.757061 18375 consensus_meta.cc:287] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.545s	user 0.012s	sys 0.001s
I20260812 19:25:23.736912 18442 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:23.759651 18208 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.457s	user 0.008s	sys 0.007s
I20260812 19:25:23.821179  6465 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260812 19:25:23.821683  6465 pending_rounds.cc:76] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 9
I20260812 19:25:23.821954  6465 pending_rounds.cc:97] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260812 19:25:23.822227  6465 raft_consensus.cc:2866] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:23.760480 18708 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:23.733675 18503 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:23.761391 18682 log.cc:924] Time spent T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.980s	user 0.001s	sys 0.001s
I20260812 19:25:23.762866 18347 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:23.762833 18346 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:23.201141 18670 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:23.835881 18133 consensus_meta.cc:287] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.820s	user 0.012s	sys 0.004s
I20260812 19:25:23.768608 18204 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:23.572033 17361 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:23.769639 18394 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:23.772315 18169 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:23.917704  6415 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.060s	sys 0.076s
I20260812 19:25:23.773633 18587 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:23.683063 18613 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:23.776332 18703 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:23.814493 18341 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:23.779364 18622 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:25:23.951335  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.003s	sys 0.011s
W20260812 19:25:23.779561 18501 consensus_meta.cc:287] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.483s	user 0.010s	sys 0.003s
I20260812 19:25:23.293920 18544 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:23.332520 18182 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:23.750355 18391 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:23.781783 17916 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:23.294211 18545 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:23.783890 18672 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:25:23.802547  6481 consensus_meta.cc:287] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 1.198s	user 0.009s	sys 0.005s
I20260812 19:25:23.974318  6481 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
W20260812 19:25:23.975071  6481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 3481) took 1384 ms (client timeout 1790 ms). Trace:
W20260812 19:25:23.975538  6481 rpcz_store.cc:269] 0812 19:25:22.602515 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.603015 (+   500us) service_pool.cc:227] Handling call
0812 19:25:23.975008 (+1371993us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:25:23.804177  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:25:23.768659 18663 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.211s	user 0.009s	sys 0.005s
I20260812 19:25:23.793222 18509 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:23.820360 18702 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:23.832844  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:23.835520  6344 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:23.762431  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 3483) took 1128 ms. Trace:
I20260812 19:25:23.901367 18133 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:23.987393  6349 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260812 19:25:23.720187 18607 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:23.872576 18658 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.144s	sys 0.209s
I20260812 19:25:23.833475 18635 raft_consensus.cc:3032] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Stepping down as leader of term 20
W20260812 19:25:23.773233 18669 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.979s	user 0.001s	sys 0.001s
W20260812 19:25:23.918246  6415 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.060s	sys 0.077s
I20260812 19:25:23.775475 18678 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:23.522562  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:23.882268 18684 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260812 19:25:23.830076 17337 consensus_meta.cc:287] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 1.377s	user 0.012s	sys 0.002s
I20260812 19:25:23.930917  6473 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 24.
I20260812 19:25:23.778251 18705 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:23.894019 18334 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:23.833941 18208 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:23.951786  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.003s	sys 0.011s
I20260812 19:25:23.951802  6470 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260812 19:25:23.833750 18442 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:23.958775  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2940) took 1882 ms. Trace:
I20260812 19:25:23.959736  6238 raft_consensus.cc:2396] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260812 19:25:23.908918 18346 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
W20260812 19:25:23.984416  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 180363us
I20260812 19:25:23.751984 18675 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:23.872988 18708 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:24.039693  6232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2919) took 1974 ms. Trace:
W20260812 19:25:24.006976  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 484551us
W20260812 19:25:24.023401  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 149708us
W20260812 19:25:23.995479 18658 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.144s	sys 0.209s
I20260812 19:25:24.033326 18703 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:24.021292  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:25:24.047700  6175 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.007s	sys 0.034s
W20260812 19:25:24.048005  6175 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.007s	sys 0.034s
I20260812 19:25:23.987111  6482 rpcz_store.cc:276] 0812 19:25:22.634162 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.634457 (+   295us) service_pool.cc:227] Handling call
0812 19:25:23.762225 (+1127768us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b54004448d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:23.762343 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":90558208}
I20260812 19:25:24.026214  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:24.023154  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:24.029812 18501 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:24.010578 18678 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:24.016222 18620 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.710s	user 0.011s	sys 0.036s
I20260812 19:25:24.003651 18732 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.057945 18703 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:24.071353 18732 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.071975 18702 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:24.073427 18703 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:24.073577 18732 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:24.063567 18501 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:24.074798 18405 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:24.075124 18776 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:24.075356 18405 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:24.075685 18776 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:24.076442  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:24.077061  7597 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:24.077492 18405 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:24.077812 18776 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:24.035797 18208 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.080695  6235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2930) took 1647 ms. Trace:
I20260812 19:25:23.995326 18672 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:24.081858 18620 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.765s	user 0.012s	sys 0.037s
I20260812 19:25:24.081065  6235 rpcz_store.cc:276] 0812 19:25:22.432954 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.433252 (+   298us) service_pool.cc:227] Handling call
0812 19:25:22.440269 (+  7017us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:22.592448 (+152179us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:22.592489 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:22.605882 (+ 13393us) log.cc:842] Serialized 26 byte log entry
0812 19:25:23.175472 (+569590us) raft_consensus.cc:1631] Marking committed up to 9
0812 19:25:23.175515 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:23.175586 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:24.080457 (+904871us) raft_consensus.cc:1671] finished
0812 19:25:24.080483 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:24.080629 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4959,"raft.queue_time_us":83678,"spinlock_wait_cycles":19784576,"thread_start_us":621861,"threads_started":2,"wal-append.queue_time_us":1384324}
I20260812 19:25:24.054849 18389 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.078081  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.083186 18672 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:24.083279 18346 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.083869 18346 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.085924 18346 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:24.086117  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3494) took 1105 ms. Trace:
I20260812 19:25:24.016008 18730 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:24.087929  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:24.088595 18341 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:24.088882  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.090016 18667 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:24.090235  6179 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:24.090452 18613 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.058382 18662 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:24.091367 18587 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:24.039247 18761 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:24.091619 18662 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.092398 18761 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.093503  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:24.094048 18662 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.025300 18705 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:24.036095  6172 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.041s	sys 0.121s
I20260812 19:25:24.013458 18334 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:24.063086 18347 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.037456  6230 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 18: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:25:24.038506 18720 log.cc:924] Time spent T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260812 19:25:23.995923 17996 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:24.001358  6353 raft_consensus.cc:2354] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 23. Current term is 24.
I20260812 19:25:23.997746 18509 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:24.130157 18509 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:24.022087  6342 rpcz_store.cc:276] 0812 19:25:22.076546 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.076666 (+   120us) service_pool.cc:227] Handling call
0812 19:25:22.076998 (+   332us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:22.077359 (+   361us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:22.077401 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:22.149180 (+ 71779us) log.cc:842] Serialized 26 byte log entry
0812 19:25:22.447964 (+298784us) raft_consensus.cc:1631] Marking committed up to 14
0812 19:25:22.694348 (+246384us) log.cc:842] Serialized 14 byte log entry
0812 19:25:22.786942 (+ 92594us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:22.787016 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:23.957407 (+1170391us) raft_consensus.cc:1671] finished
0812 19:25:23.957429 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:23.958696 (+  1267us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":113517,"prepare.queue_time_us":358423,"prepare.run_cpu_time_us":147,"prepare.run_wall_time_us":1033,"raft.queue_time_us":73851,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":62623,"thread_start_us":373182,"threads_started":2,"wal-append.queue_time_us":475254}
I20260812 19:25:24.000563 18722 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:24.134037 18613 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.133920 18722 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:24.134732 18613 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:24.136441 18722 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:24.010006 18635 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:24.137002 18613 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:23.982892 17916 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.008591 17337 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:24.005101 18684 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.143596 18684 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:24.143885 18544 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.078413 18776 consensus_queue.cc:1046] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260812 19:25:24.145491 18708 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:24.056293  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:24.033442 18499 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:24.147138 18509 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:24.147783  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 91575.8us
I20260812 19:25:24.147603 18499 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.149119  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:24.149755 18499 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.040129  6232 rpcz_store.cc:276] 0812 19:25:22.065125 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.065270 (+   145us) service_pool.cc:227] Handling call
0812 19:25:22.085541 (+ 20271us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:22.085899 (+   358us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:22.085928 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:22.154229 (+ 68301us) log.cc:842] Serialized 26 byte log entry
0812 19:25:22.506806 (+352577us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:22.506886 (+    80us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:22.507036 (+   150us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:24.039495 (+1532459us) raft_consensus.cc:1671] finished
0812 19:25:24.039515 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:24.039636 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5229,"raft.queue_time_us":58572,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":18261,"thread_start_us":315679,"threads_started":1,"wal-append.queue_time_us":469717}
W20260812 19:25:24.059512 18743 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260812 19:25:24.063086 18758 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:24.076071 18501 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:24.078361  7552 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.165s	user 0.010s	sys 0.019s
W20260812 19:25:24.151067  7552 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.337s	user 0.011s	sys 0.019s
I20260812 19:25:24.151350 18182 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.096843 18678 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.154038 18678 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:24.037205 18360 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:24.155143 18678 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:23.979076 18622 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.158944 18622 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.035487 18607 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.095707 18347 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.150830 18755 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:25:24.130249 17996 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:24.165189  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:33372 (request call id 25) took 1187 ms. Trace:
I20260812 19:25:24.165608  6464 rpcz_store.cc:276] 0812 19:25:22.977639 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:23.162027 (+184388us) service_pool.cc:227] Handling call
0812 19:25:24.164921 (+1002894us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54002d2154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777e7c5 00007f98fc6baf39 00007f98f5db2704 00007f98f5db2692 00007f98f5db25c1 00007f98f5db253c 00007f98f5db17f2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:24.165100 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":410408320}
I20260812 19:25:24.165934 17916 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.166162 17996 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:24.168054 18545 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.133298 18334 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.137599 18635 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:23.979902 18391 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:24.174106  6353 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2938) took 2110 ms (client timeout 2061 ms). Trace:
I20260812 19:25:24.174507 18391 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:24.139389 18133 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.094923 18705 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.150902  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:24.076947 18442 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:24.177881 18705 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.154814 18360 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:24.123245 18340 consensus_meta.cc:287] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.948s	user 0.008s	sys 0.005s
I20260812 19:25:24.178638 18340 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.180647 18360 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:24.168180  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2925) took 2091 ms. Trace:
W20260812 19:25:24.171056  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:24.181321  6230 rpcz_store.cc:276] 0812 19:25:22.077006 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.077953 (+   947us) service_pool.cc:227] Handling call
0812 19:25:24.167923 (+2089970us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b540013f454. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:24.168081 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4503165824}
W20260812 19:25:24.183768  6353 rpcz_store.cc:269] 0812 19:25:22.063434 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.064607 (+  1173us) service_pool.cc:227] Handling call
0812 19:25:24.173807 (+2109200us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b540034f654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:24.173970 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4431837440}
I20260812 19:25:24.184397  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2762) took 2098 ms. Trace:
I20260812 19:25:24.184832  6477 rpcz_store.cc:276] 0812 19:25:22.086255 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.086381 (+   126us) service_pool.cc:227] Handling call
0812 19:25:22.162557 (+ 76176us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:22.273108 (+110551us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:22.273155 (+    47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:22.273209 (+    54us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:22.273248 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:24.184148 (+1910900us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400364054. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:24.184197 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:24.184312 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":253658880}
I20260812 19:25:24.180848 18340 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:24.187242 18670 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:24.188692  6473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 2768) took 1750 ms (client timeout 2123 ms). Trace:
W20260812 19:25:24.189121  6473 rpcz_store.cc:269] 0812 19:25:22.438621 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.446569 (+  7948us) service_pool.cc:227] Handling call
0812 19:25:24.188504 (+1741935us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000735d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:24.188613 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2698373376}
I20260812 19:25:24.150300  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:24.192410  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3506) took 1911 ms. Trace:
I20260812 19:25:24.192811  6224 rpcz_store.cc:276] 0812 19:25:22.280856 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.281074 (+   218us) service_pool.cc:227] Handling call
0812 19:25:22.293887 (+ 12813us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:22.558569 (+264682us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:22.558614 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:22.579028 (+ 20414us) log.cc:842] Serialized 26 byte log entry
0812 19:25:23.323898 (+744870us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:23.323948 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:24.192025 (+868077us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b540001d454. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:24.192081 (+    56us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:24.192131 (+    50us) raft_consensus.cc:1671] finished
0812 19:25:24.192144 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:24.192356 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3804,"raft.queue_time_us":138,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":17139,"spinlock_wait_cycles":607614848,"thread_start_us":744503,"threads_started":1,"wal-append.queue_time_us":1341931}
I20260812 19:25:24.194801  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:24.196501 18717 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.853s	user 0.003s	sys 0.000s
I20260812 19:25:24.197041  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.197685  6236 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 14.
I20260812 19:25:24.198518  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.199390  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.201588  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3514) took 1624 ms. Trace:
I20260812 19:25:24.201824  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.202001  6228 rpcz_store.cc:276] 0812 19:25:22.576985 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.760271 (+183286us) service_pool.cc:227] Handling call
0812 19:25:22.760593 (+   322us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:23.200301 (+439708us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:23.200333 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:23.200377 (+    44us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:23.200408 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:24.201381 (+1000973us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b540017a554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:24.201422 (+    41us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:24.201537 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1003794816}
I20260812 19:25:24.204181  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.205418 18340 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:24.206146 18340 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.206601 18340 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.207897  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3524) took 1093 ms. Trace:
I20260812 19:25:24.208267  6229 rpcz_store.cc:276] 0812 19:25:23.114876 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:23.657947 (+543071us) service_pool.cc:227] Handling call
0812 19:25:23.658398 (+   451us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:23.751250 (+ 92852us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:23.751296 (+    46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:23.751353 (+    57us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:23.751395 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:24.207664 (+456269us) spinlock_profiling.cc:243] Waited 92.6 ms on lock 0x7b5400179154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:24.207712 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:24.207842 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":212887296}
W20260812 19:25:24.210083 18660 log.cc:924] Time spent T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.653s	user 0.008s	sys 0.008s
I20260812 19:25:24.212131 18170 raft_consensus.cc:979] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: : Instructing follower bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:25:24.212862 18170 raft_consensus.cc:1067] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Signalling peer bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:25:24.187366  7600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 892) took 1555 ms. Trace:
I20260812 19:25:24.213766  7600 rpcz_store.cc:276] 0812 19:25:22.632221 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.632388 (+   167us) service_pool.cc:227] Handling call
0812 19:25:22.654856 (+ 22468us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:22.794388 (+139532us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:22.794428 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:22.929369 (+134941us) log.cc:842] Serialized 26 byte log entry
0812 19:25:23.330281 (+400912us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:23.330330 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:24.186871 (+856541us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b5400670554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:24.186926 (+    55us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:24.186971 (+    45us) raft_consensus.cc:1671] finished
0812 19:25:24.186993 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:24.187265 (+   272us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":520,"raft.queue_time_us":275365,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":59652,"spinlock_wait_cycles":108192128,"thread_start_us":316841,"threads_started":1,"wal-append.queue_time_us":1051186}
I20260812 19:25:24.219365 18347 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.219770 18182 raft_consensus.cc:3032] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:24.220167 18182 raft_consensus.cc:729] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:24.094619 18662 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:24.221005 18662 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.221572 18662 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:24.221055 18182 consensus_queue.cc:260] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.078074 18405 consensus_queue.cc:1046] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 19:25:24.225379 18405 consensus_queue.cc:1225] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer bdfa5579d4534c618c00db6b4a841c81 log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260812 19:25:24.225620  6238 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53176 (request call id 2918) took 2162 ms (client timeout 2132 ms). Trace:
I20260812 19:25:24.226011 18405 raft_consensus.cc:3032] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Stepping down as leader of term 19
W20260812 19:25:24.126590  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 57272.5us
I20260812 19:25:24.228113  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.228776  6473 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:25:24.234522  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.086516  6465 rpcz_store.cc:276] 0812 19:25:22.981078 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:23.114793 (+133715us) service_pool.cc:227] Handling call
0812 19:25:23.154543 (+ 39750us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:23.823587 (+669044us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:24.085882 (+262295us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400022954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:24.086059 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1531842304}
W20260812 19:25:24.095166  6172 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.041s	sys 0.122s
I20260812 19:25:24.236586  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.237818 18723 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.238876 18611 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.239439 18611 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.240295  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.241067  6236 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 24.
I20260812 19:25:24.242283 18611 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.246924  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:24.226058  6238 rpcz_store.cc:269] 0812 19:25:22.063434 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:22.064716 (+  1282us) service_pool.cc:227] Handling call
0812 19:25:24.225377 (+2160661us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54001635d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:24.225525 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4314799488}
I20260812 19:25:24.242641  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.256621  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.244371 18704 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.094592 18761 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.267875  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.276080  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:24.250717 18437 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.006s	sys 0.019s
I20260812 19:25:24.278062  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.279584  6465 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 14.
I20260812 19:25:24.282100  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.226493 18405 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:24.288757  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.290962  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.291788  6236 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:24.293011  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.294450  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.297068  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.298768  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.299374  6235 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:24.301891  6228 raft_consensus.cc:2396] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 23 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260812 19:25:24.303013  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.306370  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.307755  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:24.309170  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.310150  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.310832  6236 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 20.
I20260812 19:25:24.311813  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:24.279593 18437 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.006s	sys 0.020s
I20260812 19:25:24.271559 18553 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.312461  6353 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:24.312325  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.325630  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.313186  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.208698 18340 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:24.313630  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.327235 18780 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.327900 18780 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.329630  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.330475  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.330874  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.333947  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.336941  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:24.339378  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.342613  6228 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: []
W20260812 19:25:24.343101  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 293196us
I20260812 19:25:24.343964  6229 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260812 19:25:24.346369  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.348925 18347 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:24.348776 18733 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:24.349318  6416 leader_election.cc:398] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 23. Current term is 24.
I20260812 19:25:24.350288 18733 raft_consensus.cc:3032] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:24.350773 18733 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:24.351852 18733 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.353572 18733 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:24.354135  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.354624  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.354839  6473 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:24.355114  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.355748  6477 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:24.356113  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.349501 18347 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.356931  6465 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
I20260812 19:25:24.358436 18347 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.359472  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.359973  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.360102  6477 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:24.360401  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:24.361166  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.361439  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.361795  6482 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:24.362247 18675 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:25:24.362390  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:24.362841 18675 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.362934  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.364281  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:24.364996 18670 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:24.366972 18670 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:24.367367 18670 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:24.367573  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:24.368152 18442 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:24.368922 18442 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:24.369154  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:24.370199 18755 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:24.363487 18675 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:24.363934  6477 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:24.365860  6473 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:25:24.280869 18704 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.372717  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:24.373476  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:24.421226  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.421702  6235 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 18: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:24.423004  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:24.424046  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:25:24.375015 18590 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.869s	user 0.016s	sys 0.015s
W20260812 19:25:24.414686  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 70701.2us
W20260812 19:25:24.427947  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 55296.4us
I20260812 19:25:24.415112  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.428808  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:24.417201  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.312194 18611 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:24.426394  6345 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:24.429104  6353 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:24.433796  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:24.438004  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:24.436266 18755 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:24.441051 18755 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.441229 18780 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:24.441460 18755 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:24.444109  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:24.445143  7593 raft_consensus.cc:2396] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260812 19:25:24.446136  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:24.446857 18340 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:24.447266 18340 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:24.447613 18340 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:24.448130 18493 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader election won for term 24
W20260812 19:25:24.448834 18686 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260812 19:25:24.453333  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:24.453562 18704 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.454988  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.455822  6465 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:24.456812  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:24.457808  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.458103  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:24.459146 18442 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:24.459654 17793 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:25:24.460183 18545 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 19:25:24.460309 18442 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:24.460922 18442 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:24.461875 18442 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.473906  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.463986  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.459448  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:25:24.460423 18792 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260812 19:25:24.454561  6297 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:24.479272  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:24.428117 18590 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.942s	user 0.017s	sys 0.015s
I20260812 19:25:24.447518  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:24.466010  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:24.466161  6473 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260812 19:25:24.466529  6350 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.009s	sys 0.048s
I20260812 19:25:24.448776 18493 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 24 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:24.466975  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:24.482271  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:24.483556  6345 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:24.466905  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:24.469059  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.471050  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:24.433032  6224 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:24.462755 17622 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:24.483670  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:24.352557 18509 consensus_queue.cc:1046] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260812 19:25:24.468153  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.489665  6352 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:24.485405  6359 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
W20260812 19:25:24.481531  6350 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.009s	sys 0.048s
I20260812 19:25:24.485759  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:24.333848 18553 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.508482  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:24.521245  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:24.508634  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.502867  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:24.519742  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet f7798b18b2fb4b0baa349294c1006e91, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:24.526626  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet f7798b18b2fb4b0baa349294c1006e91, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.526923  6235 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
I20260812 19:25:24.510771  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.520141  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:24.527014  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.495625  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.562471  6483 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 18: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:24.562505  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.537106  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:24.533105  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.425872 18761 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260812 19:25:24.564396  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.577500  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.569172  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.493889  6417 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:24.509707 18545 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:24.490387 18744 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:24.592830  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.519722 18590 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:24.494115  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.518886 18544 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.106s
I20260812 19:25:24.592314 18684 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.633173 18684 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:24.643250 18760 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.644294 18760 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.585167 18733 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260812 19:25:24.650092 18796 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260812 19:25:24.652590  6470 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:24.654829 18493 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 22.9, Last appended by leader: 9, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.660931  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:24.663834  6464 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:24.593344 18347 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260812 19:25:24.582357  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45332.9us
I20260812 19:25:24.494098  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:24.667193  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 173178us
I20260812 19:25:24.668757  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:24.579958  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 86144.6us
I20260812 19:25:24.486626 17864 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:24.493619 18385 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:25:24.383347 18405 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.585948  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:24.586122  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.586951  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.583755  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:24.493379 18442 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:24.505477  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.508668 18167 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.488322 17622 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:24.689215 17622 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:24.676676 18545 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:24.690812 18760 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.691072 18545 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:24.490154 17906 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:25:24.693142 17906 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.693387 18670 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.696887 18182 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:24.700767  6475 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 25: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:24.509021 18724 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.167s
I20260812 19:25:24.531649 18698 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:24.562184 18610 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:25:24.714242 18610 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.714844 18610 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:24.613000  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.618762 18553 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.606607 18503 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:24.471928 18611 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:24.509402 18753 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.114s
I20260812 19:25:24.674010  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:24.735172  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 61242.7us
I20260812 19:25:24.675017  6417 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:25:24.736864  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 61935.3us
I20260812 19:25:24.738253  6417 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:24.687595  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:24.671427 18347 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:24.693981 18167 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:24.705157  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 119299us
I20260812 19:25:24.509246 18665 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.571247  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:24.717620  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:24.677258 18590 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:24.681658 18684 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:24.693637 17906 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:24.626430 18755 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.684432 18385 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:24.731763  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet ff48be70624f412e9bf485b5e489adf3, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:24.763224  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet ff48be70624f412e9bf485b5e489adf3, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.592458 18744 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.736181  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:24.721511 18544 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:24.723418 18698 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:24.750025  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 62527.9us
W20260812 19:25:24.750133  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 178983us
I20260812 19:25:24.746075 18509 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:24.744292 18780 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:25:24.756305 17864 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:24.756184 18665 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.771194 18611 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:24.772101 18665 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.772133 18670 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:24.769372 18744 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
W20260812 19:25:24.783634 18791 log.cc:924] Time spent T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.436s	user 0.000s	sys 0.003s
I20260812 19:25:24.771052 18502 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:24.744369 18347 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:24.733098 18503 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:24.769852 17864 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.752796 18437 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.778987 18590 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:24.758028 18684 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:24.748894 18712 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:25:24.757058 18553 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:24.777846  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:24.736132 18340 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.817343 18340 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:24.749092 18548 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260812 19:25:24.765256 18385 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:24.821869  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:25:24.831533  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 53804.3us
I20260812 19:25:24.833164 18434 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:24.829742 18437 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.841683  6342 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:24.866938  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:24.844696 18167 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:24.787333 18394 consensus_queue.cc:1159] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdfa5579d4534c618c00db6b4a841c81" responder_term: 20 status { last_received { term: 20 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 20 index: 11 } }
I20260812 19:25:24.823004 18684 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:24.775452 18544 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:24.775012 18698 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:24.811506 17864 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:24.826324 18553 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:24.830991 18662 consensus_meta.cc:287] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.609s	user 0.013s	sys 0.003s
W20260812 19:25:24.874791  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 61065.6us
W20260812 19:25:24.874961  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 93caa3d3062a45cbad94ff4ba511f2e0, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:24.885042  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 93caa3d3062a45cbad94ff4ba511f2e0, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.885298  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:24.847390 18503 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:24.883380 18553 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:24.896013 18744 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.899044 18744 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:24.901328  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.903126  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.904803  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:24.916702  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:24.934850  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 0715e834130d426f8038cf97eecb0687, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:24.935257  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 0715e834130d426f8038cf97eecb0687, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:24.935532  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 50324.7us
I20260812 19:25:24.864778 18434 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.940685 18360 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:24.881981 18607 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:24.881780 18544 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:24.911717 18167 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.944253 18434 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:24.955906 18607 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:24.883953 18675 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:24.984040  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:24.913070 18662 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:25.007030 18755 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:24.990484 18607 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:24.992707 17916 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:24.991449 18611 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:24.972152 18167 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.008086 17622 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:25.009004 18503 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:25.037992  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 45831us
W20260812 19:25:25.039249  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 44933.9us
I20260812 19:25:25.041152 18437 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:25.032569 18611 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.033736 17916 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.049983 18611 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.052897  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2952) took 1754 ms. Trace:
I20260812 19:25:25.053419  6350 rpcz_store.cc:276] 0812 19:25:23.298928 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:23.299080 (+   152us) service_pool.cc:227] Handling call
0812 19:25:23.299449 (+   369us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:23.719011 (+419562us) raft_consensus.cc:1520] Early marking committed up to index 11
0812 19:25:23.784725 (+ 65714us) log.cc:842] Serialized 14 byte log entry
0812 19:25:24.510937 (+726212us) log.cc:842] Serialized 14 byte log entry
0812 19:25:24.511151 (+   214us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:24.511204 (+    53us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:24.511257 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:24.659949 (+148692us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4800111558. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fc61f7f1 00007f98fc6168e7 00007f98fc61677a 00007f98fc70a95f 00007f98fc70a627 00007f98fc71eb2c 00007f98fc71ead8 00007f98fc71ea58 00007f98fc71ea13 00007f98fc71dcbc 00007f98fb69fbe6
0812 19:25:24.715526 (+ 55577us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b18003621a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:25:25.052608 (+337082us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b5400180454. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:25.052668 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:25.052825 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":84081,"prepare.queue_time_us":163734,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":100,"raft.queue_time_us":2563,"raft.run_cpu_time_us":2809,"raft.run_wall_time_us":197732,"spinlock_wait_cycles":1085642752,"thread_start_us":706288,"threads_started":1,"wal-append.queue_time_us":823095}
I20260812 19:25:25.067067  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:25.075799  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:25.077277  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:25:25.071691 18807 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260812 19:25:25.073621 18760 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:25.080029 18760 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:25.071559 18133 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:25.081383 18167 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.035009 18503 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.081439 18133 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.084089 18503 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:25.084350 18133 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.084972 17622 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.085253 18675 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:25.087078 18662 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:25.105249  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 347926us
I20260812 19:25:25.092617 18761 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:25.108472  6230 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260812 19:25:25.109778  6229 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:25.111640  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:25.115893  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:25.116561  6229 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:25.118671  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:25.120838  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:25.121486  6464 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:25.122931  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:25.125365  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:25.128628  6230 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:25.130394  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:25.131654  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:25.131371 18610 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.133898 18610 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.074599 17906 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:25.140672  6238 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22. Ops: []
W20260812 19:25:25.143642  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 376201us
I20260812 19:25:25.145383  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:25.146149  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:25.151170  7606 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:25:25.151433  6464 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 24: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:25.155911  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:25.135229 18493 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:25.163023  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:25.163727  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:25.170904  6464 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:38150
I20260812 19:25:25.171707  6464 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:25:25.172092  6464 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:25.175218  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:25.177246  6481 raft_consensus.cc:2396] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260812 19:25:25.191947  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:25.193446  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:25.193567  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:25.195164  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:25.192176  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:25.199997  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:25.201968 18442 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:25.202355 18442 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:25.204216 18434 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.206872  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:25.208583 18385 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:25.163882 18553 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.170921 18493 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.212635 18553 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.213129 18493 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.214954  6465 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:25.216040  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:25.217027 17916 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.217952  7599 raft_consensus.cc:1226] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 14. Current term is 15. Ops: []
I20260812 19:25:25.218412  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:25.219920  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:25.220541  6344 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:25.221119  6238 raft_consensus.cc:1226] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:25.225174  6482 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:25.225925  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:25.226372  6235 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:25:25.227900  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:25.222466  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:25.223836  6347 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260812 19:25:25.224102  6230 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:25.226238  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:25.217080  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:25.173244 18758 raft_consensus.cc:3032] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Stepping down as leader of term 16
I20260812 19:25:25.239452  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:25.243149  6464 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.230676  6482 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:25.236264  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:25.246642  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:25.225152 18442 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:25.199894 17864 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:25.266959 18385 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.267371  7591 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:25.268061 17906 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:25.268805 18809 log.cc:924] Time spent T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.089s	user 0.003s	sys 0.000s
I20260812 19:25:25.273020  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:25:25.274966 18800 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.629s	user 0.000s	sys 0.009s
I20260812 19:25:25.277750 18434 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.235689 18780 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:25.247146  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:25.254005  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:25.239705 18758 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:25.328541  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:25.220824 18347 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.256616 18590 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:25.280257 17864 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:25.250751  6465 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:25.285046  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:25.288219 18544 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.288836  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:25.292155  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:25.296957 18405 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:25.304963 18684 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:25.308852  6464 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:25.314419  7594 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260812 19:25:25.316190  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:25.281757 18607 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:25.323312  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:25:25.330446  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 76563.1us
I20260812 19:25:25.331574  6235 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260812 19:25:25.333947  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:25.301074 18442 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.405104  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:25.405629  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:25.407164  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:25.408099  6236 raft_consensus.cc:2379] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 15: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:25.427464  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:25.334131 18712 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:25.406018  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:25.438544  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:25.439038  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:25.439318  6481 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 15.
I20260812 19:25:25.439397  6235 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:25.441558  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:25.441989  6232 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 19: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:25.442858  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:25.344592 18755 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:25.444988  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:25.448233  6224 raft_consensus.cc:1226] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260812 19:25:25.450999  6236 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 19: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:25.455498  6483 raft_consensus.cc:1226] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:25.457204  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:25.458508  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:25.456441  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:25.463506  6236 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:25.472576  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:25.479559  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:25.332770 18698 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.481664  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:25.481702  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:25.441118 18712 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:25.456166 18590 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260812 19:25:25.517319  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 74574.2us
I20260812 19:25:25.522056  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:25.408845 18600 consensus_queue.cc:1046] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.081s
I20260812 19:25:25.489073  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:25.332473 18780 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.494287  6482 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:25:25.455356 18545 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260812 19:25:25.476658 18758 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.512814 18347 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.514462 18607 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:25.527607  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:25.492533 18721 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:25:25.486627  6235 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:25.517135 18712 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:25.540005  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:25.543179  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:25.563958  6347 raft_consensus.cc:3032] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:25.564394  6347 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:25.544843  6349 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:25.488094 18581 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:25.491953 18733 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:25:25.539798 18392 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:25.557097  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:25.533320 18502 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:25:25.517716 18590 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:25.461714 18755 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.562672  6464 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:25.565564  6236 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:25.481195 18340 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.075s
I20260812 19:25:25.568576  6475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 2787) took 1210 ms. Trace:
I20260812 19:25:25.569154  6477 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 24. Current term is 25. Ops: []
I20260812 19:25:25.539795 17940 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:25.570788  6347 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:25.578835  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.009s	sys 0.024s
W20260812 19:25:25.589705  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.009s	sys 0.024s
I20260812 19:25:25.589845  6347 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
W20260812 19:25:25.590344  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 513133us
I20260812 19:25:25.593744  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:25.588260  6475 rpcz_store.cc:276] 0812 19:25:24.357904 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:24.358027 (+   123us) service_pool.cc:227] Handling call
0812 19:25:24.562325 (+204298us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b5800061598. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f4824851 00007f98f4824702 00007f98fd708b09 00007f98fc644730 00007f98fc70a79b 00007f98fc70a821 00007f98fc6ba1b0 00007f98fc6b9a94 00007f98f5dadc04 00007f98f5dadb92
0812 19:25:25.568363 (+1006038us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400364a54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:25.568516 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":308767360}
I20260812 19:25:25.591894 17940 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:25.596035 17940 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:25.601042  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:25.603299  6236 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:25.609241  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:25.611624  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:25.613920  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:25.615626  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:25.577338 18590 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:25.575964 18437 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:25.593441 18814 log.cc:924] Time spent T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260812 19:25:25.627511  6236 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:25.627858  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:25.629420  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:25.615206 18509 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:25.620644 18733 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:25.625861  6242 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:25.574101 18581 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:25.618460  6347 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:25.633942  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:25.614053 18607 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:25.629782 18544 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.666869  6473 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260812 19:25:25.659174  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:25.644289  6236 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:25.705818 18662 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260812 19:25:25.706640 18821 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260812 19:25:25.706707  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 72822.2us
I20260812 19:25:25.764158  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:25.763572  6297 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:25.766476 18546 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:25.767006 18662 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:25.628374 18670 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:25.685345 18394 raft_consensus.cc:3032] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:25:25.768784 18394 raft_consensus.cc:729] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:25.769672 18394 consensus_queue.cc:260] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:25.770934 18394 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:25.707497 18733 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260812 19:25:25.693753 18758 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:25.708101 18509 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:25.708968 18581 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:25.782640 18607 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:25.783258 18607 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.783512 18509 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.785355 18607 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.787225  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:25.788028  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:25.788482  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:25.789124  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:25.789536  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:25.790061  6352 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:25.790267  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:25.798636  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:25.800020 18607 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:25.800729 18607 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.719376 18675 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:25:24.968279  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:25.724908 18635 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:25.803418 18607 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.804549  6352 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
I20260812 19:25:25.808286 18607 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:25.809090 18607 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.811933 18607 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.813551  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:25.818989 18607 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:25.819615 18607 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:25.820099 18607 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:25.825929  6353 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260812 19:25:25.832612  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:25.735988  6483 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:25.738034  6464 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260812 19:25:25.742563 18744 consensus_queue.cc:1046] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:25:25.843639 18493 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:25.844055 18744 raft_consensus.cc:3032] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:25:25.844700 18744 raft_consensus.cc:729] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:25.844414 18493 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.744074 18442 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:25.667215 18698 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:25.678134 18823 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260812 19:25:25.746987 17361 consensus_queue.cc:1046] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:25.748247 18544 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:25:25.848487 18611 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:25.749388  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:25.849300 18544 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:25.727895  6049 catalog_manager.cc:5495] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 15 to 17, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 17 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:25.850308 18544 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:25.772943  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:25.773172  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:25.776564  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:25.851444  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 78598.6us
I20260812 19:25:25.851609 18544 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:25.853356 18544 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:25.853681  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:25.777043  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:25.854540 18783 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:25.855046  6344 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:25.636590 18133 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:25.856338 18133 raft_consensus.cc:686] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:25.857448 18133 consensus_queue.cc:237] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.791229  6345 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:25.787144  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:25.714143 18780 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:25.860077 18495 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:25.793061 18360 consensus_queue.cc:1046] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:25:25.837949  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:25.744118 18684 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:25.861614 18360 raft_consensus.cc:3032] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:25.862010 18360 raft_consensus.cc:729] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:25.862977  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:25.845853 18744 consensus_queue.cc:260] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:25.848524 17361 raft_consensus.cc:3032] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:25:25.855214 18783 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:25.865000 18744 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:25.791494  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:25.711994 18755 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:25.864640 17361 raft_consensus.cc:729] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:25.864627 18607 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.868919 17361 consensus_queue.cc:260] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:25.870270 17361 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:25.881384  6354 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:25.882833  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 2886) took 1388 ms. Trace:
I20260812 19:25:25.883265  6354 rpcz_store.cc:276] 0812 19:25:24.494052 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:24.612641 (+118589us) service_pool.cc:227] Handling call
0812 19:25:25.882629 (+1269988us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002d0fd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:25.882776 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2677117696}
I20260812 19:25:25.865118 18783 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:25.862831 18360 consensus_queue.cc:260] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:25.869889 18607 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.893740 18360 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:25.874393  6297 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:25.901628 18394 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:25.878702 18493 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:25.916950  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:25.917857 18394 consensus_queue.cc:1046] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:25.920964 18495 raft_consensus.cc:3032] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:25.921429 18495 raft_consensus.cc:729] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:25.922537 18495 consensus_queue.cc:260] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.923959 18495 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:25.939500 18493 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:25.940223 18493 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:25.940793 18493 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:25.942894 18394 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:25.943890 18394 raft_consensus.cc:686] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:25.945106 18394 consensus_queue.cc:237] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:25.947118  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 84225.9us
I20260812 19:25:25.948028  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:25.948773 18607 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:25.949885  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:25.951525  6359 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 22 index: 9. Preceding OpId from leader: term: 24 index: 10. (index mismatch)
I20260812 19:25:25.951056  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:25.953207  6229 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.024s	sys 0.076s
W20260812 19:25:25.953619  6229 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.024s	sys 0.076s
I20260812 19:25:25.954281 18611 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:25.621496 17916 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:25.971457  6049 catalog_manager.cc:5495] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 12 to 20, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:25.974922  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:25.973568  6049 catalog_manager.cc:5495] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 10 to 17, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 17 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:25.933817 18783 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.966846 18607 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:25.983541 18824 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:25.983888 18607 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:25.984007 18611 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:25.984140 18824 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.984376 18607 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:25.635097 18761 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:25.970463 18347 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:25.988970  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:25.984820 18611 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:25.967469 17916 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:25.981856 17622 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260812 19:25:25.994871 18698 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:25.989512 18405 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260812 19:25:25.997574 17622 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Stepping down as leader of term 24
I20260812 19:25:25.997985 17622 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:25.998885 17622 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.632543 18437 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.990080 18761 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:25.998821 18787 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:25.991334 18705 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:25.981103 18635 consensus_queue.cc:1046] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260812 19:25:26.001816 17916 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:25.969211 18712 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:25.973505 17940 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.026822  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:26.017004 18761 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:26.016603 17622 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:26.053871  6470 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:26.015880 18787 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.032924 18713 raft_consensus.cc:3032] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:26.052958  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:26.089234  6232 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.027s	sys 0.082s
I20260812 19:25:26.026043 18405 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
W20260812 19:25:26.089722  6232 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.028s	sys 0.082s
W20260812 19:25:26.110052  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 57203.3us
I20260812 19:25:26.111111  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:26.053750 18691 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:26.115072 18783 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:26.124366 18437 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:26.072839 18713 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:26.128433 18493 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.129141 18712 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:26.130441  6049 catalog_manager.cc:5495] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:26.132088 18787 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:26.132270  6049 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 16 to 18, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 18 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260812 19:25:26.133697 18590 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260812 19:25:26.134243 18590 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.136741 18590 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:26.108927 18405 consensus_queue.cc:1225] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260812 19:25:26.033272 18723 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260812 19:25:26.134092  6049 catalog_manager.cc:5495] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 19 to 20, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 20 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:26.025036 18833 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
I20260812 19:25:26.152433 18824 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:26.155972 18713 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.157781 18713 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
W20260812 19:25:26.159765  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 48772.6us
I20260812 19:25:26.160544  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:26.064167 18600 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.095s
W20260812 19:25:26.168891 18503 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.006s	sys 0.022s
I20260812 19:25:26.161444 18495 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:26.165855 18590 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:26.181006 18590 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.182639 18783 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:26.183139 18590 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:26.184036 18493 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:26.185369  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:26.186226 18405 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260812 19:25:26.187489  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:26.188946  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:26.189968 18723 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:25:26.190934  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.016s	sys 0.031s
W20260812 19:25:26.192725  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.016s	sys 0.031s
I20260812 19:25:26.175314 17940 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:26.176308 18503 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.006s	sys 0.022s
W20260812 19:25:26.193388  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 565718us
I20260812 19:25:26.198810  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:26.193096 18405 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260812 19:25:26.195464 18816 raft_consensus.cc:3032] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Stepping down as leader of term 14
I20260812 19:25:26.202839  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:26.195369 18748 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:26.195353 18846 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:26.209241  6482 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.034s	sys 0.029s
W20260812 19:25:26.211912  6482 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.034s	sys 0.029s
I20260812 19:25:26.193819 18424 consensus_queue.cc:1046] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260812 19:25:26.221551  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:26.221871  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:26.222817  6236 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 21
I20260812 19:25:26.224749  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:26.227209  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:26.228065  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:26.228966  6354 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 23.
I20260812 19:25:26.232728  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:26.234266  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:26.206732 18816 raft_consensus.cc:729] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:26.220010  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:26.238114  6359 raft_consensus.cc:3037] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:26.241117  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:26.241927  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:26.206471 18780 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260812 19:25:26.243160  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:26.243037  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:26.243753  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:26.247392  6354 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:26.192651 18607 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.256348 18607 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:26.215305 18846 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.259261 18846 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:26.262313 17916 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.272578  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:26.275527  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:26.264575 17916 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:26.279378  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:26.280293  6230 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:26.249081  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:26.246091  6342 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:26.213315 17940 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:26.249893  6349 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:26.296212  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:26.297036  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:26.288162  6236 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:26.215134 18495 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:26.315521  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:26.316090  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:26.294611  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:26.316922  6483 raft_consensus.cc:2379] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 15: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:26.317914  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:26.319883  6224 raft_consensus.cc:2379] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 21: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:26.316286  6242 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:26.315029 17940 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:26.325199  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:26.325441 17940 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.327405 18761 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:26.329253  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:26.332580  6464 raft_consensus.cc:2379] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 19: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:26.333388  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:26.335017  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:26.335580  6470 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:26.330847  6359 raft_consensus.cc:2454] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:26.338883  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:26.339978  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:26.341157  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:26.342474  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:26.344424  6464 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 22 index: 9. Preceding OpId from leader: term: 24 index: 10. (index mismatch)
I20260812 19:25:26.339670  6230 raft_consensus.cc:2454] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:26.345399  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:26.351792  6465 raft_consensus.cc:2354] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 20. Current term is 21.
I20260812 19:25:26.346606  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:26.353281  6473 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.019s	sys 0.022s
W20260812 19:25:26.354931  6473 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.019s	sys 0.022s
I20260812 19:25:26.237416 18684 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.096s
I20260812 19:25:26.374711  6416 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:26.375947  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:26.364732 18753 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:25:26.365803  6235 raft_consensus.cc:1226] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:26.381543 18846 raft_consensus.cc:2781] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:26.381652 18424 consensus_queue.cc:1046] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 19:25:26.382795 18424 raft_consensus.cc:3032] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:26.382858 18503 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:26.383222 18424 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:26.383067  6416 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:26.384477 18755 raft_consensus.cc:2781] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:26.384914  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2792) took 1183 ms. Trace:
I20260812 19:25:26.385004 18755 raft_consensus.cc:686] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:26.385438  6477 rpcz_store.cc:276] 0812 19:25:25.201752 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:25.683372 (+481620us) service_pool.cc:227] Handling call
0812 19:25:25.683681 (+   309us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:25.705970 (+ 22289us) raft_consensus.cc:1520] Early marking committed up to index 12
0812 19:25:25.706347 (+   377us) log.cc:842] Serialized 14 byte log entry
0812 19:25:26.195960 (+489613us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:26.196040 (+    80us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:26.196106 (+    66us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:26.236396 (+ 40290us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b180026c4a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f4829f96 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9
0812 19:25:26.384645 (+148249us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b54004448d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:26.384713 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:26.384850 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2362,"prepare.queue_time_us":2414,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":707,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":2160,"spinlock_wait_cycles":57473024,"thread_start_us":488936,"threads_started":1}
I20260812 19:25:26.386829 18712 raft_consensus.cc:3032] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 22 LEADER]: Stepping down as leader of term 22
I20260812 19:25:26.387449 18712 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:26.387856 18761 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:26.345707 18495 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:26.388273 18712 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.388897 18544 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:26.389693 18712 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:26.389061 18424 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.383551 18503 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:26.394824  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:26.395648  6359 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 23: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:26.395975  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:26.398121  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:26.352948 18758 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:26.408404  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:26.408699  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:26.410293  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:26.411366  6230 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:26.372258 18442 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:26.379323 18684 consensus_queue.cc:1225] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer 54f83319db6b49929cc8f18a66a66975 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260812 19:25:26.405126  6224 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 15. Current term is 16. Ops: []
I20260812 19:25:26.405917  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:26.417665  6236 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 20: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:26.412297  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:26.413280  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:26.412415  6238 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: [16.9-19.10]
I20260812 19:25:26.419502  6236 raft_consensus.cc:1226] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 14. Current term is 15. Ops: []
I20260812 19:25:26.410745  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:26.419550  6235 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 23: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:26.421850  6242 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:26.402100  6470 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
I20260812 19:25:26.415462  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:26.397541 18833 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:26.421150  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:26.427722 18753 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:26.401209 18437 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:26.441504  6230 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:26.389338 18544 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:26.430084  6465 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:26.389214 18846 raft_consensus.cc:686] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:26.433858  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:26.397724 18503 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:26.386062 18755 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.398829 18360 consensus_queue.cc:1046] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260812 19:25:26.436955 18424 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
W20260812 19:25:26.465215 18843 log.cc:924] Time spent T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260812 19:25:26.467018 18846 consensus_queue.cc:237] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.472506 18780 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:26.434748 18833 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:26.474694 18833 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.476274 18833 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:26.480326 18360 raft_consensus.cc:3032] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:26.480844 18360 raft_consensus.cc:729] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:26.481751 18360 consensus_queue.cc:260] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:26.483253 18544 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:26.484800 18544 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:26.485308 18546 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:26.485707 18546 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:26.447597 18590 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:26.486524 18546 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.487064 18590 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:26.487537 18590 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:26.458050 18857 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260812 19:25:26.416751 18758 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:26.511715  7594 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.001s	sys 0.025s
I20260812 19:25:26.457437 18437 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260812 19:25:26.446722 18509 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.008s	sys 0.016s
W20260812 19:25:26.522516  7594 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.001s	sys 0.025s
I20260812 19:25:26.445178 18753 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.457113 18611 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:26.539444 18509 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.009s	sys 0.016s
W20260812 19:25:26.553016  6178 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.006s	sys 0.026s
W20260812 19:25:26.553572  6178 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.006s	sys 0.026s
I20260812 19:25:26.470503 18816 consensus_queue.cc:260] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:26.561631  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 572680us
I20260812 19:25:26.571617  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:26.574908  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:26.575846  6349 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 23: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:26.579555  6359 raft_consensus.cc:2396] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260812 19:25:26.614059 18758 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:26.562641 18360 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:26.628111  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:26.651185 18437 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:26.638923 18758 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:26.642462 18816 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:26.698861  7594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60748 (request call id 905) took 1074 ms. Trace:
I20260812 19:25:26.702292  7594 rpcz_store.cc:276] 0812 19:25:25.624236 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:25.624446 (+   210us) service_pool.cc:227] Handling call
0812 19:25:25.624793 (+   347us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:25.625134 (+   341us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:25.625163 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:25.625636 (+   473us) log.cc:842] Serialized 26 byte log entry
0812 19:25:26.538383 (+912747us) raft_consensus.cc:1631] Marking committed up to 14
0812 19:25:26.538448 (+    65us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:26.538794 (+   346us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:26.698561 (+159767us) raft_consensus.cc:1671] finished
0812 19:25:26.698591 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:26.698786 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":752,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":5706,"thread_start_us":779764,"threads_started":1,"wal-append.queue_time_us":991600}
W20260812 19:25:26.731185 18862 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260812 19:25:26.694366 18758 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:26.727278 18713 consensus_meta.cc:287] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.569s	user 0.013s	sys 0.004s
W20260812 19:25:26.783079  6049 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.007s	sys 0.015s
W20260812 19:25:26.821264  6228 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.009s	sys 0.009s
W20260812 19:25:26.821978  6229 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.004s	sys 0.016s
W20260812 19:25:26.822515  6232 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.009s	sys 0.014s
I20260812 19:25:26.823688  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:25:26.827622  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 333378us
I20260812 19:25:26.832297  6359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:26.947363  6359 raft_consensus.cc:595] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:26.947852  6474 raft_consensus.cc:1226] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:26.837673  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:26.949438 18611 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:26.839376  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:26.839582  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:26.841220  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:26.843493  6345 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260812 19:25:26.950443  6229 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.005s	sys 0.017s
I20260812 19:25:26.843904  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:26.844579  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:25:26.855249  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 432207us
I20260812 19:25:26.872094  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3517) took 1701 ms. Trace:
I20260812 19:25:26.872634  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2795) took 1669 ms. Trace:
I20260812 19:25:26.879153 17916 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:26.716113 18394 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.029s	sys 0.037s
I20260812 19:25:26.692307 18437 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:26.892346 18442 raft_consensus.cc:686] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:25:26.959197 18394 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.030s	sys 0.038s
I20260812 19:25:26.959328 18882 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260812 19:25:26.960322  6049 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.008s	sys 0.015s
I20260812 19:25:26.960430 18442 consensus_queue.cc:237] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:26.950600  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:26.966595  6352 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:26.899008 18503 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:26.746182 18849 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260812 19:25:26.742951 18860 log.cc:924] Time spent T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260812 19:25:26.979055  6482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3518) took 1808 ms. Trace:
I20260812 19:25:26.979549  6482 rpcz_store.cc:276] 0812 19:25:25.170187 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:25.554910 (+384723us) service_pool.cc:227] Handling call
0812 19:25:25.558340 (+  3430us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:25:25.633325 (+ 74985us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:25.633356 (+    31us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:25:25.634298 (+   942us) log.cc:842] Serialized 52 byte log entry
0812 19:25:26.212365 (+578067us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:26.212414 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:26.212552 (+   138us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:26.978460 (+765908us) raft_consensus.cc:1671] finished
0812 19:25:26.978502 (+    42us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:26.978805 (+   303us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":17846,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":13274,"thread_start_us":610855,"threads_started":2,"wal-append.queue_time_us":843546}
I20260812 19:25:26.917806 18753 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:26.933101 18758 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:26.948009  6359 raft_consensus.cc:603] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:26.835657  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:25:26.950803  6228 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.009s	sys 0.009s
W20260812 19:25:26.972908  6232 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.010s	sys 0.014s
I20260812 19:25:26.952963  6473 rpcz_store.cc:276] 0812 19:25:25.202579 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:25.700558 (+497979us) service_pool.cc:227] Handling call
0812 19:25:25.705288 (+  4730us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:26.411570 (+706282us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:26.411601 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:26.421029 (+  9428us) log.cc:842] Serialized 26 byte log entry
0812 19:25:26.871630 (+450601us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:26.871804 (+   174us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:26.872011 (+   207us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:26.872118 (+   107us) raft_consensus.cc:1671] finished
0812 19:25:26.872134 (+    16us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:26.872389 (+   255us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2546,"raft.queue_time_us":39702,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":65,"thread_start_us":1117056,"threads_started":2,"wal-append.queue_time_us":302645}
I20260812 19:25:27.007380  6354 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 17: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:27.008111 17916 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.010455 18503 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:27.015131  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 191994us
I20260812 19:25:26.952881  6481 rpcz_store.cc:276] 0812 19:25:25.169917 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:25.485838 (+315921us) service_pool.cc:227] Handling call
0812 19:25:25.532581 (+ 46743us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:25:25.987708 (+455127us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:25.987740 (+    32us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:25:25.993388 (+  5648us) log.cc:842] Serialized 52 byte log entry
0812 19:25:26.438437 (+445049us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:26.438469 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:26.438533 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:26.871225 (+432692us) raft_consensus.cc:1671] finished
0812 19:25:26.871287 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:26.871770 (+   483us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":22328,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8636,"thread_start_us":895469,"threads_started":2,"wal-append.queue_time_us":644030}
I20260812 19:25:27.028008  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:27.017074 18437 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:27.018601 18394 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Stepping down as leader of term 22
I20260812 19:25:27.026553  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:27.015908 18611 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:27.031764 18394 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:27.032168 18611 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:27.033375 18394 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.033643 18611 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.035938 18394 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:27.038012  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:27.039237 18879 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:27.039820 18879 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:27.040246 18133 raft_consensus.cc:2741] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260812 19:25:27.041378 18133 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:27.043035 18865 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:27.043654 18865 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:27.040269 18879 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:27.046615 18865 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:27.048046 18865 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
W20260812 19:25:27.000018  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 49641.5us
I20260812 19:25:27.064847  6344 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "545108632fab48129db7f032619a1e55"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:27.056430  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:27.067502  6464 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:27.083068 18852 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:27.087215 18424 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:25:27.088971 18424 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:27.089447 18424 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:27.090971 18882 consensus_queue.cc:1046] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:27.091943 18882 consensus_queue.cc:1225] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer bdfa5579d4534c618c00db6b4a841c81 log is divergent from this leader: its last log entry 21.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260812 19:25:27.092162  6228 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:27.092715 18882 raft_consensus.cc:3032] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:27.093127 18882 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:25:27.096025  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 58230.1us
I20260812 19:25:27.099294 18691 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:27.100243 18691 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:27.102777 17622 consensus_queue.cc:1159] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdfa5579d4534c618c00db6b4a841c81" responder_term: 20 status { last_received { term: 20 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 20 index: 12 } }
I20260812 19:25:27.105652 18761 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260812 19:25:27.105944  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 52861.3us
I20260812 19:25:27.107076  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:27.108191 18761 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:27.108662 18761 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:27.109064 18761 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:27.111809 18744 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:25:27.117725 18546 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:27.123374  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:27.124491  7591 raft_consensus.cc:2379] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 15: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:25:27.128194 17916 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:27.143321  6228 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22. Ops: []
W20260812 19:25:27.137559 18590 consensus_meta.cc:287] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.619s	user 0.017s	sys 0.006s
I20260812 19:25:27.094277 18882 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.168617  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:27.174520 18424 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.176481 18424 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
W20260812 19:25:27.187505  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 45568us
I20260812 19:25:27.202593 18691 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:27.178192 18761 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.179724 18590 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.209263 18385 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:27.209483  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:27.210006 18133 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260812 19:25:27.225179 18882 raft_consensus.cc:3037] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:27.228106 18846 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:27.230073  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.235931 18437 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:27.237516 18442 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:27.226092  6229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 2972) took 1008 ms. Trace:
I20260812 19:25:27.240466 17622 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:27.243230  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 88305us
I20260812 19:25:27.244576  6342 pending_rounds.cc:76] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 11
I20260812 19:25:27.245163  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:27.247109  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:27.248308 18816 consensus_meta.cc:287] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.002s
I20260812 19:25:27.249514  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.252066  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:27.265674  6342 pending_rounds.cc:97] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260812 19:25:27.265075  7591 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:27.240602 18879 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.273375  6353 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:27.279073 18846 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:27.279997  6298 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:27.281677 18846 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:27.275842  6344 raft_consensus.cc:595] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.283044  6344 raft_consensus.cc:603] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:27.276892  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:27.277387  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:27.273748  6342 raft_consensus.cc:2866] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:27.288838  6345 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260812 19:25:27.290920  6228 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:27.293016  6354 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 22
I20260812 19:25:27.264454  6229 rpcz_store.cc:276] 0812 19:25:26.217700 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:26.226791 (+  9091us) service_pool.cc:227] Handling call
0812 19:25:26.227206 (+   415us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:26.227487 (+   281us) raft_consensus.cc:1520] Early marking committed up to index 11
0812 19:25:27.029817 (+802330us) log.cc:842] Serialized 14 byte log entry
0812 19:25:27.173084 (+143267us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:27.178900 (+  5816us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:27.191569 (+ 12669us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:27.207097 (+ 15528us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:27.226028 (+ 18931us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":30710,"prepare.queue_time_us":28059,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":34,"raft.queue_time_us":4132,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":20852,"thread_start_us":829317,"threads_started":2}
I20260812 19:25:27.295243  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:27.296835  6232 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 16.
I20260812 19:25:27.299238  6242 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260812 19:25:27.301723  6359 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:25:27.277645 18385 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:27.285480 18437 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:27.305124 17916 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260812 19:25:27.305313  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.288931 17622 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.306605  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.307361 18385 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:27.307518  6241 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:25:27.308651 17622 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:27.309931 18590 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:27.310005  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:27.310413  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:27.311496 17864 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:27.311560 18607 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:27.311946  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:27.312184  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:27.305317 18437 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:27.318280  6230 raft_consensus.cc:1261] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260812 19:25:27.324841  6232 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:27.287550 18816 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:27.326020 18816 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:27.326417 18816 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:27.312076 17864 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:27.330957 17864 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:27.328408  6230 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260812 19:25:27.343181  6052 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 242) took 38544 ms (client timeout 15000 ms). Trace:
I20260812 19:25:27.344842 18902 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:27.345717 18846 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:27.345618 18902 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.346463 18846 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.348311 18902 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:27.348791 18846 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:27.363124 18852 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:27.363727  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:27.365140  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:27.365347  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:27.365576  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.366112  6477 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 23: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:27.366515 17916 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:27.368256  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:27.368451  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.369314  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:27.369889  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.369994  6481 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:25:27.370437 17916 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:27.371882  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:27.372341  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:27.373354  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:27.290428 18442 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.377600 18761 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:27.377986 18879 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:27.378506  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:27.379279  6228 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
W20260812 19:25:27.379649 18544 consensus_meta.cc:287] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.870s	user 0.007s	sys 0.019s
I20260812 19:25:27.376132  6354 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
I20260812 19:25:27.391135  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.392110 18761 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 19:25:27.392788 18761 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:27.394261  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.396309 18761 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:27.397270 18816 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:27.397852  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:27.398733 18761 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:25:27.400409  6464 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260812 19:25:27.400959  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.402395  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:27.402943 18852 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:25:27.403327 18437 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:27.404024 18590 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:27.404582 18590 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:27.404731 18761 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:27.405843 18590 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.406612  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.410612  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:27.411523 18437 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:27.411968 18437 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:27.412380 18437 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:27.408072 18590 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:27.412147 18780 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260812 19:25:27.425405 18755 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:27.415740 18394 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:27.428704 18394 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.409605 18544 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:27.433014 18385 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:27.431072 18503 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260812 19:25:27.437017 18385 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:27.439008 18385 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:27.441869  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:27.434504 18544 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.446429  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:27.447428  6474 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 20.
I20260812 19:25:27.447700 18544 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:27.417393 18761 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260812 19:25:27.343818  6052 rpcz_store.cc:269] 0812 19:24:48.798768 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:48.804680 (+  5912us) service_pool.cc:227] Handling call
0812 19:25:27.342856 (+38538176us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:21.825359 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:21.956362 (+131003us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:21.961262 (+  4900us) write_op.cc:435] Acquired schema lock
0812 19:25:21.964115 (+  2853us) tablet.cc:660] Decoding operations
0812 19:25:22.011705 (+ 47590us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:22.011767 (+    62us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:22.011795 (+    28us) tablet.cc:683] Acquiring locks for 10 operations
0812 19:25:22.012617 (+   822us) tablet.cc:699] Row locks acquired
0812 19:25:22.012640 (+    23us) write_op.cc:260] PREPARE: finished
0812 19:25:22.012796 (+   156us) write_op.cc:270] Start()
0812 19:25:22.012923 (+   127us) write_op.cc:276] Timestamp: P: 1786562722012746 usec, L: 0
0812 19:25:22.012942 (+    19us) op_driver.cc:331] REPLICATION: starting
0812 19:25:22.013636 (+   694us) log.cc:842] Serialized 3974 byte log entry
0812 19:25:24.086320 (+2072684us) op_driver.cc:444] REPLICATION: finished
0812 19:25:24.596206 (+509886us) write_op.cc:301] APPLY: starting
0812 19:25:24.616671 (+ 20465us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:24.816658 (+199987us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:24.816806 (+   148us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:24.892880 (+ 76074us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:24.893210 (+   330us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0812 19:25:24.893276 (+    66us) write_op.cc:312] APPLY: finished
0812 19:25:24.893798 (+   522us) log.cc:842] Serialized 97 byte log entry
0812 19:25:24.894048 (+   250us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:24.894239 (+   191us) write_op.cc:454] Released schema lock
0812 19:25:24.894306 (+    67us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:24.894705 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:24.894745 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":474966,"apply.run_cpu_time_us":20939,"apply.run_wall_time_us":316077,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45987,"num_ops":10,"prepare.queue_time_us":269820,"prepare.run_cpu_time_us":44296,"prepare.run_wall_time_us":522040,"raft.queue_time_us":952016,"raft.run_cpu_time_us":142897,"raft.run_wall_time_us":360883,"replication_time_us":2073262,"thread_start_us":1698529,"threads_started":4,"wal-append.queue_time_us":389778,"wal-append.run_cpu_time_us":367996,"wal-append.run_wall_time_us":3470765}]]}
I20260812 19:25:27.450381  6354 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 19.
I20260812 19:25:27.431491 18394 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:27.453188  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.458552  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:27.456353  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.420231 17864 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:27.461571  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:27.462301 18730 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:27.457307 18385 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:27.472820  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.478209  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:27.479283  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.477702  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:27.476807  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:27.470173 18730 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:27.460428 18544 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:27.468125 18761 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:27.469791 18780 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election won for term 22
W20260812 19:25:27.487353  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47246.1us
I20260812 19:25:27.491573  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:27.492261  7594 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:27.493326  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:27.494052  6241 raft_consensus.cc:2354] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22.
I20260812 19:25:27.490376  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:27.475478 18394 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:27.482312  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.472805 18385 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:27.498909  6350 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
I20260812 19:25:27.479453 18816 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:27.507975  6359 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:27.488606 18730 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:27.509691 18544 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.528687 18385 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:27.529209 18544 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:27.510572  6230 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 22: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:27.507757 18780 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:27.540076  6344 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260812 19:25:27.538144  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:27.546288  6353 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260812 19:25:27.551366 18442 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:27.556332 18607 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:27.557129  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.557926  6229 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
I20260812 19:25:27.559079 17864 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:27.561348  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.563463 18780 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.541986  6464 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:25:27.569437  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:27.570120  6230 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:27.573562 18394 consensus_queue.cc:1046] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:25:27.574854 18394 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:27.575500 18394 raft_consensus.cc:3032] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:25:27.575831 18394 raft_consensus.cc:729] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
W20260812 19:25:27.578873  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 66497.4us
I20260812 19:25:27.588289  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:27.536974  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:27.591069  6345 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:27.594542  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:27.593223  7594 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:27.603436  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.607118 18755 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260812 19:25:27.621593 18923 log.cc:924] Time spent T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260812 19:25:27.620411 18360 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:27.623833  6298 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:27.619571 18607 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:27.625514 18360 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:27.587425 18394 consensus_queue.cc:260] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:27.627221  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 90343.8us
I20260812 19:25:27.630565  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:27.627877 18360 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:27.630812 18816 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
W20260812 19:25:27.642707  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 49076.3us
I20260812 19:25:27.636557 18879 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260812 19:25:27.625092 18544 consensus_queue.cc:1046] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.012s
I20260812 19:25:27.653172 18544 raft_consensus.cc:3032] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Stepping down as leader of term 22
I20260812 19:25:27.653580 18544 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:27.654495 18544 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.655927 18544 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:27.658178 18437 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.660766 18437 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:27.643579 18816 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:27.665750  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:27.635069 18846 consensus_queue.cc:1035] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260812 19:25:27.650815 18590 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:27.676805  6178 leader_election.cc:398] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 20. Current term is 21.
I20260812 19:25:27.651777 18879 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:27.668134 18394 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:27.687561 18879 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 15
I20260812 19:25:27.690470  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:27.675631 18437 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:27.694142  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.693858 18816 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:27.695079 18442 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:27.688328 18940 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260812 19:25:27.715488  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.717293  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:27.717913  6345 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:27.718901  6229 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260812 19:25:27.719940  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:27.720554  6241 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 18
I20260812 19:25:27.721200  6359 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260812 19:25:27.717828  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:27.721575  6359 pending_rounds.cc:76] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Aborting all ops after (but not including) 9
I20260812 19:25:27.721917  6359 pending_rounds.cc:97] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260812 19:25:27.722160  6359 raft_consensus.cc:2866] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:27.723331 18635 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260812 19:25:27.724557 18635 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Stepping down as leader of term 22
I20260812 19:25:27.724944 18635 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:27.715032 18761 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:27.728875 18761 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:25:27.730487  6228 raft_consensus.cc:2379] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 21: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:27.731292  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.732290 18865 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:27.733799  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.736987  6345 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:27.741186 17916 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:27.705246 18437 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:27.683573 18590 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.711462 18755 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:27.751376  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:27.762753  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.725996 18635 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.769580  6416 leader_election.cc:398] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22.
I20260812 19:25:27.771945  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:27.773551  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:27.751397 18437 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:27.778981  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.779608  6242 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:27.771101 18865 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:27.764847 18852 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260812 19:25:27.792615  6228 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:27.793553  6229 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:27.793267  6230 raft_consensus.cc:2454] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
I20260812 19:25:27.788213  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.799062 18607 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260812 19:25:27.771684 18755 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:27.812070  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:27.816725  7553 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.780964 18846 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:27.819126  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.821285 18424 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:27.821900 18424 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.824177 18424 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:27.825392 18852 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:27.825997 18852 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.827271  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.827972  6224 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:27.828114 18852 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:27.828395 18635 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:27.829195  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:27.829843  6228 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 22
I20260812 19:25:27.832108  6049 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 124) took 7947 ms. Trace:
I20260812 19:25:27.834069  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.833566  6047 catalog_manager.cc:5495] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:27.835229  6047 catalog_manager.cc:5495] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 16 to 20, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:27.835749 18755 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.837229  6047 catalog_manager.cc:5495] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 12 to 16, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 16 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:27.839906  6047 catalog_manager.cc:5495] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:27.841765  6047 catalog_manager.cc:5495] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 10 to 16, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 16 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:27.843324  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:27.844017  6477 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 25.
I20260812 19:25:27.843839  6047 catalog_manager.cc:5495] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 11 to 18, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 18 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:27.845983  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:27.845695  6047 catalog_manager.cc:5495] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 18, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 18 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:27.786984 17864 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:27.846696  6481 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:27.847122 17864 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:27.847254  6047 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 18 to 19, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 19 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:27.849783 17864 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:27.850821 18780 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:27.851066  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:27.851379 18780 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:27.851876  6482 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:25:27.853494 18780 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:27.849656  6047 catalog_manager.cc:5495] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 16 to 19, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 19 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:27.854492  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:27.855234  6482 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:27.855611  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:27.855721 18590 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:27.856693  6047 catalog_manager.cc:5495] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 16 to 19, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 19 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:27.859000  6047 catalog_manager.cc:5495] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:27.819921  6242 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 25.
I20260812 19:25:27.860607  6047 catalog_manager.cc:5495] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 16 to 19, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 19 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:27.862350  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.862934  6047 catalog_manager.cc:5495] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:27.865168 17361 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:27.865149  6047 catalog_manager.cc:5495] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:27.865926 17361 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:27.866971  6047 catalog_manager.cc:5495] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:27.868446 17361 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:27.832502  6049 rpcz_store.cc:276] 0812 19:25:19.888269 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:19.914756 (+ 26487us) service_pool.cc:227] Handling call
0812 19:25:27.831996 (+7917240us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:26.731317 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:26.935288 (+203971us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:26.935409 (+   121us) write_op.cc:435] Acquired schema lock
0812 19:25:26.935452 (+    43us) tablet.cc:660] Decoding operations
0812 19:25:26.936819 (+  1367us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:26.936957 (+   138us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:26.937019 (+    62us) tablet.cc:683] Acquiring locks for 6 operations
0812 19:25:26.941653 (+  4634us) tablet.cc:699] Row locks acquired
0812 19:25:26.942626 (+   973us) write_op.cc:260] PREPARE: finished
0812 19:25:26.966191 (+ 23565us) write_op.cc:270] Start()
0812 19:25:26.966440 (+   249us) write_op.cc:276] Timestamp: P: 1786562726966060 usec, L: 0
0812 19:25:26.966489 (+    49us) op_driver.cc:331] REPLICATION: starting
0812 19:25:26.974430 (+  7941us) log.cc:842] Serialized 2416 byte log entry
0812 19:25:27.296783 (+322353us) op_driver.cc:444] REPLICATION: finished
0812 19:25:27.356517 (+ 59734us) write_op.cc:301] APPLY: starting
0812 19:25:27.356655 (+   138us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:27.538167 (+181512us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:27.567529 (+ 29362us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:27.598624 (+ 31095us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:27.599045 (+   421us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0812 19:25:27.599125 (+    80us) write_op.cc:312] APPLY: finished
0812 19:25:27.599529 (+   404us) log.cc:842] Serialized 65 byte log entry
0812 19:25:27.608493 (+  8964us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:27.619048 (+ 10555us) write_op.cc:454] Released schema lock
0812 19:25:27.621205 (+  2157us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:27.621641 (+   436us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:27.621681 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":728624,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":59322,"apply.run_cpu_time_us":14414,"apply.run_wall_time_us":265576,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29243,"num_ops":6,"prepare.queue_time_us":540851,"prepare.run_cpu_time_us":29514,"prepare.run_wall_time_us":351154,"raft.queue_time_us":90577,"raft.run_cpu_time_us":22422,"raft.run_wall_time_us":67443,"replication_time_us":328379,"thread_start_us":994432,"threads_started":4,"wal-append.queue_time_us":178999}]]}
I20260812 19:25:27.868803  6047 catalog_manager.cc:5495] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:27.871496  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.872262  6230 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:25:27.871490  6047 catalog_manager.cc:5495] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 18, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 18 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:27.874235  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:27.875289 18882 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:27.875850 18882 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:27.876780 18882 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:27.894626  6241 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:27.901491  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:27.899494  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 82907.5us
I20260812 19:25:27.895491  6228 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
W20260812 19:25:27.920152  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 144268us
I20260812 19:25:27.921402  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:27.939581  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:27.940876  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.941797  6241 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 22: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:27.945487 18865 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:27.862509 18879 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:27.939473 18761 raft_consensus.cc:2741] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260812 19:25:27.948068 18879 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:27.931059  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:27.950062  6345 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 22.
I20260812 19:25:27.950884 18941 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:25:27.939530  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 127588us
I20260812 19:25:27.928143  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:27.957165  6359 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:25:27.958359  6481 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 15.
I20260812 19:25:27.959973  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:27.963562  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:27.953882  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:27.960513  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:27.974351 18816 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:27.975004 18816 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:27.975436 18816 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:27.978889 17864 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:27.979439 17864 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:27.979913 17864 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:27.983662  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:27.985539 18394 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260812 19:25:27.986117 18394 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:27.923470 17361 raft_consensus.cc:2781] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:25:27.996248  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:27.903064 18424 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:28.001224  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.940905 18787 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:28.002050  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:27.924979 18590 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:28.001608  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:28.006150  6230 raft_consensus.cc:2354] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
I20260812 19:25:27.926363 17916 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:27.986526 18394 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:28.009344  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:28.007740  6345 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 24.
W20260812 19:25:28.010416  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 56615.1us
I20260812 19:25:28.011473  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:28.015391  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:28.019526  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:28.018746  6344 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:27.955571 18780 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260812 19:25:28.000062 18879 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:27.924769 18360 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:28.005962 18761 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:27.940909 18730 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:28.041232  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:28.018528 18544 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:28.054610  6241 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917"
dest_uuid: "a1541d11be514114966dc1e92a345298"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:42218
I20260812 19:25:28.055406  6241 raft_consensus.cc:595] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:28.056326  6241 raft_consensus.cc:603] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:28.029282 18607 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:28.038534 18780 consensus_queue.cc:1225] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer a1541d11be514114966dc1e92a345298 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260812 19:25:28.014497 18590 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.018129 17916 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.053117 18385 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:28.033394 18424 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:27.901973  6047 catalog_manager.cc:5495] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 13 to 17, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 17 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:28.058168 18879 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:28.065011 18865 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 19:25:28.080993 18385 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:28.059551 18544 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.120922 18961 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:28.127842  6345 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 15.
I20260812 19:25:28.123500 18385 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 15 FOLLOWER]: Advancing to term 16
W20260812 19:25:28.153158  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 157034us
I20260812 19:25:28.147680  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
W20260812 19:25:28.145833  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 175062us
I20260812 19:25:28.169334  6345 raft_consensus.cc:595] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:28.169967  6345 raft_consensus.cc:603] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:28.182471  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:28.191057  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:28.191896  6230 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
W20260812 19:25:28.194659  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 153511us
I20260812 19:25:28.195568  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:28.139077 18961 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:28.205904  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:28.206730  6344 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 21
I20260812 19:25:28.209158  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:28.182032 17361 raft_consensus.cc:686] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:28.200469 18882 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260812 19:25:28.210264 17622 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:28.263602  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 66495.8us
I20260812 19:25:28.265431  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:28.218438 18607 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:28.218477 18635 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:28.237076 18882 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:28.231477 18360 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:28.218544 18730 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:28.272439  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:25:28.274531  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 65486.1us
I20260812 19:25:28.198163 18879 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.281435  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:28.277412  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:28.282153  6241 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:28.282603  6345 raft_consensus.cc:595] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:28.283022  6345 raft_consensus.cc:603] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:28.283917  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:28.295075  6230 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:25:28.273527 18882 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:28.316450  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:28.278628 18962 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:28.316623  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:28.275128 18590 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:28.285112 18442 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:28.281628 18424 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:28.331466  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:28.281251 17916 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:28.339661 17916 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:28.340008  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica a1541d11be514114966dc1e92a345298 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:28.340221 17916 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:25:28.342154 18953 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260812 19:25:28.333364  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260812 19:25:28.343721 18964 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260812 19:25:28.344973  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:25:28.345827  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:28.268050 17622 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:28.348212 17622 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:28.211491  6047 catalog_manager.cc:5495] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 11 to 18, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 18 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:28.349622 18544 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:28.349506  6047 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:28.275312 18635 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:28.355340 18980 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260812 19:25:28.356448 18635 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:28.357267  6354 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
I20260812 19:25:28.272178 18611 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260812 19:25:28.322911 18962 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:28.370092  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:28.370894  6345 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:28.367166  6353 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
I20260812 19:25:28.342512 17916 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:28.373588 18979 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:28.374109 18979 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.376329 18979 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:28.381781  6344 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 21.
I20260812 19:25:28.372242 18962 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:28.371289 17622 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:28.390292 18959 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:28.392295 18748 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:28.392395 18959 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.393136 18748 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:28.395939 18852 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:28.396471 18852 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.296249 17361 consensus_queue.cc:237] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:28.399012  6047 catalog_manager.cc:5495] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 12 to 16, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 16 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:28.337997 18966 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260812 19:25:28.401120  6047 catalog_manager.cc:5495] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 16 to 18, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 18 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:28.402288 18961 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:28.404978 18437 consensus_meta.cc:287] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.000s
I20260812 19:25:28.405413 18437 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.404971 18544 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260812 19:25:28.350517 18816 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.421492  6345 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:28.415686 17864 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:28.416735  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 1e69ce57e6c74dea9e207b6ae03c43b2, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.438853  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:28.413014 18959 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:28.452821  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:28.451535  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 1e69ce57e6c74dea9e207b6ae03c43b2, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.459180  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:28.459862  6345 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:28.460961  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:28.407807 17622 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.410751 18394 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.466849  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:28.453209 18852 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:28.455231 18816 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:28.477981 17864 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:28.479889 17622 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:28.483201 18937 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.692s	user 0.004s	sys 0.008s
I20260812 19:25:28.488651 18394 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:28.461716 18787 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:28.506726 18748 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:28.508692  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:28.509415  6232 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:28.510012  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:28.510715  6481 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:28.510629  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:28.511471  6483 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:28.511998  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:28.512601  6474 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:28.513525  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:28.514161  6477 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:28.515139  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:28.516007  6473 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:28.494059  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:28.519132  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55723.1us
I20260812 19:25:28.524293  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:28.524977  6241 raft_consensus.cc:3037] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:28.495558  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:28.527642  6228 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:28.425089  6047 catalog_manager.cc:5495] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 14 to 15, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 15 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:28.500722  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:28.536608  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:28.537631  6465 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:28.538211 18991 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:28.538703 18991 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:28.540017 19000 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:28.539935  6047 catalog_manager.cc:5495] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 13 to 17, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 17 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:28.542029  6047 catalog_manager.cc:5495] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 16 to 21, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 21 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:28.550386  6047 catalog_manager.cc:5495] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 17, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 17 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:25:28.551723  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 180907us
I20260812 19:25:28.540853 19000 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:28.569229  6229 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260812 19:25:28.472198 18544 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:28.556722  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:28.563618  6224 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260812 19:25:28.563496  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:28.567821  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 58572.9us
I20260812 19:25:28.546015 18385 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:28.521800 18437 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:28.602233  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 332731us
I20260812 19:25:28.602415  7591 raft_consensus.cc:2354] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
I20260812 19:25:28.587522  6241 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:28.603035  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:28.603332  6230 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:28.604045  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:28.596328  6232 raft_consensus.cc:2379] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 18: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:28.605353  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:28.596029  6483 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 26.
W20260812 19:25:28.609547  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet f1b6d90aaa384b5fb66f3320981f1aa0, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.585103 18544 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:25:28.610069  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet f1b6d90aaa384b5fb66f3320981f1aa0, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.609028  6178 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:28.611270  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:28.613324 18437 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader election won for term 15
I20260812 19:25:28.613917 18437 raft_consensus.cc:686] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:28.614980  6235 pending_rounds.cc:76] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: Aborting all ops after (but not including) 8
I20260812 19:25:28.615363  6235 pending_rounds.cc:97] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260812 19:25:28.615614  6235 raft_consensus.cc:2866] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:28.615520 18437 consensus_queue.cc:237] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:28.629894  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 362580us
I20260812 19:25:28.618311  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:28.627485  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:28.592387 18385 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:28.632313  6224 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:28.608635 18852 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:28.633793  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:28.637028  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:28.632668  6230 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260812 19:25:28.636796  6354 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260812 19:25:28.638223 18973 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:28.593935 19000 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.642043 18985 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:28.643486 18865 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:28.643124  6047 catalog_manager.cc:5495] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 17 to 21, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 21 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:28.645941  6483 raft_consensus.cc:3037] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:28.647266  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:28.647966  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:28.619208 18544 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:28.648945  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:28.651937  6354 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:28.654775  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:28.591403 18882 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.657588  6464 raft_consensus.cc:3037] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 17
W20260812 19:25:28.658617  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 49671.4us
I20260812 19:25:28.660925  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:28.666356  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:28.648300 18852 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:28.669685  6297 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:28.657835  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:28.650949 18973 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:28.656112 18985 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:28.700871  6473 raft_consensus.cc:2454] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:28.674063  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:28.665488  6352 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 23.
I20260812 19:25:28.683187  6481 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 23. Current term is 24. Ops: []
I20260812 19:25:28.680235  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:28.699638  6230 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 22: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:28.704908  6354 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:25:28.699762  6464 raft_consensus.cc:2454] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:25:28.656855 18424 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:28.709811  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:28.712011  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:28.714545  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:28.715996  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:28.716027 18748 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:28.716838  6477 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 23: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:28.716986 18748 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:28.717459  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:28.667207 19011 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260812 19:25:28.717459 18748 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:28.718122  6242 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
I20260812 19:25:28.689237 18607 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:28.719542 18607 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:28.719934 18607 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:28.720166 18424 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:28.720709 18424 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:28.722829 17622 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:28.723330 17622 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:28.723490  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:28.723728 17622 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:28.730923  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:28.690367 19015 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:28.732388 19015 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.667487 18787 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260812 19:25:28.722955  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:28.735559  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:28.743577  6230 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 22: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
W20260812 19:25:28.687429 19009 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260812 19:25:28.746608 18945 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:28.668332 18865 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:28.747386  6473 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260812 19:25:28.689487 18852 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:28.688665 18442 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:28.701689 18973 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:28.706251 18992 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260812 19:25:28.689735 18962 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.767037  6349 raft_consensus.cc:1226] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260812 19:25:28.767845 18962 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:28.757977 18945 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.769498  6354 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 22.
I20260812 19:25:28.690048 18984 raft_consensus.cc:2781] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:28.753527  6297 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:28.773361  7553 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:28.763146  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:28.774183  6359 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:28.763391  6483 raft_consensus.cc:2454] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 21.
I20260812 19:25:28.763855  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:28.706802 18985 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:28.777329  6224 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 26.
I20260812 19:25:28.787866  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:28.749027 18940 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:28.792691  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:28.788722  6483 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:28.793567  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:28.791704  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:28.819824  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:28.763505 18424 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.778590 18945 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:28.782018 18385 raft_consensus.cc:2781] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:28.841164  6416 leader_election.cc:398] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
I20260812 19:25:28.841540  6416 leader_election.cc:401] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:25:28.781070 19015 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:28.845026  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 46014.9us
W20260812 19:25:28.846549  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet c3c085c12bc74f5b8a4f6f69990e1a82, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:28.847084  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet c3c085c12bc74f5b8a4f6f69990e1a82, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.784794 18607 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:28.846519  6353 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
I20260812 19:25:28.846639 18945 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:28.851161 18879 raft_consensus.cc:3037] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Advancing to term 16
I20260812 19:25:28.824295 18940 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.848417 17864 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:28.867537 18977 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:28.851854 18385 raft_consensus.cc:686] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 21 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:28.875341 18945 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.876034  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:28.884891 18385 consensus_queue.cc:237] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:28.898716  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:28.901093 19018 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:28.901603 19018 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:28.901994 19018 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:28.876766 18865 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.911685 18607 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:28.893453 18882 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:28.915082  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 200610us
I20260812 19:25:28.879421 18977 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:28.880366 18503 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.036s
I20260812 19:25:28.916450 18977 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:28.918357 19000 consensus_queue.cc:1046] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:25:28.918736 18945 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:28.919322 18940 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:28.925899  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:28.927014  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:28.927743  6224 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 23: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:28.927451 17622 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:28.922806  6359 raft_consensus.cc:2454] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 16.
I20260812 19:25:28.929112  6352 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 23: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:28.930492  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:28.931970  6353 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:28.929850  6241 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 23.
I20260812 19:25:28.929347  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:28.896734 17864 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 22 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:28.933271  7553 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:28.941114  7594 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260812 19:25:28.943449 17622 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:28.954129  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:28.955374  6230 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:28.961064  6229 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:25:28.959079  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:28.965294  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:28.969066  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:28.975947  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:28.929214 18607 raft_consensus.cc:3032] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:28.979112 19015 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:28.979598 19015 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:28.979950 19015 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:28.980968 19031 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:28.981547 19031 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:28.986340 19029 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260812 19:25:28.987332 18424 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:28.958391 18997 raft_consensus.cc:2781] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:25:28.991745  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:29.035429  6477 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:28.996923  6353 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:28.989352 18607 raft_consensus.cc:729] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:29.038982 18607 consensus_queue.cc:260] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.040596 18607 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:28.973564 18437 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.122s
I20260812 19:25:28.978057 18947 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:28.992147 18442 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:28.973376 18945 consensus_queue.cc:1046] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.153s
I20260812 19:25:29.107558 18997 raft_consensus.cc:686] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:29.127264 18442 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:29.152469 19025 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:29.153218 19025 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:29.167637 19038 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260812 19:25:29.170118 19031 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:29.148896 18442 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:29.175539 18748 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.177664 18748 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:29.182098 18544 consensus_meta.cc:287] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.000s
I20260812 19:25:29.185050 19018 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.134857 17864 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:29.186347 18879 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
I20260812 19:25:29.191589 18442 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.158298 18997 consensus_queue.cc:237] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:29.196959 18442 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:29.203363 19018 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:29.206679  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 237629us
I20260812 19:25:29.150002 18846 raft_consensus.cc:3032] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:29.215061  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:29.229538 19034 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:29.230162 19034 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:29.232610 19034 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:29.239111 19057 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:29.239670 19057 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:29.240072 19057 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
W20260812 19:25:29.245246 19027 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260812 19:25:29.171060 19031 consensus_queue.cc:1046] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260812 19:25:29.218909 18846 raft_consensus.cc:729] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:29.248744 18846 consensus_queue.cc:260] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.250130 18846 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:29.252022 18976 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260812 19:25:29.254828  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 501378us
I20260812 19:25:29.255760 18991 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.257333 18991 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:29.259972  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:29.260579  6483 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:29.261881  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:29.262284 18984 raft_consensus.cc:686] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:29.262485  6238 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 23
I20260812 19:25:29.263046  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:29.263319 18984 consensus_queue.cc:237] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.264014  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:29.264582  6230 raft_consensus.cc:3037] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:29.265926 18987 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election won for term 26
I20260812 19:25:29.266986  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:29.267602  6232 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:29.182551 18544 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.272518  6477 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:29.289354  6350 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260812 19:25:29.291185  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:29.298413  6229 raft_consensus.cc:2396] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260812 19:25:29.296986  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 300517us
W20260812 19:25:29.283433 18973 consensus_meta.cc:287] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.003s
I20260812 19:25:29.309967  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:29.310433  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:29.306350  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:29.266477 18987 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:29.320791  6465 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 22
W20260812 19:25:29.328828  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 190709us
I20260812 19:25:29.297458 19023 raft_consensus.cc:3032] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Stepping down as leader of term 23
I20260812 19:25:29.290230 18947 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:29.297768 18959 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:29.308779 18973 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.339161  6483 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
W20260812 19:25:29.330888 18852 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.007s
I20260812 19:25:29.342908  6230 raft_consensus.cc:2454] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:25:29.345877  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:29.348786  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:29.348225  7553 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:29.350231 17361 raft_consensus.cc:2781] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:25:29.350594 17622 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:29.351429 17622 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.352169  6483 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260812 19:25:29.356006 17361 raft_consensus.cc:686] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:29.333330 19023 raft_consensus.cc:729] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:29.363823  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:29.366760  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:29.307849 19057 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.367434  6475 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:29.372234  6417 leader_election.cc:398] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16.
I20260812 19:25:29.370328  6238 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:29.363085  6298 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:29.376533  6242 raft_consensus.cc:1261] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260812 19:25:29.352449 18992 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:29.355718 18394 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:29.384011 17622 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:29.372164  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:29.385035  6236 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:29.385123  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:29.382645  6298 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:29.346877 18959 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.387149  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:29.373148 17361 consensus_queue.cc:237] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:29.390491  6483 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:29.353502 18852 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.399338  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:29.403124  6353 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:29.404629  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:29.405514  6349 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:29.377310 18544 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:29.406942 18544 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:29.407826 18544 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:29.418789  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:29.419189  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:29.340807 18947 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.422765  6359 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260812 19:25:29.422946  6344 raft_consensus.cc:2354] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 23. Current term is 24.
I20260812 19:25:29.423285 19042 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:29.423704 18973 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:29.423854 19056 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:29.396613 19025 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:29.424487 19056 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 20 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:29.401856 18987 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.425470 19056 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:29.427042 19045 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.073s
I20260812 19:25:29.428799  6352 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260812 19:25:29.429432  6345 raft_consensus.cc:2354] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23.
I20260812 19:25:29.434919  6474 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 24. Current term is 25. Ops: [24.10-24.10]
I20260812 19:25:29.436339  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:29.437091  6359 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:29.441896  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:29.381631 17864 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
W20260812 19:25:29.444710  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 66197.2us
I20260812 19:25:29.446213  6352 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:25:29.391280 18394 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.447116  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:29.456198  6465 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:29.447640  6464 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:29.448099 18947 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:29.442721  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:29.464552  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:29.446385  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:29.450510  6232 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:29.459985  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:29.462033 19057 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:29.462997  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 113908us
I20260812 19:25:29.465909  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:29.388473 18992 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.470289  6349 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:25:29.400897 19015 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.466445  6342 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 23.
I20260812 19:25:29.470822  6297 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:29.470925  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:29.479894  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:29.421417 18544 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260812 19:25:29.480788  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:29.482924  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:25:29.483183  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44545.3us
I20260812 19:25:29.489964  6464 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260812 19:25:29.491720  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:29.492357  6232 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:29.492774  6178 leader_election.cc:398] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 23. Current term is 24.
I20260812 19:25:29.493075  6178 leader_election.cc:401] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260812 19:25:29.488443  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:29.486644  6236 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:29.501245  6232 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:29.495438 19059 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:29.502281 19059 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:29.502321  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:29.502888 19059 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:29.504845  6481 raft_consensus.cc:1261] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260812 19:25:29.488920 19067 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260812 19:25:29.507893 19015 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:29.508517  6477 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 24: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:29.508987 19025 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 23. Current term is 24.
I20260812 19:25:29.483863 19075 raft_consensus.cc:2781] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader election won for term 16
I20260812 19:25:29.490069 18984 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:29.472370 18948 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:29.509531 18852 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:29.489042 19065 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260812 19:25:29.516232  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:29.470135 19055 consensus_queue.cc:1035] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260812 19:25:29.490072 19045 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:29.538973  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:29.539721  6178 leader_election.cc:398] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23.
I20260812 19:25:29.542371  6178 leader_election.cc:401] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:25:29.543125  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
W20260812 19:25:29.522929 18977 consensus_meta.cc:287] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.606s	user 0.014s	sys 0.004s
W20260812 19:25:29.525236 18985 consensus_meta.cc:287] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.731s	user 0.013s	sys 0.000s
I20260812 19:25:29.546990  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:29.549708  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:29.550209  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:29.551088  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:29.557292  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:29.549245 18846 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260812 19:25:29.559262  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:29.559893  6349 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:29.546032 18442 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:29.561152 18879 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:29.561568 18879 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:29.561697 18992 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:29.561971 18879 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:29.562886 19080 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23.
I20260812 19:25:29.525748 18948 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 22 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:29.564829 18948 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:29.568230 19087 log.cc:924] Time spent T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260812 19:25:29.569671  6344 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 24: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:29.569476  6342 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 23: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:29.542644 18544 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:29.547226 19045 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:29.570364  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:29.574141  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 4995e2d6140a4fa3a2dadad444b9a924, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:29.582973  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 4995e2d6140a4fa3a2dadad444b9a924, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.583873  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:29.574960  6349 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:29.569708  6236 raft_consensus.cc:2379] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 24: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:25:29.589303  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 87217.8us
I20260812 19:25:29.590009  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:29.569187 19015 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260812 19:25:29.571925 18442 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:29.562886 19074 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:29.560071 18963 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.083s
I20260812 19:25:29.603965  6342 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260812 19:25:29.582883 19045 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:29.601698 18984 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:29.586879 19034 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.068s
I20260812 19:25:29.593765 18544 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:29.609308 19015 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:29.609678 19096 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election won for term 24
I20260812 19:25:29.569729 18977 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:29.608884 19074 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.571357 18985 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.608660 19075 raft_consensus.cc:686] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:29.581279 18852 consensus_queue.cc:1046] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260812 19:25:29.661993  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:29.717047  6483 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:29.660347  6475 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:29.667290  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:29.603293 18959 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:29.595723 19080 consensus_queue.cc:1046] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260812 19:25:29.710330  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:29.655601  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:29.711961  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:29.726493  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 156206us
I20260812 19:25:29.748131  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:29.749027  6232 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:29.753468  7599 raft_consensus.cc:2354] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19.
I20260812 19:25:29.756410  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:29.757853  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:29.760147  6475 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260812 19:25:29.762231  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 55606.5us
I20260812 19:25:29.708752 18987 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:29.758790  6232 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 16.
I20260812 19:25:29.719497 18947 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260812 19:25:29.771309 19088 log.cc:924] Time spent T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260812 19:25:29.771631 18971 consensus_queue.cc:1035] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260812 19:25:29.772541  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:29.779299  6342 raft_consensus.cc:595] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:29.779728  6342 raft_consensus.cc:603] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:29.746133 18394 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:29.752015 19096 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:29.793617  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:29.788441  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:29.790984 19107 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:29.791944 18985 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:29.794620  6470 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 15.
I20260812 19:25:29.752585 18761 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260812 19:25:29.777491 18984 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.808843  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:29.818464  6345 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260812 19:25:29.785169 18611 raft_consensus.cc:3032] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:29.824651  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:29.745402 18442 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.829923  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:29.840891  6236 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
W20260812 19:25:29.841686  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 172008us
I20260812 19:25:29.843518  6345 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260812 19:25:29.838805  6359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:29.845937  6359 raft_consensus.cc:595] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:29.815382 18394 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:29.849012 19124 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260812 19:25:29.825537 19080 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:29.832266 19120 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:29.884799  6236 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:29.852587  6475 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260812 19:25:29.848157  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:29.834358 18992 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260812 19:25:29.779245 18987 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.883886  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:29.834898 18611 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
W20260812 19:25:29.904731  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 56668.8us
I20260812 19:25:29.903352 19120 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.909086 19044 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260812 19:25:29.910547 19109 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:29.911026 19120 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:29.907325  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:29.912711  6470 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 21
I20260812 19:25:29.793442 18544 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.916613  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:29.891083 18992 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:29.927078 18967 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:25:29.927474  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:29.923674  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:29.937152  6359 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 19
I20260812 19:25:29.903105 18977 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:29.933552 18879 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:29.934518 19106 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260812 19:25:29.921123 18635 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260812 19:25:29.934895 19098 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260812 19:25:29.811542 19107 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.839818 19096 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.921865 18948 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260812 19:25:29.940816 18991 consensus_meta.cc:287] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.678s	user 0.013s	sys 0.003s
I20260812 19:25:29.953423  6345 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:29.981228  6345 raft_consensus.cc:595] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:29.981655  6345 raft_consensus.cc:603] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260812 19:25:29.956764 19091 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.258s	user 0.001s	sys 0.001s
I20260812 19:25:29.962075 18987 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:29.844998 19075 consensus_queue.cc:237] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.934984 18972 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.156s
I20260812 19:25:29.936373 18992 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:29.939719 19059 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.890446 19080 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:29.974116  6464 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:29.973057 18879 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:29.974960 18948 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260812 19:25:29.966431 19107 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:29.996692  6470 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:29.999104  6359 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 19.
I20260812 19:25:29.970042 19045 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:30.057655  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 152059us
I20260812 19:25:30.067166  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:30.071072  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 147477us
I20260812 19:25:30.072257  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:30.076678  7591 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: []
I20260812 19:25:30.081525  6236 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:30.078109 18948 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260812 19:25:30.106607  6235 raft_consensus.cc:1261] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260812 19:25:30.096347 19045 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:30.090786 19056 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:30.128826  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:30.137017  6235 raft_consensus.cc:3037] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:30.129420  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:30.130132 19059 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:30.103863 19080 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:30.132663 19023 consensus_queue.cc:260] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:30.137954  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:30.143107 18983 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260812 19:25:30.150292  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:30.151198  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:30.159936  6232 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 23: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:30.157617  6477 raft_consensus.cc:1226] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 23. Current term is 24. Ops: []
I20260812 19:25:30.163498 19023 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:30.147997 19056 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:30.171409 19056 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:30.177420  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:30.181411  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:30.182269  6230 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:30.184247  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:30.188434  6473 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: []
W20260812 19:25:30.217362  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 70479.1us
I20260812 19:25:30.274428  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3044) took 1600 ms. Trace:
I20260812 19:25:30.275136  6350 rpcz_store.cc:276] 0812 19:25:28.673486 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:28.673623 (+   137us) service_pool.cc:227] Handling call
0812 19:25:28.673912 (+   289us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:29.289880 (+615968us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:30.273936 (+984056us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b540036d154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:30.274171 (+   235us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1414540032}
I20260812 19:25:30.284412  6236 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 24.
I20260812 19:25:30.285418  6235 raft_consensus.cc:2454] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 19.
I20260812 19:25:30.176920 18963 consensus_queue.cc:1035] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260812 19:25:30.287505  7553 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:30.292346  6235 raft_consensus.cc:1226] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260812 19:25:30.290292 18972 raft_consensus.cc:2781] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:30.295447 17361 consensus_queue.cc:1046] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260812 19:25:30.299642 19153 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:30.300184 19153 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:30.300477 19059 consensus_queue.cc:1046] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 19:25:30.302369 19153 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:30.303602 18940 raft_consensus.cc:3032] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Stepping down as leader of term 15
I20260812 19:25:30.298429 18972 raft_consensus.cc:686] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 19 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:30.307847 19107 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:30.308537 19107 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:30.308930 18972 consensus_queue.cc:237] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:30.310089 19074 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:30.320833  7599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60748 (request call id 914) took 1406 ms. Trace:
I20260812 19:25:30.321957 19109 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:25:30.325089  6465 pending_rounds.cc:76] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 11
I20260812 19:25:30.325054  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:30.325598  6465 pending_rounds.cc:97] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260812 19:25:30.325695  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3607) took 1066 ms. Trace:
I20260812 19:25:30.325891  6465 raft_consensus.cc:2866] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:30.325920  6470 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:30.327587 19107 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:30.328907  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:30.321415  7599 rpcz_store.cc:276] 0812 19:25:28.914484 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:28.914748 (+   264us) service_pool.cc:227] Handling call
0812 19:25:30.320597 (+1405849us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b540022abd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:30.320741 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1867589504}
I20260812 19:25:30.332588  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:30.332368  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:30.321847 18992 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:30.336790  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:30.326174  6224 rpcz_store.cc:276] 0812 19:25:29.259285 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:29.259966 (+   681us) service_pool.cc:227] Handling call
0812 19:25:29.260299 (+   333us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:29.260625 (+   326us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:29.260654 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:29.261112 (+   458us) log.cc:842] Serialized 26 byte log entry
0812 19:25:30.325063 (+1063951us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b1800193420. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f740782c 00007f98f483e9dc 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411
0812 19:25:30.325214 (+   151us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:30.325247 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:30.325312 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:30.325382 (+    70us) raft_consensus.cc:1671] finished
0812 19:25:30.325396 (+    14us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:30.325611 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12416,"raft.queue_time_us":22903,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":117,"spinlock_wait_cycles":23454080,"thread_start_us":47458,"threads_started":1,"wal-append.queue_time_us":59298}
I20260812 19:25:30.346609 19023 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:30.306458 18940 raft_consensus.cc:729] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:30.353415  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:30.355707  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:30.312373 19153 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:30.347118 19023 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:30.347179 18948 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 22 LEADER]: Stepping down as leader of term 22
I20260812 19:25:30.358572 19107 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260812 19:25:30.364161 19163 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260812 19:25:30.401441 18940 consensus_queue.cc:260] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:30.413815 18940 raft_consensus.cc:3037] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 16
I20260812 19:25:30.361080 18976 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:30.361558 19136 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:25:30.416311  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 54907.4us
I20260812 19:25:30.416296 19107 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:30.407130 19023 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:30.407298 18948 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:30.391850 19153 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:30.458501 19107 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:30.494668 19062 raft_consensus.cc:3032] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 22 LEADER]: Stepping down as leader of term 22
I20260812 19:25:30.495247 19062 raft_consensus.cc:729] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:30.496158 19062 consensus_queue.cc:260] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:30.497483 19062 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:30.447086 18976 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:30.500452 18976 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:30.508445  6235 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260812 19:25:30.510804  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:30.511332  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:30.512032  6242 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:30.515713  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:30.520694 19136 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:30.521291 19136 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:30.521750 19136 raft_consensus.cc:3037] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:30.532639 18992 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:30.516642 18852 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.017s
I20260812 19:25:30.537395 18611 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:30.555197  6477 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:30.513501 18948 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:30.520028 19153 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:30.605670  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 145642us
W20260812 19:25:30.631251 19170 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260812 19:25:30.638633 19107 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:30.647607  6470 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260812 19:25:30.648056  6470 pending_rounds.cc:76] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 12
I20260812 19:25:30.648294  6470 pending_rounds.cc:97] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260812 19:25:30.648531  6470 raft_consensus.cc:2866] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:30.650014  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:30.662276  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3057) took 1222 ms. Trace:
I20260812 19:25:30.662729  6354 rpcz_store.cc:276] 0812 19:25:29.439501 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:29.439642 (+   141us) service_pool.cc:227] Handling call
0812 19:25:29.440014 (+   372us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:29.576308 (+136294us) raft_consensus.cc:1520] Early marking committed up to index 11
0812 19:25:29.576439 (+   131us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:29.594959 (+ 18520us) log.cc:842] Serialized 26 byte log entry
0812 19:25:29.721215 (+126256us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:29.721272 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:30.655386 (+934114us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b54004114d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:30.655423 (+    37us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:30.655455 (+    32us) raft_consensus.cc:1671] finished
0812 19:25:30.655462 (+     7us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:30.662176 (+  6714us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7268,"raft.queue_time_us":40937,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":19116,"spinlock_wait_cycles":113980800,"thread_start_us":134120,"threads_started":2,"wal-append.queue_time_us":163520}
W20260812 19:25:30.674352  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 701203us
I20260812 19:25:30.676148 19107 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:30.676657  6298 leader_election.cc:398] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19.
I20260812 19:25:30.677060  6298 leader_election.cc:401] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:25:30.679558 18635 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:30.680217 18635 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:30.680974  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:30.681751 18991 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:30.683113  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:30.684434  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:30.685132  6350 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:30.685877  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:30.686444  6353 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:30.688637  6350 raft_consensus.cc:1226] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260812 19:25:30.695597  6353 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260812 19:25:30.696190  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38140 (request call id 2835) took 1948 ms. Trace:
I20260812 19:25:30.700539  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:30.702265  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:30.704885  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:30.705490  6359 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:30.703224  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:30.713164 19133 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:30.713729 19133 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:30.714111 19184 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:30.714962  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:30.714818 19184 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:30.716915 18394 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:30.706318  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:30.717417 18394 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:30.717650  6359 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:30.718218 19184 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:30.719476  6228 raft_consensus.cc:1226] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22. Ops: []
W20260812 19:25:30.721290  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 44842.7us
I20260812 19:25:30.696559  6474 rpcz_store.cc:276] 0812 19:25:28.747996 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:28.748135 (+   139us) service_pool.cc:227] Handling call
0812 19:25:28.748690 (+   555us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:29.435415 (+686725us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:30.695946 (+1260531us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b54000735d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:30.696131 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1577543424}
I20260812 19:25:30.733769  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:30.682305 18991 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:30.748934  6359 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
I20260812 19:25:30.751724  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:30.753051  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 686039us
I20260812 19:25:30.755013  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:30.766557  6359 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260812 19:25:30.767306  6353 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:30.735327 18865 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:30.769214  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:30.770529 17916 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:30.779493  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:30.782032  6350 raft_consensus.cc:1261] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260812 19:25:30.759353 18987 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:30.799082  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:30.799119 19081 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:30.800468 18959 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:30.803594  6352 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 23.
I20260812 19:25:30.805456 18882 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:30.804891  6359 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260812 19:25:30.805859  6353 raft_consensus.cc:595] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:30.806416  6353 raft_consensus.cc:603] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:30.768504 18607 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:30.823714  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:30.778861 19031 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:30.824710  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:30.826835  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:30.830410  6230 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Advancing to term 17
I20260812 19:25:30.828655  6235 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260812 19:25:30.832408  6241 raft_consensus.cc:1261] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260812 19:25:30.838884  6235 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260812 19:25:30.839816  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:30.851585  6235 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260812 19:25:30.851586  6230 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:25:30.824080 18635 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:30.782945 17916 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:30.810279 17864 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260812 19:25:30.841678 19031 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:30.810762 18865 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.045s
I20260812 19:25:30.868834  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:30.833928 18607 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:30.880836 19136 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:30.883272 18607 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:30.883505 19081 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 19:25:30.883325 19136 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:30.887063  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:30.887239 19133 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:30.888032 19133 consensus_queue.cc:1035] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 19:25:30.888556 18992 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:25:30.890764 19081 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader election won for term 17
I20260812 19:25:30.892143 18991 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:30.893401 19031 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:30.899673 19093 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 18. Current term is 19.
I20260812 19:25:30.901289 19053 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260812 19:25:30.912595 19053 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:30.913386 19053 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:30.917778  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:30.919104 19134 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:30.920317 19053 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:30.927739 19202 log.cc:924] Time spent T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260812 19:25:30.863463 19184 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.084s
I20260812 19:25:30.955551 17916 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:30.958191  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:30.962101  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:30.964903  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:30.976599  6178 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:30.990173  6228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 3018) took 2345 ms. Trace:
I20260812 19:25:30.990713  6228 rpcz_store.cc:276] 0812 19:25:28.636904 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:28.637027 (+   123us) service_pool.cc:227] Handling call
0812 19:25:28.656258 (+ 19231us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:30.719872 (+2063614us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:30.982503 (+262631us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b540001de54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:30.982744 (+   241us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4744509696}
I20260812 19:25:30.993348  6349 raft_consensus.cc:1261] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260812 19:25:31.005057 19023 consensus_meta.cc:287] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.001s
I20260812 19:25:31.005690 19023 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:30.978148 19081 raft_consensus.cc:686] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:31.007733 19081 consensus_queue.cc:237] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.009348 19203 consensus_queue.cc:1035] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260812 19:25:31.019873  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 128246us
I20260812 19:25:31.020648  6297 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:31.024734  6236 raft_consensus.cc:2379] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 22: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:31.032136  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:30.990605 19059 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:31.012827 19134 raft_consensus.cc:686] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:31.018553 19053 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:31.043655  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:31.034941 18991 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:31.045394 19059 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.089628  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:31.090466  6345 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:31.105373 19023 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:31.109448  6242 raft_consensus.cc:1261] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260812 19:25:31.112330 19179 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.529s	user 0.002s	sys 0.000s
I20260812 19:25:31.112483  6345 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:31.073486 18394 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.087170 19134 consensus_queue.cc:237] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.121094  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:25:31.093309 19062 consensus_meta.cc:287] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Time spent flushing consensus metadata: real 0.592s	user 0.016s	sys 0.000s
I20260812 19:25:31.123611 18761 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:31.125576 19059 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:31.127758 19093 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260812 19:25:31.144285  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:31.141925 18761 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:31.166581 18761 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.183205  7591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 813) took 1831 ms. Trace:
I20260812 19:25:31.183678  7591 rpcz_store.cc:276] 0812 19:25:29.351315 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:29.358906 (+  7591us) service_pool.cc:227] Handling call
0812 19:25:29.377769 (+ 18863us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:30.082768 (+704999us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:31.182923 (+1100155us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b5400670554. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:31.183116 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1605935360}
W20260812 19:25:31.187196 19209 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260812 19:25:31.189329 19215 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.153s	user 0.001s	sys 0.002s
I20260812 19:25:31.190178  6344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3067) took 1379 ms. Trace:
I20260812 19:25:31.193135  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 2947) took 1349 ms. Trace:
I20260812 19:25:31.193048  6232 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260812 19:25:31.190619  6344 rpcz_store.cc:276] 0812 19:25:29.810740 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:29.810887 (+   147us) service_pool.cc:227] Handling call
0812 19:25:29.834008 (+ 23121us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:25:30.673013 (+839005us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:30.673042 (+    29us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:25:30.673602 (+   560us) log.cc:842] Serialized 52 byte log entry
0812 19:25:30.769039 (+ 95437us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:30.769329 (+   290us) log.cc:842] Serialized 14 byte log entry
0812 19:25:30.779476 (+ 10147us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:31.189753 (+410277us) spinlock_profiling.cc:243] Waited 87.3 ms on lock 0x7b540025f654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:31.189804 (+    51us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:31.189852 (+    48us) raft_consensus.cc:1671] finished
0812 19:25:31.189957 (+   105us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:31.190120 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":757020,"prepare.queue_time_us":1963,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":757265,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":12191,"spinlock_wait_cycles":200798592,"thread_start_us":95048,"threads_started":1,"wal-append.queue_time_us":89854}
I20260812 19:25:31.206269 19042 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:31.206154  6342 rpcz_store.cc:276] 0812 19:25:29.843244 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:29.843479 (+   235us) service_pool.cc:227] Handling call
0812 19:25:29.843807 (+   328us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:29.860435 (+ 16628us) raft_consensus.cc:1520] Early marking committed up to index 14
0812 19:25:29.907511 (+ 47076us) log.cc:842] Serialized 14 byte log entry
0812 19:25:29.978383 (+ 70872us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b1800388cc0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff57b 00007f98f778288a
0812 19:25:30.524638 (+546255us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b1800388cc0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:25:30.671216 (+146578us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b1800388cc0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f47d34ca 00007f98fdea8f99 00007f98fb620bcf 00007f98f485c7b6 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d
0812 19:25:30.714846 (+ 43630us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:30.715290 (+   444us) log.cc:842] Serialized 26 byte log entry
0812 19:25:30.715433 (+   143us) raft_consensus.cc:1631] Marking committed up to 14
0812 19:25:30.715465 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:31.192839 (+477374us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b540003f7d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:31.192885 (+    46us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:31.192931 (+    46us) raft_consensus.cc:1671] finished
0812 19:25:31.192944 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:31.193070 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":655374,"prepare.queue_time_us":51657,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":672816,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":12938,"spinlock_wait_cycles":46057216,"thread_start_us":90180,"threads_started":1,"wal-append.queue_time_us":222102}
I20260812 19:25:31.220252 18611 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:31.231305 18945 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:31.231945 18945 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.234333 18945 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:31.235816  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 593758us
I20260812 19:25:31.236090  6417 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:31.247009  6474 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 23. Current term is 24. Ops: []
I20260812 19:25:31.248466  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:31.251401  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:31.252506  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:31.253140  6241 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:31.254280  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:31.256237  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:31.257519  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:31.258244  6474 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 15 FOLLOWER]: Advancing to term 17
I20260812 19:25:31.259734  6359 raft_consensus.cc:2379] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:31.267233  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:31.273895  6224 raft_consensus.cc:2454] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:31.238350 19023 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:31.276525  6473 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260812 19:25:31.288159  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:31.284533  6241 raft_consensus.cc:2454] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 25.
I20260812 19:25:31.245947 18940 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:31.301312  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:31.304474  6465 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 24: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:31.348654  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:31.351984  6477 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260812 19:25:31.352226  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:31.288815 18879 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:31.247529 18987 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260812 19:25:31.267210 17916 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 22.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.084s
I20260812 19:25:31.373342  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:31.374086  6477 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:31.342581 19045 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:31.378846  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:31.355895 19018 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:31.292290 19023 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.244053 19042 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.387750  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:31.396055  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:31.399463  6477 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:31.400028  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:31.378927 18976 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:31.429239  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:31.431674 19057 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:31.433257  6483 raft_consensus.cc:1261] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260812 19:25:31.437345  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260812 19:25:31.439662  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:25:31.401481 18973 raft_consensus.cc:2741] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260812 19:25:31.440392  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:31.448727  6482 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260812 19:25:31.347496 18940 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:31.383913 18437 consensus_queue.cc:1046] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260812 19:25:31.433306  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:25:31.458933 19247 log.cc:924] Time spent T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260812 19:25:31.384323 19045 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:31.454625 19249 log.cc:924] Time spent T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260812 19:25:31.466261 19225 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260812 19:25:31.488318  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 55102.9us
W20260812 19:25:31.492502 19231 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.366s	user 0.003s	sys 0.000s
I20260812 19:25:31.535718  6474 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 17.
I20260812 19:25:31.441952 18976 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.499337 19127 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election won for term 23
W20260812 19:25:31.541770  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 305734us
I20260812 19:25:31.500329 18940 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:31.501183  6473 raft_consensus.cc:2454] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 14.
W20260812 19:25:31.506158  6464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38150 (request call id 3580) took 1796 ms (client timeout 1982 ms). Trace:
I20260812 19:25:31.510409 19045 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:31.515125 18948 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:31.517892 18882 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:31.397828 19018 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.543020  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:31.549578  6464 rpcz_store.cc:269] 0812 19:25:29.709760 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:29.710077 (+   317us) service_pool.cc:227] Handling call
0812 19:25:31.505952 (+1795875us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54003a9154. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:31.506072 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":523172096}
W20260812 19:25:31.764883  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 203194us
I20260812 19:25:31.769003 18437 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:31.769230  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:31.769681 18437 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:31.772917 18437 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:31.766139 19127 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 23 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:31.774477 19127 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.775805 19042 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:31.570627 18882 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:31.790642 18424 raft_consensus.cc:979] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: : Instructing follower a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:25:31.791280 18424 raft_consensus.cc:1067] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Signalling peer a1541d11be514114966dc1e92a345298 to start an election
I20260812 19:25:31.565402 19133 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:31.792255 19133 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.785097 18976 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:31.785809 18394 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:31.559942 19107 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.221s
I20260812 19:25:31.808239  6416 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:25:31.810964  6297 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.253.3:42599 timed out after 1.982s (SENT) [suppressed 22 similar messages]
I20260812 19:25:31.842420  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:31.846581  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:31.856590  6416 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:31.838608 18976 raft_consensus.cc:2781] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:31.835619 18611 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:31.864758  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:31.865867  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:31.867642 19025 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:31.868209 19025 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.870227 19025 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:31.872447  6465 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260812 19:25:31.872819  6465 pending_rounds.cc:76] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 12
I20260812 19:25:31.873010  6465 pending_rounds.cc:97] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260812 19:25:31.873234  6465 raft_consensus.cc:2866] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:31.852932 18442 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:31.873654 18882 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.875195 18360 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:31.853214 18966 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:31.876993 18882 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:31.876741 18966 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:31.861089  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:31.852149 19136 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:31.886801 18852 raft_consensus.cc:2781] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader election won for term 25
I20260812 19:25:31.878890 18966 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:31.874225 18442 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.892448 19133 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:31.913038 18879 raft_consensus.cc:3032] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:31.897651 19136 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.913455 18879 raft_consensus.cc:729] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:31.915112 19136 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:31.882411 18611 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.917851 18611 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:31.906169  6470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 1280) took 1299 ms. Trace:
I20260812 19:25:31.919821 18442 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:31.919785  6470 rpcz_store.cc:276] 0812 19:25:30.607255 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:30.607525 (+   270us) service_pool.cc:227] Handling call
0812 19:25:30.632171 (+ 24646us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:30.648911 (+ 16740us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:31.905902 (+1256991us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5400103bd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:31.906102 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":34607872}
I20260812 19:25:31.909056 19023 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:31.898281 18973 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260812 19:25:31.910852  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica bdfa5579d4534c618c00db6b4a841c81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:31.888227 18976 raft_consensus.cc:686] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 19 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:31.914381 18879 consensus_queue.cc:260] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.981267 19023 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:25:31.986426  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 0715e834130d426f8038cf97eecb0687, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:31.986948  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 0715e834130d426f8038cf97eecb0687, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:31.989809 18879 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:31.989364 18761 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:25:32.012403  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 201472us
W20260812 19:25:32.018371  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 171887us
I20260812 19:25:31.997853 19018 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:32.030450 17916 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:32.032027  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:25:32.037393  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:32.034051 17622 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:32.040110 17622 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:31.990869 19023 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:32.044530  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 183536us
I20260812 19:25:32.048604  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:32.049499  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 213463us
I20260812 19:25:32.049885  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:32.059391 17622 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:32.060792  6350 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260812 19:25:31.994383 18976 consensus_queue.cc:237] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.065346  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:32.041702 19120 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:32.051379 19096 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:32.022845 18761 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.105113  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:32.105679  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:32.101500  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:32.106420  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:32.111573  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 08db676d084c41abaa2e196e5c2653b5, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:32.112054  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 08db676d084c41abaa2e196e5c2653b5, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.107785  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:32.058363 18947 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:32.108273  6350 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260812 19:25:32.061513 18984 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:32.109220  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:32.120366  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:32.124542  6359 raft_consensus.cc:1226] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260812 19:25:32.127832  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:32.129012 17622 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:32.129944 19134 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:32.130139  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:32.130873 19134 consensus_queue.cc:1035] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260812 19:25:32.053738 18987 consensus_queue.cc:1046] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260812 19:25:32.100476 19268 log.cc:924] Time spent T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260812 19:25:32.043789 17916 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.139906  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:32.141278  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:32.141600  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:32.144119  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:32.153172  6349 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 21: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:32.144192  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:32.144919  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:32.099644 19148 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:32.109431 18611 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:32.113963 18852 raft_consensus.cc:686] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 25 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:32.156014  6352 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 24: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:32.159786 17622 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:25:32.161170  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:32.145552 18973 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:32.096980 19120 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:32.179337  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 8b1f6c5d06f046a1818f453d9b609502, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:32.180119  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 8b1f6c5d06f046a1818f453d9b609502, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.126668 18992 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
W20260812 19:25:32.234428  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 73364.7us
I20260812 19:25:32.108516 19279 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
I20260812 19:25:32.137362 18947 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.235976  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:32.226605 19263 log.cc:924] Time spent T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260812 19:25:32.180269 18948 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:32.178555 19133 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:32.226888 19261 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:32.265064  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:32.170698 18611 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.244966 19059 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:32.265868  6483 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 24.
I20260812 19:25:32.268853 18442 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:32.269390 19286 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:32.270704 19034 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:32.258283 19096 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:32.184891 18973 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:32.282442  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:32.259094 18948 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.258814 19133 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.285708  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:32.165522 19148 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:32.270731 18966 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:32.265129 19275 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:32.281298  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:32.323515  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 197010us
I20260812 19:25:32.324200  6483 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:32.250849 19127 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:32.340663  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:32.344511  6465 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:32.263198 19261 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.353427  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:32.302349 18442 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.339668 19023 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:32.316627 18984 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:32.345937 18544 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:32.307396 19034 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.457185  6475 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 24. Current term is 25. Ops: [24.10-24.10]
I20260812 19:25:32.315390 19096 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.356896 19018 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:32.392491 19272 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:32.415131 19055 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:32.332156 18966 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.303413 18852 consensus_queue.cc:237] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.456343 17916 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:32.342628 19127 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:32.306821 19286 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:32.493918 19120 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:32.502158 18947 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:32.507589 19148 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:32.491791 19055 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:32.509809 19055 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:32.510514 18948 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:32.471382 18544 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.488971 19018 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:32.512527 18544 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:32.512609 18966 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:32.472272 18984 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:32.488863 18761 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:32.523864  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:32.524780  6359 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 22.
I20260812 19:25:32.524844 18611 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:32.491602 19277 consensus_queue.cc:1035] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.034s
I20260812 19:25:32.525792 18973 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:32.561946  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:32.562904  7594 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:32.567027  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:32.567996  6229 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 23.
W20260812 19:25:32.581012  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 99750.3us
W20260812 19:25:32.582245  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 346346us
W20260812 19:25:32.578871 19130 log.cc:924] Time spent T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: Append to log took a long time: real 1.454s	user 0.007s	sys 0.000s
I20260812 19:25:32.489287 19272 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:32.583511  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 269529us
I20260812 19:25:32.592849 19133 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:32.584115  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:32.592106  6416 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:32.608557  6473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 2868) took 1261 ms. Trace:
I20260812 19:25:32.620337  6473 rpcz_store.cc:276] 0812 19:25:31.346985 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:31.348317 (+  1332us) service_pool.cc:227] Handling call
0812 19:25:32.608369 (+1260052us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54003a8c54. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:32.608497 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":348742400}
I20260812 19:25:32.620997  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:32.625743  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:32.629855  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:32.630563  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:32.585348  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 237759us
W20260812 19:25:32.604249  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 81141.1us
I20260812 19:25:32.630671  6347 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:32.634157  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:32.616680 18879 consensus_meta.cc:287] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.606s	user 0.011s	sys 0.012s
W20260812 19:25:32.600994 19296 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260812 19:25:32.588759 18611 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260812 19:25:32.641779  6483 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:32.600590 17916 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:32.646123 17916 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:32.646598 17916 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:32.649209 19272 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:32.635432 18984 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:32.609021 19096 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:32.600418 19332 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:32.604580 19261 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:32.608569 19059 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:32.609434 19034 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:32.610484 19127 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:32.643235 18442 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:32.680596  6298 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:32.725225  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:32.728598  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:25:32.730086  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 139912us
W20260812 19:25:32.801275  6298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 120819us
I20260812 19:25:32.802300  6477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 1284) took 1267 ms. Trace:
I20260812 19:25:32.810388  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:25:32.804984  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 71702.2us
I20260812 19:25:32.814527  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:32.806298  6477 rpcz_store.cc:276] 0812 19:25:31.535133 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:31.535290 (+   157us) service_pool.cc:227] Handling call
0812 19:25:32.608503 (+1073213us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:32.608692 (+   189us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:32.608715 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:32.608753 (+    38us) raft_consensus.cc:1631] Marking committed up to 13
0812 19:25:32.608782 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:32.608833 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:32.802081 (+193248us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003a8c50. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7777a09 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:32.802230 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2442728192}
W20260812 19:25:32.727638 19296 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260812 19:25:32.906178  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 177658us
W20260812 19:25:32.920905  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 110668us
W20260812 19:25:32.939589  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 308078us
I20260812 19:25:32.659353 19025 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.148s
I20260812 19:25:32.660385 19031 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.248s
I20260812 19:25:32.958289  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:32.954614  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:32.894618 19261 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:32.872390 18984 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260812 19:25:32.974713  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 160289us
I20260812 19:25:32.941648 19055 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:32.941879 19056 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 24 LEADER]: Stepping down as leader of term 24
I20260812 19:25:33.010931 19056 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:33.012130 19056 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 24.10, Last appended by leader: 10, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.013785 19056 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:32.941859 19104 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:32.977084 18442 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:32.939630 19318 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:32.660835 19332 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:32.972059 19330 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:32.975826 19286 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:33.035341  6230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3638) took 2003 ms. Trace:
I20260812 19:25:33.004915  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:33.058666  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 92598.5us
I20260812 19:25:32.973371 18984 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:33.054881  6230 rpcz_store.cc:276] 0812 19:25:31.032178 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:31.032319 (+   141us) service_pool.cc:227] Handling call
0812 19:25:31.032627 (+   308us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:31.044521 (+ 11894us) raft_consensus.cc:1520] Early marking committed up to index 11
0812 19:25:31.044550 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:31.045002 (+   452us) log.cc:842] Serialized 26 byte log entry
0812 19:25:32.610430 (+1565428us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b18004eb620. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:25:32.728625 (+118195us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:32.728668 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:32.728779 (+   111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:33.034991 (+306212us) raft_consensus.cc:1671] finished
0812 19:25:33.035017 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:33.035272 (+   255us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9008,"raft.queue_time_us":17828,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4121,"spinlock_wait_cycles":4597504,"thread_start_us":117565,"threads_started":1,"wal-append.queue_time_us":1914540}
W20260812 19:25:33.059537  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 77861.7us
I20260812 19:25:33.018599 19055 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:33.032677 19261 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:33.021034 19059 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:33.073716  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:33.033038 19018 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.063684 19286 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:33.027405 19306 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:33.093122 19055 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:33.063530 19025 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:33.093343 19350 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:33.028168 19341 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:33.114493  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 112170us
I20260812 19:25:33.099510 18984 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:33.118391 19324 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:33.119226 19324 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:33.092165  6416 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:33.099941 19059 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:33.125782  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:33.056979 19104 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.130021  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:33.123912 19289 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:33.101733 19261 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.125113 19275 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:33.140970  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.057816 19318 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.142242  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.134603 18879 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:33.124311 19286 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:25:33.125736 19059 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
W20260812 19:25:33.137302 18976 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.009s	sys 0.008s
I20260812 19:25:33.146730  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.148154  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.177466  6241 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:33.148483  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.127496 19018 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:33.062927 19330 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.150980  6230 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:33.159881  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.115649 19025 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.206491  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.168155  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.169072  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.135946 19021 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:33.211297  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.212601  6350 raft_consensus.cc:2379] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 24: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:33.172760  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.186156 19312 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:33.215306 19312 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.217530 19312 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.218001 19312 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:33.188673 19053 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:33.218914 19053 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.220978 19053 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.189631 19311 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:33.221635 19311 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.224090  6238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53176 (request call id 3078) took 1124 ms. Trace:
I20260812 19:25:33.224427 19288 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260812 19:25:33.224754 19259 log.cc:924] Time spent T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.450s	user 0.004s	sys 0.005s
I20260812 19:25:33.226085  6481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 1270) took 3515 ms. Trace:
I20260812 19:25:33.226259 19021 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.226450  6481 rpcz_store.cc:276] 0812 19:25:29.710454 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:29.710622 (+   168us) service_pool.cc:227] Handling call
0812 19:25:29.747528 (+ 36906us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:29.756908 (+  9380us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:29.756938 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:31.294359 (+1537421us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b2c000cda88. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f6167e11 00007f98f6177442 00007f98f77b3c11 00007f98f777858a 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772
0812 19:25:31.362345 (+ 67986us) log.cc:842] Serialized 26 byte log entry
0812 19:25:31.558931 (+196586us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:31.558971 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:31.559897 (+   926us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:33.139742 (+1579845us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:25:33.225833 (+ 86091us) raft_consensus.cc:1671] finished
0812 19:25:33.225857 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:33.226001 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8925,"raft.queue_time_us":28678,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":14038,"spinlock_wait_cycles":59279488,"thread_start_us":159649,"threads_started":1,"wal-append.queue_time_us":396461}
I20260812 19:25:33.228420 19025 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.190147 18503 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:33.229795 18503 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.232470 18503 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:33.190604 18940 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:33.191164  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.233243 18940 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.191267  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.235812 18940 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:33.235915 19318 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.192608  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.194211 19120 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:33.237330 19120 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:33.192955 19264 log.cc:924] Time spent T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 1.401s	user 0.010s	sys 0.009s
I20260812 19:25:33.239943 19120 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:33.111618 19306 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.234494  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.242295  6474 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:33.205171  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.244485  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.117522 19350 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.189738  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.212004  6236 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:33.205718 19018 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.245540  6477 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:33.214082  6349 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:33.224495  6238 rpcz_store.cc:276] 0812 19:25:32.099805 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:32.100166 (+   361us) service_pool.cc:227] Handling call
0812 19:25:32.132847 (+ 32681us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:32.302476 (+169629us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:32.302512 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:32.302549 (+    37us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:32.302581 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:33.223877 (+921296us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54001644d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:33.223920 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:33.224037 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":389580672}
I20260812 19:25:33.228521  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.242378 19306 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:33.195408 18976 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.009s	sys 0.008s
I20260812 19:25:33.218467 19312 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.261649 19311 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:33.262482  6350 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 23. Current term is 24. Ops: []
I20260812 19:25:33.263959 19261 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:33.265264 19324 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:33.204101  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.244544 19330 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:33.266224  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.267479  6349 raft_consensus.cc:2396] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260812 19:25:33.214063  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.268062 19332 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.268404  6347 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 23.
I20260812 19:25:33.188820 18879 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:33.269882 19021 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:33.254981  6172 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.006s	sys 0.002s
W20260812 19:25:33.270834  6172 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.006s	sys 0.002s
I20260812 19:25:33.270295 18879 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.268074  6352 raft_consensus.cc:1261] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260812 19:25:33.162546 19346 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:33.130069 19341 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.265472  6350 raft_consensus.cc:3037] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 25
I20260812 19:25:33.272935 18879 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:33.287314  6241 raft_consensus.cc:2396] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260812 19:25:33.289355  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.273182 19025 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:33.151170 19275 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.149477 19289 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:33.261744 19312 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.278999 19053 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:33.281545 19031 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:33.279918 19348 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:33.308138  6236 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260812 19:25:33.331382  6474 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:25:33.332630  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:33.334553  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.335460  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.339332 19333 raft_consensus.cc:482] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:33.340973  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:33.341641  6481 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:33.342634  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.344713  6477 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260812 19:25:33.345842  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.299832 19025 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.354807  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.353320  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.314872 19031 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.359511 19025 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.360704 19031 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.360770 19275 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.364866  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:33.368373 19303 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260812 19:25:33.315234 19348 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.372056 19350 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.373541 19348 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.374200 19289 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:33.376539 19341 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.340065 19333 raft_consensus.cc:504] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:33.283742 19346 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:33.384997 19299 log.cc:924] Time spent T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.920s	user 0.000s	sys 0.012s
I20260812 19:25:33.385281 19346 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.387583 19333 leader_election.cc:288] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:33.379894  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:33.313444 19053 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.389437 19326 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:33.389969 19326 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:33.389863  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:33.391033  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.359407  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.391944  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:33.380714  6482 raft_consensus.cc:2396] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260812 19:25:33.366366  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.394784 19326 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:33.395038  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.395671  6470 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
I20260812 19:25:33.396490  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.396399 19261 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:25:33.397922  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.398288 19261 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 23 LEADER]: Stepping down as leader of term 23
I20260812 19:25:33.399545  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.358502 19104 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.419552  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3102) took 1105 ms. Trace:
I20260812 19:25:33.423491  6345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3098) took 1304 ms. Trace:
I20260812 19:25:33.412499 19311 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:33.424407  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.425999  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.412230  6416 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:33.428529 19311 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:33.427997  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:33.430011  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.431074  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:33.420773 19290 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.951s	user 0.004s	sys 0.021s
I20260812 19:25:33.413679  6465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38140 (request call id 2874) took 1150 ms. Trace:
I20260812 19:25:33.401038  6350 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260812 19:25:33.435180  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.423787  6342 rpcz_store.cc:276] 0812 19:25:32.313741 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:32.314245 (+   504us) service_pool.cc:227] Handling call
0812 19:25:32.314609 (+   364us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:32.492364 (+177755us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:32.492399 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:32.492442 (+    43us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:32.492468 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:33.419203 (+926735us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400180954. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:33.419271 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:33.419478 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":408290176}
I20260812 19:25:33.436455  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:33.370425 17916 consensus_meta.cc:287] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.722s	user 0.009s	sys 0.000s
I20260812 19:25:33.437602 19261 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:33.440660 19055 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:33.441520 19261 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.423877  6345 rpcz_store.cc:276] 0812 19:25:32.118730 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:32.120138 (+  1408us) service_pool.cc:227] Handling call
0812 19:25:32.120472 (+   334us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:32.145317 (+ 24845us) raft_consensus.cc:1520] Early marking committed up to index 11
0812 19:25:32.145568 (+   251us) log.cc:842] Serialized 14 byte log entry
0812 19:25:32.267706 (+122138us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:32.267812 (+   106us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:32.267871 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:33.384395 (+1116524us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:25:33.406934 (+ 22539us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b4800111558. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fc61f7f1 00007f98fc6168e7 00007f98fc61677a 00007f98fc70a95f 00007f98fc70a627 00007f98fc71eb2c 00007f98fc71ead8 00007f98fc71ea58 00007f98fc71ea13 00007f98fc71dcbc 00007f98fb69fbe6
0812 19:25:33.423246 (+ 16312us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b540025f654. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:33.423300 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:33.423436 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5279,"prepare.queue_time_us":2926,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":9806,"raft.run_cpu_time_us":8345,"raft.run_wall_time_us":1131361,"spinlock_wait_cycles":136675968,"thread_start_us":115672,"threads_started":1,"wal-append.queue_time_us":202284}
I20260812 19:25:33.443161  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.440313 19333 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:33.443804 19333 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:33.444291 19333 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:33.445199 19053 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.445442 18976 consensus_queue.cc:1035] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:25:33.446310  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.444314  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.447386  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.447556  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 27 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.414621 19326 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.454118  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.454763 19326 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:33.455606  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.456997  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:33.460215 19291 log.cc:924] Time spent T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.150s	user 0.003s	sys 0.011s
I20260812 19:25:33.433519  6481 raft_consensus.cc:2454] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:33.432493  6465 rpcz_store.cc:276] 0812 19:25:32.262932 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:32.263075 (+   143us) service_pool.cc:227] Handling call
0812 19:25:33.413445 (+1150370us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b5400272254. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f777c2ae 00007f98fc6b9c27 00007f98f5dadc04 00007f98f5dadb92 00007f98f5dadac1 00007f98f5dada3c 00007f98f5daccf2 00007f98f5bae94c 00007f98f5badd86 00007f98f5bad72f
0812 19:25:33.413596 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":76032896}
I20260812 19:25:33.458292  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.468328  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:33.468492  6473 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:33.469877  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:33.470809 19053 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:33.471603 19023 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:33.472136 19023 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:33.472595 19023 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
W20260812 19:25:33.473294 19292 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 1.001s	user 0.011s	sys 0.014s
I20260812 19:25:33.470199  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ff4c3d452047f29f09437fda663aed" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.474582 19055 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:33.482151 18976 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:25:33.463506 19261 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:33.496006  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:33.489114 18984 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:33.489135  6464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33386 (request call id 1288) took 1639 ms. Trace:
I20260812 19:25:33.507833  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:33.360795 19018 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.516997  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.519999  6236 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
I20260812 19:25:33.516893  6359 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 21
I20260812 19:25:33.505086  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:33.524811  7591 raft_consensus.cc:2354] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 23. Current term is 24.
I20260812 19:25:33.515353  6464 rpcz_store.cc:276] 0812 19:25:31.849823 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:31.850152 (+   329us) service_pool.cc:227] Handling call
0812 19:25:31.862985 (+ 12833us) raft_consensus.cc:1457] Updating replica for 0 ops
0812 19:25:31.878575 (+ 15590us) raft_consensus.cc:1520] Early marking committed up to index 14
0812 19:25:32.066972 (+188397us) log.cc:842] Serialized 14 byte log entry
0812 19:25:32.583847 (+516875us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0812 19:25:32.583914 (+    67us) raft_consensus.cc:1631] Marking committed up to 14
0812 19:25:32.583978 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:33.488863 (+904885us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b54003ef8d4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f7778f51 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c 00007f98f5badd86
0812 19:25:33.488924 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:33.489070 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":32006,"prepare.queue_time_us":165873,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1849,"raft.queue_time_us":118620,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":26084,"spinlock_wait_cycles":35305216,"thread_start_us":666380,"threads_started":3,"wal-append.queue_time_us":403812}
I20260812 19:25:33.530224  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:33.531213  6349 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:33.530457  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.533104  6473 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260812 19:25:33.531970  6236 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
I20260812 19:25:33.538803  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.539561  6238 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
W20260812 19:25:33.544674  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 74885.6us
I20260812 19:25:33.545403  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.545630  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:33.550287  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.467782 17916 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.546289  6238 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:33.553880  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.551748  6298 leader_election.cc:398] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 23. Current term is 24.
I20260812 19:25:33.556399  6298 leader_election.cc:401] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260812 19:25:33.551222 19018 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:33.561474  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 27 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.540973 18984 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:33.563100  6236 raft_consensus.cc:2396] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 27 because replica has last-logged OpId of term: 26 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260812 19:25:33.565706  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:33.568961  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 75114.3us
I20260812 19:25:33.570830  6241 raft_consensus.cc:1261] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260812 19:25:33.568015  6236 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:33.581153  6297 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:33.587193  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:33.586952  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:33.572099 18985 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:33.582597  6416 leader_election.cc:302] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:33.558681 19332 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260812 19:25:33.601449  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.602332  6228 raft_consensus.cc:2354] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 24. Current term is 25.
I20260812 19:25:33.592005  6349 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 24.
I20260812 19:25:33.593348 19045 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:33.598378 19358 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:33.594602 19349 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:33.603225  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:33.605542  7553 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:33.608139  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.603631  6230 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a"
dest_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:53178
I20260812 19:25:33.611986  6230 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:25:33.612378  6230 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:33.620291  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.621788  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.623090  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.603850 18394 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891) with higher term. Message: Invalid argument: T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 23. Current term is 24.
I20260812 19:25:33.609658 19358 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:33.625494 19349 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:33.607025 19045 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.627239  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.628233 19349 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:33.628762 19045 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.619832  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.629696  6228 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 23: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:33.626586 19358 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:33.630641  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.637374  6359 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:33.596015 19279 raft_consensus.cc:2781] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election won for term 24
I20260812 19:25:33.649264  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:33.670771  6235 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260812 19:25:33.652530  6238 raft_consensus.cc:1226] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260812 19:25:33.604038 18962 raft_consensus.cc:3032] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Stepping down as leader of term 23
I20260812 19:25:33.658784 18360 raft_consensus.cc:2781] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Leader election won for term 24
I20260812 19:25:33.658129 19023 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.663144  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:33.667878 17916 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.678115  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.600004 18985 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:33.689353  6179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.017s	sys 0.044s
W20260812 19:25:33.689706  6179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.018s	sys 0.044s
I20260812 19:25:33.638208 19310 raft_consensus.cc:2726] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:33.694141  6236 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 21: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:33.678942  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:33.680519  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 93665.3us
I20260812 19:25:33.695770  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:33.580447 18984 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260812 19:25:33.675776 18962 raft_consensus.cc:729] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:33.686172 18879 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260812 19:25:33.701828 19338 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.012s	sys 0.050s
I20260812 19:25:33.701725 19023 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.690861 18360 raft_consensus.cc:686] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 24 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:33.699265 19045 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:33.683961 18959 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:33.685925 19358 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:33.707461  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:33.685799 19279 raft_consensus.cc:686] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:33.713840  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.712916  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.709653 18879 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:33.720252  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:33.721768  6344 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.013s	sys 0.019s
W20260812 19:25:33.782786  6344 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.014s	sys 0.019s
I20260812 19:25:33.683818 19059 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.713986  6230 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:33.705080 18962 consensus_queue.cc:260] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:33.787690  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 80312.2us
I20260812 19:25:33.788045  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:33.789076  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:33.709867 19310 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:33.763777  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:33.719349 19338 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.012s	sys 0.051s
I20260812 19:25:33.802706 18360 consensus_queue.cc:237] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:33.804185 19311 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:33.804658 19311 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:33.805004 19311 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:33.795100  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:33.806547  6228 raft_consensus.cc:2379] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 23: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:33.817171  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:33.818135  6238 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 23. Current term is 24. Ops: []
I20260812 19:25:33.812762  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:33.821949  7591 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:33.829020  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:33.830222 19055 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:33.737447  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:33.861737  6236 raft_consensus.cc:3037] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:33.861958  6483 raft_consensus.cc:1226] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260812 19:25:33.786453  6230 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:33.717898 18991 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:33.866133 18991 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.791922  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:33.793002  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:25:33.794366  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 83010.7us
I20260812 19:25:33.874341  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:33.755118 19358 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:33.800158 17916 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:33.802052 18846 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:33.802116 19059 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.757704 19279 consensus_queue.cc:237] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.835322  6229 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260812 19:25:33.838534  7591 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
I20260812 19:25:33.916350  7594 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:33.917778  6179 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:33.839835 18985 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:33.763401 18959 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:33.785485 18879 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
W20260812 19:25:33.846630 19340 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260812 19:25:33.848829 19018 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:33.720692  6354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3093) took 1615 ms. Trace:
I20260812 19:25:33.857848  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260812 19:25:33.887633  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 94772.8us
I20260812 19:25:33.891573  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:33.900594 19056 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:33.895382  6230 raft_consensus.cc:1226] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:33.937985  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:33.895808  6236 raft_consensus.cc:2454] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 24.
I20260812 19:25:33.899076  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:33.887133 19358 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
W20260812 19:25:33.758729 19273 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.476s	user 0.020s	sys 0.025s
I20260812 19:25:33.897984 19107 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:25:33.941891  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 50425.4us
I20260812 19:25:33.933897  6354 rpcz_store.cc:276] 0812 19:25:32.105058 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:32.106197 (+  1139us) service_pool.cc:227] Handling call
0812 19:25:32.106506 (+   309us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:25:32.117820 (+ 11314us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:32.117852 (+    32us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:25:32.136104 (+ 18252us) log.cc:842] Serialized 52 byte log entry
0812 19:25:32.314568 (+178464us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:32.347314 (+ 32746us) log.cc:842] Serialized 14 byte log entry
0812 19:25:32.466800 (+119486us) log.cc:842] Serialized 14 byte log entry
0812 19:25:32.606311 (+139511us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b18002e38a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:25:33.275051 (+668740us) spinlock_profiling.cc:243] Waited 59.1 ms on lock 0x7b18002e38a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:25:33.463276 (+188225us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b18002e38a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f4859155 00007f98f77703d0 00007f98f7782576 00007f98f77930d7 00007f98f7793058
0812 19:25:33.493099 (+ 29823us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b18002e38a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:25:33.717571 (+224472us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:33.717654 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:33.717703 (+    49us) raft_consensus.cc:1671] finished
0812 19:25:33.717722 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:33.717869 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":124890,"prepare.queue_time_us":29692,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":90,"raft.queue_time_us":230351,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":34101,"spinlock_wait_cycles":167710720,"thread_start_us":398746,"threads_started":2,"wal-append.queue_time_us":246178}
I20260812 19:25:33.946736  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:33.949745  6230 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:33.949090  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:33.951275  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:33.943944 19042 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:33.961622  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:33.957329  6297 leader_election.cc:398] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 24. Current term is 25.
I20260812 19:25:33.962396  6297 leader_election.cc:401] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:25:33.949038  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:33.960446  6232 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:33.964795  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:33.904631 19333 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:33.951324 19273 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.670s	user 0.022s	sys 0.027s
I20260812 19:25:33.938252 19056 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:33.947096 19059 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:33.978132  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:33.962559 19045 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:33.983475  6465 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 24: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:33.974632 19359 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:33.967257 17916 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:33.969651 19018 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:33.991803 19018 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:33.992254 19018 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:33.976837 19056 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:33.976388 19059 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:33.994975 19059 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:33.996428 18962 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:33.969667 19042 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:34.001883 19042 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:34.002740 19378 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260812 19:25:34.006932  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:34.007987 19333 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:34.009130 19261 consensus_meta.cc:287] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.005s
I20260812 19:25:34.010725 18985 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260812 19:25:34.013376  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 64431.7us
I20260812 19:25:34.014142  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:34.015267  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:34.016373  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:34.017418  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:34.019374  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:34.022387  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:33.980624 18984 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for earlier term 24. Current term is 25.
I20260812 19:25:34.022123  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:34.024816 19333 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:34.028028 19333 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:34.028473 19333 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:34.020267 19312 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:25:34.030834 19350 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:34.031239 19350 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:34.031587 19350 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:34.026750 19261 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:34.024329  6297 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:34.027308  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:34.026718 18985 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:34.023223 19310 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:34.025653 19153 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:34.023386 19081 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:34.025415 18976 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:34.045861  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:34.044149 18984 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:34.040709 19312 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:34.022815 19056 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.045921 19310 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:34.057005 19310 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:34.056864 19358 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.057304 19056 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:34.058018 18984 consensus_queue.cc:1046] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260812 19:25:34.059027 19358 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:34.056085 19311 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.063079  6235 raft_consensus.cc:2396] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260812 19:25:34.064152  6482 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260812 19:25:34.064996 18962 consensus_queue.cc:1046] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260812 19:25:34.066200 19093 raft_consensus.cc:3032] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Stepping down as leader of term 22
I20260812 19:25:34.066548 19093 raft_consensus.cc:729] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:34.067431 19093 consensus_queue.cc:260] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:34.068539 19093 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:34.073770 18991 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:34.049642 19153 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:34.081000  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:34.082587 19153 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:34.050374 18976 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:34.088650 17622 raft_consensus.cc:3032] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Stepping down as leader of term 24
I20260812 19:25:34.089131 17622 raft_consensus.cc:729] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:34.088769  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:34.054502 19312 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:34.093099  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:34.094854 18882 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 19:25:34.098757 19312 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:34.101361 18959 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:34.047346 19045 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260812 19:25:34.053157 19096 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260812 19:25:34.090703 18976 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:34.093473  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:34.108094  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:34.110038  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:34.112965  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:34.113652  6345 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
I20260812 19:25:34.114459  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:34.115305  6232 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260812 19:25:34.116576 18959 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:34.111541 18984 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:34.117672 18984 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:34.118074 18984 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:34.091322 17622 consensus_queue.cc:260] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.120987 17622 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:34.093952 18394 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:34.128224  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:34.124769  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:34.131747  6235 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:34.131907 19334 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:34.160455 19334 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.177614 19018 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.166456  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:34.213858  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47487.4us
I20260812 19:25:34.180013 19334 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:34.182986 19311 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:34.188766 19310 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.192543  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:34.193001  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:34.194101  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:34.119328 19096 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election won for term 24
I20260812 19:25:34.195684  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:34.196586  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:34.038343 19333 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:34.200090  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 58957.7us
I20260812 19:25:34.199003  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:34.198954  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:34.224525 19093 consensus_queue.cc:1046] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:25:34.229700  6242 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 23. Current term is 24. Ops: []
I20260812 19:25:34.229389 19350 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.219548 18394 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:34.236495  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:34.239194 19310 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:34.249702  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:34.259986 17622 consensus_queue.cc:1046] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260812 19:25:34.254751  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:34.132043 19059 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.260928  6465 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 25: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:34.202747 19314 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:34.261677  6235 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 25.
I20260812 19:25:34.161211 18879 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.273444  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:34.273706  6482 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:34.279248  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:34.280558  6353 raft_consensus.cc:2396] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260812 19:25:34.254184 19096 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:34.287379  6230 raft_consensus.cc:1226] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260812 19:25:34.287186  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:34.276301 19314 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:34.299528  6349 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 21: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:34.298077  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:34.300585  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:34.301204  6481 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:34.312631  6350 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
I20260812 19:25:34.293641 19310 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:34.296587 19332 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:34.310930 18991 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:34.318212 18991 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:34.317718 19096 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.319857 19314 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:34.323357  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:34.328047  6242 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:34.328186  6482 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:34.330394  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:34.323521 18991 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:34.339238 17622 raft_consensus.cc:3032] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:34.342085 17622 raft_consensus.cc:729] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:34.342978 17622 consensus_queue.cc:260] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.344178 17622 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:34.348726  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:34.333081 18962 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:34.323858 19310 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:34.340907 18360 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.030s	sys 0.028s
I20260812 19:25:34.346840 19034 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:34.335072 18959 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260812 19:25:34.349010 19018 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:34.351199 19045 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260812 19:25:34.381048  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:34.367400 18360 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.033s	sys 0.029s
I20260812 19:25:34.338946 19312 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:34.364651 19375 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.075s	sys 0.082s
I20260812 19:25:34.394804 19358 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:34.366089 18962 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:34.458926  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 77958.6us
I20260812 19:25:34.396090 19120 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:34.467013  6359 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 23. Current term is 24. Ops: []
W20260812 19:25:34.465629 19375 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.075s	sys 0.082s
I20260812 19:25:34.406217 18394 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:34.518697 19310 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:34.471731 18962 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:34.402808 19093 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.105s
W20260812 19:25:34.468941 19388 log.cc:924] Time spent T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260812 19:25:34.396975 19332 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260812 19:25:34.406884 19350 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:34.470068 19059 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:34.470314 19034 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:34.510245 19312 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:34.405794 18959 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.109s
I20260812 19:25:34.500430 19326 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:34.513118 18879 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:34.521831 19333 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:34.531054 19384 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260812 19:25:34.468312 19358 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.503639 19120 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:34.567800  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica a1541d11be514114966dc1e92a345298 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:25:34.571645 19042 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.001s	sys 0.040s
W20260812 19:25:34.573272  6416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.019s	sys 0.019s
W20260812 19:25:34.598085  6416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.021s	sys 0.021s
W20260812 19:25:34.598554  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 310965us
W20260812 19:25:34.599025  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 581625us
I20260812 19:25:34.600986  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:34.606426  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:34.591507 19042 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.001s	sys 0.041s
I20260812 19:25:34.612910  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:34.618705  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 7e0797ad50cb46cfb10b4a38cc815917, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:34.619216  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 7e0797ad50cb46cfb10b4a38cc815917, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.620599  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:34.621277  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:34.620368  6342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3135) took 1005 ms. Trace:
I20260812 19:25:34.611117 19261 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:34.632189  6350 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "a1541d11be514114966dc1e92a345298"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:34.633330  6350 raft_consensus.cc:595] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Received request to transfer leadership to TS a1541d11be514114966dc1e92a345298
I20260812 19:25:34.633859  6350 raft_consensus.cc:603] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260812 19:25:34.615955 19389 log.cc:924] Time spent T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.051s	user 0.001s	sys 0.001s
I20260812 19:25:34.625515  6342 rpcz_store.cc:276] 0812 19:25:33.615334 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:33.615515 (+   181us) service_pool.cc:227] Handling call
0812 19:25:33.616006 (+   491us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:33.631359 (+ 15353us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:33.631400 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:33.631964 (+   564us) log.cc:842] Serialized 26 byte log entry
0812 19:25:33.945212 (+313248us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:33.945257 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:33.945323 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:34.620131 (+674808us) raft_consensus.cc:1671] finished
0812 19:25:34.620176 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:34.620307 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14852,"raft.queue_time_us":16090,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":312232,"threads_started":1,"wal-append.queue_time_us":627083}
W20260812 19:25:34.637863  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
W20260812 19:25:34.639945  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 82ee24e5b3dd4df3bd9647d68d3ced5e, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:34.616658 19333 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:34.645342 19096 raft_consensus.cc:3032] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Stepping down as leader of term 22
I20260812 19:25:34.619344 18879 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260812 19:25:34.670218  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:25:34.671645  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:34.672221  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 6454eb944afe4306b52388febd0f82bb, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.632582 19310 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:34.684361  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:34.685201  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:34.689174  6235 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:34.655458 19042 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:34.632707 18846 consensus_queue.cc:1035] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260812 19:25:34.690460  6230 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 22: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:34.682288 19310 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:34.695564 19310 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
W20260812 19:25:34.696264 19403 log.cc:924] Time spent T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260812 19:25:34.697805 19390 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260812 19:25:34.701502  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:34.664086 19096 raft_consensus.cc:729] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:34.715132 19358 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:34.702821 19375 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:34.715617 19096 consensus_queue.cc:260] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.717003 19120 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:34.676332 19333 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.718413  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:34.719396 19333 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:34.709578  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:34.703114 19042 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.722250  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:34.723668  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:34.709861  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:34.715947 19375 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.727443  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:34.725976  6465 raft_consensus.cc:1226] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 23. Current term is 24. Ops: []
I20260812 19:25:34.713655  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:34.728108  6477 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260812 19:25:34.728598  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:34.729429  6342 raft_consensus.cc:595] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:34.729692  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:34.728864  6235 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:34.731040  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:34.731863  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:34.732301  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 263627us
I20260812 19:25:34.733362  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:34.735635  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:34.736617  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:34.736797  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:34.738319  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:25:34.741115  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 238491us
I20260812 19:25:34.738567  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:34.720089 18984 consensus_meta.cc:287] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.007s
I20260812 19:25:34.745369  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:34.745700  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:34.746344  6353 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:34.747352  6235 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 23. Current term is 24. Ops: []
I20260812 19:25:34.747778  6342 raft_consensus.cc:2396] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260812 19:25:34.748659  6230 raft_consensus.cc:1226] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
W20260812 19:25:34.722918 18976 consensus_meta.cc:287] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.619s	user 0.014s	sys 0.000s
I20260812 19:25:34.750291  6224 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:34.752017  6465 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260812 19:25:34.717037 19096 raft_consensus.cc:3037] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
W20260812 19:25:34.759860  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet b6ca6db9aa4e4bdd829dc087e97096a0, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:34.760303  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet b6ca6db9aa4e4bdd829dc087e97096a0, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.757948  6235 raft_consensus.cc:3032] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Stepping down as leader of term 23
I20260812 19:25:34.761215  6235 raft_consensus.cc:729] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:34.762373  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:34.761940  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:34.779771  6235 consensus_queue.cc:260] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.788117  6235 raft_consensus.cc:3037] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:34.796860  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:34.780344 19153 consensus_meta.cc:287] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.697s	user 0.004s	sys 0.010s
I20260812 19:25:34.803081  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:34.803758  6342 raft_consensus.cc:595] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:34.802170  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:34.745231 19333 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:34.813234  6235 raft_consensus.cc:1261] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260812 19:25:34.815099  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:34.815459  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:34.823606  6474 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 21: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:34.824183 19420 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260812 19:25:34.757326 18984 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.816349  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:34.826627 18984 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:34.817910  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:34.828543  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:34.829272  6475 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:34.830035 18879 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:34.818840 19332 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260812 19:25:34.821439 18394 consensus_queue.cc:1046] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260812 19:25:34.821869 19093 raft_consensus.cc:979] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: : Instructing follower bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:25:34.832005 19093 raft_consensus.cc:3032] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Stepping down as leader of term 22
I20260812 19:25:34.832072 18394 raft_consensus.cc:1067] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Signalling peer bdfa5579d4534c618c00db6b4a841c81 to start an election
I20260812 19:25:34.832459 19093 raft_consensus.cc:729] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:34.833300 19093 consensus_queue.cc:260] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.821985  6342 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0"
dest_uuid: "54f83319db6b49929cc8f18a66a66975"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:49464
I20260812 19:25:34.834944  6342 raft_consensus.cc:595] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:34.835381  6342 raft_consensus.cc:603] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:34.838570  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:34.794013 19045 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260812 19:25:34.840871  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 157088us
I20260812 19:25:34.842810  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:34.846203  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260812 19:25:34.845333  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:34.851567  6230 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260812 19:25:34.854079  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:25:34.855050  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:34.857496  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:34.864158  6474 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b"
dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:38150
I20260812 19:25:34.864813  6474 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:25:34.865198  6474 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:34.806128 19375 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:34.758553 18976 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.846971 19045 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:34.846771 18984 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:34.907485  6464 raft_consensus.cc:1226] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:34.879375 19332 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:34.836417 19333 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:34.888854 19297 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260812 19:25:34.930963  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 100642us
I20260812 19:25:34.835570 19153 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.938598  6474 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.913463 19045 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:34.926973 18879 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:34.946983  6474 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:34.893537 19093 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:34.928095 19332 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:34.913031 18984 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:34.941037 19312 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:25:34.982577  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 77696.8us
I20260812 19:25:34.972736 19416 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:34.968981 19429 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.038s
I20260812 19:25:34.982105 19421 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:34.936872 18959 consensus_queue.cc:1035] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260812 19:25:34.930334 19279 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260812 19:25:34.975782 19332 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:35.023044  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:35.024507  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:25:35.025192 18991 consensus_meta.cc:287] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.671s	user 0.003s	sys 0.007s
I20260812 19:25:35.025417  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:35.025652 18991 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.026484  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:35.027451  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:35.027602  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:35.028309  6342 raft_consensus.cc:2379] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 21: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:35.029785 19333 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:35.030270  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:35.031261  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:35.025431  6353 raft_consensus.cc:2396] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
W20260812 19:25:35.033025 19423 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260812 19:25:35.033157  6347 raft_consensus.cc:1226] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 23. Current term is 24. Ops: []
I20260812 19:25:35.044291 18879 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.015957  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.050899  6230 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260812 19:25:34.982007 18394 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:34.993793 19042 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:35.059085  6230 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 23. Current term is 24. Ops: []
I20260812 19:25:35.067571  6473 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260812 19:25:35.068112  6473 pending_rounds.cc:76] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 12
I20260812 19:25:35.068377  6473 pending_rounds.cc:97] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260812 19:25:35.068650  6473 raft_consensus.cc:2866] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:35.068678  6475 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:34.998988 19420 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:35.050530 19446 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260812 19:25:35.087191 19438 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260812 19:25:34.997977 19416 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.093377 19334 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Stepping down as leader of term 23
I20260812 19:25:35.093822 19334 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:34.997756 19312 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.095868  6352 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 24.
W20260812 19:25:35.111505 19434 log.cc:924] Time spent T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260812 19:25:35.114081 19127 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:35.114696 19127 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.094607 19334 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.132531 18882 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:35.133123 18882 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:35.004549 19421 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.125896 19334 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
W20260812 19:25:35.147286  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 199698us
I20260812 19:25:35.070721 18394 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:35.128648 18976 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:35.164148 18882 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.180238 18882 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:35.182210 18991 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:35.145813 19446 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260812 19:25:35.082116 19419 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.065s
I20260812 19:25:35.091002 19420 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:35.197206  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 162932us
I20260812 19:25:35.216444  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:35.225944  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:35.238848 19441 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:35.239471 19441 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:35.239846 19441 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:35.239908 19421 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:35.241905  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.244232  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:35.246881  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:35.260691  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:35.260946  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:35.261881  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:35.262207  6342 raft_consensus.cc:3032] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:35.262706  6342 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:35.267168 17622 consensus_queue.cc:1046] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260812 19:25:35.239061 19450 log.cc:924] Time spent T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260812 19:25:35.283871  6473 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:35.272783  6475 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:35.272964  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.275498  6464 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:35.275730  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:35.277834  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:35.278441  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:35.279835  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:35.288107  6236 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:35.280165  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:35.289103  6228 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 23: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:35.290753  6349 raft_consensus.cc:1226] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:35.290917  6235 raft_consensus.cc:2396] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 26 because replica has last-logged OpId of term: 24 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 9.
I20260812 19:25:35.294370  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:35.295352  6241 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 23: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:35.274073  6342 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.298296  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:35.298604  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:35.300691  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:35.301038  6238 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 21: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:35.301380  6230 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:35.304888  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:35.305097  6349 raft_consensus.cc:1226] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:35.293277  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:35.308074  6342 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:35.309572  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:35.300176  6236 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:35.259130 19153 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:35.317095 19127 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:35.320426 17916 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:35.323936 18984 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:35.324570 19120 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260812 19:25:35.328171  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:35.298830 19419 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:35.269122 18394 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:35.343206 17622 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:35.347774 17622 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.355620 17622 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:35.338469 19096 consensus_meta.cc:287] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.542s	user 0.014s	sys 0.001s
I20260812 19:25:35.284757 19421 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260812 19:25:35.361883  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:35.362845  6236 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 25.
I20260812 19:25:35.376470  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.380941  6350 raft_consensus.cc:2396] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
W20260812 19:25:35.358428 18962 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.828s	user 0.022s	sys 0.000s
I20260812 19:25:35.342888 19120 consensus_queue.cc:1046] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260812 19:25:35.378804 18991 consensus_queue.cc:1046] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260812 19:25:35.392752 19420 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:35.393728 19312 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:35.399916 19455 log.cc:924] Time spent T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260812 19:25:35.390174  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:35.407433 18985 raft_consensus.cc:3032] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Stepping down as leader of term 19
I20260812 19:25:35.408035 18985 raft_consensus.cc:729] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:35.411091 19045 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.412249  6224 raft_consensus.cc:1226] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:35.415397 19096 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
W20260812 19:25:35.421702 19310 consensus_meta.cc:287] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.726s	user 0.008s	sys 0.012s
I20260812 19:25:35.422236 19310 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.423728  6470 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:35.425329 19311 raft_consensus.cc:3032] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:35.425690 19311 raft_consensus.cc:729] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:35.426519 19311 consensus_queue.cc:260] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.388834  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:35.385427  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:35.428063 19045 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:35.432809  6474 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:35.429060 19332 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.426934 19441 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.378140 19416 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:35.471813  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 81719.2us
I20260812 19:25:35.473765  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.476112  6347 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:35.477837  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:35.481583  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:35.481966  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 209091us
I20260812 19:25:35.482852  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:35.485885  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 186438us
I20260812 19:25:35.488162  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:35.468003 19045 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:35.489871  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:35.489189  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 206879us
I20260812 19:25:35.491293 17622 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:35.492997  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:35.493306 17622 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.493660  6464 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:35.476807 19436 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:35.490558  6474 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:35.435938 18962 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.496482 19127 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:35.496905  6352 raft_consensus.cc:1261] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260812 19:25:35.497457  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:35.481369 19279 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:35.500190  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.503180  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.488023 19416 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260812 19:25:35.507705 17622 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:35.512615 19416 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:35.516492 19416 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:35.512737 19449 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260812 19:25:35.521788 18959 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:35.493964 19045 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.524703 19045 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:35.522818  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:35.526057 17622 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:35.526561 17622 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:35.528504 17622 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:35.528991 17622 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:35.529306 17622 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:35.529629 17622 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:35.531477 19473 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:35.534963  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:35.539456 19332 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:35.539618  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:35.540308  6242 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:35.535018 19310 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:35.533485  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.536602  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:35.548448 19441 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:35.550566 19461 consensus_queue.cc:1046] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260812 19:25:35.552241 19473 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:35.552445 19453 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:35.552755  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:35.553431 19370 raft_consensus.cc:3032] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Stepping down as leader of term 23
I20260812 19:25:35.553820 19370 raft_consensus.cc:729] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:35.554770 19081 raft_consensus.cc:3032] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Stepping down as leader of term 22
I20260812 19:25:35.555147 19081 raft_consensus.cc:729] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:35.555213  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:35.555977 19081 consensus_queue.cc:260] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.553678  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.557214 19081 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:35.557734 19045 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:35.560819 19442 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:35.561971 18985 consensus_queue.cc:260] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.564765  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:35.564842 18985 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:35.558624  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:35.566681 19464 consensus_queue.cc:1035] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260812 19:25:35.567456 19420 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:35.567894 19420 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:35.568463 19420 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:35.568617 19120 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:35.570159 19311 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:35.566967  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.572013  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:35.572928  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:35.573225  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:35.498327 19436 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:35.574198 19436 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:35.574707 19120 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:35.574450  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:35.497762 19470 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:35.576298  6354 raft_consensus.cc:2396] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for term 26 because replica has last-logged OpId of term: 24 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 9.
I20260812 19:25:35.576644  6298 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:35.577005 19153 consensus_queue.cc:1046] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 19:25:35.577777 19279 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:35.578713 19473 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:35.578898 19045 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:35.583269 19370 consensus_queue.cc:260] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.585355  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:35.591473  6475 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:35.591984  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.594619 18991 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 19:25:35.595659 19471 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:35.591109 19153 raft_consensus.cc:3032] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:35.596787 19153 raft_consensus.cc:729] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:35.597577 19445 raft_consensus.cc:3032] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:35.598119 19445 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:35.597648 19153 consensus_queue.cc:260] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.598941 19445 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.586002 19370 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:35.599485  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:35.600435 19445 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:35.602007 19471 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:35.586334  6464 raft_consensus.cc:1226] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:35.584501  6477 raft_consensus.cc:1226] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 19. Current term is 20. Ops: []
I20260812 19:25:35.604769 19153 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:35.606263  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.567922 18962 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:35.589013  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:35.575287 19120 raft_consensus.cc:686] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:35.608516 19120 consensus_queue.cc:237] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.613883  6475 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:35.614702  6224 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 25.
I20260812 19:25:35.615522 19416 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.616103  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:35.614996  6342 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:35.617344 17622 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.618018  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:35.628844  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 48691.2us
I20260812 19:25:35.629480  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.631502  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:35.633039  6475 raft_consensus.cc:2379] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 23: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:35.633478  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.635699  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:35.646842  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:35.647545  6475 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260812 19:25:35.648124  6298 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:35.648411  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:35.649161  6342 raft_consensus.cc:2379] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 23: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:35.649847  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:35.650482 17622 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:35.653355  6481 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 25: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:35.653903  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:35.655117  6477 raft_consensus.cc:2354] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22.
W20260812 19:25:35.639117 19093 consensus_meta.cc:287] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.681s	user 0.013s	sys 0.007s
I20260812 19:25:35.619061 19471 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260812 19:25:35.630345 19045 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:35.668785  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:35.669606  6464 raft_consensus.cc:2379] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 23: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:35.654556 19446 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:35.670823  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:35.671512  6464 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 24.
I20260812 19:25:35.673110  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:35.674237  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:35.674688  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:35.675534  6477 raft_consensus.cc:2379] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 22: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:35.658438  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:35.677603 19045 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:35.677999 19045 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:35.678318 19045 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:35.679626  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:35.656011  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:35.682587  6465 raft_consensus.cc:2379] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 20: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:35.658867  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:35.635305 18991 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader election won for term 25
I20260812 19:25:35.645006 19470 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:35.680183  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:35.692279  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:35.695168  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:35.695140  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:35.701328  6241 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260812 19:25:35.703261  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:35.713712  6228 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:35.700814  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:35.705829  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:35.645774 19473 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:35.712668  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:35.716814  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:35.690415  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:35.715464  6352 raft_consensus.cc:3037] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:35.718053  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:35.718598 17622 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:35.721913 17622 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:35.722636 17622 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.720563  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:35.724329  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:25:35.711588 18882 consensus_meta.cc:287] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.531s	user 0.004s	sys 0.007s
I20260812 19:25:35.725808  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:35.739447  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.739423  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:35.728173 18991 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 25 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:35.744132 19127 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:35.744860 18991 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 24.10, Last appended by leader: 10, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.728061 19326 consensus_queue.cc:1046] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260812 19:25:35.746773  6055 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 19 to 22, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 22 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:35.721619 19452 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260812 19:25:35.752846 19416 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:35.717999 19096 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:35.734550 18879 consensus_queue.cc:1046] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260812 19:25:35.754422 18879 raft_consensus.cc:3032] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 LEADER]: Stepping down as leader of term 22
I20260812 19:25:35.754796 18879 raft_consensus.cc:729] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:35.755592 18879 consensus_queue.cc:260] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.756807 18879 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:35.760700  6353 raft_consensus.cc:1226] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:35.748325 19326 raft_consensus.cc:3032] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:35.761444 19326 raft_consensus.cc:729] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:35.762349 19326 consensus_queue.cc:260] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.763602 19326 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:35.721206 19441 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:35.717373 19471 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.053s
I20260812 19:25:35.771380 19471 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Stepping down as leader of term 22
I20260812 19:25:35.771760 19471 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:35.772485 19471 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.773630 19471 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:35.780000  6345 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
W20260812 19:25:35.782832  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 59693.2us
I20260812 19:25:35.783536  6228 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
I20260812 19:25:35.784430  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:35.785175  6359 raft_consensus.cc:2454] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 23.
I20260812 19:25:35.785192  6481 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Advancing to term 26
W20260812 19:25:35.789088  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 49719.4us
I20260812 19:25:35.787560  6477 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 19.
I20260812 19:25:35.797046 19045 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.792896  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:35.813692  6224 raft_consensus.cc:3037] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:35.818708  6352 raft_consensus.cc:2454] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
W20260812 19:25:35.829867  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 47274.5us
I20260812 19:25:35.830308  6481 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 26.
I20260812 19:25:35.827941  6347 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:35.807217  6055 catalog_manager.cc:5495] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 19 to 21, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 21 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260812 19:25:35.837936  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47815.1us
I20260812 19:25:35.840997  6178 leader_election.cc:398] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22.
I20260812 19:25:35.841374  6178 leader_election.cc:401] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
W20260812 19:25:35.846756  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 59566.7us
I20260812 19:25:35.807724 19359 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260812 19:25:35.850484  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.852296  6297 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:35.858326  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.867085  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.873389  6224 raft_consensus.cc:2454] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 26.
I20260812 19:25:35.882193  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.847390 19461 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 21. Current term is 22.
I20260812 19:25:35.887547  6178 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.888839  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:35.886238  6416 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:35.890691  6416 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:35.884420  6055 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 18 to 20, leader changed from f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:35.886811 19419 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:35.899986 19034 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:35.901444 19442 raft_consensus.cc:2781] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:35.902043 19442 raft_consensus.cc:686] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 23 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:35.885174 19470 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:35.902987 19442 consensus_queue.cc:237] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.903635 19045 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:35.866715 19018 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:35.909828  6055 catalog_manager.cc:5495] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:35.911540  6055 catalog_manager.cc:5495] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:35.855726 19422 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260812 19:25:35.863565 19093 raft_consensus.cc:2781] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election won for term 26
W20260812 19:25:35.928251 19484 log.cc:924] Time spent T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260812 19:25:35.930404  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:35.936792  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.941190 19452 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:35.952307 19453 raft_consensus.cc:2781] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:35.953050 19453 raft_consensus.cc:686] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 22 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:35.958904  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:35.959705  6481 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:35.965381  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:35.941913 19452 raft_consensus.cc:686] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:35.968771  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:35.954020 19453 consensus_queue.cc:237] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.980659  6481 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 25.
I20260812 19:25:35.997126 19034 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:35.977540 19311 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260812 19:25:35.998445 19034 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:35.964087 19093 raft_consensus.cc:686] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:35.966639 19056 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:36.007817 19153 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260812 19:25:36.030936  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 65666us
I20260812 19:25:36.041555 19312 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260812 19:25:36.043648  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:36.047461  6470 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:25:36.053229  6178 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:36.060240  6178 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:36.065953  6350 raft_consensus.cc:1226] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 23. Current term is 24. Ops: []
I20260812 19:25:36.057097 19497 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260812 19:25:36.035040 19436 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:36.076839 19312 consensus_queue.cc:1046] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260812 19:25:36.295882 19312 raft_consensus.cc:3032] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Stepping down as leader of term 23
I20260812 19:25:36.296309 19312 raft_consensus.cc:729] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:36.297106 19436 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:36.069643 19359 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader election won for term 25
I20260812 19:25:36.299196  6347 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 25: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:36.029645 19452 consensus_queue.cc:237] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:36.081831 19093 consensus_queue.cc:237] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:36.225690 19502 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.228s	user 0.002s	sys 0.000s
I20260812 19:25:36.067826 19045 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader election won for term 19
W20260812 19:25:36.292445  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 207440us
W20260812 19:25:36.274452 19420 consensus_meta.cc:287] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.705s	user 0.012s	sys 0.000s
I20260812 19:25:36.322404  6481 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 22 index: 9. Preceding OpId from leader: term: 25 index: 11. (index mismatch)
I20260812 19:25:36.326108  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:36.304206 18991 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:36.007090  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260812 19:25:36.312001 18879 consensus_meta.cc:287] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.009s
I20260812 19:25:36.361181 17622 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 19:25:36.367967  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:36.315413 19359 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 25 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:36.319286 19045 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:36.376466  6474 raft_consensus.cc:2379] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 25: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:36.382419  6228 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 24 index: 10. Preceding OpId from leader: term: 25 index: 11. (index mismatch)
I20260812 19:25:36.347807 19461 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:36.297135 19312 consensus_queue.cc:260] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:36.325582 19420 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:36.388746 19471 consensus_meta.cc:287] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.615s	user 0.015s	sys 0.000s
I20260812 19:25:36.405437  6474 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260812 19:25:36.408144 17622 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260812 19:25:36.411950  6228 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260812 19:25:36.353427 18991 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:36.415249  6224 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260812 19:25:36.426403  6352 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:36.431113 18846 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 19:25:36.392603 19445 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260812 19:25:36.451978  6235 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260812 19:25:36.395619 19461 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:36.447053 19045 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:36.463627 19439 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:25:36.480485  6353 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260812 19:25:36.491698  6359 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260812 19:25:36.499503  6235 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260812 19:25:36.508603  6235 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2"
dest_uuid: "a1541d11be514114966dc1e92a345298"
mode: GRACEFUL
new_leader_uuid: "bdfa5579d4534c618c00db6b4a841c81"
 from {username='slave'} at 127.0.0.1:42218
I20260812 19:25:36.509486  6235 raft_consensus.cc:595] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Received request to transfer leadership to TS bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:36.509933  6235 raft_consensus.cc:603] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:36.513577  6235 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72"
dest_uuid: "a1541d11be514114966dc1e92a345298"
mode: GRACEFUL
new_leader_uuid: "54f83319db6b49929cc8f18a66a66975"
 from {username='slave'} at 127.0.0.1:42218
I20260812 19:25:36.516743  6235 raft_consensus.cc:595] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Received request to transfer leadership to TS 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:36.517387  6235 raft_consensus.cc:603] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260812 19:25:36.532646  6224 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260812 19:25:36.540700  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 83581.5us
I20260812 19:25:36.541999  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:36.543717  6353 raft_consensus.cc:1261] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260812 19:25:36.496809 19056 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:36.438316 19359 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:36.546379  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260812 19:25:36.550153 18879 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260812 19:25:36.551111 19492 log.cc:924] Time spent T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.623s	user 0.005s	sys 0.002s
W20260812 19:25:36.552356  6417 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2661573faf994c8f9bb837f55af974d9. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:36.552821  6417 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 52015.3us
I20260812 19:25:36.553392 19519 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260812 19:25:36.578704  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:36.579751  6232 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:36.581705  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:36.583197 19517 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:36.583766 19517 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:36.584247 19517 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:36.548447 19515 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260812 19:25:36.594122 19461 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:36.563380 19420 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:36.596021 18991 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:36.597031 19510 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260812 19:25:36.598675 19507 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260812 19:25:36.600503  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:36.601215  6474 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:36.601691  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:36.555092 18846 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260812 19:25:36.602753 19120 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:36.603556 19120 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:36.604377 19505 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.245s	user 0.001s	sys 0.001s
I20260812 19:25:36.540584 19509 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
W20260812 19:25:36.613957  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 66032.3us
I20260812 19:25:36.615307  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:36.617748  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 68515.1us
I20260812 19:25:36.623576  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:36.624502  6350 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:36.646368  6353 raft_consensus.cc:1261] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260812 19:25:36.646627  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:36.668915  6473 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260812 19:25:36.666448  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:36.669796  6465 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 22: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:36.620554 19375 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:36.647930 19445 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:36.670358 19127 consensus_queue.cc:1035] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260812 19:25:36.646126 19439 consensus_queue.cc:1035] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260812 19:25:36.688669 19531 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260812 19:25:36.685806 19042 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:36.716284  6359 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260812 19:25:36.712579 19042 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:36.724736 19042 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:36.727931 19056 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260812 19:25:36.728813 19120 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:36.678097 19375 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:36.737922  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:36.738900  6349 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 24.
I20260812 19:25:36.743247  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:36.767076 17622 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:36.767932 17622 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:36.750756 19445 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:36.779062  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:36.758697 19120 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:36.798563  6232 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 24: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:36.800022 17622 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:36.802693  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:36.873312  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:36.755873 19326 consensus_queue.cc:1046] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260812 19:25:36.798614 19120 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:36.894887 19120 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
W20260812 19:25:36.879634 19541 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260812 19:25:36.805661 19445 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:36.947008  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 70382.7us
I20260812 19:25:36.913092 19517 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:36.951015  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 150043us
I20260812 19:25:36.950263 19375 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:36.969873  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:36.976372  6477 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:36.983625  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:36.996745  6349 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260812 19:25:36.967283 19570 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:36.988092 19081 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:37.014951 19081 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:25:37.042874  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 47872.3us
I20260812 19:25:37.015553 19570 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.055927 19570 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.049609 19081 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:37.061971  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:37.062770  6477 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:37.064334  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:37.065191 19570 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:37.065577 19570 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:37.065908 19570 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
W20260812 19:25:37.067428 19555 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260812 19:25:37.069422 19556 log.cc:924] Time spent T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260812 19:25:37.071620 19565 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:37.072203 19565 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:37.058749 19543 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260812 19:25:37.077555  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:37.078238  6477 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:37.086479  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:37.092784  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:37.148746  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 61565.9us
W20260812 19:25:37.179582  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 95186.8us
I20260812 19:25:37.200532 19582 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:37.201198 19582 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.205339 19573 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:37.206159 19573 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:37.206617 19573 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:37.207062 19573 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:37.209309 19349 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:37.209959 19349 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:37.222069  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 68862us
I20260812 19:25:37.015017 19572 consensus_queue.cc:1046] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.145s
I20260812 19:25:37.057928 19042 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:37.152312 19505 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260812 19:25:37.086468 19445 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.217971 19081 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.192260 19528 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:37.440572 19565 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:37.448427 19445 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:37.452276 19564 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:37.476295 19536 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:37.474869 19517 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.459558 19528 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.497465 19536 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:37.504352 19528 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:37.505970 19536 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:37.499456 19582 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.480641 19564 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.510044 19573 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.502537 19570 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.512274 19573 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.513463 19570 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.514916 19564 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:37.550992  6224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3744) took 1008 ms. Trace:
W20260812 19:25:37.551514  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 474156us
I20260812 19:25:37.552222  6224 rpcz_store.cc:276] 0812 19:25:36.541987 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:36.542135 (+   148us) service_pool.cc:227] Handling call
0812 19:25:36.542458 (+   323us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:36.546265 (+  3807us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:36.546300 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:36.546871 (+   571us) log.cc:842] Serialized 26 byte log entry
0812 19:25:36.957924 (+411053us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b1800384d60. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f483e345 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98f73f95bb 00007f98f73ff063 00007f98f73ff411 00007f98f774c5cf
0812 19:25:37.022149 (+ 64225us) raft_consensus.cc:1631] Marking committed up to 10
0812 19:25:37.022193 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:37.022267 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:37.549535 (+527268us) raft_consensus.cc:1671] finished
0812 19:25:37.549644 (+   109us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:37.550428 (+   784us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3400,"raft.queue_time_us":4158,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3567,"spinlock_wait_cycles":3153792,"thread_start_us":53089,"threads_started":1,"wal-append.queue_time_us":894295}
W20260812 19:25:37.555348  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 462485us
W20260812 19:25:37.563112  6415 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.008s	sys 0.024s
W20260812 19:25:37.563742  6415 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.008s	sys 0.025s
I20260812 19:25:37.585292 19056 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:37.586007  6417 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.018s	sys 0.018s
W20260812 19:25:37.586496  6417 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.018s	sys 0.018s
I20260812 19:25:37.590158 19042 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.590767 19056 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.594482  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:37.596169  6235 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:37.599083 19056 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:37.602623 19120 consensus_meta.cc:287] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.002s
I20260812 19:25:37.603302 19120 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.603924 19081 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.604859 19081 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:37.605741 19081 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.606588 19120 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:37.607440  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:37.608405  6242 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:37.608587 19081 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.609395 19081 raft_consensus.cc:482] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:37.609630  6229 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260812 19:25:37.609836  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:37.610117 19081 raft_consensus.cc:504] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:37.610834  6228 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:37.611182  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:37.612310  6235 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:37.481281 19445 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:37.614864  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:37.617542  6230 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:37.620596 19445 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:37.645074 19473 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:37.646113 19473 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.647248  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:37.647967  6230 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:37.649101 19473 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.658078 19604 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:37.659212 19604 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.662169 19604 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.664455  6465 raft_consensus.cc:1261] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260812 19:25:37.665298  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:37.666218  6232 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:37.666515  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:37.667606  6481 raft_consensus.cc:3037] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:37.646153 19612 raft_consensus.cc:482] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:37.670203 19598 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:37.671206 19598 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.671211 19612 raft_consensus.cc:504] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:37.674769 19598 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:37.678215 19573 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:37.679239 19573 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.680122  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:37.680194  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:37.680948  6477 raft_consensus.cc:3037] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:37.681169  6470 raft_consensus.cc:3037] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:37.682139 19573 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.687175  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:37.683182 19349 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.696967  6465 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:37.686213  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:37.705924  6238 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
W20260812 19:25:37.708791  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 53469.4us
I20260812 19:25:37.655196 19081 leader_election.cc:288] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:37.720384  6242 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
W20260812 19:25:37.746404  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 97378.7us
I20260812 19:25:37.734536 19612 leader_election.cc:288] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:37.707654 19598 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:37.754681 19598 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.770597  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:37.771703  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:37.775252 19612 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:37.775364 19312 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:37.783625  6230 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:37.784523  6477 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 25.
I20260812 19:25:37.788671  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:37.777979 19598 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:37.778900 19468 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:37.793702  6475 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:37.795372  6470 raft_consensus.cc:2454] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:37.795892  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:37.797309 19468 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.801245 19468 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:37.806067  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:25:37.809445  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:37.810542  6350 raft_consensus.cc:2379] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 22: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:37.815539  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:37.816612  6473 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:37.819619  6242 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260812 19:25:37.821163  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:37.822325  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:25:37.822471  6047 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 199) took 26970 ms (client timeout 15000 ms). Trace:
I20260812 19:25:37.831302 19508 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:37.832346 19508 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.835458 19508 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:37.827332 19452 raft_consensus.cc:2932] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:25:37.849261  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:37.861174  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe2a7dc98f92406fbf459b7c9d812bf7" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:37.859716  6352 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:37.818118 19612 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.870141  6474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38150 (request call id 3702) took 1254 ms. Trace:
I20260812 19:25:37.862282  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:37.880995  6347 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
W20260812 19:25:37.823024  6047 rpcz_store.cc:269] 0812 19:25:10.851937 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:10.852247 (+   310us) service_pool.cc:227] Handling call
0812 19:25:37.822105 (+26969858us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:29.401437 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:29.567089 (+165652us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:29.567143 (+    54us) write_op.cc:435] Acquired schema lock
0812 19:25:29.567167 (+    24us) tablet.cc:660] Decoding operations
0812 19:25:29.792414 (+225247us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:29.792483 (+    69us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:29.792520 (+    37us) tablet.cc:683] Acquiring locks for 27 operations
0812 19:25:29.805427 (+ 12907us) tablet.cc:699] Row locks acquired
0812 19:25:29.805457 (+    30us) write_op.cc:260] PREPARE: finished
0812 19:25:29.805636 (+   179us) write_op.cc:270] Start()
0812 19:25:29.805770 (+   134us) write_op.cc:276] Timestamp: P: 1786562729805579 usec, L: 0
0812 19:25:29.805793 (+    23us) op_driver.cc:331] REPLICATION: starting
0812 19:25:29.806615 (+   822us) log.cc:842] Serialized 10459 byte log entry
0812 19:25:31.124415 (+1317800us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b1800377440. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c638 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:25:32.527389 (+1402974us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:25:33.020388 (+492999us) op_driver.cc:444] REPLICATION: finished
0812 19:25:33.807772 (+787384us) write_op.cc:301] APPLY: starting
0812 19:25:33.807873 (+   101us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:34.164617 (+356744us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:34.164647 (+    30us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:35.036404 (+871757us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:35.036779 (+   375us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=0,mrs_lookups=0
0812 19:25:35.036830 (+    51us) write_op.cc:312] APPLY: finished
0812 19:25:35.037435 (+   605us) log.cc:842] Serialized 236 byte log entry
0812 19:25:35.387524 (+350089us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:35.394975 (+  7451us) write_op.cc:454] Released schema lock
0812 19:25:35.395076 (+   101us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:35.395472 (+   396us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:35.395517 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18226,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":733190,"apply.run_cpu_time_us":131426,"apply.run_wall_time_us":1588564,"cfile_cache_hit":110,"cfile_cache_hit_bytes":117149,"num_ops":27,"prepare.queue_time_us":119856,"prepare.run_cpu_time_us":10638,"prepare.run_wall_time_us":533636,"raft.queue_time_us":510675,"raft.run_cpu_time_us":127389,"raft.run_wall_time_us":1036422,"replication_time_us":3170367,"spinlock_wait_cycles":61259008,"thread_start_us":1600406,"threads_started":6,"wal-append.queue_time_us":555135,"wal-append.run_cpu_time_us":47041,"wal-append.run_wall_time_us":2815993}]]}
I20260812 19:25:37.897390 19564 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:37.898674 19564 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:37.871969 19120 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:37.904496 19120 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.907230 19627 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:37.908041 19627 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:37.902297 19564 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:37.914887  6475 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:37.913185 19312 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:37.918437  6345 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:37.919620  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:37.920320 19120 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:37.921731 19612 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.922427 19600 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:37.923169 19600 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:37.924458 19546 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 1.142s	user 0.013s	sys 0.000s
I20260812 19:25:37.925545 19600 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.926182 19034 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:37.926744 19034 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.927233  6353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3187) took 1240 ms. Trace:
I20260812 19:25:37.927594  6353 rpcz_store.cc:276] 0812 19:25:36.686865 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:36.687003 (+   138us) service_pool.cc:227] Handling call
0812 19:25:36.689137 (+  2134us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:36.689512 (+   375us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:36.689537 (+    25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:36.690429 (+   892us) log.cc:842] Serialized 492 byte log entry
0812 19:25:36.769064 (+ 78635us) raft_consensus.cc:1631] Marking committed up to 11
0812 19:25:36.769100 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:36.769167 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:37.923243 (+1154076us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:25:37.926708 (+  3465us) raft_consensus.cc:1671] finished
0812 19:25:37.926728 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:37.926995 (+   267us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6992256,"thread_start_us":78357,"threads_started":1,"wal-append.queue_time_us":91274}
I20260812 19:25:37.929348 19034 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.933353 19519 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:37.934116 19519 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.934577 19627 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:37.934645  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:37.935312 19627 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:37.936105  6353 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 23.
I20260812 19:25:37.937464  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:37.938118  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 62677.4us
I20260812 19:25:37.938869  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:37.939777  6347 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 25: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:37.934116 19517 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:37.942366 19517 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:37.944690 19517 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:37.935909 19627 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.936424 19519 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:37.937076 19270 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:37.952353  6481 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:37.949738  6232 raft_consensus.cc:2454] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 25.
I20260812 19:25:37.960388 19270 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:37.962218  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:37.968896  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:37.970702  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:37.954581  6345 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260812 19:25:37.971634  6354 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:37.971349  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:37.945664 19312 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.976302 19153 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:37.983410 19153 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:37.977075 19531 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:37.979473 18846 raft_consensus.cc:3032] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:37.808617  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:37.873207  6474 rpcz_store.cc:276] 0812 19:25:36.616027 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:36.616156 (+   129us) service_pool.cc:227] Handling call
0812 19:25:36.616580 (+   424us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:25:36.617061 (+   481us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:36.617106 (+    45us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:25:36.647108 (+ 30002us) log.cc:842] Serialized 52 byte log entry
0812 19:25:37.869009 (+1221901us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54000265a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fdaf0 00007f98f7708028 00007f98f7778a7b 00007f98f777799e 00007f98fc6b92e9 00007f98f5dab684 00007f98f5dab612 00007f98f5dab541 00007f98f5dab4bc 00007f98f5daa772 00007f98f5bae94c
0812 19:25:37.869145 (+   136us) raft_consensus.cc:1631] Marking committed up to 14
0812 19:25:37.869276 (+   131us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:37.869424 (+   148us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:37.869541 (+   117us) raft_consensus.cc:1671] finished
0812 19:25:37.869558 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:37.869908 (+   350us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2977,"raft.queue_time_us":132,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":24822,"spinlock_wait_cycles":261796736,"thread_start_us":104197,"threads_started":1,"wal-append.queue_time_us":96816}
I20260812 19:25:37.980446 19519 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:37.988636  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:37.995865  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:37.996832  6242 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:37.997367  6235 raft_consensus.cc:2454] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:37.985613 19312 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.007596  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.007761 19370 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:38.008224  6349 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260812 19:25:38.008456  6228 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
I20260812 19:25:38.005851 19034 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:38.008601 19370 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.007608 19311 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:38.009465 19034 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.010473  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.010079 19311 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:38.011149  6236 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 24.
I20260812 19:25:37.986851 18846 raft_consensus.cc:729] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:38.010826 19419 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:38.012921 19608 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:38.018790 19515 raft_consensus.cc:482] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:38.021011 19311 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:38.023942 19627 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.024923  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.026825  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:38.027467  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.027841  6241 raft_consensus.cc:2379] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 24: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:38.028209  6230 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:38.027803 18846 consensus_queue.cc:260] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.029609 18846 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:38.031105 19600 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260812 19:25:38.034322  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.018538 19608 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:38.036952 19576 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.005s	sys 0.012s
W20260812 19:25:38.037456 19576 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.005s	sys 0.013s
I20260812 19:25:38.016618 19270 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.038731 19608 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.018042 19419 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.040566  6236 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 26.
I20260812 19:25:38.041585 19419 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.019480 19515 raft_consensus.cc:504] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:38.043499  6230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.044420 19515 leader_election.cc:288] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:38.046535  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.047251  6342 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:37.986888 19531 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.050016 19531 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.047271 19370 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.051708 19034 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.052310  6055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 125) took 7575 ms. Trace:
I20260812 19:25:38.056746  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.056885  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.057623  6359 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 17.
I20260812 19:25:38.058169  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.059013  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.059304  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.059926  6342 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
W20260812 19:25:38.064291  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 277027us
I20260812 19:25:38.064836  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:38.065619  6241 raft_consensus.cc:3037] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:38.070987  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.056185  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:38.080701  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:38.081514 19419 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:25:38.085388 19127 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:38.085856 19127 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:38.086257 19127 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:38.089872 19572 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:38.091150 19473 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:38.091948 19473 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.096364 19473 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.098613 19370 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:38.099390 19370 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:38.100517 19370 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.109978 19533 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:25:38.112469  6474 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260812 19:25:38.115079  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:38.115833  6474 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 22: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:38.116580  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:38.117458 19531 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:38.117753  6474 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260812 19:25:38.117890 19531 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:38.118363 19531 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:38.135421  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.136330  6481 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 24.
I20260812 19:25:38.137285  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.140559  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.141217  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.141489  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.141963  6359 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 20.
I20260812 19:25:38.148252  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.149783  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.150619  6342 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:38.149053  6477 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:38.152863  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.108510 19153 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:38.052680  6055 rpcz_store.cc:276] 0812 19:25:30.415085 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:30.464344 (+ 49259us) service_pool.cc:227] Handling call
0812 19:25:37.986626 (+7522282us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:36.078518 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:36.371363 (+292845us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:36.378151 (+  6788us) write_op.cc:435] Acquired schema lock
0812 19:25:36.378180 (+    29us) tablet.cc:660] Decoding operations
0812 19:25:36.430280 (+ 52100us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:36.430338 (+    58us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:36.430366 (+    28us) tablet.cc:683] Acquiring locks for 5 operations
0812 19:25:36.430932 (+   566us) tablet.cc:699] Row locks acquired
0812 19:25:36.430953 (+    21us) write_op.cc:260] PREPARE: finished
0812 19:25:36.431130 (+   177us) write_op.cc:270] Start()
0812 19:25:36.431249 (+   119us) write_op.cc:276] Timestamp: P: 1786562736431074 usec, L: 0
0812 19:25:36.431273 (+    24us) op_driver.cc:331] REPLICATION: starting
0812 19:25:36.431910 (+   637us) log.cc:842] Serialized 2039 byte log entry
0812 19:25:36.612701 (+180791us) op_driver.cc:444] REPLICATION: finished
0812 19:25:36.909278 (+296577us) write_op.cc:301] APPLY: starting
0812 19:25:36.912164 (+  2886us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:36.991946 (+ 79782us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:36.992060 (+   114us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:37.204634 (+212574us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:37.204885 (+   251us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0812 19:25:37.204936 (+    51us) write_op.cc:312] APPLY: finished
0812 19:25:37.205178 (+   242us) log.cc:842] Serialized 57 byte log entry
0812 19:25:37.205391 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:37.205511 (+   120us) write_op.cc:454] Released schema lock
0812 19:25:37.205565 (+    54us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:37.205894 (+   329us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:37.205923 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":840850,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":270108,"apply.run_cpu_time_us":10569,"apply.run_wall_time_us":304022,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":109824,"prepare.run_cpu_time_us":4922,"prepare.run_wall_time_us":371837,"replication_time_us":181301,"thread_start_us":245050,"threads_started":2}]]}
I20260812 19:25:38.158308  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.159478  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.073031 19519 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.163012  6481 raft_consensus.cc:2379] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 25: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:38.164947  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.166419  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.168260 19452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:33372 (request call id 27) took 2123 ms. Trace:
I20260812 19:25:38.130286 19515 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:38.178923  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.157569 19608 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:38.182951  6352 raft_consensus.cc:2379] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 24: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:38.188490  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.190590  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:38.191501  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:38.191784  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:25:38.192286  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 62844.1us
I20260812 19:25:38.193514 19270 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:38.193948 19270 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:38.196038 19270 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:38.198853 19615 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:38.199484 19615 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:38.201720 19615 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.203873 19608 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.206228 19608 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.170596 19452 rpcz_store.cc:276] 0812 19:25:36.044658 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:36.045014 (+   356us) service_pool.cc:227] Handling call
0812 19:25:36.063642 (+ 18628us) log.cc:842] Serialized 492 byte log entry
0812 19:25:37.815223 (+1751581us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b540033ad18. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fd471 00007f98f774d37c 00007f98f774fe80 00007f98f774fe08 00007f98f774fd88 00007f98f774fd43 00007f98f774f00c 00007f98fd781206 00007f98fd779808 00007f98f7406eb1 00007f98f73fa2aa
0812 19:25:37.926173 (+110950us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b180037b3a0. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98fd6ef8b1 00007f98fd6fc661 00007f98f485c764 00007f98f485fb11 00007f98f485fac9 00007f98f485fa59 00007f98f485fa21 00007f98f485ed1d 00007f98fdab4204 00007f98fdab4039 00007f98f483edc6
0812 19:25:38.134019 (+207846us) log.cc:842] Serialized 14 byte log entry
0812 19:25:38.168116 (+ 34097us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16242,"raft.queue_time_us":48356,"raft.run_cpu_time_us":2378,"raft.run_wall_time_us":96128,"spinlock_wait_cycles":38677248,"thread_start_us":344370,"threads_started":2,"wal-append.queue_time_us":370275}
I20260812 19:25:38.208628 19473 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:38.209185 19473 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:38.209652 19473 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:38.215052 19034 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:38.215675 19034 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:38.216127 19034 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:38.232698  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:38.234467  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 104820us
I20260812 19:25:38.238260 19606 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:25:38.239913  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:38.241755  6297 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:38.186672  6344 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 24.
I20260812 19:25:38.246539  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.249738  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.251098 18962 raft_consensus.cc:2781] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:38.251547 19622 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:38.251840 18962 raft_consensus.cc:686] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:38.252084 19622 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:38.252516 19622 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:38.253243 18962 consensus_queue.cc:237] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.256280  6297 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:38.260206  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e3bf4ae67ff4aaa9287a253c6db6575" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:38.263505 19311 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:38.264261 19311 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.266872 19311 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:38.271014  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.247620  6235 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:38.169122 19127 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:38.290575  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 45637.4us
I20260812 19:25:38.292850  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.293741  6232 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:38.306540  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.256438 19515 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.307370  6474 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 24.
I20260812 19:25:38.312561  6060 catalog_manager.cc:5495] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 14 to 16, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 16 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:38.299505 19573 raft_consensus.cc:2781] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader election won for term 25
I20260812 19:25:38.301080 19608 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:38.323041 19422 consensus_queue.cc:1035] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:25:38.340008  6297 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:38.366382  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:38.368201  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.371155 19473 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.372239 19127 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:38.373317 19473 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.373994  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.375085  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.376734  6481 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 26.
I20260812 19:25:38.377895  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.378536  6465 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 17.
I20260812 19:25:38.379022 19573 raft_consensus.cc:686] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 25 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:38.379928 19096 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:38.380429 19096 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:38.380836 19096 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:38.381100  6297 leader_election.cc:302] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:38.381258  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.382669  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.383363 19582 raft_consensus.cc:2726] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:38.378597 19093 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:38.374002 19515 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:38.385109  7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:38.380131 19573 consensus_queue.cc:237] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.387862  6297 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:38.385025  6138 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Leader has not yet committed an operation in its own term
I20260812 19:25:38.395431  7599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:38.397717  7594 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:38.408043  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:38.408887  6353 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:38.401624  6474 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:38.417027  7600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:38.397161  7606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:38.432651  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:38.438905  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 56302.8us
I20260812 19:25:38.439956  6297 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:38.443078 17622 raft_consensus.cc:2781] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election won for term 24
I20260812 19:25:38.443171 18985 raft_consensus.cc:2781] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:38.443753 17622 raft_consensus.cc:686] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:38.444898 17622 consensus_queue.cc:237] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.446619 18985 raft_consensus.cc:686] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:38.447885 18985 consensus_queue.cc:237] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.451027  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:38.452037  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.451102  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.453420  6475 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 25.
I20260812 19:25:38.455322  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.458915  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.459229  6417 leader_election.cc:302] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:38.459573  6475 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 20.
I20260812 19:25:38.460489 19515 raft_consensus.cc:2726] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:38.452765  6481 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
W20260812 19:25:38.464272  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 89d6b10f5ff448f592a41c3a77692cfe, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.464658 19519 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:38.464704  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 89d6b10f5ff448f592a41c3a77692cfe, TS 54f83319db6b49929cc8f18a66a66975 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.413264 19608 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.327111 19270 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:38.480721  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.485026  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.493075  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.502964  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.503912  6474 raft_consensus.cc:2379] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 19: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:38.504747  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:38.506325 19452 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:38.506733 19452 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:38.507072 19452 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:38.507228 19572 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:38.510972  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.512744  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.473891  6060 catalog_manager.cc:5495] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 8 to 14, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 14 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:38.530189  7598 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:38.548049  6417 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:38.531700  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:38.530824  6241 raft_consensus.cc:2454] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:38.552522  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.560770  6344 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260812 19:25:38.557971  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:38.552667  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.564983  6235 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:38.572991  6353 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
W20260812 19:25:38.573887  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet b6ca6db9aa4e4bdd829dc087e97096a0, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:38.574429  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet b6ca6db9aa4e4bdd829dc087e97096a0, TS a1541d11be514114966dc1e92a345298 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.554625 18846 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:38.554092 19606 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:38.553242 19608 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.552350 18962 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:38.586970  6178 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:38.603801  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:38.607219  6347 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 22: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:38.567993 19034 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.588011 18846 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:38.623345  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44004.6us
I20260812 19:25:38.625094  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.579435 19473 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260812 19:25:38.627559  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.628549  6297 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:38.629566  6347 raft_consensus.cc:1226] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260812 19:25:38.632202  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:38.635474 19554 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:38.635923 19554 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:38.636257 19554 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:38.636303  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:38.637513  6345 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:38.638463 19600 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:38.602217 19422 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:38.636322  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5046f0183a45f4a5ae164f4ff6792c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.618328 19608 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader election won for term 21
I20260812 19:25:38.576838 19515 consensus_queue.cc:1046] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260812 19:25:38.638338  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:38.627431 19153 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election won for term 24
I20260812 19:25:38.645772  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:38.632063 19531 consensus_meta.cc:287] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.003s
I20260812 19:25:38.639166 19600 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:38.652902  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.653849  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:38.654156 19370 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 19:25:38.655964  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.659996 19093 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:25:38.678016  6138 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 67c9cd7e3397473ba76fb87340b6c6e0, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:38.678489  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 67c9cd7e3397473ba76fb87340b6c6e0, TS bdfa5579d4534c618c00db6b4a841c81 -> TS f4ef77b3328a44e8a21dd902b370e25a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.656864 19096 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.657574  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:38.619601 19606 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:38.656741  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:38.673655  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:38.681852  6235 raft_consensus.cc:3037] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 24
I20260812 19:25:38.634593 18846 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:38.665122 19608 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:38.668126 19600 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:38.691226 19279 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:38.675017 19270 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.632769 18962 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.675836 19153 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 24 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:38.706853  6344 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 24: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:38.667789 19531 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.675573  6342 raft_consensus.cc:2932] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:25:38.708180 19600 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:38.694320 19422 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.708585 19609 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260812 19:25:38.778620  6224 raft_consensus.cc:2379] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 22: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:38.729391 19279 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:38.774173  6349 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.024s	sys 0.060s
W20260812 19:25:38.790385  6349 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.024s	sys 0.061s
I20260812 19:25:38.808478  6235 raft_consensus.cc:2454] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 24.
W20260812 19:25:38.804795 19622 consensus_meta.cc:287] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: Time spent flushing consensus metadata: real 0.552s	user 0.002s	sys 0.013s
I20260812 19:25:38.784504 19279 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.842311 19034 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.838542 19622 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.949506  6238 raft_consensus.cc:1226] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260812 19:25:38.928314 19096 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.858978 19153 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.853408 19608 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:38.948980 19606 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:38.962673  7591 thread.cc:636] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.013s	sys 0.009s
I20260812 19:25:38.969492 19279 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.970098 18962 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.974844 19422 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:38.954282 19531 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:38.979063  7591 thread.cc:602] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.014s	sys 0.009s
I20260812 19:25:38.992136  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:38.981508 19452 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:39.008498 18985 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.009s	sys 0.026s
I20260812 19:25:38.998930 18846 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:39.025398 18985 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.010s	sys 0.026s
W20260812 19:25:39.044258  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 52197.2us
W20260812 19:25:39.040637 19645 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
W20260812 19:25:39.049254  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 474793us
W20260812 19:25:39.051991  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 359884us
W20260812 19:25:39.053085  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 361662us
I20260812 19:25:39.040390 19572 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:39.043200 19622 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:39.076310 19572 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.108076 18846 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:39.109973 19572 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:39.110845 19127 raft_consensus.cc:3032] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Stepping down as leader of term 17
W20260812 19:25:39.079501 19642 log.cc:924] Time spent T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260812 19:25:39.083771 19311 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:39.087024  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:39.076169  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:25:39.092665 19644 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260812 19:25:39.097018 19531 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:39.100282 19452 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:39.073235 19641 log.cc:924] Time spent T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260812 19:25:39.063298  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:25:39.125377  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 49304.5us
I20260812 19:25:39.131820 19600 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.133553  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:39.111421 19127 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:39.158067  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:39.158192  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:39.159088  6238 raft_consensus.cc:2396] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260812 19:25:39.159689  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:39.159992  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:39.160576  6238 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 23
I20260812 19:25:39.124603 19311 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:39.161222  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:39.161669 19311 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:39.166298 19055 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:39.166810 19055 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:39.167176 19055 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:39.155445  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:39.167563  6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:39.186887  6350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 3081) took 1034 ms. Trace:
I20260812 19:25:39.134078 19531 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:39.192113  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 128941us
I20260812 19:25:39.128875 19622 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:39.170264  6238 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:39.206858  6228 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260812 19:25:39.192991  6241 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 24: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:39.130178 19554 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.172298 19646 ts_tablet_manager.cc:927] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:39.214363  6354 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.008s	sys 0.016s
I20260812 19:25:39.228540  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:39.234516  6354 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.009s	sys 0.016s
I20260812 19:25:39.189690  6350 rpcz_store.cc:276] 0812 19:25:38.152361 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:38.152488 (+   127us) service_pool.cc:227] Handling call
0812 19:25:38.152832 (+   344us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:25:38.153167 (+   335us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:38.153194 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:25:38.170872 (+ 17678us) log.cc:842] Serialized 26 byte log entry
0812 19:25:38.664988 (+494116us) raft_consensus.cc:1631] Marking committed up to 12
0812 19:25:38.665033 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:38.665096 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:39.171440 (+506344us) raft_consensus.cc:1671] finished
0812 19:25:39.171467 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:39.186819 (+ 15352us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1288,"raft.queue_time_us":4755,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5138,"thread_start_us":457471,"threads_started":1,"wal-append.queue_time_us":645450}
I20260812 19:25:39.236882  6297 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:39.238090  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:39.205307 19034 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:39.244864  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:39.245433  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:39.255525  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:39.257398  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:39.215555 19622 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:39.262523 17622 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:39.265329  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:39.252151  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:39.267653  6349 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:39.239924 19279 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:39.245115 19606 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:39.294941  6297 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:39.259871 19018 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:39.248323 19034 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:39.306224  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:39.273371 19622 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:39.272742 19370 raft_consensus.cc:2741] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260812 19:25:39.309731  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:39.306565  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:39.313823  6228 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260812 19:25:39.316814  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:39.325825  6473 raft_consensus.cc:2396] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260812 19:25:39.329689  6474 raft_consensus.cc:2379] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 24: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
W20260812 19:25:39.338881  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44100.5us
I20260812 19:25:39.312005 19034 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:39.346553  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:39.342589 19606 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:39.333458 19473 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:39.366531  6474 raft_consensus.cc:3037] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:39.372768 19422 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:39.374451 19531 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:39.347863 19370 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:39.352813 19554 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:39.301290 19127 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:39.401443  6297 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
W20260812 19:25:39.408449  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 143225us
I20260812 19:25:39.409658  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:39.326224 19018 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.426939 19018 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:39.388830 19370 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:39.411434  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:25:39.409659  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 354746us
W20260812 19:25:39.414902 19652 log.cc:924] Time spent T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260812 19:25:39.416671 19609 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:39.416481 19311 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.405230 19422 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:39.429612  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:39.443473  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:39.445218 19279 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260812 19:25:39.438426 19018 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260812 19:25:39.455493 19018 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:39.455895 19018 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Advancing to term 27
I20260812 19:25:39.461504 19606 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:39.462205 19606 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.464418 19606 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:39.465204 19127 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:39.467657  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:39.432163  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:39.405730 19600 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:39.433525 19370 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:39.454061 19668 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:39.468515  6465 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:39.477360 17622 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:39.469774  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:39.484059  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:39.482677  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:39.442616 19671 raft_consensus.cc:2781] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:39.466950 19531 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:39.487718  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:39.468912 19609 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:39.493675  6354 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:39.489564  6297 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:39.490693  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:39.489638  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:39.547545  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:39.495220  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:39.475948 19576 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260812 19:25:39.503171  6470 raft_consensus.cc:1261] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260812 19:25:39.540620  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
W20260812 19:25:39.550379  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60913.9us
I20260812 19:25:39.492460 19473 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:39.555457 19471 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260812 19:25:39.555905 19471 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:39.556250 19471 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:39.552680 19311 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:39.493412 19531 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:39.488353 19554 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:39.570081 19627 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:39.570842 19609 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:39.571547 19609 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
W20260812 19:25:39.572082 19649 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260812 19:25:39.574580 19622 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.576695 19622 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:39.577369 19531 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:39.562083 19153 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260812 19:25:39.579038 19153 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:39.579420 19153 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Advancing to term 27
I20260812 19:25:39.581730 19689 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:39.584784  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:39.582315 19689 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.587350 19093 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:39.587899 19093 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.588615 19689 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:39.590063 19093 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:39.586923 19573 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:39.590634 19093 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:25:39.592559 19663 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.271s	user 0.000s	sys 0.002s
I20260812 19:25:39.545310 19671 raft_consensus.cc:686] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:39.590095 19627 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.593060 19018 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.593755 19671 consensus_queue.cc:237] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.572155 19055 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:39.595322 19627 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:39.596098  7591 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:39.597348 19055 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:39.545972  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 50012.3us
I20260812 19:25:39.495057  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:39.476672 19519 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260812 19:25:39.592178 19093 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.553226  6297 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:39.613888  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60774.9us
I20260812 19:25:39.614630  6297 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:39.551709 19576 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:39.603765  6349 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
W20260812 19:25:39.548390  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 61731.6us
I20260812 19:25:39.562007  6232 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:39.609858  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:39.577409  6474 raft_consensus.cc:2454] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:39.554134 19473 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:39.617257  6242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53178 (request call id 3775) took 1085 ms. Trace:
I20260812 19:25:39.628227 19422 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:39.633174  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:39.615633 19576 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:39.641173  6474 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:39.643869  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:39.628958  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:39.647482  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:39.647482  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:39.649118  6228 raft_consensus.cc:3037] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:39.629297  6242 rpcz_store.cc:276] 0812 19:25:38.522186 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:38.527687 (+  5501us) service_pool.cc:227] Handling call
0812 19:25:38.528002 (+   315us) raft_consensus.cc:1457] Updating replica for 2 ops
0812 19:25:38.556251 (+ 28249us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:25:38.556299 (+    48us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0812 19:25:38.580450 (+ 24151us) log.cc:842] Serialized 52 byte log entry
0812 19:25:39.051625 (+471175us) raft_consensus.cc:1631] Marking committed up to 13
0812 19:25:39.051697 (+    72us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:25:39.051794 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:25:39.591903 (+540109us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f73fabee 00007f98f73f9f36 00007f98f73f9b58 00007f98f7403551 00007f98f7403509 00007f98f7403499
0812 19:25:39.602022 (+ 10119us) raft_consensus.cc:1671] finished
0812 19:25:39.602052 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:25:39.607148 (+  5096us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3015,"raft.queue_time_us":27457,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":139,"spinlock_wait_cycles":13487488,"thread_start_us":414241,"threads_started":1,"wal-append.queue_time_us":638811}
I20260812 19:25:39.617691 19600 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260812 19:25:39.637523 19515 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:39.654124 19515 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.654781 19674 consensus_queue.cc:1046] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260812 19:25:39.656503 19515 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:39.657474 19683 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260812 19:25:39.620198 19622 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:39.637302 19473 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:39.673810  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:39.674798  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:39.652526 19646 tablet_copy_client.cc:316] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.253.3:42599
I20260812 19:25:39.678160 19554 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:39.683782  6474 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 25.
I20260812 19:25:39.644188 19573 consensus_queue.cc:1035] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260812 19:25:39.678849 19554 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:39.701953  6297 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:39.703933  6464 raft_consensus.cc:1261] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260812 19:25:39.704829 19034 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.707240 19034 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:39.711144 19688 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:39.711957 19093 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:39.688437 19018 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:39.724300  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:39.745056 17622 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:39.745760 17622 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:39.746248 17622 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:39.733529  6228 raft_consensus.cc:2454] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 25.
W20260812 19:25:39.747989  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 95657.7us
I20260812 19:25:39.753741  6354 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:39.758826  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:39.758111  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 80321.6us
I20260812 19:25:39.759528  6232 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 24. Current term is 25. Ops: []
I20260812 19:25:39.772737 19311 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:39.773589 19311 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.776489 19311 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:39.789124 19576 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.791018  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:39.791375  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:39.696943 19609 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:39.792621  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:39.743001 19279 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:39.761801 17622 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.795938  6465 raft_consensus.cc:1261] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260812 19:25:39.796089  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:39.797410 17622 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:39.799167  6473 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:39.800872  6297 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:39.801311 19600 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:39.802013  6297 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:39.760797  6416 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:39.804257  6416 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:39.802770  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 136345us
I20260812 19:25:39.696237 19612 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:39.805778  6464 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:39.815439 19279 raft_consensus.cc:2781] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader election won for term 25
I20260812 19:25:39.815802 19127 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:39.828099 17622 consensus_queue.cc:1035] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:25:39.806743 18985 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:39.840678  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:39.845089  6465 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 22: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:39.842463  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:39.846026  6473 raft_consensus.cc:1226] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23. Ops: []
I20260812 19:25:39.846583  6470 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:39.835062 19452 raft_consensus.cc:2781] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election won for term 24
I20260812 19:25:39.852480  7553 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:39.839661 19279 raft_consensus.cc:686] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 25 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:39.858637 19279 consensus_queue.cc:237] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.859570  6500 tablet_copy_service.cc:140] P bdfa5579d4534c618c00db6b4a841c81: Received BeginTabletCopySession request for tablet 2661573faf994c8f9bb837f55af974d9 from peer f4ef77b3328a44e8a21dd902b370e25a ({username='slave'} at 127.0.0.1:33386)
I20260812 19:25:39.860216  6500 tablet_copy_service.cc:161] P bdfa5579d4534c618c00db6b4a841c81: Beginning new tablet copy session on tablet 2661573faf994c8f9bb837f55af974d9 from peer f4ef77b3328a44e8a21dd902b370e25a at {username='slave'} at 127.0.0.1:33386: session id = f4ef77b3328a44e8a21dd902b370e25a-2661573faf994c8f9bb837f55af974d9
I20260812 19:25:39.863214  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:39.869405  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:39.871729  6354 raft_consensus.cc:1226] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:39.873247  6342 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 22: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:39.873134  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:39.875660  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:39.879130  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:39.880450  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:39.858511  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:39.888999  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:39.833452 19096 consensus_queue.cc:1035] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
I20260812 19:25:39.892153  6475 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:39.892081  6297 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:39.894203  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:39.895349  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:39.834187 19612 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.894215  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:39.902410  6235 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260812 19:25:39.904554  6229 raft_consensus.cc:2379] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 22: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:39.838894 19688 consensus_queue.cc:1046] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260812 19:25:39.906917  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:39.909214  6228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:39.913944  6228 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:39.913956  6178 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:39.903537  6232 raft_consensus.cc:2932] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:25:39.880728 19713 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:39.899521 19414 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:39.857378 19370 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.942796 19675 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:39.943236  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:39.934060  6229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:39.968541  6353 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 17. Current term is 18. Ops: []
I20260812 19:25:39.971511  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:39.974172  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 60312.4us
I20260812 19:25:39.979036 19727 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:39.979779 19727 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:39.980856 19727 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:39.983605  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:39.985265  6238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:39.986917  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:39.987483  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:39.989326  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:39.991751  6347 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260812 19:25:39.986275  6238 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 21.
I20260812 19:25:39.883672 18985 consensus_queue.cc:1046] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260812 19:25:39.997886  6345 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260812 19:25:39.918097 19576 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:40.000288  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:40.002661  6229 raft_consensus.cc:2354] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 24. Current term is 25.
I20260812 19:25:40.004127  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:40.004922  6349 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 22.
I20260812 19:25:39.995371 19713 raft_consensus.cc:686] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:40.008350 19713 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:40.018105  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 122062us
I20260812 19:25:40.046604 19452 raft_consensus.cc:686] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 24 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:40.031359 19576 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:40.017531 19688 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:39.916136 19422 consensus_queue.cc:1046] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
W20260812 19:25:40.020727  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 147655us
I20260812 19:25:40.045881  6228 raft_consensus.cc:2454] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:40.047905  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:40.018488  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:40.041174 19554 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:39.995720 19667 raft_consensus.cc:3032] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:40.087673  6228 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 26. Current term is 27. Ops: []
I20260812 19:25:40.090009  6475 raft_consensus.cc:1261] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260812 19:25:40.043154 19531 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:40.088879 19471 consensus_meta.cc:287] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.004s
I20260812 19:25:40.095216 19627 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:25:40.096050 19731 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:40.096622  6465 raft_consensus.cc:1261] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260812 19:25:40.097355 19728 log.cc:924] Time spent T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260812 19:25:40.102814 18985 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:25:40.105504 19612 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:40.106982 19370 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:40.083465 19576 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.095081 19471 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:40.107164 19711 log.cc:924] Time spent T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260812 19:25:40.087302 19018 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:40.086817 19667 raft_consensus.cc:729] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:40.134443  6242 raft_consensus.cc:1226] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 17. Current term is 18. Ops: []
W20260812 19:25:40.137550  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 57020.6us
W20260812 19:25:40.144287  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 54535.2us
I20260812 19:25:40.079350 19688 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:40.089542 19533 consensus_queue.cc:1046] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
W20260812 19:25:40.133972 19725 log.cc:924] Time spent T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260812 19:25:40.130336 19582 raft_consensus.cc:3032] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:40.152602  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:40.154798  6349 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:40.124805 19018 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:40.143162 19695 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:40.219549  7591 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:40.165517 19018 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:40.096640 19731 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:40.158489 19582 raft_consensus.cc:729] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:40.228259  6349 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 25.
I20260812 19:25:40.249372 19731 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:40.251853 19153 consensus_meta.cc:287] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.004s
I20260812 19:25:40.252322 19153 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.254076 19531 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:40.235528 19576 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:40.254773 19698 log.cc:924] Time spent T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260812 19:25:40.222982 19452 consensus_queue.cc:237] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.255700 19582 consensus_queue.cc:260] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:40.256840 19582 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:40.254871  6474 raft_consensus.cc:1226] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 26. Current term is 27. Ops: []
I20260812 19:25:40.220659 19600 consensus_queue.cc:1046] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260812 19:25:40.259811 19471 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:40.254442 19153 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:40.243126 19667 consensus_queue.cc:260] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.261622 19667 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:40.262965 19688 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:40.263597 19422 raft_consensus.cc:3032] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Stepping down as leader of term 17
I20260812 19:25:40.264065 19422 raft_consensus.cc:729] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:40.264986 19422 consensus_queue.cc:260] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.169596 19473 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.272354 19473 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:40.228876 19695 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.292495 19695 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:40.295166 19018 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.298429 19018 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:40.298815 18962 raft_consensus.cc:3032] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Stepping down as leader of term 24
I20260812 19:25:40.299278 18962 raft_consensus.cc:729] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:40.300143 18962 consensus_queue.cc:260] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.311764  6500 tablet_copy_source_session.cc:205] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: Tablet Copy: opened 0 blocks and 1 log segments
W20260812 19:25:40.313774  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 161637us
I20260812 19:25:40.314038 19736 consensus_queue.cc:1046] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:25:40.315605 19714 raft_consensus.cc:3032] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:40.316090 19714 raft_consensus.cc:729] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:40.317135 19714 consensus_queue.cc:260] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.314437 19764 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:40.330514  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 150948us
I20260812 19:25:40.314705  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:40.333909  6416 leader_election.cc:302] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:40.335542  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:40.337055  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:40.344702  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:25:40.346776  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 195909us
I20260812 19:25:40.346321  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:40.361250  6178 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:40.372329  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:40.340548 19688 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:40.340435 19127 raft_consensus.cc:2726] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:40.340173 19680 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:25:40.385279  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 235358us
I20260812 19:25:40.340915 19736 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:40.379839  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:40.387668  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:40.347913 18962 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:40.381708  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:40.360329 19714 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:40.393312  6353 raft_consensus.cc:2379] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 22: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:40.389683 17622 consensus_queue.cc:1035] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260812 19:25:40.350217 19764 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.395486 19764 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:40.396090 19153 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:40.398789 19742 consensus_queue.cc:1046] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260812 19:25:40.400028 19680 raft_consensus.cc:3032] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:40.400455 19680 raft_consensus.cc:729] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:40.401322 19627 raft_consensus.cc:3032] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Stepping down as leader of term 22
I20260812 19:25:40.404211 19627 raft_consensus.cc:729] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:40.405143 19627 consensus_queue.cc:260] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:40.406569  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 45652us
I20260812 19:25:40.406960 19769 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader election won for term 25
I20260812 19:25:40.407542 19769 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 25 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:40.408835 19646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2661573faf994c8f9bb837f55af974d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:25:40.408542 19769 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:40.414847 19756 log.cc:924] Time spent T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.086s	user 0.000s	sys 0.003s
I20260812 19:25:40.414469 19622 consensus_queue.cc:1035] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:25:40.418222 19627 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
W20260812 19:25:40.420322 19747 log.cc:924] Time spent T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260812 19:25:40.410053 19680 consensus_queue.cc:260] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.428815 19680 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
W20260812 19:25:40.429898 19751 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260812 19:25:40.434818 19422 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Advancing to term 18
W20260812 19:25:40.436573 19744 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260812 19:25:40.447692  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:40.449240  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:40.452346  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:40.466756  6359 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 18.
W20260812 19:25:40.472958  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 49330.9us
W20260812 19:25:40.475006  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 50875.8us
I20260812 19:25:40.475998  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:40.477319 19311 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:40.477806 19311 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:40.478154 19311 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:40.479529  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:40.480716 19754 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260812 19:25:40.481216 19754 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:40.481611 19754 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:40.485642 19279 consensus_queue.cc:1046] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260812 19:25:40.484939 19667 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260812 19:25:40.486913 19279 raft_consensus.cc:3032] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Stepping down as leader of term 26
I20260812 19:25:40.487318 19279 raft_consensus.cc:729] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:40.488224  6178 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:40.494463  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:40.497152  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:40.493662  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:40.499145  6354 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 18: Already voted for candidate a1541d11be514114966dc1e92a345298 in this term.
I20260812 19:25:40.489512 19279 consensus_queue.cc:260] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.501077 19279 raft_consensus.cc:3037] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Advancing to term 27
I20260812 19:25:40.501698  6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:40.501147  6242 raft_consensus.cc:1226] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:40.495625  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:40.503767 19370 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:40.505259  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:40.509075 19701 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:40.514271  6297 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:40.514627  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:40.516830 19370 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:40.518148 19755 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:40.518770  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:25:40.521246  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:40.523233  6232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:40.525139  6242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:40.525691  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:40.528736  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:40.513006 19701 raft_consensus.cc:686] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:40.530515 19701 consensus_queue.cc:237] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.533905  6354 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:40.534153  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:40.537190  6349 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260812 19:25:40.538775 19422 raft_consensus.cc:2781] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:40.539630 19422 raft_consensus.cc:686] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:40.540648 19422 consensus_queue.cc:237] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.548374  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:40.549438  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:40.550235  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:40.550601  6473 raft_consensus.cc:2379] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 27: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:40.554243  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:40.557271  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:40.560729  6473 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260812 19:25:40.585893  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:40.589745 19714 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260812 19:25:40.589668 19311 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.590173  6344 raft_consensus.cc:2454] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 27.
I20260812 19:25:40.595999  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:40.597971  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:40.599216 19714 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260812 19:25:40.599362  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:40.600279  6481 raft_consensus.cc:2379] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 18: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:40.601142  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:40.601034  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:40.608225  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:40.616256  6224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298" is_pre_election: true
I20260812 19:25:40.624984  6474 raft_consensus.cc:1226] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:40.626998  6475 raft_consensus.cc:2354] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23.
I20260812 19:25:40.632756  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:40.633756  6242 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 23. Current term is 24. Ops: []
I20260812 19:25:40.632726  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:40.637974  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:40.641497  6416 leader_election.cc:398] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 24. Current term is 25.
I20260812 19:25:40.641932  6416 leader_election.cc:401] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260812 19:25:40.643327  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:40.616546 19776 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:40.659508  6229 raft_consensus.cc:1226] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 24. Current term is 25. Ops: []
I20260812 19:25:40.644809 19736 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707) with higher term. Message: Invalid argument: T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 24. Current term is 25.
I20260812 19:25:40.668113  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:40.670544  6228 raft_consensus.cc:1226] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Rejecting Update request from peer 54f83319db6b49929cc8f18a66a66975 for earlier term 25. Current term is 26. Ops: []
I20260812 19:25:40.671325  6475 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260812 19:25:40.654119 19515 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:40.693614 19311 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:40.694309  6416 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:40.696470  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:40.697053 19452 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:25:40.698271 19452 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:40.708436  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:40.709460 19627 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:40.710330  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:40.711866 19627 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:40.712071  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:40.713562  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:40.716750 19627 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260812 19:25:40.717743  6229 raft_consensus.cc:1226] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 25 LEADER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 24. Current term is 25. Ops: []
I20260812 19:25:40.717797  6235 raft_consensus.cc:1226] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 21. Current term is 22. Ops: []
I20260812 19:25:40.724771  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:40.732885  6235 raft_consensus.cc:1261] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260812 19:25:40.743021  6235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a1541d11be514114966dc1e92a345298"
I20260812 19:25:40.743997  6235 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:40.681149 19422 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.045s
I20260812 19:25:40.752523  6297 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:40.758579  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:40.759944 19764 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260812 19:25:40.727981 19622 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:40.760757 19754 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:40.763358 19754 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:40.732885 18962 consensus_queue.cc:1046] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: INVALID_TERM, Last received: 25.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260812 19:25:40.753809 19018 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260812 19:25:40.760833 19622 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:25:40.770236 19622 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:40.762499  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:435: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 2
I20260812 19:25:40.771735 19018 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:40.727604 19759 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:40.771876  4084 tablet_server.cc:178] TabletServer@127.3.253.1:0 shutting down...
I20260812 19:25:40.772339  6178 leader_election.cc:398] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23.
I20260812 19:25:40.772676  6178 leader_election.cc:401] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260812 19:25:40.775166  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:40.775976  6344 raft_consensus.cc:3037] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:40.781216 19093 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:40.782366 19600 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260812 19:25:40.783643 19422 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Stepping down as leader of term 23
I20260812 19:25:40.735196 19370 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260812 19:25:40.784055 19422 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:40.784924 19422 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.786319 19436 raft_consensus.cc:3032] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 25 LEADER]: Stepping down as leader of term 25
I20260812 19:25:40.786799 19436 raft_consensus.cc:729] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:40.786506 19422 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:40.793345 19754 consensus_queue.cc:1035] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260812 19:25:40.793759  7553 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260812 19:25:40.789203  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:40.796911 19667 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:40.798408  6344 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 23.
I20260812 19:25:40.805433  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:40.820116 19436 consensus_queue.cc:260] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.11, Last appended by leader: 11, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.807436 19667 consensus_queue.cc:1046] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260812 19:25:40.799787  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:40.802137  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:40.844499  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:40.838637  6055 catalog_manager.cc:5495] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:40.840853  6235 raft_consensus.cc:2454] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 23.
I20260812 19:25:40.840433 19436 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:40.843703 19769 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260812 19:25:40.848564 19473 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23.
I20260812 19:25:40.843492  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:40.849812 19680 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:40.847729 19714 consensus_queue.cc:1046] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260812 19:25:40.856029  6416 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:40.866858 19714 raft_consensus.cc:3032] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 24 LEADER]: Stepping down as leader of term 24
I20260812 19:25:40.867276 19714 raft_consensus.cc:729] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:40.868171 19714 consensus_queue.cc:260] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.869414 19714 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:40.857450 19701 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:40.885779  6416 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:40.880201 19776 raft_consensus.cc:2781] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Leader election won for term 27
I20260812 19:25:40.889304  6344 raft_consensus.cc:1226] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Rejecting Update request from peer a1541d11be514114966dc1e92a345298 for earlier term 20. Current term is 21. Ops: []
I20260812 19:25:40.897373  6055 catalog_manager.cc:5495] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:40.897454 19311 raft_consensus.cc:3032] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Stepping down as leader of term 21
I20260812 19:25:40.910509 19311 raft_consensus.cc:729] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:40.911473 19311 consensus_queue.cc:260] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.912957 19311 raft_consensus.cc:3037] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:40.916307  6359 raft_consensus.cc:1261] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260812 19:25:40.899423 19731 raft_consensus.cc:2781] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:40.899518 19776 raft_consensus.cc:686] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 27 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:40.934612  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:40.938272  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 44179.4us
W20260812 19:25:40.939404  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 145673us
I20260812 19:25:40.935899 19731 raft_consensus.cc:686] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 23 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
W20260812 19:25:40.979897  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 45378.8us
W20260812 19:25:40.980502  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 182475us
I20260812 19:25:40.949486  6482 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260812 19:25:40.983826 19667 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:40.984408 19785 log.cc:924] Time spent T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260812 19:25:40.984419 19667 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:40.991611 19776 consensus_queue.cc:237] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:40.982458 19452 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260812 19:25:40.999995  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 53738.8us
I20260812 19:25:41.038160  6359 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260812 19:25:41.010462 19531 consensus_queue.cc:1046] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260812 19:25:41.049899 19153 consensus_queue.cc:1035] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260812 19:25:41.085472 19531 raft_consensus.cc:3032] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 20 LEADER]: Stepping down as leader of term 20
I20260812 19:25:41.085902 19531 raft_consensus.cc:729] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:41.017254 19731 consensus_queue.cc:237] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.091568 19531 consensus_queue.cc:260] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:41.089917 19646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60772 (request call id 832) took 2802 ms. Trace:
I20260812 19:25:41.097805 19646 rpcz_store.cc:276] 0812 19:25:38.311247 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:38.337671 (+ 26424us) service_pool.cc:227] Handling call
0812 19:25:39.239599 (+901928us) ts_tablet_manager.cc:928] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: Initiating tablet copy from peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
0812 19:25:40.407323 (+1167724us) tablet_copy_client.cc:361] Tablet copy session begun
0812 19:25:40.788397 (+381074us) tablet_metadata.cc:641] Metadata flushed
0812 19:25:40.788707 (+   310us) tablet_copy_client.cc:490] Wrote new tablet metadata
0812 19:25:41.088755 (+300048us) tablet_copy_client.cc:411] Wrote new consensus metadata
0812 19:25:41.089117 (+   362us) tablet_replica.cc:205] Creating consensus instance
0812 19:25:41.089714 (+   597us) ts_tablet_manager.cc:983] Replica registered.
0812 19:25:41.089801 (+    87us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":39699,"tablet-copy.queue_time_us":830773,"thread_start_us":769829,"threads_started":2}
W20260812 19:25:41.166785  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 123657us
I20260812 19:25:41.172963 19764 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:41.186510  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 163151us
I20260812 19:25:41.191699  6353 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:25:41.192396 19818 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260812 19:25:41.200663  6354 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260812 19:25:41.202296 19755 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:25:41.204535  6344 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260812 19:25:41.204545  6481 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260812 19:25:41.190819 19799 log.cc:924] Time spent T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260812 19:25:41.216466 19759 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260812 19:25:41.219175 19788 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.323s	user 0.000s	sys 0.004s
I20260812 19:25:41.222441 19812 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260812 19:25:41.186787 19646 tablet_copy_client.cc:791] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 0 data blocks...
I20260812 19:25:41.191121 19764 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.231213 19667 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:41.240442  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.224133  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.245072  6055 catalog_manager.cc:5495] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:41.210996 19612 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:41.265843  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 213418us
W20260812 19:25:41.242797 19792 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260812 19:25:41.270915  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.269443  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.271641  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.272168  6297 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:41.274739  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:41.274199  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.282635  6297 leader_election.cc:334] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:41.283262  6297 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:41.294783 19646 tablet_copy_client.cc:655] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Starting download of 1 WAL segments...
I20260812 19:25:41.300156  7598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
W20260812 19:25:41.304432  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 117097us
W20260812 19:25:41.305029  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.314366  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 75563.1us
I20260812 19:25:41.308918  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:41.318992  6344 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:41.323751  6470 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260812 19:25:41.324170  6470 pending_rounds.cc:76] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 13
I20260812 19:25:41.324383  6470 pending_rounds.cc:97] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260812 19:25:41.324632  6470 raft_consensus.cc:2866] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:41.272089 19612 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.328744 19612 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.306284 19600 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:41.330279 19764 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.331703  6481 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260812 19:25:41.334061  6464 raft_consensus.cc:1261] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260812 19:25:41.293157 19422 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260812 19:25:41.343601  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:41.289446 19755 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260812 19:25:41.359045 19531 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:41.302229 19701 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:41.372634  6055 catalog_manager.cc:5495] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260812 19:25:41.399549  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 80119.4us
I20260812 19:25:41.405423  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:41.406306  6474 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:41.408092  6345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:41.416832  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 55872.1us
I20260812 19:25:41.423547  6055 catalog_manager.cc:5495] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:41.440106  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:41.443111  6055 catalog_manager.cc:5495] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 20 to 23, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 23 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:41.418596 19608 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260812 19:25:41.448447 19674 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:41.470481  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 169381us
I20260812 19:25:41.411590 19701 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.463903 19680 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:41.461169 19436 consensus_queue.cc:1035] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
W20260812 19:25:41.511313  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.462862 19018 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
W20260812 19:25:41.518101  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 86183.9us
W20260812 19:25:41.521579  6060 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38512 (request call id 234) took 55125 ms (client timeout 15000 ms). Trace:
W20260812 19:25:41.515441  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.518231  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.487138 19674 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:41.543133  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.551891  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:41.553331  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 87798.4us
W20260812 19:25:41.522919  6060 rpcz_store.cc:269] 0812 19:24:46.396615 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:46.403011 (+  6396us) service_pool.cc:227] Handling call
0812 19:25:41.521462 (+55118451us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:39.583246 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:39.583929 (+   683us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:39.584000 (+    71us) write_op.cc:435] Acquired schema lock
0812 19:25:39.584018 (+    18us) tablet.cc:660] Decoding operations
0812 19:25:39.584545 (+   527us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:39.584648 (+   103us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:39.584698 (+    50us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:25:39.585162 (+   464us) tablet.cc:699] Row locks acquired
0812 19:25:39.585193 (+    31us) write_op.cc:260] PREPARE: finished
0812 19:25:39.585406 (+   213us) write_op.cc:270] Start()
0812 19:25:39.585568 (+   162us) write_op.cc:276] Timestamp: P: 1786562739585328 usec, L: 0
0812 19:25:39.585602 (+    34us) op_driver.cc:331] REPLICATION: starting
0812 19:25:39.586356 (+   754us) log.cc:842] Serialized 917 byte log entry
0812 19:25:40.179218 (+592862us) op_driver.cc:444] REPLICATION: finished
0812 19:25:40.392806 (+213588us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b44000232cc. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f46a0f11 00007f98f476ea95 00007f98f476f4b2 00007f98f740b511 00007f98f7406e1a 00007f98f483e5fe 00007f98fd669a39 00007f98f485b8bb 00007f98f4859cbf 00007f98f485be22 00007f98fb188410
0812 19:25:40.669739 (+276933us) write_op.cc:301] APPLY: starting
0812 19:25:40.669895 (+   156us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:40.696850 (+ 26955us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:40.696893 (+    43us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:40.698220 (+  1327us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:40.698491 (+   271us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0812 19:25:40.698556 (+    65us) write_op.cc:312] APPLY: finished
0812 19:25:40.710317 (+ 11761us) log.cc:842] Serialized 33 byte log entry
0812 19:25:40.711322 (+  1005us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:40.711423 (+   101us) write_op.cc:454] Released schema lock
0812 19:25:40.711492 (+    69us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:40.725617 (+ 14125us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:40.728195 (+  2578us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10427,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":402621,"apply.run_cpu_time_us":5942,"apply.run_wall_time_us":97806,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12499,"num_ops":2,"prepare.queue_time_us":472778,"prepare.run_cpu_time_us":52989,"prepare.run_wall_time_us":270031,"raft.queue_time_us":91469,"raft.run_cpu_time_us":59266,"raft.run_wall_time_us":369489,"replication_time_us":572150,"spinlock_wait_cycles":6369024,"thread_start_us":636715,"threads_started":4,"wal-append.queue_time_us":348251}]]}
W20260812 19:25:41.562203  6179 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:35891, user_credentials={real_user=slave}} blocked reactor thread for 102507us
I20260812 19:25:41.561401 19608 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
W20260812 19:25:41.560160 19820 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260812 19:25:41.599476  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:41.586347 19754 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:41.590269 19093 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:41.599071 19764 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:41.604445 19018 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:41.605795 19370 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260812 19:25:41.629081  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.632881  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:41.621177 19608 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:41.649812  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:41.620568 19093 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:25:41.662352 19840 log.cc:924] Time spent T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260812 19:25:41.620878 19754 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.651376 19646 tablet_copy_client.cc:531] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 19:25:41.643554 19701 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.628159 19018 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.630466 19764 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.660701 19093 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:41.653169 19608 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:41.700560 19843 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.069s	user 0.000s	sys 0.003s
I20260812 19:25:41.691886 19612 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:41.692142 19674 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.705246 19680 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:41.725428 19667 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:41.729977 19667 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:41.690244  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.722162  6344 raft_consensus.cc:1261] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260812 19:25:41.726788 19680 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:41.735626 19754 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.727460 19612 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.740494 19608 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:41.746723  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 61049.4us
W20260812 19:25:41.751784  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 189985us
W20260812 19:25:41.752822  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.757629  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.750224 19018 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.775523  6354 raft_consensus.cc:1261] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260812 19:25:41.783004 19667 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:41.773562 19701 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:41.771581 19754 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:41.751097 19473 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:41.814709 19612 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:41.817026  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.817953  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.827771 19764 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.804965 19754 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:41.835374 19833 log.cc:924] Time spent T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.131s	user 0.003s	sys 0.000s
I20260812 19:25:41.851366 19754 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:41.801622 19701 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:41.852288 19856 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260812 19:25:41.853921 19701 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:41.858232  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.858705  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 90881.9us
W20260812 19:25:41.859320  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.860071  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.860769  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.861459  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.861994  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.806737 19473 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.864835 19473 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.873690  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:41.874482  7591 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:41.878378  6298 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
W20260812 19:25:41.879631 19830 log.cc:924] Time spent T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.465s	user 0.000s	sys 0.005s
I20260812 19:25:41.882292 19837 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:41.882807 19837 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:41.883179 19837 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:41.898756  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:41.899645  6474 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:41.901006  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:41.901917  6482 raft_consensus.cc:2379] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 23: Already voted for candidate bdfa5579d4534c618c00db6b4a841c81 in this term.
I20260812 19:25:41.903935 19680 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:41.899000  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.906872 19680 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:41.889810 19093 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:41.862509  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.910140  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 47666us
W20260812 19:25:41.907439  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.913884  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
W20260812 19:25:41.914887  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.918495  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:41.919315  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.922389  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
W20260812 19:25:41.922942  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:41.926331 19667 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:41.919205  6347 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 25.
I20260812 19:25:41.927016 19667 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:41.928872 19093 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:41.929642 19667 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:41.934768 19646 tablet_bootstrap.cc:492] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap starting.
I20260812 19:25:41.934453 19837 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:41.937335 19837 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:41.938362  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:41.939260  7591 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Advancing to term 22
W20260812 19:25:41.942422  6297 leader_election.cc:334] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260812 19:25:41.949154  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:41.951828  6297 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:41.955152  6416 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:25:41.959148  6297 leader_election.cc:334] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260812 19:25:41.961467  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 184344us
I20260812 19:25:41.950296 19473 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:41.954960 19452 consensus_queue.cc:1035] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260812 19:25:41.958340 19680 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:41.979831  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:41.963135 19701 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:41.985102  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:41.980638  6353 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:41.958120 19311 consensus_queue.cc:1035] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
I20260812 19:25:41.991644  6482 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:41.993535  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:41.991329  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:41.997198  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:41.996757  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:41.998714  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:41.999258  6474 raft_consensus.cc:3037] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:42.000142  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:42.000236  6344 raft_consensus.cc:2379] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 22: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:41.997548  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:41.997927  6483 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:42.001680  6482 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:42.006539  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:42.007222  6482 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:42.005900  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:42.008685  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:42.024624  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 66790.3us
I20260812 19:25:42.030841  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:42.027007  7591 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:42.009298 19436 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260812 19:25:42.038218 19436 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:41.989490 19701 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.039274 19436 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:42.041013 19701 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:42.022814 19582 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:42.047919 19608 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:42.049882 19582 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:42.055311 19311 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:42.055516 19370 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.055827 19311 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.056339 19311 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:42.056244 19370 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.058491 19370 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.066093  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.050918 19436 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.070638  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:42.078181  6474 raft_consensus.cc:2454] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:42.074074  6482 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:41.981933 19473 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.084123  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.084841  6344 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 24.
I20260812 19:25:42.086673  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.088498  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.089310  6475 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 23.
I20260812 19:25:42.091991  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.094426  6297 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:42.097033 19622 raft_consensus.cc:2781] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:42.099995  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:42.100025  6298 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:42.103396  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.104277  6482 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 22.
I20260812 19:25:42.107501  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.127187  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.081362 19837 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:42.084842 19473 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:42.087949 19769 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:42.118971 19582 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:42.135643 19608 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:42.104918 19805 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:42.118415 19622 raft_consensus.cc:686] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:42.177472  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:42.128227 19436 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.119613 19862 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:42.157675 19837 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:42.136222 19531 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:25:42.184965  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:42.187623  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.105590 19828 consensus_queue.cc:1046] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.077s
I20260812 19:25:42.160174 19842 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:42.199566  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:42.151648 19311 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.208626 19311 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:42.209327  6482 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:42.182785 19608 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:42.192371 19755 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.190388 19837 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:42.197906 19582 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:42.203660 19627 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:42.200814 19452 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.217574 19608 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:42.195029 19531 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.274286 19452 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.196702 19769 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.274228 19018 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:25:42.278591  6297 leader_election.cc:334] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.303790 19452 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:42.239830 19755 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.276319 19473 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
W20260812 19:25:42.308076  6297 leader_election.cc:334] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.283118 19627 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.310457  6482 raft_consensus.cc:2454] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 26.
I20260812 19:25:42.189033 19805 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.325842  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:42.204849 19842 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.329423  6344 raft_consensus.cc:2354] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 25. Current term is 26.
I20260812 19:25:42.194105 19862 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:42.356743  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 179472us
I20260812 19:25:42.282251 19622 consensus_queue.cc:237] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.316147 19018 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.320657 19627 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.349212 19863 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:42.321075 19473 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.377983  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:42.377671  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 278568us
I20260812 19:25:42.352087 19889 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:42.357869 19841 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.320188 19582 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:42.400286  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 80516.8us
I20260812 19:25:42.401392  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:42.386776 19863 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.451537 19018 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:42.452502 19863 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.453166 19805 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:42.405076 19841 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.455708 19841 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:42.468353  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 66098.3us
I20260812 19:25:42.469581  6416 leader_election.cc:398] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 25. Current term is 26.
I20260812 19:25:42.470012  6416 leader_election.cc:401] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
W20260812 19:25:42.492091  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 90126.2us
I20260812 19:25:42.441088 19531 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.493726  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.435092 19759 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.494822 19759 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.495893 19862 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:42.501847  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 110962us
I20260812 19:25:42.511395  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.489446 19892 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.532267  6297 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:42.509922 19769 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:42.506361 19900 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:42.536778  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.524974 19531 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.557231  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.397946 19889 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:42.565409  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 96053.2us
I20260812 19:25:42.568500  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.570906  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.572271  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:42.581682  6416 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260812 19:25:42.582799  6416 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.544864 19153 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 25. Current term is 26.
I20260812 19:25:42.552038 19755 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:42.584105  6297 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.552583 19900 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.588395  6359 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 26.
I20260812 19:25:42.563575 19849 raft_consensus.cc:2781] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election won for term 26
W20260812 19:25:42.588070 19886 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260812 19:25:42.532687 19892 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.615924 19889 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.617336 19892 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.619634  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.620940  6482 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 25.
I20260812 19:25:42.626355 19772 raft_consensus.cc:3032] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Stepping down as leader of term 18
I20260812 19:25:42.626907 19772 raft_consensus.cc:729] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:42.627869 19772 consensus_queue.cc:260] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:42.563828 19531 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.595230 19900 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:42.600128 19842 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:42.659286  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:42.669060  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.679332  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:42.671360  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:42.731007 19888 log.cc:924] Time spent T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.330s	user 0.004s	sys 0.000s
I20260812 19:25:42.731451 19769 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:42.732059 19769 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:42.734305 19769 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:42.734547 19370 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:42.736080 19370 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.738219 19370 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.654682 19849 raft_consensus.cc:686] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:42.741386 19849 consensus_queue.cc:237] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.696523 19896 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260812 19:25:42.747077 19896 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.747632 19896 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:42.694614 19754 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260812 19:25:42.751029 19754 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:42.751446 19754 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Advancing to term 27
I20260812 19:25:42.653292 19531 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:42.753913  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 171468us
I20260812 19:25:42.651556 19473 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:42.641652 19837 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.769275  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:42.770155  6482 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
W20260812 19:25:42.785929  6297 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.769009 19837 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.771626 19531 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.771157 19473 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.804211  6482 raft_consensus.cc:2454] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:42.805801  6297 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:42.789135 19769 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.808259 19769 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.809114 19627 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.807533 19927 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:42.810588 19769 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.811354 19927 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.814342 19927 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:42.820869  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 121774us
W20260812 19:25:42.821599  6416 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260812 19:25:42.822724  6416 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.785359 19608 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.824965 19608 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.826967 19804 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:42.827539 19804 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:42.829682 19804 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:42.800595 19473 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.833549 19612 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:42.834157 19473 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.834192 19612 raft_consensus.cc:686] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:42.846513 19612 consensus_queue.cc:237] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.800706 19531 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.851032 19531 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:42.838100 19917 log.cc:924] Time spent T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260812 19:25:42.855217  6055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 126) took 3774 ms. Trace:
I20260812 19:25:42.855743  6055 rpcz_store.cc:276] 0812 19:25:39.080659 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:39.080870 (+   211us) service_pool.cc:227] Handling call
0812 19:25:42.855112 (+3774242us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:41.627081 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:41.729688 (+102607us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:41.729728 (+    40us) write_op.cc:435] Acquired schema lock
0812 19:25:41.729763 (+    35us) tablet.cc:660] Decoding operations
0812 19:25:41.730696 (+   933us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:41.730756 (+    60us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:41.730786 (+    30us) tablet.cc:683] Acquiring locks for 6 operations
0812 19:25:41.811984 (+ 81198us) tablet.cc:699] Row locks acquired
0812 19:25:41.819554 (+  7570us) write_op.cc:260] PREPARE: finished
0812 19:25:41.837736 (+ 18182us) write_op.cc:270] Start()
0812 19:25:41.865455 (+ 27719us) write_op.cc:276] Timestamp: P: 1786562741837025 usec, L: 0
0812 19:25:41.865491 (+    36us) op_driver.cc:331] REPLICATION: starting
0812 19:25:41.866383 (+   892us) log.cc:842] Serialized 2416 byte log entry
0812 19:25:42.324752 (+458369us) op_driver.cc:444] REPLICATION: finished
0812 19:25:42.581232 (+256480us) write_op.cc:301] APPLY: starting
0812 19:25:42.584302 (+  3070us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:42.621745 (+ 37443us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:42.621898 (+   153us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:42.646848 (+ 24950us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:42.649357 (+  2509us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0812 19:25:42.649431 (+    74us) write_op.cc:312] APPLY: finished
0812 19:25:42.649778 (+   347us) log.cc:842] Serialized 65 byte log entry
0812 19:25:42.649973 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:42.650140 (+   167us) write_op.cc:454] Released schema lock
0812 19:25:42.650222 (+    82us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:42.651814 (+  1592us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:42.651850 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":558354,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":214742,"apply.run_cpu_time_us":12969,"apply.run_wall_time_us":86364,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29243,"num_ops":6,"prepare.queue_time_us":132602,"prepare.run_cpu_time_us":21404,"prepare.run_wall_time_us":360105,"raft.queue_time_us":308371,"raft.run_cpu_time_us":7890,"raft.run_wall_time_us":196580,"replication_time_us":459138,"thread_start_us":478654,"threads_started":4,"wal-append.queue_time_us":132431}]]}
I20260812 19:25:42.843204  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.870173  6347 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 in current term 21: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:42.794765 19759 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.859480 19896 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.860368 19900 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.863437 19754 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:42.864964  6416 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.866851 19531 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:42.838769  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975
W20260812 19:25:42.872731  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 103528us
I20260812 19:25:42.870535 19473 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:42.883010  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 44545.3us
I20260812 19:25:42.886595  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:42.893064  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:42.894882  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:42.896973  6483 raft_consensus.cc:1226] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 18. Current term is 19. Ops: []
I20260812 19:25:42.889483 19759 raft_consensus.cc:2781] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:42.909319  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:42.889559 19878 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Advancing to term 21
I20260812 19:25:42.912441  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:42.908384 19018 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260812 19:25:42.931154  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:42.911885 19769 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:42.911059 19759 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:42.914680 19627 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:25:42.935197  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 100047us
I20260812 19:25:42.886739 19531 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.950810  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.892068 19473 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:42.923133 19370 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:25:42.950129  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.955852  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.954105  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.956884  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.959630  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:42.959652 19922 consensus_queue.cc:1159] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdfa5579d4534c618c00db6b4a841c81" responder_term: 19 status { last_received { term: 18 index: 15 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f4ef77b3328a44e8a21dd902b370e25a for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260812 19:25:42.961627  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.962379  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.964077  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:42.964928  6297 leader_election.cc:334] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:42.965359  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.966584 19473 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.967981 19531 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.968346  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.969641 19772 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:42.969815 19900 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:42.969918  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.971323  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.929455 19849 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:42.954013  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.954195  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:42.977922  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:42.985111 19754 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 27 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:42.936702 19608 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:42.986785  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.987929  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:42.992755  6349 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 24.
I20260812 19:25:42.946323 19759 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:42.996486  6473 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260812 19:25:42.955107 19918 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:42.998692 19918 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:43.001710 19918 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:43.001746 19759 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:43.003479 19929 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260812 19:25:43.023985 19841 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:43.024545  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.024552 19841 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.025964  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.026081  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:43.027052 19841 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.027745 19898 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election won for term 24
I20260812 19:25:43.004488  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59df69987ce4bc38077cd7681552414" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.006124  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.007216  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.018555 19805 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:43.019783 19759 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.030146  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.031178  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.032655  6474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.032856  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.036765  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.037632  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:43.037858 19805 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.046116  6470 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:43.046234  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.047027  6354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.047631 19805 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.048594  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.048847  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:43.043141  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.049772  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.050151  6344 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:43.050400  6349 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 24.
I20260812 19:25:43.043448  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.053802  6178 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:43.055856  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.059031  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:43.067746  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.067904  6465 raft_consensus.cc:1261] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260812 19:25:43.070437  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:43.071044  6477 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Advancing to term 27
I20260812 19:25:43.072110  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:43.076901  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.077535  6470 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 24.
I20260812 19:25:43.034874 19898 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 24 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:43.063225 19842 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:43.078538 19370 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:43.091323  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.069921 19759 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:43.014452 19849 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:43.089496  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.097339  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.093983  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:43.102286  6475 raft_consensus.cc:2354] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23.
I20260812 19:25:43.102788  6481 raft_consensus.cc:2379] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 26: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:43.101959  6477 raft_consensus.cc:2454] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 27.
I20260812 19:25:43.076225 19903 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260812 19:25:43.104900  6359 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
W20260812 19:25:43.110426  6416 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:43.105515  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.096872 19370 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:25:43.116360  6477 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 27: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:43.116601  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:43.115993  6178 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:43.121579 19805 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:43.125290  6344 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 24.
I20260812 19:25:43.129055 19849 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.126610  6178 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:43.136435  6178 leader_election.cc:398] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23.
I20260812 19:25:43.136924  6178 leader_election.cc:401] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
W20260812 19:25:43.149155  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 76902.4us
I20260812 19:25:43.133356 19878 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:43.136200 19842 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader election won for term 24
W20260812 19:25:43.148845  6416 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:43.150390  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.155313  6483 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 21.
I20260812 19:25:43.158070  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.155669  6416 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:43.160444  6352 raft_consensus.cc:2379] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 27: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:43.162441 19370 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.168679  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:43.168104  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.150430 19825 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:43.155068 19899 raft_consensus.cc:3037] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:43.172006  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.182184  6359 raft_consensus.cc:2354] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 26. Current term is 27.
I20260812 19:25:43.160799 19842 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 24 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:43.184087 19842 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.186414  6046 catalog_manager.cc:5495] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 13 to 17, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 17 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:25:43.191216 19940 log.cc:924] Time spent T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260812 19:25:43.193506  6046 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 15 to 18, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 18 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:43.196704  6046 catalog_manager.cc:5495] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:43.199375  6046 catalog_manager.cc:5495] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 14 to 18, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 18 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:43.202841 19370 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:43.131781 19898 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.173523  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:43.171689 19900 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:43.175779 19825 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.212374 19825 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:43.217394  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 45054.4us
I20260812 19:25:43.218357  6297 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:43.175799  6416 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260812 19:25:43.219558  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 43794.7us
I20260812 19:25:43.222150 19754 consensus_queue.cc:1035] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260812 19:25:43.161408 19896 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:43.226884 19939 log.cc:924] Time spent T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260812 19:25:43.229293  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.230007  6483 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
W20260812 19:25:43.238150  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 64677.9us
I20260812 19:25:43.238878  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.239080  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.241036  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.243427  6416 leader_election.cc:398] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 election: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 26. Current term is 27.
I20260812 19:25:43.244216  6416 leader_election.cc:401] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260812 19:25:43.247511  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.261001  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.263458  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:43.245060 19909 raft_consensus.cc:2781] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Leader election won for term 27
I20260812 19:25:43.267071 19913 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:43.251833 19370 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260812 19:25:43.270725  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:43.263200 19608 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:43.245285 19825 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:43.296656 19902 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969) with higher term. Message: Invalid argument: T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfa5579d4534c618c00db6b4a841c81 for earlier term 26. Current term is 27.
I20260812 19:25:43.298439 19909 raft_consensus.cc:686] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:43.299512 19909 consensus_queue.cc:237] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.11, Last appended by leader: 11, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.270218  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:43.260826 19805 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:43.258143 19841 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:43.305047  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.315351  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.269199 19899 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599) with higher term. Message: Invalid argument: T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 for earlier term 22. Current term is 23.
I20260812 19:25:43.319620  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.321808  6178 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.317548 19608 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260812 19:25:43.310109 19370 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260812 19:25:43.310110  6297 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:43.342515  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:43.344923 19913 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:43.345270 19910 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:43.345759 19910 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:43.346113 19910 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:43.323673 19841 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:43.323241 19825 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:43.357407  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.360910  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:43.364261  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.365860  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.368567 19608 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:43.373960  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.363174 19825 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:43.380795  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.366393 19842 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:43.366911 19841 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:43.389104 19841 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:43.389684 19841 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Advancing to term 25
W20260812 19:25:43.395161  6297 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:43.399609  7591 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260812 19:25:43.383849 19759 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:43.404014  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:43.398764 19842 raft_consensus.cc:3037] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:43.410797  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.412359 19805 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:43.412489  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:43.413319  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:43.414119 19825 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:43.414557 19825 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:43.414939 19825 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:43.416354 19805 raft_consensus.cc:3037] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Advancing to term 27
I20260812 19:25:43.420626  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.425911 19805 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260812 19:25:43.427759  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.412236 19849 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
W20260812 19:25:43.449453 19942 log.cc:924] Time spent T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.140s	user 0.004s	sys 0.000s
I20260812 19:25:43.461906  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.446177 19627 raft_consensus.cc:482] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:43.465298 19899 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:43.477854  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:43.472057 19944 log.cc:924] Time spent T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260812 19:25:43.483510 19701 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260812 19:25:43.488458  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:43.468466 19627 raft_consensus.cc:504] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.500412  6473 raft_consensus.cc:1261] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260812 19:25:43.505517 19627 leader_election.cc:288] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.519204 19842 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:43.528707 19841 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.506166 19093 consensus_queue.cc:1035] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260812 19:25:43.539377  6473 raft_consensus.cc:1261] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260812 19:25:43.547423 19910 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:43.552884 19910 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.541488 19825 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:43.564028 19825 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Requested vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:43.570925 19841 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:43.573287  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 66711.4us
I20260812 19:25:43.576380  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.580684  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04c512eaceae43d2a378065361eb4854" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.584882  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:43.585649  6344 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:43.588563  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:43.589481  6465 raft_consensus.cc:3037] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:43.594841  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:43.595535  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:43.596483  6349 raft_consensus.cc:2379] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a1541d11be514114966dc1e92a345298 in current term 22: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
I20260812 19:25:43.605835  6344 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1541d11be514114966dc1e92a345298 in term 25.
I20260812 19:25:43.600282  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:43.617627  6178 leader_election.cc:302] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.620800 19018 raft_consensus.cc:2726] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:25:43.633721  6417 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891): Couldn't send request to peer f4ef77b3328a44e8a21dd902b370e25a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:43.636380  6178 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298; no voters: 
I20260812 19:25:43.637650 19825 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader election won for term 25
I20260812 19:25:43.638172 19825 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 25 LEADER]: Becoming Leader. State: Replica: a1541d11be514114966dc1e92a345298, State: Running, Role: LEADER
I20260812 19:25:43.638952  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.640020 19805 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260812 19:25:43.595722 19093 consensus_queue.cc:1035] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
W20260812 19:25:43.640638  6297 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 19:25:43.660887 19825 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.662727  6465 raft_consensus.cc:2454] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:43.665644 19018 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:43.666290 19018 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:43.668412 19018 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:43.681465 19646 tablet_bootstrap.cc:492] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:25:43.684746 19646 tablet_bootstrap.cc:492] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: Bootstrap complete.
I20260812 19:25:43.685709 19646 ts_tablet_manager.cc:1397] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: Time spent bootstrapping tablet: real 1.751s	user 0.060s	sys 0.037s
I20260812 19:25:43.689747  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:43.696715  6349 raft_consensus.cc:1226] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Rejecting Update request from peer bdfa5579d4534c618c00db6b4a841c81 for earlier term 24. Current term is 25. Ops: []
I20260812 19:25:43.701989  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89d6b10f5ff448f592a41c3a77692cfe" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.708155  6178 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:43.710865 19018 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:43.712611  6473 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260812 19:25:43.724924  6297 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:43.725950 19422 raft_consensus.cc:2781] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:43.726675 19422 raft_consensus.cc:686] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:43.727531 19422 consensus_queue.cc:237] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:43.734953 19902 consensus_queue.cc:1046] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.005s
I20260812 19:25:43.740867 19878 raft_consensus.cc:3032] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 24 LEADER]: Stepping down as leader of term 24
I20260812 19:25:43.741339 19878 raft_consensus.cc:729] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:43.746043  6482 raft_consensus.cc:1261] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 25 index: 11. Preceding OpId from leader: term: 27 index: 12. (index mismatch)
I20260812 19:25:43.745667 19878 consensus_queue.cc:260] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:43.742978  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:43.738065 19018 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260812 19:25:43.778491 19878 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:43.798904 19754 consensus_queue.cc:1035] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260812 19:25:43.806638  6344 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260812 19:25:43.809638 19825 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
W20260812 19:25:43.857537  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:43.881908 19646 raft_consensus.cc:348] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:25:43.883096 19646 raft_consensus.cc:729] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Initialized, Role: LEARNER
I20260812 19:25:43.884068 19646 consensus_queue.cc:260] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:25:43.950990 19878 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:43.951743 19878 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:43.948342 19646 ts_tablet_manager.cc:1428] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: Time spent starting tablet: real 0.262s	user 0.007s	sys 0.004s
I20260812 19:25:43.966056 19878 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:43.972527  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:43.975919  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:43.976761  7591 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 19.
I20260812 19:25:43.979154  6417 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:43.989163 19898 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:43.989679 19898 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:43.990057 19898 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:43.999612  6049 catalog_manager.cc:5495] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.001241  6049 catalog_manager.cc:5495] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 16 to 22, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 22 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.012502  6049 catalog_manager.cc:5495] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.014954  6500 tablet_copy_service.cc:342] P bdfa5579d4534c618c00db6b4a841c81: Request end of tablet copy session f4ef77b3328a44e8a21dd902b370e25a-2661573faf994c8f9bb837f55af974d9 received from {username='slave'} at 127.0.0.1:33386
I20260812 19:25:44.015465  6500 tablet_copy_service.cc:433] P bdfa5579d4534c618c00db6b4a841c81: ending tablet copy session f4ef77b3328a44e8a21dd902b370e25a-2661573faf994c8f9bb837f55af974d9 on tablet 2661573faf994c8f9bb837f55af974d9 with peer f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:44.014504  6049 catalog_manager.cc:5495] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 16 to 20, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 20 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.019956  6049 catalog_manager.cc:5495] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.021626  6049 catalog_manager.cc:5495] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.031720  6049 catalog_manager.cc:5495] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 17 to 19, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 19 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.033784  6049 catalog_manager.cc:5495] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.035785  6049 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 22, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:25:44.048333  6046 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38512 (request call id 235) took 32980 ms (client timeout 15000 ms). Trace:
I20260812 19:25:44.049501  6049 catalog_manager.cc:5495] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 21 to 22, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.051338  6049 catalog_manager.cc:5495] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.053486  6049 catalog_manager.cc:5495] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 16 to 18, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 18 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.066947 19842 raft_consensus.cc:482] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:44.067582 19842 raft_consensus.cc:504] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:44.069813 19842 leader_election.cc:288] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:44.070245  6049 catalog_manager.cc:5495] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 11 to 20, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 20 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.072165  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:44.074191  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2920c51f14548a48637e645e719d9cd" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:44.079031  6178 leader_election.cc:302] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:44.080189 19842 raft_consensus.cc:2726] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:44.072844  6049 catalog_manager.cc:5495] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 17 to 21, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 21 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
W20260812 19:25:44.093222  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.094374 19898 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:44.099187 19898 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:44.099843  6049 catalog_manager.cc:5495] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 20, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 20 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.104882  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:44.121572  6049 catalog_manager.cc:5495] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.123281  6049 catalog_manager.cc:5495] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 19 to 21, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 21 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.117571  6347 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260812 19:25:44.126931  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.131090  6049 catalog_manager.cc:5495] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.129920  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:44.137234  7591 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Advancing to term 20
W20260812 19:25:44.055259  6046 rpcz_store.cc:269] 0812 19:25:11.067965 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:11.097664 (+ 29699us) service_pool.cc:227] Handling call
0812 19:25:44.048232 (+32950568us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:43.559477 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:43.560048 (+   571us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:43.560094 (+    46us) write_op.cc:435] Acquired schema lock
0812 19:25:43.560121 (+    27us) tablet.cc:660] Decoding operations
0812 19:25:43.563922 (+  3801us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:43.563999 (+    77us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:43.564023 (+    24us) tablet.cc:683] Acquiring locks for 4 operations
0812 19:25:43.564405 (+   382us) tablet.cc:699] Row locks acquired
0812 19:25:43.564424 (+    19us) write_op.cc:260] PREPARE: finished
0812 19:25:43.564574 (+   150us) write_op.cc:270] Start()
0812 19:25:43.564688 (+   114us) write_op.cc:276] Timestamp: P: 1786562743564527 usec, L: 0
0812 19:25:43.564717 (+    29us) op_driver.cc:331] REPLICATION: starting
0812 19:25:43.565866 (+  1149us) log.cc:842] Serialized 1682 byte log entry
0812 19:25:43.589442 (+ 23576us) op_driver.cc:444] REPLICATION: finished
0812 19:25:43.835704 (+246262us) write_op.cc:301] APPLY: starting
0812 19:25:43.841482 (+  5778us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:43.859663 (+ 18181us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:43.860942 (+  1279us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:43.927527 (+ 66585us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:43.927754 (+   227us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0812 19:25:43.927814 (+    60us) write_op.cc:312] APPLY: finished
0812 19:25:43.928082 (+   268us) log.cc:842] Serialized 49 byte log entry
0812 19:25:43.928280 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:43.928397 (+   117us) write_op.cc:454] Released schema lock
0812 19:25:43.928447 (+    50us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:43.947204 (+ 18757us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:43.947239 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3520,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":239701,"apply.run_cpu_time_us":8556,"apply.run_wall_time_us":115306,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20871,"num_ops":4,"prepare.queue_time_us":204514,"prepare.run_cpu_time_us":3389,"prepare.run_wall_time_us":21141,"replication_time_us":24606,"thread_start_us":255162,"threads_started":2}]]}
I20260812 19:25:44.137666 19825 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260812 19:25:44.143980  6482 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Refusing update from remote peer a1541d11be514114966dc1e92a345298: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 17. (term mismatch)
I20260812 19:25:44.144394  6482 pending_rounds.cc:76] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Aborting all ops after (but not including) 16
I20260812 19:25:44.144622  6482 pending_rounds.cc:97] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: Aborting uncommitted NO_OP operation due to leader change: 24.17
I20260812 19:25:44.144866  6482 raft_consensus.cc:2866] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:25:44.146114  6049 catalog_manager.cc:5495] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.148051 19769 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260812 19:25:44.154232  4084 thread.cc:536] Waited for 1000ms trying to join with heartbeat (tid 6273)
I20260812 19:25:44.160871  6049 catalog_manager.cc:5495] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 20, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:25:44.175436  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.171303  6049 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 19 to 20, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.158982  7591 raft_consensus.cc:2454] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 20.
I20260812 19:25:44.179212  6417 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:25:44.180033 19898 raft_consensus.cc:2781] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:44.181003  6049 catalog_manager.cc:5495] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 19 to 20, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 20 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.182309 19898 raft_consensus.cc:686] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:44.184274 19898 consensus_queue.cc:237] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:44.205056  7591 raft_consensus.cc:1203] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 LEARNER]: Deduplicated request from leader. Original: 21.11->[21.12-21.12]   Dedup: 21.12->[]
I20260812 19:25:44.222294  6483 raft_consensus.cc:1261] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260812 19:25:44.226286 19769 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:44.235044 19769 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:44.227967  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.241667 19769 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:44.243234  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:44.245810  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:44.248670  6178 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:44.251185 19842 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:44.240859 19612 consensus_queue.cc:1035] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
W20260812 19:25:44.276988  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.285665  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.324091  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.327490  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:44.387121  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.388264  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.409771  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.446977  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.471204  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.472584  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.500083 19841 raft_consensus.cc:482] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:44.500798 19841 raft_consensus.cc:504] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:44.505388 19841 leader_election.cc:288] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:44.505422  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:44.507037  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d49af1f98624af48adc92f25f5a2be7" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:44.508646  6178 leader_election.cc:302] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:44.510596 19841 raft_consensus.cc:2726] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260812 19:25:44.525833  6046 catalog_manager.cc:5495] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index -1 to 12, NON_VOTER f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) added. New cstate: current_term: 21 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } }
I20260812 19:25:44.527841  6046 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
W20260812 19:25:44.536022  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.549950  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.567405  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.579617  7591 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260812 19:25:44.581022 19878 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260812 19:25:44.586294 19825 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:44.587020 19825 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:44.592121 19898 raft_consensus.cc:1050] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: attempting to promote NON_VOTER f4ef77b3328a44e8a21dd902b370e25a to VOTER
I20260812 19:25:44.592262  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:44.595682 19825 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:44.595860  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:44.597198 19898 consensus_queue.cc:237] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 10, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:44.599730  6178 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:44.604820 19825 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:44.608042 19825 raft_consensus.cc:482] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:44.608647 19825 raft_consensus.cc:504] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:44.629803  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:44.636898 19825 leader_election.cc:288] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:44.637938  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4b7bb14bdb4198a276add34849a84e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:44.639228  6349 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260812 19:25:44.639614  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.647286  7598 raft_consensus.cc:1261] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 LEARNER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260812 19:25:44.647193  6179 leader_election.cc:302] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:44.654943 19825 raft_consensus.cc:2726] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:44.647004 19918 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260812 19:25:44.678339 19878 consensus_queue.cc:1035] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
W20260812 19:25:44.697014  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.707151  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:44.716781  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:44.720544  6060 catalog_manager.cc:5495] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.726557  6060 catalog_manager.cc:5495] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 20 to 21, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 21 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.729084  6060 catalog_manager.cc:5495] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 22, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 22 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.736353 19849 raft_consensus.cc:482] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:44.737185 19849 raft_consensus.cc:504] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:44.739459 19849 leader_election.cc:288] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:44.740497  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:44.743453  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76f36493d454308b43951f8eb142b7e" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:44.744299  6060 catalog_manager.cc:5495] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.746227  6060 catalog_manager.cc:5495] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 18 to 24, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 24 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:25:44.748322  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.748692  6347 raft_consensus.cc:3037] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 20
I20260812 19:25:44.749135  6297 leader_election.cc:302] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:44.753953  6060 catalog_manager.cc:5495] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 19 to 25, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 25 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.756330  6060 catalog_manager.cc:5495] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 21 to 24, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 24 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:44.757869  6060 catalog_manager.cc:5495] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.759470  6060 catalog_manager.cc:5495] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 19, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 19 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.761049  6060 catalog_manager.cc:5495] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 19 to 26. New cstate: current_term: 26 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.762224  6060 catalog_manager.cc:5495] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
W20260812 19:25:44.783171  6049 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 244) took 16111 ms (client timeout 15000 ms). Trace:
I20260812 19:25:44.787220  6060 catalog_manager.cc:5495] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 20 to 24, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 24 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.790462  6060 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 22 to 23, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 23 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
W20260812 19:25:44.796183  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.797595  6060 catalog_manager.cc:5495] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.801185  6347 raft_consensus.cc:1261] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260812 19:25:44.809466 19422 raft_consensus.cc:2726] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:44.805500 19841 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:44.811925 19841 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:44.783658  6049 rpcz_store.cc:269] 0812 19:25:28.671890 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:28.680377 (+  8487us) service_pool.cc:227] Handling call
0812 19:25:44.783059 (+16102682us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:44.268515 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:44.269025 (+   510us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:44.269058 (+    33us) write_op.cc:435] Acquired schema lock
0812 19:25:44.269074 (+    16us) tablet.cc:660] Decoding operations
0812 19:25:44.321391 (+ 52317us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:44.321478 (+    87us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:44.321503 (+    25us) tablet.cc:683] Acquiring locks for 22 operations
0812 19:25:44.323068 (+  1565us) tablet.cc:699] Row locks acquired
0812 19:25:44.323089 (+    21us) write_op.cc:260] PREPARE: finished
0812 19:25:44.323243 (+   154us) write_op.cc:270] Start()
0812 19:25:44.323377 (+   134us) write_op.cc:276] Timestamp: P: 1786562744323193 usec, L: 0
0812 19:25:44.323402 (+    25us) op_driver.cc:331] REPLICATION: starting
0812 19:25:44.324019 (+   617us) log.cc:842] Serialized 8558 byte log entry
0812 19:25:44.390816 (+ 66797us) op_driver.cc:444] REPLICATION: finished
0812 19:25:44.391190 (+   374us) write_op.cc:301] APPLY: starting
0812 19:25:44.391290 (+   100us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:44.411328 (+ 20038us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:44.411425 (+    97us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:44.508775 (+ 97350us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:44.509103 (+   328us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0812 19:25:44.509145 (+    42us) write_op.cc:312] APPLY: finished
0812 19:25:44.511111 (+  1966us) log.cc:842] Serialized 196 byte log entry
0812 19:25:44.523153 (+ 12042us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:44.523376 (+   223us) write_op.cc:454] Released schema lock
0812 19:25:44.523434 (+    58us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:44.523768 (+   334us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:44.523795 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34971,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":93,"apply.run_cpu_time_us":28001,"apply.run_wall_time_us":133018,"cfile_cache_hit":88,"cfile_cache_hit_bytes":92092,"num_ops":22,"prepare.queue_time_us":59929,"prepare.run_cpu_time_us":6325,"prepare.run_wall_time_us":55836,"replication_time_us":67291,"thread_start_us":31825,"threads_started":1}]]}
I20260812 19:25:44.808496  6060 catalog_manager.cc:5495] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 20 to 22, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 22 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
W20260812 19:25:44.815857  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:44.815766  6060 catalog_manager.cc:5495] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 16 to 25. New cstate: current_term: 25 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.819087  6060 catalog_manager.cc:5495] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 20 to 23, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 23 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.818475 19878 raft_consensus.cc:2932] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index 12 to 13, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:44.820272  6060 catalog_manager.cc:5495] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 18, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 18 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:44.821419  6060 catalog_manager.cc:5495] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.823331 19898 consensus_queue.cc:1035] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260812 19:25:44.822492  6060 catalog_manager.cc:5495] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 21 to 25, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 25 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.984978 19841 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:44.986620  6060 catalog_manager.cc:5495] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 reported cstate change: term changed from 15 to 25, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 25 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:44.984409  6349 raft_consensus.cc:2932] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:45.011183 19825 raft_consensus.cc:482] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
W20260812 19:25:45.061582  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 67242.4us
I20260812 19:25:45.063741  7591 raft_consensus.cc:2932] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:45.051965 19825 raft_consensus.cc:504] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.079562 19825 leader_election.cc:288] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.092674 19998 raft_consensus.cc:482] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:25:45.121136  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 76029.9us
I20260812 19:25:45.121117  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.120105 19998 raft_consensus.cc:504] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.104996 19825 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:45.143913 19998 leader_election.cc:288] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.145474 19998 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:45.146035 19998 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.122313  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:45.158952  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44576.6us
W20260812 19:25:45.159780  4084 thread.cc:536] Waited for 2000ms trying to join with heartbeat (tid 6273)
W20260812 19:25:45.175200  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 52722us
I20260812 19:25:45.188633  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eac496b52764773a5bb2dceffc30dc3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.194713  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6454eb944afe4306b52388febd0f82bb" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.200410 19998 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.141463 19825 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.220152 19825 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.214815 19841 raft_consensus.cc:482] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:45.223610 19841 raft_consensus.cc:504] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.225884 19841 leader_election.cc:288] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.230834 19841 raft_consensus.cc:482] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:45.231411 19841 raft_consensus.cc:504] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:45.233582 19841 leader_election.cc:288] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:45.275558  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:45.278409  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:45.280313  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.285410  6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.289059  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.285463  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.288113  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7798b18b2fb4b0baa349294c1006e91" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.293529  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7441e51865745dea6bedf82183de6c0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.303182  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e69ce57e6c74dea9e207b6ae03c43b2" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.303283  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ae22a8efcc4f26bdc2d4cc4266111a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.303313  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:45.309476  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 51495.2us
I20260812 19:25:45.282519 19842 raft_consensus.cc:482] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:45.295136 20001 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:45.321789 19842 raft_consensus.cc:504] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.309562 19769 raft_consensus.cc:482] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:45.303086 20024 raft_consensus.cc:482] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:45.339428  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bacc9fc105004c639dc9ed487bd8dd97" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:45.315186 19627 raft_consensus.cc:482] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:45.342533 19841 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:45.323576 20021 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:45.330981 19842 leader_election.cc:288] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.354312 19627 raft_consensus.cc:504] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:45.363281 19627 leader_election.cc:288] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:45.338798 19769 raft_consensus.cc:504] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.368695 19769 leader_election.cc:288] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:45.374099  6178 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 56939us
W20260812 19:25:45.380129  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 60562.2us
I20260812 19:25:45.342392 20001 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.384163 20001 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.359969 19841 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.388517 19841 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.370456 20021 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.391319 20021 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.345404 20024 raft_consensus.cc:504] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:45.393930 20024 leader_election.cc:288] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:45.412757  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:45.417891 20001 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:45.419490 20001 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.421573 20001 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.415125 19841 raft_consensus.cc:482] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:45.422376 19841 raft_consensus.cc:504] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.423674  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:45.424319  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:45.425061 19627 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:45.424523 19841 leader_election.cc:288] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.425617 19627 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.426841  6178 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.429581 19627 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.432426 20025 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260812 19:25:45.434192  6178 leader_election.cc:302] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.435070 20026 raft_consensus.cc:2726] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:45.440120 20041 raft_consensus.cc:482] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:45.440662 20041 raft_consensus.cc:504] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:45.442858 20041 leader_election.cc:288] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:45.455847  6178 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
W20260812 19:25:45.456485  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:45.456874  6179 leader_election.cc:302] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:45.458747  6178 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.460098 20024 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:45.477566 20041 raft_consensus.cc:2726] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:45.486908 19627 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:45.487252  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:45.487396  6178 leader_election.cc:302] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.488243 19627 raft_consensus.cc:2726] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:45.488672  6178 leader_election.cc:302] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.491377  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.494450  6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.494536  6483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ed79a983adf41fb8e94a099bb3c0974" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.495764  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.495838  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3d1eb75377449c8b2ea3ee9e6622404" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.495787  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.497073  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.498219 20041 raft_consensus.cc:2726] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:45.501221  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.502099  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956de4b24b3d4a2693e1dcc392b1dd00" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.503445  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.504961  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e38bc4707784979b4d00b45879a8f0b" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.497133  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b02969fd01604c6eb8dad2ecb92d0224" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.507464  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.510620 19627 raft_consensus.cc:482] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:45.510891 20041 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:25:45.511282 19627 raft_consensus.cc:504] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.511446 20041 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.513288  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4c2eb0bf29b48b3ae29c175fe03718f" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.513603 20041 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.513568 19627 leader_election.cc:288] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.515021  6349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545108632fab48129db7f032619a1e55" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.517102  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.518447  6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67c9cd7e3397473ba76fb87340b6c6e0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.514567  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.520884  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b6d90aaa384b5fb66f3320981f1aa0" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.522980  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.524052  6353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "982b09b6d3b34920ac161f2649012c72" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.524778  6178 leader_election.cc:302] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:45.525574 20041 raft_consensus.cc:2726] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:45.527143 19627 raft_consensus.cc:482] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ef77b3328a44e8a21dd902b370e25a)
I20260812 19:25:45.527655 19627 raft_consensus.cc:504] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:45.529677 19627 leader_election.cc:288] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:45.538239  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc485edcf4e4bbc84bff9c14c471284" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.538823  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:45.540515  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bf9c8ef81414ede8e942ee03b95a816" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.551100 19627 raft_consensus.cc:482] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:45.551797 19627 raft_consensus.cc:504] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.554000 19627 leader_election.cc:288] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.554575  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e47beaf4e3f74103977b8ba04492ff79" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:45.558493  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:45.562078  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:45.562767  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:45.563452  6178 leader_election.cc:302] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.564330 19627 raft_consensus.cc:2726] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:45.565075  6178 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.566287 19627 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:45.593674  6178 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.595510 20041 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:45.597373  6178 leader_election.cc:302] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.598945 20041 raft_consensus.cc:2726] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260812 19:25:45.593739  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:45.600720  6178 leader_election.cc:302] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
W20260812 19:25:45.600776  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:45.602351  6178 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.609583  6178 leader_election.cc:302] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.601667 20041 raft_consensus.cc:2726] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:45.610853 20024 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:25:45.608207 19627 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:45.611595 20024 raft_consensus.cc:2726] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:45.612844  6178 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.613771 20024 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260812 19:25:45.612282 19627 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:25:45.615234  6178 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.615963 19627 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:45.616098 20024 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:45.617115  6178 leader_election.cc:302] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:45.618798 20024 raft_consensus.cc:2726] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:45.623410  6178 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.624635  6178 leader_election.cc:302] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.624867 19627 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:25:45.628520 20026 raft_consensus.cc:2726] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:45.630944  6178 leader_election.cc:302] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:45.640846 20024 raft_consensus.cc:2726] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:45.644681  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.647243  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.650940  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ee24e5b3dd4df3bd9647d68d3ced5e" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.655519  6178 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.656508 20024 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:45.662803  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8fcb9244e2242f0bb95ee6cb9a69d50" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:45.666047  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:45.677022  6178 leader_election.cc:302] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:45.677873 20026 raft_consensus.cc:2726] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:45.734886  6046 catalog_manager.cc:5495] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:45.758443  6044 maintenance_manager.cc:419] P 4483e3a69e644cbea699c6f7c9c1da9e: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033360
I20260812 19:25:45.793167  6060 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 201) took 2097 ms. Trace:
I20260812 19:25:45.793699  6060 rpcz_store.cc:276] 0812 19:25:43.695558 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:43.697570 (+  2012us) service_pool.cc:227] Handling call
0812 19:25:43.737696 (+ 40126us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b5400002dd4. stack: 00007f98f482a033 00007f98f4829f30 00007f98f4188534 00007f98fde888b4 00007f98fde88849 00007f98f76fdaf0 00007f98f7780f2a 00007f98fd6d2d6c 00007f98fd7ccc3e 00007f98fbadefb4 00007f98fbadef42 00007f98fbadee71 00007f98fbadedec 00007f98fbade0a2 00007f98f5bae94c 00007f98f5badd86
0812 19:25:45.793071 (+2055375us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:45.205554 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:45.206193 (+   639us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:45.206228 (+    35us) write_op.cc:435] Acquired schema lock
0812 19:25:45.206239 (+    11us) tablet.cc:660] Decoding operations
0812 19:25:45.207923 (+  1684us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:45.207983 (+    60us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:45.208011 (+    28us) tablet.cc:683] Acquiring locks for 21 operations
0812 19:25:45.216520 (+  8509us) tablet.cc:699] Row locks acquired
0812 19:25:45.216542 (+    22us) write_op.cc:260] PREPARE: finished
0812 19:25:45.216695 (+   153us) write_op.cc:270] Start()
0812 19:25:45.216823 (+   128us) write_op.cc:276] Timestamp: P: 1786562745216644 usec, L: 0
0812 19:25:45.216845 (+    22us) op_driver.cc:331] REPLICATION: starting
0812 19:25:45.217586 (+   741us) log.cc:842] Serialized 8172 byte log entry
0812 19:25:45.327227 (+109641us) op_driver.cc:444] REPLICATION: finished
0812 19:25:45.467147 (+139920us) write_op.cc:301] APPLY: starting
0812 19:25:45.467234 (+    87us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:45.597414 (+130180us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:45.597540 (+   126us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:45.682523 (+ 84983us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:45.686296 (+  3773us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=0,mrs_lookups=0
0812 19:25:45.686347 (+    51us) write_op.cc:312] APPLY: finished
0812 19:25:45.689594 (+  3247us) log.cc:842] Serialized 188 byte log entry
0812 19:25:45.689786 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:45.689989 (+   203us) write_op.cc:454] Released schema lock
0812 19:25:45.690049 (+    60us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:45.751995 (+ 61946us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:45.752028 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":602,"reported_tablets":52,"spinlock_wait_cycles":5283712,"child_traces":[["op",{"apply.queue_time_us":139619,"apply.run_cpu_time_us":29851,"apply.run_wall_time_us":285357,"cfile_cache_hit":86,"cfile_cache_hit_bytes":92033,"num_ops":21,"prepare.queue_time_us":138250,"prepare.run_cpu_time_us":5580,"prepare.run_wall_time_us":15301,"replication_time_us":110274,"thread_start_us":196507,"threads_started":2}]]}
I20260812 19:25:45.804317  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:25:45.807901  4084 tablet_replica.cc:330] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:45.808897  4084 raft_consensus.cc:2229] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 25 LEADER]: Raft consensus shutting down.
I20260812 19:25:45.810017  4084 raft_consensus.cc:2258] T c3c085c12bc74f5b8a4f6f69990e1a82 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:45.813405  4084 tablet_replica.cc:330] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:45.814494  4084 raft_consensus.cc:2229] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:45.817116  4084 pending_rounds.cc:62] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Trying to abort 2 pending ops.
I20260812 19:25:45.817430  4084 pending_rounds.cc:68] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Aborting op as it isn't in flight: id { term: 23 index: 13 } timestamp: 7317760976692563968 op_type: NO_OP noop_request { }
I20260812 19:25:45.818102  4084 raft_consensus.cc:2866] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:25:45.819569  4084 pending_rounds.cc:68] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298: Aborting op as it isn't in flight: id { term: 21 index: 12 } timestamp: 7317760946661949440 op_type: NO_OP noop_request { }
I20260812 19:25:45.820278  4084 raft_consensus.cc:2866] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:25:45.820751  4084 raft_consensus.cc:2258] T 956de4b24b3d4a2693e1dcc392b1dd00 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:45.840524  6046 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60312 (request call id 129) took 1137 ms. Trace:
W20260812 19:25:45.848145  7553 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 287 similar messages]
I20260812 19:25:45.863812  4084 tablet_replica.cc:330] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:45.864997  4084 raft_consensus.cc:2229] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:45.868646  6055 catalog_manager.cc:5495] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 16 to 23, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 23 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:45.870010  4084 raft_consensus.cc:2258] T 93caa3d3062a45cbad94ff4ba511f2e0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:45.870434  6055 catalog_manager.cc:5495] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 21 to 23, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 23 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:45.873117  6055 catalog_manager.cc:5495] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 22 to 24, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 24 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:45.874907  6055 catalog_manager.cc:5495] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 19 to 23, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 23 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:45.877908  6055 catalog_manager.cc:5495] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:45.883891  6055 catalog_manager.cc:5495] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 18 to 27, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 27 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:45.888968  6055 catalog_manager.cc:5495] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 22 to 25. New cstate: current_term: 25 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:45.890175  6055 catalog_manager.cc:5495] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 20 to 23. New cstate: current_term: 23 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:45.841079  6046 rpcz_store.cc:276] 0812 19:25:44.703190 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:44.703399 (+   209us) service_pool.cc:227] Handling call
0812 19:25:45.840442 (+1137043us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:45.787749 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:45.788335 (+   586us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:45.788397 (+    62us) write_op.cc:435] Acquired schema lock
0812 19:25:45.788417 (+    20us) tablet.cc:660] Decoding operations
0812 19:25:45.788806 (+   389us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:45.788904 (+    98us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:45.788936 (+    32us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:25:45.789140 (+   204us) tablet.cc:699] Row locks acquired
0812 19:25:45.789161 (+    21us) write_op.cc:260] PREPARE: finished
0812 19:25:45.789353 (+   192us) write_op.cc:270] Start()
0812 19:25:45.789468 (+   115us) write_op.cc:276] Timestamp: P: 1786562745789292 usec, L: 0
0812 19:25:45.789491 (+    23us) op_driver.cc:331] REPLICATION: starting
0812 19:25:45.808938 (+ 19447us) log.cc:842] Serialized 530 byte log entry
0812 19:25:45.830720 (+ 21782us) op_driver.cc:444] REPLICATION: finished
0812 19:25:45.834618 (+  3898us) write_op.cc:301] APPLY: starting
0812 19:25:45.834782 (+   164us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:45.835659 (+   877us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:45.835762 (+   103us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:45.836797 (+  1035us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:45.836994 (+   197us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0812 19:25:45.837042 (+    48us) write_op.cc:312] APPLY: finished
0812 19:25:45.837245 (+   203us) log.cc:842] Serialized 25 byte log entry
0812 19:25:45.837412 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:45.837502 (+    90us) write_op.cc:454] Released schema lock
0812 19:25:45.837545 (+    43us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:45.837870 (+   325us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:45.837911 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8031,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":2513,"apply.run_cpu_time_us":3553,"apply.run_wall_time_us":3554,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":49711,"prepare.run_cpu_time_us":3024,"prepare.run_wall_time_us":39474,"replication_time_us":38409,"thread_start_us":49332,"threads_started":1}]]}
I20260812 19:25:45.891309  6055 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 20 to 24, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 24 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:45.923410  4084 tablet_replica.cc:330] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:45.924583  4084 raft_consensus.cc:2229] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:45.925206  4084 raft_consensus.cc:2258] T 6454eb944afe4306b52388febd0f82bb P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:45.944651 20041 raft_consensus.cc:482] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:45.950445 20041 raft_consensus.cc:504] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.965965 20041 leader_election.cc:288] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.968066  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.973577  4084 tablet_replica.cc:330] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:45.961120 19627 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:45.979565 19627 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:45.984362 19627 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:45.984699  6043 maintenance_manager.cc:643] P 4483e3a69e644cbea699c6f7c9c1da9e: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.225s	user 0.038s	sys 0.000s Metrics: {"bytes_written":6045,"delete_count":0,"lbm_write_time_us":1101,"lbm_writes_lt_1ms":6,"reinsert_count":0,"update_count":250}
I20260812 19:25:45.985934  4084 raft_consensus.cc:2229] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:45.987115  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 28 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:45.988909  4084 raft_consensus.cc:2258] T 4ed79a983adf41fb8e94a099bb3c0974 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:45.995023  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff48be70624f412e9bf485b5e489adf3" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 28 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.994596  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed681895af14e88b9b457a6b6a85e1a" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:45.996029  6044 maintenance_manager.cc:419] P 4483e3a69e644cbea699c6f7c9c1da9e: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.268047
I20260812 19:25:46.001477  6178 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:46.012670  4084 tablet_replica.cc:330] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.013186 20043 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260812 19:25:46.025718  4084 raft_consensus.cc:2229] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.031311  4084 raft_consensus.cc:2258] T 04c512eaceae43d2a378065361eb4854 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260812 19:25:46.033923  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:46.044296 19627 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:46.049229 19627 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:46.062887  4084 tablet_replica.cc:330] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.063994  4084 raft_consensus.cc:2229] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260812 19:25:46.065128  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 51699.3us
I20260812 19:25:46.066336  6178 leader_election.cc:302] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:46.068365 20043 raft_consensus.cc:2726] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:46.068778 19627 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:46.070595  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:46.074992  4084 raft_consensus.cc:2258] T 82ee24e5b3dd4df3bd9647d68d3ced5e P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.075050  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4336f7dd434c238a9022aa16490450" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:46.078819  6178 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:46.114871 20026 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260812 19:25:46.141983  4084 tablet_replica.cc:330] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.143409  4084 raft_consensus.cc:2229] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.144193  4084 raft_consensus.cc:2258] T 1ed681895af14e88b9b457a6b6a85e1a P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.138857 20026 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:25:46.172009  6046 catalog_manager.cc:5495] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: config changed from index 12 to 13, f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } } }
I20260812 19:25:46.150430 20026 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } }
I20260812 19:25:46.177450  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:46.178604 20026 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:46.184710  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2661573faf994c8f9bb837f55af974d9" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:46.186147  6178 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:46.187394 20026 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:46.193601  4084 tablet_replica.cc:330] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.194535  4084 raft_consensus.cc:2229] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.207948  4084 raft_consensus.cc:2258] T 8b1f6c5d06f046a1818f453d9b609502 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.226915  4084 tablet_replica.cc:330] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.239595  4084 raft_consensus.cc:2229] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.240363  4084 raft_consensus.cc:2258] T f1b6d90aaa384b5fb66f3320981f1aa0 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.248486  4084 tablet_replica.cc:330] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.253520  4084 raft_consensus.cc:2229] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.254828  4084 raft_consensus.cc:2258] T 7230832bbf3743e0a33e68f405d6b124 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.297049  4084 tablet_replica.cc:330] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.316642  4084 raft_consensus.cc:2229] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.316768  6055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 245) took 2503 ms. Trace:
I20260812 19:25:46.317236  6055 rpcz_store.cc:276] 0812 19:25:43.813867 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:43.988253 (+174386us) service_pool.cc:227] Handling call
0812 19:25:46.316704 (+2328451us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:25:45.982244 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:25:45.982771 (+   527us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:25:45.982810 (+    39us) write_op.cc:435] Acquired schema lock
0812 19:25:45.982822 (+    12us) tablet.cc:660] Decoding operations
0812 19:25:45.983815 (+   993us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:25:45.983875 (+    60us) write_op.cc:641] Partition lock acquired for write op
0812 19:25:45.983901 (+    26us) tablet.cc:683] Acquiring locks for 9 operations
0812 19:25:45.984633 (+   732us) tablet.cc:699] Row locks acquired
0812 19:25:45.984656 (+    23us) write_op.cc:260] PREPARE: finished
0812 19:25:45.984800 (+   144us) write_op.cc:270] Start()
0812 19:25:45.984907 (+   107us) write_op.cc:276] Timestamp: P: 1786562745984746 usec, L: 0
0812 19:25:45.984927 (+    20us) op_driver.cc:331] REPLICATION: starting
0812 19:25:45.985568 (+   641us) log.cc:842] Serialized 3592 byte log entry
0812 19:25:46.022111 (+ 36543us) op_driver.cc:444] REPLICATION: finished
0812 19:25:46.027271 (+  5160us) write_op.cc:301] APPLY: starting
0812 19:25:46.027426 (+   155us) tablet.cc:1365] starting BulkCheckPresence
0812 19:25:46.062220 (+ 34794us) tablet.cc:1368] finished BulkCheckPresence
0812 19:25:46.062387 (+   167us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:25:46.149601 (+ 87214us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:25:46.163332 (+ 13731us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0812 19:25:46.163383 (+    51us) write_op.cc:312] APPLY: finished
0812 19:25:46.163764 (+   381us) log.cc:842] Serialized 89 byte log entry
0812 19:25:46.165770 (+  2006us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:46.165929 (+   159us) write_op.cc:454] Released schema lock
0812 19:25:46.165984 (+    55us) write_op.cc:341] FINISH: Updating metrics
0812 19:25:46.183883 (+ 17899us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:25:46.183915 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38782,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":2260,"apply.run_cpu_time_us":16645,"apply.run_wall_time_us":157580,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37674,"cfile_init":1,"lbm_read_time_us":527,"lbm_reads_lt_1ms":4,"num_ops":9,"prepare.queue_time_us":11164,"prepare.run_cpu_time_us":3661,"prepare.run_wall_time_us":9420,"replication_time_us":36153}]]}
I20260812 19:25:46.328069  4084 raft_consensus.cc:2258] T 545108632fab48129db7f032619a1e55 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.346554  4084 tablet_replica.cc:330] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.347448  4084 raft_consensus.cc:2229] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 25 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.348536  4084 raft_consensus.cc:2258] T 529ed979cd2842acb5bc24debb151b93 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.358613  4084 tablet_replica.cc:330] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.359503  4084 raft_consensus.cc:2229] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.369921  4084 raft_consensus.cc:2258] T 89d6b10f5ff448f592a41c3a77692cfe P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.373055  4084 tablet_replica.cc:330] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.373854  4084 raft_consensus.cc:2229] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.374487  4084 raft_consensus.cc:2258] T b02969fd01604c6eb8dad2ecb92d0224 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.381850  6043 maintenance_manager.cc:643] P 4483e3a69e644cbea699c6f7c9c1da9e: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.384s	user 0.091s	sys 0.016s Metrics: {"cfile_cache_miss":7,"cfile_cache_miss_bytes":26039,"cfile_init":3,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":33885,"dirs.run_cpu_time_us":284,"dirs.run_wall_time_us":285,"lbm_read_time_us":2019,"lbm_reads_lt_1ms":19,"lbm_write_time_us":1630,"lbm_writes_lt_1ms":11,"reinsert_count":0,"thread_start_us":36342,"threads_started":1,"update_count":250}
I20260812 19:25:46.385924  4084 tablet_replica.cc:330] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.386952  4084 raft_consensus.cc:2229] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 22 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.388063  4084 raft_consensus.cc:2258] T 08db676d084c41abaa2e196e5c2653b5 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.393899  4084 tablet_replica.cc:330] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.403542  4084 raft_consensus.cc:2229] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.406237  4084 raft_consensus.cc:2258] T fa4336f7dd434c238a9022aa16490450 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.453258  4084 tablet_replica.cc:330] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.454177  4084 raft_consensus.cc:2229] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.454833  4084 raft_consensus.cc:2258] T e47beaf4e3f74103977b8ba04492ff79 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260812 19:25:46.455763  6053 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 243) took 37893 ms (client timeout 15000 ms). Trace:
W20260812 19:25:46.461005  6053 rpcz_store.cc:269] 0812 19:25:08.566180 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:08.566606 (+   426us) service_pool.cc:227] Handling call
0812 19:25:46.455544 (+37888938us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":52}
I20260812 19:25:46.458102  4084 tablet_replica.cc:330] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.462806  4084 raft_consensus.cc:2229] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.463410  4084 pending_rounds.cc:62] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Trying to abort 1 pending ops.
I20260812 19:25:46.463675  4084 pending_rounds.cc:68] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298: Aborting op as it isn't in flight: id { term: 24 index: 14 } timestamp: 7317760976731385856 op_type: NO_OP noop_request { }
I20260812 19:25:46.464057  4084 raft_consensus.cc:2866] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:25:46.464447  4084 raft_consensus.cc:2258] T c7441e51865745dea6bedf82183de6c0 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.467276  4084 tablet_replica.cc:330] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.468071  4084 raft_consensus.cc:2229] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.468688  4084 raft_consensus.cc:2258] T 982b09b6d3b34920ac161f2649012c72 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.480729  4084 tablet_replica.cc:330] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.481606  4084 raft_consensus.cc:2229] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.482327  4084 raft_consensus.cc:2258] T 67c9cd7e3397473ba76fb87340b6c6e0 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260812 19:25:46.502240  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:46.503713  4084 tablet_replica.cc:330] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.504684  4084 raft_consensus.cc:2229] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.505402  4084 pending_rounds.cc:62] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Trying to abort 1 pending ops.
I20260812 19:25:46.505687  4084 pending_rounds.cc:68] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298: Aborting op as it isn't in flight: id { term: 21 index: 13 } timestamp: 7317760975919271936 op_type: NO_OP noop_request { }
I20260812 19:25:46.506114  4084 raft_consensus.cc:2866] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:25:46.506620  4084 raft_consensus.cc:2258] T c59df69987ce4bc38077cd7681552414 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.514823  4084 tablet_replica.cc:330] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.515870  4084 raft_consensus.cc:2229] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.516830  4084 raft_consensus.cc:2258] T 2661573faf994c8f9bb837f55af974d9 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.521449  4084 tablet_replica.cc:330] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.522356  4084 raft_consensus.cc:2229] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.527872  4084 raft_consensus.cc:2258] T 9444dc5105264169a510f4261e7a1f40 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.531452 19627 raft_consensus.cc:482] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:46.547789 19627 raft_consensus.cc:504] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:46.552054 19627 leader_election.cc:288] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:46.558091  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:46.554766  4084 tablet_replica.cc:330] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.562214  4084 raft_consensus.cc:2229] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.562949  4084 raft_consensus.cc:2258] T d3d1eb75377449c8b2ea3ee9e6622404 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260812 19:25:46.563414  6058 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 197) took 81343 ms (client timeout 15000 ms). Trace:
W20260812 19:25:46.566998  6058 rpcz_store.cc:269] 0812 19:24:25.220176 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:25.222854 (+  2678us) service_pool.cc:227] Handling call
0812 19:25:46.563169 (+81340315us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13070,"reported_tablets":52}
I20260812 19:25:46.564622  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95d32ece4a8c43b6a779d59f9981db43" candidate_uuid: "a1541d11be514114966dc1e92a345298" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:46.569141  6178 leader_election.cc:302] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1541d11be514114966dc1e92a345298; no voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:46.569969 19627 raft_consensus.cc:2726] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260812 19:25:46.572352  4084 tablet_replica.cc:330] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.573410  4084 raft_consensus.cc:2229] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.582072  4084 raft_consensus.cc:2258] T 3bc485edcf4e4bbc84bff9c14c471284 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.592149  4084 tablet_replica.cc:330] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.593035  4084 raft_consensus.cc:2229] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.593811  4084 raft_consensus.cc:2258] T 5d49af1f98624af48adc92f25f5a2be7 P a1541d11be514114966dc1e92a345298 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.597064  4084 tablet_replica.cc:330] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.597925  4084 raft_consensus.cc:2229] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.598724  4084 raft_consensus.cc:2258] T b6ca6db9aa4e4bdd829dc087e97096a0 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.602988  4084 tablet_replica.cc:330] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.603919  4084 raft_consensus.cc:2229] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.604542  4084 raft_consensus.cc:2258] T f2920c51f14548a48637e645e719d9cd P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.607548  4084 tablet_replica.cc:330] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298: stopping tablet replica
W20260812 19:25:46.607910  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:46.608321  4084 raft_consensus.cc:2229] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 12 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.609520  4084 raft_consensus.cc:2258] T 6f50bde12f2b4852a014b508724cf2ca P a1541d11be514114966dc1e92a345298 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.612532  4084 tablet_replica.cc:330] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.613379  4084 raft_consensus.cc:2229] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.614140  4084 raft_consensus.cc:2258] T 5bf9c8ef81414ede8e942ee03b95a816 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.617020  4084 tablet_replica.cc:330] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.617839  4084 raft_consensus.cc:2229] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 21 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.619056  4084 raft_consensus.cc:2258] T d1275ccc06f94fcdaa82a73420569651 P a1541d11be514114966dc1e92a345298 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.624068  4084 tablet_replica.cc:330] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.624873  4084 raft_consensus.cc:2229] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.626817  6055 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 24 to 25, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to a1541d11be514114966dc1e92a345298 (127.3.253.1). New cstate: current_term: 25 leader_uuid: "a1541d11be514114966dc1e92a345298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:46.628422  4084 raft_consensus.cc:2258] T aa4b7bb14bdb4198a276add34849a84e P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.628543  6055 catalog_manager.cc:5495] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 17 to 27, leader changed from bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 27 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:46.630026  6055 catalog_manager.cc:5495] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 22 to 26. New cstate: current_term: 26 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } }
I20260812 19:25:46.631855  6055 catalog_manager.cc:5495] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 16 to 22, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } }
I20260812 19:25:46.647728  4084 tablet_replica.cc:330] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.649767  4084 raft_consensus.cc:2229] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.650379  4084 raft_consensus.cc:2258] T c4c2eb0bf29b48b3ae29c175fe03718f P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260812 19:25:46.664331  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:46.663717  4084 tablet_replica.cc:330] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298: stopping tablet replica
W20260812 19:25:46.673537  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:46.673699  4084 raft_consensus.cc:2229] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.683060  4084 raft_consensus.cc:2258] T f7798b18b2fb4b0baa349294c1006e91 P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.686976  4084 tablet_replica.cc:330] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.688128  4084 raft_consensus.cc:2229] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.688899  4084 raft_consensus.cc:2258] T 9e38bc4707784979b4d00b45879a8f0b P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.691977  4084 tablet_replica.cc:330] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.692801  4084 raft_consensus.cc:2229] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 17 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.696501  4084 raft_consensus.cc:2258] T d2d336a1bcca41809d1c89b7833de9a5 P a1541d11be514114966dc1e92a345298 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.708335  4084 tablet_replica.cc:330] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.711144  4084 raft_consensus.cc:2229] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.712491  4084 raft_consensus.cc:2258] T 7e0797ad50cb46cfb10b4a38cc815917 P a1541d11be514114966dc1e92a345298 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.715714  4084 tablet_replica.cc:330] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.716473  4084 raft_consensus.cc:2229] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.717089  4084 raft_consensus.cc:2258] T bacc9fc105004c639dc9ed487bd8dd97 P a1541d11be514114966dc1e92a345298 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.719794  4084 tablet_replica.cc:330] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.720579  4084 raft_consensus.cc:2229] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.721653  4084 raft_consensus.cc:2258] T 0715e834130d426f8038cf97eecb0687 P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.724359  4084 tablet_replica.cc:330] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.725219  4084 raft_consensus.cc:2229] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.725976  4084 raft_consensus.cc:2258] T 4eac496b52764773a5bb2dceffc30dc3 P a1541d11be514114966dc1e92a345298 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.728668  4084 tablet_replica.cc:330] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.729449  4084 raft_consensus.cc:2229] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 19 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.730515  4084 raft_consensus.cc:2258] T 4995e2d6140a4fa3a2dadad444b9a924 P a1541d11be514114966dc1e92a345298 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260812 19:25:46.731101  6054 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38524 (request call id 240) took 100872 ms (client timeout 15000 ms). Trace:
W20260812 19:25:46.731572  6054 rpcz_store.cc:269] 0812 19:24:05.858488 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:05.858702 (+   214us) service_pool.cc:227] Handling call
0812 19:25:46.730849 (+100872147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17539,"reported_tablets":51}
I20260812 19:25:46.733472  4084 tablet_replica.cc:330] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.734588  4084 raft_consensus.cc:2229] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.735778  4084 raft_consensus.cc:2258] T 0d8cbc6671344bd789fa2d3e4986c4b4 P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.738628  4084 tablet_replica.cc:330] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.739499  4084 raft_consensus.cc:2229] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.740552  4084 raft_consensus.cc:2258] T 6554cc94d5d248589dde19ca72bd508a P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.749202  4084 tablet_replica.cc:330] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.750170  4084 raft_consensus.cc:2229] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.751464  4084 raft_consensus.cc:2258] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.761526  4084 tablet_replica.cc:330] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.762401  4084 raft_consensus.cc:2229] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.763167  4084 raft_consensus.cc:2258] T f4ae22a8efcc4f26bdc2d4cc4266111a P a1541d11be514114966dc1e92a345298 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.765937  4084 tablet_replica.cc:330] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.766636  4084 raft_consensus.cc:2229] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.767433  4084 raft_consensus.cc:2258] T ff48be70624f412e9bf485b5e489adf3 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.770527  4084 tablet_replica.cc:330] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.771308  4084 raft_consensus.cc:2229] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.771970  4084 raft_consensus.cc:2258] T 1e69ce57e6c74dea9e207b6ae03c43b2 P a1541d11be514114966dc1e92a345298 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.774544  4084 tablet_replica.cc:330] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.775283  4084 raft_consensus.cc:2229] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.775938  4084 raft_consensus.cc:2258] T 95d32ece4a8c43b6a779d59f9981db43 P a1541d11be514114966dc1e92a345298 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.778599  4084 tablet_replica.cc:330] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.779304  4084 raft_consensus.cc:2229] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 18 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.780367  4084 raft_consensus.cc:2258] T d0976a98f9404c3d8150d0de9a8b385c P a1541d11be514114966dc1e92a345298 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.783288  4084 tablet_replica.cc:330] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.784212  4084 raft_consensus.cc:2229] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:25:46.785029  4084 raft_consensus.cc:2258] T c8fcb9244e2242f0bb95ee6cb9a69d50 P a1541d11be514114966dc1e92a345298 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:25:46.787750  4084 tablet_replica.cc:330] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298: stopping tablet replica
I20260812 19:25:46.788412  4084 raft_consensus.cc:2229] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 25 LEADER]: Raft consensus shutting down.
I20260812 19:25:46.789490  4084 raft_consensus.cc:2258] T fd2a75ee87424ce9809bec32f2ae38fa P a1541d11be514114966dc1e92a345298 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260812 19:25:46.790297  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:46.820741  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:46.866941  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:46.921492  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:46.934784  6052 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38508 (request call id 200) took 19071 ms (client timeout 15000 ms). Trace:
W20260812 19:25:46.935318  6052 rpcz_store.cc:269] 0812 19:25:27.863480 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:27.863798 (+   318us) service_pool.cc:227] Handling call
0812 19:25:46.934521 (+19070723us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6311,"reported_tablets":52}
W20260812 19:25:46.999662  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.011883  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.011955  6059 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38512 (request call id 233) took 89405 ms (client timeout 15000 ms). Trace:
W20260812 19:25:47.012534  6059 rpcz_store.cc:269] 0812 19:24:17.606791 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:24:17.608284 (+  1493us) service_pool.cc:227] Handling call
0812 19:25:47.011683 (+89403399us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39711,"reported_tablets":53}
W20260812 19:25:47.036747  6047 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38512 (request call id 236) took 14781 ms (client timeout 15000 ms). Trace:
W20260812 19:25:47.037334  6047 rpcz_store.cc:269] 0812 19:25:32.262307 (+     0us) service_pool.cc:170] Inserting onto call queue
0812 19:25:37.890693 (+5628386us) service_pool.cc:227] Handling call
0812 19:25:47.036676 (+9145983us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1566,"reported_tablets":53}
W20260812 19:25:47.040465  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.056949  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.057452  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.066866  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.080241  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.104260  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.128834  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.185738  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.188187  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.203425  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.228873  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:47.267060 19878 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.267705 19878 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.269570 20048 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.270035 19878 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.270159 20048 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.272614 20048 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.273622  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:47.274830  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:47.281513  6416 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.281949  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:25:47.282862  6297 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.283311  6297 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:47.284008 20048 raft_consensus.cc:2726] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:47.285390 19878 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:47.303977 20048 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.304685 20048 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.306986 20048 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.309940  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:47.310542  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:47.315884  6464 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 25.
W20260812 19:25:47.318764  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.319641  6297 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.320459  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:47.321573 20048 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260812 19:25:47.321990 20048 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.322368 20048 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:47.345634 20048 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.349119 20048 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.354018  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c085c12bc74f5b8a4f6f69990e1a82" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:47.354780  6477 raft_consensus.cc:3037] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Advancing to term 26
W20260812 19:25:47.358559  6297 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.363003  6477 raft_consensus.cc:2454] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 26.
I20260812 19:25:47.364605  6297 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:47.365477 20048 raft_consensus.cc:2781] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election won for term 26
I20260812 19:25:47.366044 20048 raft_consensus.cc:686] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:47.366946 20048 consensus_queue.cc:237] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:47.381664  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.408996  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:25:47.453603  6059 catalog_manager.cc:5495] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 25 to 26, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 26 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:25:47.528882  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:47.573203 19878 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.573920 19878 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.579201 19878 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.573937 20049 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.583778 20049 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.586097 20049 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.582927  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:47.591434  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:47.593281  6416 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.594115  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:47.598591 19878 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260812 19:25:47.601315  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.606093  6416 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.607829  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:47.610858 19878 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:47.619941 19878 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.620537 19878 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.629642 19878 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.635412  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:47.635946 20069 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.636576 20069 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.638806 20069 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:47.649044  6416 leader_election.cc:334] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.649498  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:47.648859  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:47.650269  6477 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:47.650368 20049 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:25:47.658766  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:47.659580 20069 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:47.660004 20069 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.660382 20069 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
W20260812 19:25:47.675439  6297 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:47.705689  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 64428us
I20260812 19:25:47.711386 20069 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.713657 20069 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.722206  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b1f6c5d06f046a1818f453d9b609502" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:47.723037  6464 raft_consensus.cc:3037] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:47.725899 20073 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.726485 20073 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.729467 20073 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.732049  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:47.734432  6416 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.735287  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:47.736392 20073 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:25:47.732306 19878 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.737425 19878 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.741289  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:47.741827  6297 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.742622 20073 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.743432 20073 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.741973  6342 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 25.
I20260812 19:25:47.739533 19878 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.744753 20048 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.745362 20048 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.746050 20073 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.747601 20048 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.749399  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:47.751367 20073 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260812 19:25:47.751838 20073 raft_consensus.cc:482] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.752194 20073 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:47.753338  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:47.753993  6482 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:47.754994  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:25:47.750846  6416 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.758968  6464 raft_consensus.cc:2454] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
W20260812 19:25:47.759806  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.762409  6416 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.762853  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:47.763618 19878 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:25:47.770915 20073 raft_consensus.cc:504] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.771930  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:47.772730 20069 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:47.773111  6297 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:47.773195 20069 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.773826 20069 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
W20260812 19:25:47.774192  6297 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.773888 20048 raft_consensus.cc:2781] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:47.775254 20048 raft_consensus.cc:686] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:47.776145 20048 consensus_queue.cc:237] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.782356 20042 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.782212 20069 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.783010 20042 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:47.784885 20069 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.785171 20042 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:47.787323  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:47.787443  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:25:47.789592  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:47.792774  6416 leader_election.cc:334] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:47.794615  7553 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.795181  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:47.794960 20073 leader_election.cc:288] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.799783 20042 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260812 19:25:47.802260  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7230832bbf3743e0a33e68f405d6b124" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:47.802925  6477 raft_consensus.cc:3037] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:25:47.807895  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529ed979cd2842acb5bc24debb151b93" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:47.808691  6342 raft_consensus.cc:3037] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Advancing to term 26
W20260812 19:25:47.856279  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 44060.4us
W20260812 19:25:47.859443  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:47.819741  6477 raft_consensus.cc:2454] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:47.880005 20044 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.885933 20069 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.886848 20069 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.887880 20073 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.885268  6059 catalog_manager.cc:5495] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 21 to 22, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:47.888795 20073 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.890023 20069 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.892433 20073 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.892503 20067 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.894035 20067 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:47.896664  6352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:47.901296 20067 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:47.881384 20044 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:47.898664  6416 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.921300 20044 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.923724  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:47.926596 19878 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260812 19:25:47.933226  6342 raft_consensus.cc:2454] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 26.
I20260812 19:25:47.938493  6416 leader_election.cc:302] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:47.939983 20069 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.940276 20073 raft_consensus.cc:2781] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader election won for term 26
I20260812 19:25:47.941109 20073 raft_consensus.cc:686] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 26 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:47.941066 20069 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.937552 20067 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.942930 20073 consensus_queue.cc:237] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.945271 20069 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.949798  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:47.953014  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:47.942955 20067 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:47.957170 20067 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:47.941890 20044 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.963538 20044 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:47.967021 20044 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:47.970276 19878 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:47.971128 19878 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:47.979842  6416 leader_election.cc:334] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:47.981711 19878 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:25:47.982874  4084 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 6269)
I20260812 19:25:47.998287  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:47.999348  6477 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:48.004726 20089 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.005728 20089 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.012082 20089 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:48.013767 19878 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.014541 19878 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.017107 19878 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:25:48.022442  6416 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.023449 20089 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.024235 20089 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.027139 20089 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:48.030200  6297 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:48.034719  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:48.043850  7553 leader_election.cc:334] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.044283  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:48.035580 19878 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.046726 19878 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.050488 19878 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:48.039323  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:48.051506  6482 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
I20260812 19:25:48.027391  6059 catalog_manager.cc:5495] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 25 to 26, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 26 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260812 19:25:48.052668  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:48.056950 20090 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260812 19:25:48.062180  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:48.066139 20073 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260812 19:25:48.040362  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:48.083534 20073 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.085258 20073 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.087911  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:48.088646  6347 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 18.
I20260812 19:25:48.090126  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:48.093520  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:48.088230 20073 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.094172  7591 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:48.100137  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:48.104046 20067 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.105058 20067 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.107035 20073 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.107878 20067 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.107755 20073 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.110042 20073 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.108968  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:48.111271 20042 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:48.111694 20042 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.112051 20042 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:48.117254  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:48.118003  7597 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 12.
I20260812 19:25:48.121075  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:25:48.121732  7597 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 17.
I20260812 19:25:48.124086  6298 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:48.124959 20067 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:48.125351 20067 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.125711 20067 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:48.131153 20042 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.135242 20089 raft_consensus.cc:2781] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:48.143721  6417 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.144006 20089 raft_consensus.cc:686] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:48.144680 20073 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260812 19:25:48.145148 20073 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.145623 20073 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:25:48.145896 20089 consensus_queue.cc:237] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.147886  6417 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:48.148826 20049 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260812 19:25:48.135632  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 105570us
I20260812 19:25:48.142031  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:48.136296 20067 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.149933  6347 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 24.
I20260812 19:25:48.149263 20049 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.157953 20049 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:48.159345 20067 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:48.163254 20073 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:48.149715  6416 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.163255  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:48.168146 20042 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.171164 20091 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:25:48.171605 20091 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.171983 20091 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Advancing to term 23
W20260812 19:25:48.171990  6416 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.174629 20042 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.175710  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:48.175387 20042 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.180171 20042 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.174321  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:48.181027  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:48.181829  7597 raft_consensus.cc:2379] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 54f83319db6b49929cc8f18a66a66975 in current term 19: Already voted for candidate f4ef77b3328a44e8a21dd902b370e25a in this term.
I20260812 19:25:48.181879 19878 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:25:48.184965 20073 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:48.184460 20067 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:48.188858 20067 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.189357 20067 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:48.193087 20042 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.193884 20042 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.196058 20042 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.198211  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:48.199328  6416 leader_election.cc:334] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.201802 20091 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.203255  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:48.228152  6347 raft_consensus.cc:2379] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ef77b3328a44e8a21dd902b370e25a in current term 19: Already voted for candidate 54f83319db6b49929cc8f18a66a66975 in this term.
W20260812 19:25:48.203120  7553 leader_election.cc:334] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.204160  6059 catalog_manager.cc:5495] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 22 to 23, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 23 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:48.206602 20073 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260812 19:25:48.229631 20073 raft_consensus.cc:482] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.230144 20073 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Advancing to term 25
I20260812 19:25:48.215204 20049 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.229823 20091 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.226987 20089 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:48.225519  6297 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.245067 20089 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.247404 20089 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:48.232064  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:48.248121  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:48.250674  6482 raft_consensus.cc:1261] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260812 19:25:48.251717  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:48.252506  6347 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 23.
W20260812 19:25:48.217664  6416 leader_election.cc:334] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.238750 20049 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
I20260812 19:25:48.256914  7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f50bde12f2b4852a014b508724cf2ca" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:48.257530  7597 raft_consensus.cc:3037] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 12 FOLLOWER]: Advancing to term 13
I20260812 19:25:48.259029  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a"
I20260812 19:25:48.259678  7591 raft_consensus.cc:3037] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Advancing to term 18
I20260812 19:25:48.261487 20073 raft_consensus.cc:504] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.263641 20073 leader_election.cc:288] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.266963  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0715e834130d426f8038cf97eecb0687" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:48.268225  6347 raft_consensus.cc:3037] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Advancing to term 25
W20260812 19:25:48.275931  6416 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.279088  7591 raft_consensus.cc:2454] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 18.
I20260812 19:25:48.280517  6347 raft_consensus.cc:2454] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 25.
W20260812 19:25:48.282872  6416 leader_election.cc:334] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.309744  6416 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.310849 20073 raft_consensus.cc:2781] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader election won for term 25
I20260812 19:25:48.311312 20091 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.294404  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:48.312031 20091 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.312690 20042 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:48.313176 20042 raft_consensus.cc:482] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.313570 20042 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:48.314100 20091 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.314559  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:48.315235  6347 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 23.
I20260812 19:25:48.296124  7597 raft_consensus.cc:2454] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfa5579d4534c618c00db6b4a841c81 in term 13.
I20260812 19:25:48.301213  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:48.296666 20067 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.317294  6473 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:48.311420 20073 raft_consensus.cc:686] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 25 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:48.318622 20073 consensus_queue.cc:237] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:48.322216  7553 leader_election.cc:334] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.322774  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:25:48.323663 20044 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:48.324973  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08db676d084c41abaa2e196e5c2653b5" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:48.325660  6470 raft_consensus.cc:3037] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
W20260812 19:25:48.331562  6297 leader_election.cc:334] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.332561  6297 leader_election.cc:334] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.332485 20042 raft_consensus.cc:504] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.333199  6297 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:48.334020 20089 raft_consensus.cc:2726] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:25:48.334513  6297 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.335485  6297 leader_election.cc:334] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.335908  6297 leader_election.cc:302] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:25:48.336169 20067 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.336848 20067 raft_consensus.cc:2726] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260812 19:25:48.336887  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:48.343101 20042 leader_election.cc:288] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.345307 20089 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.345686  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:48.345780 20091 consensus_queue.cc:1035] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260812 19:25:48.345971 20089 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.348354 20089 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.348940 20048 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260812 19:25:48.349148  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:48.349469 20048 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
W20260812 19:25:48.349640  6297 leader_election.cc:334] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.349936 20048 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
W20260812 19:25:48.350556  6297 leader_election.cc:334] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.351016  6297 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:48.351827 20069 raft_consensus.cc:2726] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:25:48.352031  6297 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.354416  6473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:48.355268  6473 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 18.
I20260812 19:25:48.356199  6470 raft_consensus.cc:2454] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 23.
W20260812 19:25:48.358618  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:48.369437  6297 leader_election.cc:334] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.369959  6297 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975; no voters: a1541d11be514114966dc1e92a345298, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:25:48.370349  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:48.370702  6470 raft_consensus.cc:1261] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260812 19:25:48.371161  6481 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 25.
I20260812 19:25:48.371208 20091 raft_consensus.cc:2726] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260812 19:25:48.367343 20048 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:48.373090  6297 leader_election.cc:334] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.373646  6297 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.374120 20048 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.384093  6417 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.385715  6359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6554cc94d5d248589dde19ca72bd508a" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:48.386404  6359 raft_consensus.cc:3037] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:48.388430  6470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9444dc5105264169a510f4261e7a1f40" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:25:48.390053  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:48.390384  6470 raft_consensus.cc:3037] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Advancing to term 24
W20260812 19:25:48.389081  7553 leader_election.cc:334] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.382630  6059 catalog_manager.cc:5495] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 24 to 25, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 25 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } }
W20260812 19:25:48.391160  6297 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.392071  6297 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.395107  7553 leader_election.cc:334] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.405678  6417 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.408078 20049 raft_consensus.cc:2781] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Leader election won for term 18
I20260812 19:25:48.405864 20100 raft_consensus.cc:2781] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 19:25:48.409384 20100 raft_consensus.cc:686] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:48.414000 20100 consensus_queue.cc:237] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.415794  6482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:25:48.408592 20049 raft_consensus.cc:686] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Becoming Leader. State: Replica: bdfa5579d4534c618c00db6b4a841c81, State: Running, Role: LEADER
I20260812 19:25:48.416574  6482 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 21.
I20260812 19:25:48.417495  6359 raft_consensus.cc:2454] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 24.
I20260812 19:25:48.417706 20049 consensus_queue.cc:237] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.418604  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.419507 20067 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260812 19:25:48.419999 20067 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.420501 20067 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:48.426131  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4995e2d6140a4fa3a2dadad444b9a924" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:48.427284  6481 raft_consensus.cc:3037] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:48.432689  6297 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.434813 20091 raft_consensus.cc:2781] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:25:48.435009 20069 consensus_queue.cc:1035] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260812 19:25:48.435400 20091 raft_consensus.cc:686] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:48.436359 20091 consensus_queue.cc:237] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.434113  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.444243  6481 raft_consensus.cc:2454] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 20.
I20260812 19:25:48.446244 20088 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260812 19:25:48.447101  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:48.447237 20088 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.447732 20088 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:48.447268  6347 raft_consensus.cc:1261] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260812 19:25:48.453002 20069 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260812 19:25:48.453418 20069 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.453776 20069 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:48.460714  6470 raft_consensus.cc:2454] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 24.
I20260812 19:25:48.460196  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.467233 20090 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260812 19:25:48.467680 20090 raft_consensus.cc:482] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting leader election (detected failure of leader a1541d11be514114966dc1e92a345298)
I20260812 19:25:48.468061 20090 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:48.474413  6297 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
I20260812 19:25:48.481693  7553 leader_election.cc:302] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:48.482992  6297 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.484342 20089 raft_consensus.cc:2781] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:48.465592 20100 consensus_queue.cc:1035] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.019s
I20260812 19:25:48.488279 20089 raft_consensus.cc:686] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:48.489392 20089 consensus_queue.cc:237] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:48.500384  6297 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.501490  6297 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.497515 20048 raft_consensus.cc:2781] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election won for term 24
I20260812 19:25:48.499218 20042 raft_consensus.cc:2781] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Leader election won for term 24
I20260812 19:25:48.508071 20048 raft_consensus.cc:686] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:48.508481 20042 raft_consensus.cc:686] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 24 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:48.509316 20048 consensus_queue.cc:237] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.544339  6047 catalog_manager.cc:5495] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 22 to 23, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 23 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:48.526005  6059 catalog_manager.cc:5495] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 17 to 18, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 18 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:48.549468  6059 catalog_manager.cc:5495] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 reported cstate change: term changed from 12 to 13, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3). New cstate: current_term: 13 leader_uuid: "bdfa5579d4534c618c00db6b4a841c81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:48.551072 20042 consensus_queue.cc:237] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.556627  6470 raft_consensus.cc:1261] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260812 19:25:48.557928 20088 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:25:48.610071  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 128179us
I20260812 19:25:48.608399 20090 raft_consensus.cc:504] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:48.619445 20091 consensus_queue.cc:1035] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260812 19:25:48.667281 20088 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.700280  6477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2a75ee87424ce9809bec32f2ae38fa" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:48.701220  6477 raft_consensus.cc:3037] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Advancing to term 26
I20260812 19:25:48.654670 20067 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.662714 20069 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.717650 20069 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:25:48.730532  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 64742.5us
I20260812 19:25:48.743222  6481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1275ccc06f94fcdaa82a73420569651" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
I20260812 19:25:48.743889  6481 raft_consensus.cc:3037] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Advancing to term 22
I20260812 19:25:48.744231 20090 leader_election.cc:288] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:48.749006 20067 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:25:48.761096  6481 raft_consensus.cc:2454] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 22.
I20260812 19:25:48.769155  6047 catalog_manager.cc:5495] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 23 to 24, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 24 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:25:48.779567  6059 catalog_manager.cc:5495] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 19 to 20, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 20 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:48.785082  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0976a98f9404c3d8150d0de9a8b385c" candidate_uuid: "54f83319db6b49929cc8f18a66a66975" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:25:48.785465  6297 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.785799  6475 raft_consensus.cc:3037] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Advancing to term 19
I20260812 19:25:48.785109  6059 catalog_manager.cc:5495] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 23 to 24, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 24 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:25:48.791175  6297 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.800199  7553 leader_election.cc:334] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.809083  6477 raft_consensus.cc:2454] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 26.
I20260812 19:25:48.812253  6475 raft_consensus.cc:2454] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f83319db6b49929cc8f18a66a66975 in term 19.
I20260812 19:25:48.816254  6297 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
W20260812 19:25:48.816368  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:48.834367  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b231cd9f80874e2dbe40dcd1f4c8e1f4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:48.835081  6342 raft_consensus.cc:3037] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Advancing to term 24
I20260812 19:25:48.850479 19622 raft_consensus.cc:2781] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Leader election won for term 22
I20260812 19:25:48.851176 19622 raft_consensus.cc:686] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:48.852264 19622 consensus_queue.cc:237] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.860563  6297 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:48.864010 20048 raft_consensus.cc:2781] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Leader election won for term 26
I20260812 19:25:48.864760 20048 raft_consensus.cc:686] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:48.865831 20048 consensus_queue.cc:237] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.868034  6297 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, bdfa5579d4534c618c00db6b4a841c81; no voters: 
W20260812 19:25:48.870038  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:48.870644  6297 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:48.870769 20128 raft_consensus.cc:2781] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader election won for term 19
I20260812 19:25:48.871557  6350 raft_consensus.cc:1261] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260812 19:25:48.877169 20073 consensus_queue.cc:1035] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260812 19:25:48.877724 20128 raft_consensus.cc:686] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Becoming Leader. State: Replica: 54f83319db6b49929cc8f18a66a66975, State: Running, Role: LEADER
I20260812 19:25:48.878777 20128 consensus_queue.cc:237] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:25:48.886626  6342 raft_consensus.cc:2454] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 24.
I20260812 19:25:48.902767  7553 leader_election.cc:302] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: 
I20260812 19:25:48.906163 20116 raft_consensus.cc:2781] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Leader election won for term 24
I20260812 19:25:48.906764 20116 raft_consensus.cc:686] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 24 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:48.907682 20116 consensus_queue.cc:237] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:48.930799  7553 leader_election.cc:334] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:25:48.958788  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:48.964568  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:25:48.984129  6482 raft_consensus.cc:1261] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260812 19:25:48.984544  4084 thread.cc:536] Waited for 2000ms trying to join with diag-logger (tid 6269)
I20260812 19:25:48.990211  6477 raft_consensus.cc:1261] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260812 19:25:48.996755  7597 raft_consensus.cc:1261] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260812 19:25:49.011273  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:49.013717 20073 consensus_queue.cc:1035] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260812 19:25:49.016172 20048 consensus_queue.cc:1035] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 19:25:49.018786 20048 consensus_queue.cc:1035] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260812 19:25:49.005373  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 19:25:49.019129  6473 raft_consensus.cc:1261] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260812 19:25:49.023062  7597 raft_consensus.cc:1261] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Refusing update from remote peer bdfa5579d4534c618c00db6b4a841c81: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260812 19:25:49.026777 20048 consensus_queue.cc:1035] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260812 19:25:49.029706 20073 consensus_queue.cc:1035] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260812 19:25:49.041253  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:49.041688  6059 catalog_manager.cc:5495] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 23 to 24, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 24 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260812 19:25:49.044037  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:49.056607  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:49.060753  6047 catalog_manager.cc:5495] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 25 to 26, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 26 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:49.063036  6047 catalog_manager.cc:5495] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 21 to 22, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 22 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260812 19:25:49.073333  6047 catalog_manager.cc:5495] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 reported cstate change: term changed from 18 to 19, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to 54f83319db6b49929cc8f18a66a66975 (127.3.253.2). New cstate: current_term: 19 leader_uuid: "54f83319db6b49929cc8f18a66a66975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } }
W20260812 19:25:49.128453  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:49.156152  6347 raft_consensus.cc:1261] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260812 19:25:49.161067 20133 consensus_queue.cc:1035] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260812 19:25:49.270109  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:49.302248  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.307202  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 19:25:49.316375  6347 raft_consensus.cc:1261] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260812 19:25:49.317281  6482 raft_consensus.cc:1261] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260812 19:25:49.317943 20116 consensus_queue.cc:1035] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260812 19:25:49.326244 20140 consensus_queue.cc:1035] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260812 19:25:49.328528  6482 raft_consensus.cc:1261] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260812 19:25:49.332156  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:49.350544 20128 consensus_queue.cc:1035] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260812 19:25:49.369179  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:49.380081  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 19:25:49.394109  6481 raft_consensus.cc:1261] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Refusing update from remote peer 54f83319db6b49929cc8f18a66a66975: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260812 19:25:49.394886  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:49.406082  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 19:25:49.413672 20091 consensus_queue.cc:1035] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260812 19:25:49.425336  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:25:49.448560  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.449185  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.474587  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:49.483824  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.568804  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.629016  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.636107  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.670835  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.702525  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.705046  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.769160  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.783350  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.795656  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.822726  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.855966  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.893011  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.897222  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.957664  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:49.970000  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:49.981673  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:49.985018  4084 thread.cc:536] Waited for 3000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:50.024549  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 19:25:50.038372 20138 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:25:50.039000 20138 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:50.041544 20138 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:50.044378  6347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
I20260812 19:25:50.046550  6347 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 19.
W20260812 19:25:50.049221  7553 leader_election.cc:334] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:50.050207  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:50.051704 20138 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260812 19:25:50.052212 20138 raft_consensus.cc:482] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:25:50.052788 20138 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:50.078154 20138 raft_consensus.cc:504] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:25:50.086772  7553 leader_election.cc:334] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:25:50.090299  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d8cbc6671344bd789fa2d3e4986c4b4" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975"
I20260812 19:25:50.090939  6342 raft_consensus.cc:3037] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Advancing to term 20
I20260812 19:25:50.105103 20138 leader_election.cc:288] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: Requested vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:25:50.116768  6342 raft_consensus.cc:2454] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 20.
I20260812 19:25:50.118180  7553 leader_election.cc:302] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298
I20260812 19:25:50.119057 20138 raft_consensus.cc:2781] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Leader election won for term 20
I20260812 19:25:50.119625 20138 raft_consensus.cc:686] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:25:50.120609 20138 consensus_queue.cc:237] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:25:50.178696  6059 catalog_manager.cc:5495] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 18 to 20, leader changed from a1541d11be514114966dc1e92a345298 (127.3.253.1) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 20 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260812 19:25:50.227818  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.241930  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.328984  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.362480  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.382546  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.387842  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.420226  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.595522  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:25:50.687402  6347 raft_consensus.cc:1261] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260812 19:25:50.694060 20126 consensus_queue.cc:1035] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260812 19:25:50.703617  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:50.715389  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.854485  6297 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111) [suppressed 470 similar messages]
W20260812 19:25:50.954252  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:50.985555  4084 thread.cc:536] Waited for 4000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:51.067865  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.071556  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.132988  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.289944  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:51.363878  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:51.393401  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.451357  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.497570  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.532580  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.560920  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.635785  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:51.665938  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:51.712786  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.740505  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.801106  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:51.803274  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.828217  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.926422  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:51.927047  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:51.931339  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:51.932272  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:51.945034  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:51.972908  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:51.986173  4084 thread.cc:536] Waited for 5000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:52.044723  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.036689  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.081466  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.095572  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.134429  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.191217  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.198735  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.294314  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.300225  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.403007  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:52.416812  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.420171  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.496979  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:52.507154  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.526950  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.588922  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.606768  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.658731  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.660629  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.681682  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.757632  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.860340  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.875126  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.920980  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:52.986726  4084 thread.cc:536] Waited for 6000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:53.034273  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:53.076043  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:53.195709  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.267055  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:25:53.438993  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.591315  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:53.730734  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:53.865907  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.899070  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.905104  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.953429  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.967147  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.969244  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:53.987383  4084 thread.cc:536] Waited for 7000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:54.019325  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:54.198406  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:54.200730  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.202138  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:54.250334  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.292810  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:54.361589  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.377385  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.384182  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:54.408145  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:54.411538  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.540135  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.561748  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:54.562549  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:54.597925  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.617146  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.705116  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.778756  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.811527  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.854161  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.891987  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.897936  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:54.904855  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.952955  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:54.987905  4084 thread.cc:536] Waited for 8000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:55.034081  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.187769  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.214174  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:55.217347  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.226245  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.226949  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.228607  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.282634  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.309063  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.367935  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:55.426756  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.441784  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.453311  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.468423  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.490603  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:55.500321  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.592360  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.680516  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:55.793505  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:25:55.881035  7553 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111) [suppressed 510 similar messages]
W20260812 19:25:55.988812  4084 thread.cc:536] Waited for 9000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:56.007262  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.086722  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:56.155298  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.158993  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:56.295415  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.341192  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:56.354417  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.358034  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.372855  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.438920  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.571058  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:56.590190  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.695705  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:56.749380  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:56.809305  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:56.851243  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:56.858489  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:56.879989  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:56.939858  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:56.981887  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:56.989498  4084 thread.cc:536] Waited for 10000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:57.010519  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.015201  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:57.035411  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.109251  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.198860  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:57.214314  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.248129  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.262591  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:57.276523  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.308521  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.324285  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.347831  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.362855  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.416925  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:57.429292  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.442042  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:57.565785  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.653549  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.759744  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.852445  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.853473  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.865139  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.894891  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:25:57.903231  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:57.957147  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:58.002942  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:58.061003  4084 thread.cc:536] Waited for 11000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:58.153647  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:58.171039  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 95125.1us
W20260812 19:25:58.172495  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:58.198668  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:58.279803  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:58.306716  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:58.313923  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:58.312592  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 19:25:58.614383  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:58.667598  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:58.694882  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:25:58.738435  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:58.747507  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:58.799345  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:58.870819  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:58.901998  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:25:58.970892  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:25:59.062547  4084 thread.cc:536] Waited for 12000ms trying to join with diag-logger (tid 6269)
W20260812 19:25:59.096787  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:59.226330  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:59.236202  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:25:59.445253  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:25:59.517297  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:25:59.571017  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:25:59.615759  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:25:59.667316  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.063115  4084 thread.cc:536] Waited for 13000ms trying to join with diag-logger (tid 6269)
I20260812 19:26:00.590152 20265 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:00.591150 20265 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:00.594368 20265 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:00.638708  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 52582.1us
I20260812 19:26:00.679926 20265 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:00.680668 20265 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:00.682947 20265 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:00.684204  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93caa3d3062a45cbad94ff4ba511f2e0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:26:00.707795  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 55535.2us
W20260812 19:26:00.715201  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.718763  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.719133  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:26:00.719727  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.719904  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:00.720309  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.720604  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:26:00.721043  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.721187  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.721766  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.722064  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.722394  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:26:00.722915  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.723515  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260812 19:26:00.725060  6342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ca6db9aa4e4bdd829dc087e97096a0" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "54f83319db6b49929cc8f18a66a66975" is_pre_election: true
W20260812 19:26:00.727824  6416 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:00.728391  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:00.729348 20252 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:26:00.729480  6416 leader_election.cc:334] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:00.734037  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:00.734941 20252 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:26:00.745378 20254 raft_consensus.cc:482] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:26:00.746117 20254 raft_consensus.cc:504] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:26:00.753670 20254 leader_election.cc:288] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:26:00.759217  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260812 19:26:00.786914  6475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2d336a1bcca41809d1c89b7833de9a5" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
W20260812 19:26:00.787815  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.788367  7553 leader_election.cc:334] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:00.811393  7553 leader_election.cc:302] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:26:00.819260 20254 raft_consensus.cc:2726] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260812 19:26:00.820179  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:00.892942  6416 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111) [suppressed 432 similar messages]
W20260812 19:26:00.973258  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:26:01.023767  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:01.031414  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:26:01.042538  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.049980  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:01.060189  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.064532  4084 thread.cc:536] Waited for 14000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:01.096171  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.202111  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:01.202914  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.219071  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.294358  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.366760  7643 debug-util.cc:398] Leaking SignalData structure 0x7b0800343fc0 after lost signal to thread 4090
W20260812 19:26:01.368086  7643 debug-util.cc:398] Leaking SignalData structure 0x7b080030fac0 after lost signal to thread 6116
W20260812 19:26:01.369690  7643 debug-util.cc:398] Leaking SignalData structure 0x7b08003223a0 after lost signal to thread 6399
W20260812 19:26:01.371052  7643 debug-util.cc:398] Leaking SignalData structure 0x7b0800332de0 after lost signal to thread 6521
W20260812 19:26:01.373272  7643 debug-util.cc:398] Leaking SignalData structure 0x7b08003c8800 after lost signal to thread 7647
W20260812 19:26:01.532817  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:01.590307  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 19:26:01.590935  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.634248  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.636132  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.694476  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:01.821578  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:01.977572  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:02.007380  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.043150  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:02.066051  4084 thread.cc:536] Waited for 15000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:02.069135  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:02.087718  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:02.144124  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.332577  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:02.334084  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.356303  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:02.486626  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.565752  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:02.575271  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.577035  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:02.593451  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.672190  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.730223  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:02.782701  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.790668  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:02.799799  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.809684  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:02.858064  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.881825  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.966823  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:02.988004  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.013918  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.066553  4084 thread.cc:536] Waited for 16000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:03.111701  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:03.132190  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.151692  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.153054  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:03.170447  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:03.177569  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.180787  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.201543  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.308066  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.429544  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:03.445439  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:03.480154  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:03.552699  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.580971  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.586932  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:03.598191  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:03.689728  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.731915  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 65347.1us
W20260812 19:26:03.743743  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.760434  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:03.799846  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.806025  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:03.978241  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 19:26:03.986465  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:04.067196  4084 thread.cc:536] Waited for 17000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:04.173635  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 58605.8us
W20260812 19:26:04.210276  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:04.225404  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:04.267854  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:04.272630  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:04.292490  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:04.312849  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:04.418223  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:04.475607  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:04.566665  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:04.739681  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:04.829460  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:04.896694  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.017861  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.031025  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.049572  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:05.053205  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.067772  4084 thread.cc:536] Waited for 18000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:05.071483  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.083180  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:05.254122  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:05.276594  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:05.282821  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.299837  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.325928  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.386921  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:05.396235  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.409044  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.532047  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.538295  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.531608  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:05.575506  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.618981  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:05.620565  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.660708  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.717715  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.722886  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:05.739809  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.759393  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:05.822105  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:05.862001  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:05.902866  6416 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111) [suppressed 525 similar messages]
W20260812 19:26:05.936132  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:05.959612  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:06.007150  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:06.045640  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:06.068409  4084 thread.cc:536] Waited for 19000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:06.075225  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:06.089906  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:06.205150  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:06.206668  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:06.287360  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:06.305492  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:06.354940  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:06.586336  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:06.631080  7553 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 44834.4us
W20260812 19:26:06.663811  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 19:26:06.725173  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:06.861253  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 420780us
W20260812 19:26:06.991812  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:07.000564  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:07.026119  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:07.034022  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:07.038153  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:07.058513  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:07.060420  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:07.068982  4084 thread.cc:536] Waited for 20000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:07.379734  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.380285  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.390182  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.390695  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:46707, user_credentials={real_user=slave}} blocked reactor thread for 71571.3us
W20260812 19:26:07.395305  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:07.435989  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:07.474325  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.725994  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.777576  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.796599  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6c20 after lost signal to thread 4090
W20260812 19:26:07.797911  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08003523a0 after lost signal to thread 6116
W20260812 19:26:07.801661  6514 debug-util.cc:398] Leaking SignalData structure 0x7b0800398700 after lost signal to thread 6399
W20260812 19:26:07.803997  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08003f4d80 after lost signal to thread 6521
W20260812 19:26:07.807432  6514 debug-util.cc:398] Leaking SignalData structure 0x7b08000f18c0 after lost signal to thread 7647
W20260812 19:26:07.849840  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.852428  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:07.865803  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:07.939826  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:07.962698  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:07.982000  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:08.016607  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.069463  4084 thread.cc:536] Waited for 21000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:08.071821  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:08.099328  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.101128  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:08.139289  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.271078  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.338835  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.340281  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.354776  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.367435  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.370411  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:08.373420  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:08.406598  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:08.415360  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.465173  6297 consensus_peers.cc:487] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.470058  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:08.482592  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.632232  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:08.659559  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.905649  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:08.990682  6297 consensus_peers.cc:487] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:08.994989  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:09.014613  6297 consensus_peers.cc:487] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.016559  6297 consensus_peers.cc:487] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.017140  6297 consensus_peers.cc:487] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.019227  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:09.049548  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.071174  4084 thread.cc:536] Waited for 22000ms trying to join with diag-logger (tid 6269)
W20260812 19:26:09.094726  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:09.111646  6297 consensus_peers.cc:487] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 19:26:09.302752  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.350271  6297 consensus_peers.cc:487] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:09.361352  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:09.440856  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:09.541832  6297 consensus_peers.cc:487] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.559718  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:09.621618  6416 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39969, user_credentials={real_user=slave}} blocked reactor thread for 49662.3us
W20260812 19:26:09.634158  6297 consensus_peers.cc:487] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.707922  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.717355  6297 consensus_peers.cc:487] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:09.760288  6396 debug-util.cc:398] Leaking SignalData structure 0x7b080031cda0 after lost signal to thread 4090
W20260812 19:26:09.761533  6396 debug-util.cc:398] Leaking SignalData structure 0x7b080033b540 after lost signal to thread 6116
W20260812 19:26:09.763131  6396 debug-util.cc:398] Leaking SignalData structure 0x7b0800338ce0 after lost signal to thread 6399
W20260812 19:26:09.764365  6396 debug-util.cc:398] Leaking SignalData structure 0x7b0800359080 after lost signal to thread 6521
W20260812 19:26:09.765692  6396 debug-util.cc:398] Leaking SignalData structure 0x7b080005dfe0 after lost signal to thread 7647
W20260812 19:26:09.779738  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.064005  6297 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:42599, user_credentials={real_user=slave}} blocked reactor thread for 124979us
W20260812 19:26:10.085685  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.162695  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:10.218613  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.218765  6297 consensus_peers.cc:487] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:10.220394  6297 consensus_peers.cc:487] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.223157  6297 consensus_peers.cc:487] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:10.230816  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.240517  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.273480  6297 consensus_peers.cc:487] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:10.396472  6297 consensus_peers.cc:487] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.425495  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:10.430460  4084 tablet_server.cc:194] TabletServer@127.3.253.1:0 shutdown complete.
W20260812 19:26:10.458757  6297 consensus_peers.cc:487] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.522151  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.579025  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 19:26:10.606051  6297 consensus_peers.cc:487] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:10.613515  6297 consensus_peers.cc:487] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:10.615072  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:10.671986  4084 tablet_server.cc:178] TabletServer@127.3.253.2:0 shutting down...
W20260812 19:26:10.712164  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.716342  7553 consensus_peers.cc:487] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.717975  6297 consensus_peers.cc:487] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:10.720125  7553 consensus_peers.cc:487] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.728263  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.736706  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.740872  6416 consensus_peers.cc:487] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.751032  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.760141  7553 consensus_peers.cc:487] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.763677  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.764926  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.783804  6297 consensus_peers.cc:487] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:10.799962  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.813570  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:26:10.815155  4084 tablet_replica.cc:330] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.827644  4084 raft_consensus.cc:2229] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Raft consensus shutting down.
W20260812 19:26:10.828804  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.830415  4084 raft_consensus.cc:2258] T c3c085c12bc74f5b8a4f6f69990e1a82 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:10.832006  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.836571  7553 consensus_peers.cc:487] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:10.839879  7553 consensus_peers.cc:487] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.842975  4084 tablet_replica.cc:330] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.844040  4084 raft_consensus.cc:2229] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.845340  4084 raft_consensus.cc:2258] T 956de4b24b3d4a2693e1dcc392b1dd00 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.848512  4084 tablet_replica.cc:330] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
W20260812 19:26:10.848428  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.849663  4084 raft_consensus.cc:2229] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.851184  4084 raft_consensus.cc:2258] T 93caa3d3062a45cbad94ff4ba511f2e0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.855424  4084 tablet_replica.cc:330] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.858165  4084 raft_consensus.cc:2229] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.859056  4084 raft_consensus.cc:2258] T 0d8cbc6671344bd789fa2d3e4986c4b4 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.861820  4084 tablet_replica.cc:330] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.862807  4084 raft_consensus.cc:2229] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.864045  4084 raft_consensus.cc:2258] T fa4336f7dd434c238a9022aa16490450 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.866940  4084 tablet_replica.cc:330] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.867712  4084 raft_consensus.cc:2229] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.868309  4084 raft_consensus.cc:2258] T 099703c7d52b4644ae3c1098ddcc0282 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.872008  4084 tablet_replica.cc:330] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.873023  4084 raft_consensus.cc:2229] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 16 LEADER]: Raft consensus shutting down.
W20260812 19:26:10.873410  6297 consensus_peers.cc:487] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260812 19:26:10.874447  4084 raft_consensus.cc:2258] T 545108632fab48129db7f032619a1e55 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.880050  4084 tablet_replica.cc:330] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.883337  4084 raft_consensus.cc:2229] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.884060  4084 raft_consensus.cc:2258] T e76f36493d454308b43951f8eb142b7e P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:10.886629  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:10.887465  4084 tablet_replica.cc:330] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.888499  4084 raft_consensus.cc:2229] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.889722  4084 raft_consensus.cc:2258] T 04c512eaceae43d2a378065361eb4854 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:10.891763  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.892912  4084 tablet_replica.cc:330] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.893697  4084 raft_consensus.cc:2229] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.894418  4084 raft_consensus.cc:2258] T 6454eb944afe4306b52388febd0f82bb P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.897532  4084 tablet_replica.cc:330] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.898177  4084 raft_consensus.cc:2229] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.899360  4084 raft_consensus.cc:2258] T 89d6b10f5ff448f592a41c3a77692cfe P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.902119  4084 tablet_replica.cc:330] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.902850  4084 raft_consensus.cc:2229] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.903477  4084 raft_consensus.cc:2258] T 529ed979cd2842acb5bc24debb151b93 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.906226  4084 tablet_replica.cc:330] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.906996  4084 raft_consensus.cc:2229] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.907656  4084 raft_consensus.cc:2258] T b02969fd01604c6eb8dad2ecb92d0224 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.910887  4084 tablet_replica.cc:330] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.911815  4084 raft_consensus.cc:2229] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.913371  4084 raft_consensus.cc:2258] T 08db676d084c41abaa2e196e5c2653b5 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.916531  4084 tablet_replica.cc:330] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.917346  4084 raft_consensus.cc:2229] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.918557  4084 raft_consensus.cc:2258] T 0b2666b0bd6d48eaac74445d6da5cf58 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.921288  4084 tablet_replica.cc:330] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.922108  4084 raft_consensus.cc:2229] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.924479  4084 raft_consensus.cc:2258] T 8b1f6c5d06f046a1818f453d9b609502 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:10.925665  6297 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111) [suppressed 513 similar messages]
I20260812 19:26:10.928154  4084 tablet_replica.cc:330] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.929201  4084 raft_consensus.cc:2229] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.930593  4084 raft_consensus.cc:2258] T f1b6d90aaa384b5fb66f3320981f1aa0 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.933856  4084 tablet_replica.cc:330] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
W20260812 19:26:10.934309  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.934979  4084 raft_consensus.cc:2229] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.935766  4084 raft_consensus.cc:2258] T cb5046f0183a45f4a5ae164f4ff6792c P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.939342  4084 tablet_replica.cc:330] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
W20260812 19:26:10.940865  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.941998  4084 raft_consensus.cc:2229] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 23 LEADER]: Raft consensus shutting down.
W20260812 19:26:10.942868  6297 consensus_peers.cc:487] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:10.943533  4084 raft_consensus.cc:2258] T 7230832bbf3743e0a33e68f405d6b124 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.946528  4084 tablet_replica.cc:330] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.947345  4084 raft_consensus.cc:2229] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Raft consensus shutting down.
W20260812 19:26:10.948028  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.948602  4084 raft_consensus.cc:2258] T 82ee24e5b3dd4df3bd9647d68d3ced5e P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.967831  4084 tablet_replica.cc:330] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.968914  4084 raft_consensus.cc:2229] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.972218  4084 raft_consensus.cc:2258] T 1ed681895af14e88b9b457a6b6a85e1a P 54f83319db6b49929cc8f18a66a66975 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:10.974345  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:10.975235  4084 tablet_replica.cc:330] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.982302  4084 raft_consensus.cc:2229] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.983284  4084 raft_consensus.cc:2258] T 42ff4c3d452047f29f09437fda663aed P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:10.982291  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:10.989895  4084 tablet_replica.cc:330] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.990942  4084 raft_consensus.cc:2229] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:10.992503  4084 raft_consensus.cc:2258] T e47beaf4e3f74103977b8ba04492ff79 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:10.996869  4084 tablet_replica.cc:330] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:10.997828  4084 raft_consensus.cc:2229] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:26:10.999864  4084 raft_consensus.cc:2258] T c7441e51865745dea6bedf82183de6c0 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:10.999936  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:11.005873  4084 tablet_replica.cc:330] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.006888  4084 raft_consensus.cc:2229] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260812 19:26:11.008216  6297 consensus_peers.cc:487] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260812 19:26:11.009927  4084 raft_consensus.cc:2258] T 982b09b6d3b34920ac161f2649012c72 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.016250  4084 tablet_replica.cc:330] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.017302  4084 raft_consensus.cc:2229] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260812 19:26:11.018503  6297 consensus_peers.cc:487] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260812 19:26:11.019186  4084 raft_consensus.cc:2258] T 67c9cd7e3397473ba76fb87340b6c6e0 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:11.020533  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:11.025033  4084 tablet_replica.cc:330] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.025980  4084 raft_consensus.cc:2229] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 21 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.030670  4084 raft_consensus.cc:2258] T c59df69987ce4bc38077cd7681552414 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:11.037894  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:11.044198  4084 tablet_replica.cc:330] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.046553  4084 raft_consensus.cc:2229] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.047855  4084 raft_consensus.cc:2258] T 9e3bf4ae67ff4aaa9287a253c6db6575 P 54f83319db6b49929cc8f18a66a66975 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.053233  4084 tablet_replica.cc:330] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.054203  4084 raft_consensus.cc:2229] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.055502  4084 raft_consensus.cc:2258] T 95d32ece4a8c43b6a779d59f9981db43 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:11.058465  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:11.064327  4084 tablet_replica.cc:330] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.065466  4084 raft_consensus.cc:2229] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.069082  4084 raft_consensus.cc:2258] T 5bf9c8ef81414ede8e942ee03b95a816 P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:11.070611  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:11.072914  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:11.075399  4084 tablet_replica.cc:330] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.076540  4084 raft_consensus.cc:2229] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.078078  4084 raft_consensus.cc:2258] T d1275ccc06f94fcdaa82a73420569651 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.081851  4084 tablet_replica.cc:330] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.082801  4084 raft_consensus.cc:2229] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.083745  4084 raft_consensus.cc:2258] T c4c2eb0bf29b48b3ae29c175fe03718f P 54f83319db6b49929cc8f18a66a66975 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.087018  4084 tablet_replica.cc:330] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.087915  4084 raft_consensus.cc:2229] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.089226  4084 raft_consensus.cc:2258] T 3bc485edcf4e4bbc84bff9c14c471284 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.092299  4084 tablet_replica.cc:330] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
W20260812 19:26:11.096894  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:11.097839  4084 raft_consensus.cc:2229] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 25 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.099771  4084 raft_consensus.cc:2258] T b6ca6db9aa4e4bdd829dc087e97096a0 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.103062  4084 tablet_replica.cc:330] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.103977  4084 raft_consensus.cc:2229] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.104774  4084 raft_consensus.cc:2258] T f2920c51f14548a48637e645e719d9cd P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.107954  4084 tablet_replica.cc:330] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.108912  4084 raft_consensus.cc:2229] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 25 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.110342  4084 raft_consensus.cc:2258] T f7798b18b2fb4b0baa349294c1006e91 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.113883  4084 tablet_replica.cc:330] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.115371  4084 raft_consensus.cc:2229] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 22 LEADER]: Raft consensus shutting down.
W20260812 19:26:11.127010  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:11.129031  4084 raft_consensus.cc:2258] T 9e38bc4707784979b4d00b45879a8f0b P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.132562  4084 tablet_replica.cc:330] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
W20260812 19:26:11.140240  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260812 19:26:11.141651  4084 raft_consensus.cc:2229] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.142831  4084 raft_consensus.cc:2258] T fe2a7dc98f92406fbf459b7c9d812bf7 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.146495  4084 tablet_replica.cc:330] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.147447  4084 raft_consensus.cc:2229] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.148756  4084 raft_consensus.cc:2258] T 7e0797ad50cb46cfb10b4a38cc815917 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.152191  4084 tablet_replica.cc:330] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.159737  4084 raft_consensus.cc:2229] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.160652  4084 raft_consensus.cc:2258] T 0715e834130d426f8038cf97eecb0687 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.164019  4084 tablet_replica.cc:330] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.165031  4084 raft_consensus.cc:2229] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.166175  4084 raft_consensus.cc:2258] T 2661573faf994c8f9bb837f55af974d9 P 54f83319db6b49929cc8f18a66a66975 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.169266  4084 tablet_replica.cc:330] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.170202  4084 raft_consensus.cc:2229] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.171725  4084 raft_consensus.cc:2258] T 9444dc5105264169a510f4261e7a1f40 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:11.176716  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:11.180286  4084 tablet_replica.cc:330] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.181167  4084 raft_consensus.cc:2229] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.182447  4084 raft_consensus.cc:2258] T 4eac496b52764773a5bb2dceffc30dc3 P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.185478  4084 tablet_replica.cc:330] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.186311  4084 raft_consensus.cc:2229] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 20 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.187954  4084 raft_consensus.cc:2258] T 4995e2d6140a4fa3a2dadad444b9a924 P 54f83319db6b49929cc8f18a66a66975 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.191493  4084 tablet_replica.cc:330] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.192391  4084 raft_consensus.cc:2229] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.193176  4084 raft_consensus.cc:2258] T 6554cc94d5d248589dde19ca72bd508a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.196305  4084 tablet_replica.cc:330] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.197501  4084 raft_consensus.cc:2229] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.198295  4084 raft_consensus.cc:2258] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.210908  4084 tablet_replica.cc:330] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.211812  4084 raft_consensus.cc:2229] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.212574  4084 raft_consensus.cc:2258] T f4ae22a8efcc4f26bdc2d4cc4266111a P 54f83319db6b49929cc8f18a66a66975 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.216223  4084 tablet_replica.cc:330] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.217095  4084 raft_consensus.cc:2229] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 LEADER]: Raft consensus shutting down.
W20260812 19:26:11.234474  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:11.258471  4084 raft_consensus.cc:2258] T ff48be70624f412e9bf485b5e489adf3 P 54f83319db6b49929cc8f18a66a66975 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.292523  4084 tablet_replica.cc:330] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.294412  4084 raft_consensus.cc:2229] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.299610  4084 raft_consensus.cc:2258] T d3d1eb75377449c8b2ea3ee9e6622404 P 54f83319db6b49929cc8f18a66a66975 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.309121  4084 tablet_replica.cc:330] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
W20260812 19:26:11.333576  6297 consensus_peers.cc:487] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260812 19:26:11.348362  4084 raft_consensus.cc:2229] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 19 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.351321  4084 raft_consensus.cc:2258] T d0976a98f9404c3d8150d0de9a8b385c P 54f83319db6b49929cc8f18a66a66975 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.355666  4084 tablet_replica.cc:330] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
W20260812 19:26:11.349829  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:11.371975  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260812 19:26:11.373039  4084 raft_consensus.cc:2229] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.374963  4084 raft_consensus.cc:2258] T c8fcb9244e2242f0bb95ee6cb9a69d50 P 54f83319db6b49929cc8f18a66a66975 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.390637  4084 tablet_replica.cc:330] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.393663  4084 raft_consensus.cc:2229] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 26 LEADER]: Raft consensus shutting down.
I20260812 19:26:11.397320  4084 raft_consensus.cc:2258] T fd2a75ee87424ce9809bec32f2ae38fa P 54f83319db6b49929cc8f18a66a66975 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:11.402755  4084 tablet_replica.cc:330] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975: stopping tablet replica
I20260812 19:26:11.403594  4084 raft_consensus.cc:2229] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:11.404488  4084 raft_consensus.cc:2258] T 1e69ce57e6c74dea9e207b6ae03c43b2 P 54f83319db6b49929cc8f18a66a66975 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:11.532433  6416 consensus_peers.cc:487] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:11.597402  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:11.703262  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:11.720494  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:11.737727  6296 connection.cc:441] server connection from 127.0.0.1:35822 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 2098) could send its response
W20260812 19:26:11.753931  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260812 19:26:11.831446 20372 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:11.832261 20372 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:11.835608 20372 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:11.842831  6416 leader_election.cc:334] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:11.845026  6416 leader_election.cc:334] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:11.845420  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:11.846553 20370 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:11.940263 20372 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:11.940834 20372 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:11.942981 20372 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:11.948148  6416 leader_election.cc:334] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:11.950412  6416 leader_election.cc:334] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:11.950919  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:11.951716 20372 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:26:11.979972  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260812 19:26:12.025442 20370 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.026165 20370 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.028966 20370 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.037894 20372 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.038472 20372 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:26:12.038683  6416 leader_election.cc:334] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.040655 20372 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.042326  6416 leader_election.cc:334] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.042835  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.043686 20372 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:26:12.046913  6416 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:12.047874  6416 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.048341  6416 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.049160 20372 raft_consensus.cc:2726] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:12.102562 20372 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.103155 20372 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.105244 20372 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.115406  6416 leader_election.cc:334] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:12.116348  6416 leader_election.cc:334] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.117064  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.120973 20372 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:12.132423 20370 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.133042 20370 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.135255 20370 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.150959  6416 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.153884  6416 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.154448  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.162947 20372 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:12.169452 20372 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.170166 20372 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.174054 20372 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.180965  6416 leader_election.cc:334] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.181778  6416 leader_election.cc:334] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.182260  6416 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.187085 20370 raft_consensus.cc:2726] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260812 19:26:12.209807  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260812 19:26:12.218072 20372 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.219774 20370 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.220417 20370 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:26:12.224169 20372 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.227603 20370 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.228399 20372 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.233858 20370 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:26:12.235551  6416 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.234433 20370 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:26:12.238370  6416 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.241156 20370 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.245532 20370 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.246170 20370 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
W20260812 19:26:12.254441  6416 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.255156  6416 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.262771 20372 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.265008 20372 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.266407 20375 raft_consensus.cc:2726] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:26:12.267284 20372 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.264154 20370 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4:35891)
W20260812 19:26:12.269120  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:12.269785  6416 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.270279  6416 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.273849  7591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "bdfa5579d4534c618c00db6b4a841c81" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f4ef77b3328a44e8a21dd902b370e25a" is_pre_election: true
I20260812 19:26:12.282747 20375 raft_consensus.cc:2726] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260812 19:26:12.296212 20370 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.296810 20370 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.299018 20370 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.301488  6416 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:12.306535  6416 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.307143  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.307971 20370 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260812 19:26:12.314270  6416 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.316318  6416 leader_election.cc:334] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.316869  6416 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, f4ef77b3328a44e8a21dd902b370e25a
I20260812 19:26:12.317850 20370 raft_consensus.cc:2726] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260812 19:26:12.318957  6416 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.319413  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.320214 20370 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260812 19:26:12.324229  6416 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.325392 20370 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.325543 20362 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.326051 20370 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.326140 20362 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:26:12.328384 20362 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:26:12.328773  6416 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.329236  6416 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.328384 20370 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.330026 20375 raft_consensus.cc:2726] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260812 19:26:12.334013  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81" is_pre_election: true
I20260812 19:26:12.334739  6464 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 22.
W20260812 19:26:12.340395  7553 leader_election.cc:334] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:12.340930  6416 leader_election.cc:334] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.341575  6416 leader_election.cc:334] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.342068  6416 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.341477  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:26:12.343107 20362 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260812 19:26:12.343550 20362 raft_consensus.cc:482] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.343945 20362 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 22 FOLLOWER]: Advancing to term 23
I20260812 19:26:12.348186 20375 raft_consensus.cc:2726] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260812 19:26:12.358319 20375 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.358927 20375 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.361584 20375 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.362958 20375 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.363518 20375 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.365660 20375 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.366870 20362 raft_consensus.cc:504] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:26:12.377115 20362 leader_election.cc:288] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 23 election: Requested vote from peers 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:26:12.378422  6464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b2666b0bd6d48eaac74445d6da5cf58" candidate_uuid: "f4ef77b3328a44e8a21dd902b370e25a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bdfa5579d4534c618c00db6b4a841c81"
W20260812 19:26:12.380045  7553 leader_election.cc:334] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.380822  6464 raft_consensus.cc:3037] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Advancing to term 23
W20260812 19:26:12.388571  6416 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.389184  6464 raft_consensus.cc:2454] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ef77b3328a44e8a21dd902b370e25a in term 23.
W20260812 19:26:12.389339  6416 leader_election.cc:334] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.390522  6416 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.391038  6416 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:12.392066  6416 leader_election.cc:334] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.392403 20370 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.392603  6416 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.393024 20370 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.394889 20372 raft_consensus.cc:2726] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260812 19:26:12.395782 20372 raft_consensus.cc:2726] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260812 19:26:12.396546 20372 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.397205 20372 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.400449  7553 leader_election.cc:302] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81, f4ef77b3328a44e8a21dd902b370e25a; no voters: 54f83319db6b49929cc8f18a66a66975
I20260812 19:26:12.401544 20362 raft_consensus.cc:2781] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Leader election won for term 23
I20260812 19:26:12.402164 20362 raft_consensus.cc:686] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 23 LEADER]: Becoming Leader. State: Replica: f4ef77b3328a44e8a21dd902b370e25a, State: Running, Role: LEADER
I20260812 19:26:12.403198 20362 consensus_queue.cc:237] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:26:12.405495 20370 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.416087 20372 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.433583  6416 leader_election.cc:334] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.439430  6052 catalog_manager.cc:5495] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a reported cstate change: term changed from 22 to 23, leader changed from 54f83319db6b49929cc8f18a66a66975 (127.3.253.2) to f4ef77b3328a44e8a21dd902b370e25a (127.3.253.4). New cstate: current_term: 23 leader_uuid: "f4ef77b3328a44e8a21dd902b370e25a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 19:26:12.455062 20375 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.455766 20375 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.458029 20375 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.461854  6416 leader_election.cc:334] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.462483  6416 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.464083 20370 raft_consensus.cc:2726] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260812 19:26:12.464452  6416 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:12.472033  6416 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.472597  6416 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.474490 20375 raft_consensus.cc:2726] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260812 19:26:12.476468  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260812 19:26:12.477607 20370 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.479314 20370 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.481549 20370 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.486918  6416 leader_election.cc:334] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.489156 20375 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.489725 20375 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:26:12.491413  6416 leader_election.cc:334] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.491940 20375 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.491918  6416 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.495929 20375 raft_consensus.cc:2726] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260812 19:26:12.493960  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:12.504388  6416 leader_election.cc:334] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.505750 20372 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.506249 20372 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.508272 20372 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.520069  6416 leader_election.cc:334] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.521448  6416 leader_election.cc:334] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.522020  6416 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.522894 20370 raft_consensus.cc:2726] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260812 19:26:12.529408  6416 leader_election.cc:334] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.530432 20370 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.531031 20370 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.532908 20370 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.529958  6416 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.534102 20370 raft_consensus.cc:2726] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260812 19:26:12.540449  6416 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.546759 20370 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.547307 20370 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.549283 20370 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:12.563184 20370 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.563709 20370 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.565636 20370 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.566707  6416 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.568214  6416 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:12.568655  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.571080 20370 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260812 19:26:12.572067 20370 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:12.572615 20370 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:12.574776 20370 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:12.576408  6416 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.577330  6416 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.579613 20370 raft_consensus.cc:2726] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260812 19:26:12.587170  6416 leader_election.cc:334] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.588752  6416 leader_election.cc:334] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.589231  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.589975 20370 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260812 19:26:12.600569  6416 leader_election.cc:334] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.601177  6416 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:12.605006  6416 leader_election.cc:334] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.605495  6416 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.606470 20370 raft_consensus.cc:2726] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260812 19:26:12.607532  6416 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:12.607954  6416 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:12.608691 20370 raft_consensus.cc:2726] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260812 19:26:12.624192  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:12.628648  6416 consensus_peers.cc:487] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:12.748673  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:12.763259  4084 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 6396)
W20260812 19:26:12.765542  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:12.814960  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260812 19:26:12.962555  6464 raft_consensus.cc:1261] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Refusing update from remote peer f4ef77b3328a44e8a21dd902b370e25a: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260812 19:26:12.972020  7553 consensus_peers.cc:487] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:12.972075 20367 consensus_queue.cc:1035] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260812 19:26:13.041931  7553 consensus_peers.cc:487] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:13.089495  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.097554  7553 consensus_peers.cc:487] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.121986  6416 consensus_peers.cc:487] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.142493  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.163322  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.163870  7553 consensus_peers.cc:487] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.164786  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.184598  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.199913  6416 consensus_peers.cc:487] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.205696  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.208979  6416 consensus_peers.cc:487] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.221489  6416 consensus_peers.cc:487] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.234077  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.247728  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.263463  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.279105  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.280697  6416 consensus_peers.cc:487] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.281148  6416 consensus_peers.cc:487] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.322005  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.338491  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 19:26:13.361467  6416 consensus_peers.cc:487] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.364898  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.389151  6416 consensus_peers.cc:487] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.419287  7553 consensus_peers.cc:487] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.493050  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.500581  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.548353  6416 consensus_peers.cc:487] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.556205  6416 consensus_peers.cc:487] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.574261  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 19:26:13.585455  6416 consensus_peers.cc:487] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.596796  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:13.665380 20406 raft_consensus.cc:482] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:13.666678 20406 raft_consensus.cc:504] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:13.668931 20406 leader_election.cc:288] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:13.682471  6416 leader_election.cc:334] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:13.685287  6416 leader_election.cc:334] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:13.687472  6416 leader_election.cc:302] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:13.688269 20406 raft_consensus.cc:2726] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260812 19:26:13.695338  7553 consensus_peers.cc:487] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.712560  6416 consensus_peers.cc:487] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.723101  6416 consensus_peers.cc:487] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:13.736192  6416 consensus_peers.cc:487] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.736760  6416 consensus_peers.cc:487] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:13.740583  7553 consensus_peers.cc:487] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:13.818549 20406 raft_consensus.cc:482] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:13.819159 20406 raft_consensus.cc:504] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:13.820902 20406 leader_election.cc:288] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:13.827817  6416 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:13.828934  6416 leader_election.cc:334] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:13.829373  6416 leader_election.cc:302] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:13.830731 20406 raft_consensus.cc:2726] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260812 19:26:13.843958 20406 raft_consensus.cc:482] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:13.844514 20406 raft_consensus.cc:504] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:13.847113 20406 leader_election.cc:288] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:13.856000  6416 leader_election.cc:334] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:13.859776  6416 leader_election.cc:334] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:13.860195  6416 leader_election.cc:302] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:13.860893 20406 raft_consensus.cc:2726] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:13.918130 20408 raft_consensus.cc:482] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:13.918774 20408 raft_consensus.cc:504] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:13.920552 20408 leader_election.cc:288] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:13.928146  6416 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:13.928826  6416 leader_election.cc:334] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:13.929183  6416 leader_election.cc:302] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:13.929803 20408 raft_consensus.cc:2726] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:13.985255 20406 raft_consensus.cc:482] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:13.985878 20406 raft_consensus.cc:504] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:13.987847 20406 leader_election.cc:288] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:13.988926 20406 raft_consensus.cc:482] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:13.990161 20406 raft_consensus.cc:504] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:13.992129 20406 leader_election.cc:288] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.001449  6416 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:14.001952  6416 leader_election.cc:334] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:14.002526  6416 leader_election.cc:334] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.002924  6416 leader_election.cc:302] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:14.003628 20406 raft_consensus.cc:2726] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260812 19:26:14.003795  6416 leader_election.cc:334] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.004237  6416 leader_election.cc:302] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:14.004948 20406 raft_consensus.cc:2726] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:14.012790 20406 raft_consensus.cc:482] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.013229 20406 raft_consensus.cc:504] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.016952 20406 leader_election.cc:288] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.054344  6416 leader_election.cc:334] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:14.057863  6416 leader_election.cc:334] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.058389  6416 leader_election.cc:302] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:14.060319 20406 raft_consensus.cc:2726] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260812 19:26:14.111763 20408 raft_consensus.cc:482] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.112327 20408 raft_consensus.cc:504] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.114400 20408 leader_election.cc:288] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.116660 20408 raft_consensus.cc:482] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.117151 20408 raft_consensus.cc:504] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.123980 20408 leader_election.cc:288] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.128109  6416 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:14.134260  6416 leader_election.cc:334] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.134826  6416 leader_election.cc:302] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:14.136454 20408 raft_consensus.cc:2726] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260812 19:26:14.146456  6416 leader_election.cc:334] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:14.147318  6416 leader_election.cc:334] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
I20260812 19:26:14.147773  6416 leader_election.cc:302] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
I20260812 19:26:14.150365 20408 raft_consensus.cc:2726] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260812 19:26:14.165464 20406 raft_consensus.cc:482] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.166028 20406 raft_consensus.cc:504] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.168270 20406 leader_election.cc:288] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.168311  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:14.181988  6416 leader_election.cc:334] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.188845 20406 raft_consensus.cc:482] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.189383 20406 raft_consensus.cc:504] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.191107 20406 leader_election.cc:288] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.195497  6416 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:14.246919  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260812 19:26:14.247437 20406 raft_consensus.cc:482] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.248016 20406 raft_consensus.cc:504] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.250015 20406 leader_election.cc:288] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.252529 20408 raft_consensus.cc:482] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.253041 20408 raft_consensus.cc:504] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.254971 20408 leader_election.cc:288] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.258486  6416 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:14.264138  6416 leader_election.cc:334] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.285223  4084 tablet_server.cc:194] TabletServer@127.3.253.2:0 shutdown complete.
I20260812 19:26:14.289319 20406 raft_consensus.cc:482] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.289950 20406 raft_consensus.cc:504] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.291893 20406 leader_election.cc:288] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.303499  6416 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.321507 20406 raft_consensus.cc:482] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.322283 20406 raft_consensus.cc:504] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } }
I20260812 19:26:14.324540 20406 leader_election.cc:288] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.328156  6416 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.328645 20406 raft_consensus.cc:482] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.334206 20408 raft_consensus.cc:482] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.335331 20408 raft_consensus.cc:504] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.337380 20408 leader_election.cc:288] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.339082 20406 raft_consensus.cc:504] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.339968 20408 raft_consensus.cc:482] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.340699 20408 raft_consensus.cc:504] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:26:14.341234  6416 leader_election.cc:334] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.343538 20406 leader_election.cc:288] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.343961 20408 leader_election.cc:288] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.346582 20408 raft_consensus.cc:482] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
W20260812 19:26:14.347167  6416 leader_election.cc:334] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.347277 20408 raft_consensus.cc:504] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:26:14.347820  6416 leader_election.cc:334] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.349238 20408 leader_election.cc:288] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.352119  6416 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.451943  4084 tablet_server.cc:178] TabletServer@127.3.253.3:0 shutting down...
I20260812 19:26:14.469667 20406 raft_consensus.cc:482] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.470316 20406 raft_consensus.cc:504] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.473922 20406 leader_election.cc:288] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.474752 20406 raft_consensus.cc:482] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.475401 20406 raft_consensus.cc:504] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.477784 20406 leader_election.cc:288] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.495267  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:14.496879  7553 consensus_peers.cc:487] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:14.495769 20406 raft_consensus.cc:482] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.497732 20406 raft_consensus.cc:504] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.499773 20406 leader_election.cc:288] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.503818 20411 raft_consensus.cc:482] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.505897 20411 raft_consensus.cc:504] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
W20260812 19:26:14.506855  6138 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260812 19:26:14.507290  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260812 19:26:14.508044  6416 leader_election.cc:334] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.508291 20411 leader_election.cc:288] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.514484  6416 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:14.515153  6416 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:14.518927  7553 consensus_peers.cc:487] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:14.519997 20411 raft_consensus.cc:482] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.520581 20411 raft_consensus.cc:504] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.522786 20411 leader_election.cc:288] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
W20260812 19:26:14.523865  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:14.525424  6416 leader_election.cc:334] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:14.529412  6416 leader_election.cc:334] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:14.550477  7553 consensus_peers.cc:487] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:14.560803  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:26:14.561684  4084 tablet_replica.cc:330] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.562439  4084 raft_consensus.cc:2229] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.563028  4084 raft_consensus.cc:2258] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.565161  4084 tablet_replica.cc:330] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.566044  4084 raft_consensus.cc:2229] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.566599  4084 raft_consensus.cc:2258] T 099703c7d52b4644ae3c1098ddcc0282 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.568917  4084 tablet_replica.cc:330] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
W20260812 19:26:14.569290  7553 consensus_peers.cc:487] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:14.569592  4084 raft_consensus.cc:2229] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.570293  4084 raft_consensus.cc:2258] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.572216  4084 tablet_replica.cc:330] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.572839  4084 raft_consensus.cc:2229] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.573655  4084 raft_consensus.cc:2258] T fa4336f7dd434c238a9022aa16490450 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.576048  4084 tablet_replica.cc:330] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.576926  4084 raft_consensus.cc:2229] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.577680  4084 raft_consensus.cc:2258] T 6454eb944afe4306b52388febd0f82bb P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.579595  4084 tablet_replica.cc:330] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.580183  4084 raft_consensus.cc:2229] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 20 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.581000  4084 raft_consensus.cc:2258] T e76f36493d454308b43951f8eb142b7e P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.582824  4084 tablet_replica.cc:330] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.583365  4084 raft_consensus.cc:2229] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.583900  4084 raft_consensus.cc:2258] T 956de4b24b3d4a2693e1dcc392b1dd00 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.585695  4084 tablet_replica.cc:330] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.586436  4084 raft_consensus.cc:2229] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.587111  4084 raft_consensus.cc:2258] T 4ed79a983adf41fb8e94a099bb3c0974 P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.589607  4084 tablet_replica.cc:330] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.590396  4084 raft_consensus.cc:2229] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.591264  4084 raft_consensus.cc:2258] T 04c512eaceae43d2a378065361eb4854 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.593113  4084 tablet_replica.cc:330] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.593710  4084 raft_consensus.cc:2229] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.594126  4084 raft_consensus.cc:2258] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.596051  4084 tablet_replica.cc:330] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.596570  4084 raft_consensus.cc:2229] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.597052  4084 raft_consensus.cc:2258] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.599030  4084 tablet_replica.cc:330] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.599537  4084 raft_consensus.cc:2229] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.600291  4084 raft_consensus.cc:2258] T 1ed681895af14e88b9b457a6b6a85e1a P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.602305  4084 tablet_replica.cc:330] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.602912  4084 raft_consensus.cc:2229] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.603380  4084 raft_consensus.cc:2258] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.605576  4084 tablet_replica.cc:330] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.606302  4084 raft_consensus.cc:2229] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.606891  4084 raft_consensus.cc:2258] T f1b6d90aaa384b5fb66f3320981f1aa0 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.609190  4084 tablet_replica.cc:330] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.609771  4084 raft_consensus.cc:2229] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.610267  4084 raft_consensus.cc:2258] T cb5046f0183a45f4a5ae164f4ff6792c P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.612841  4084 tablet_replica.cc:330] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.613436  4084 raft_consensus.cc:2229] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.614225  4084 raft_consensus.cc:2258] T 7230832bbf3743e0a33e68f405d6b124 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.613905 20411 raft_consensus.cc:482] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 54f83319db6b49929cc8f18a66a66975)
I20260812 19:26:14.614971 20411 raft_consensus.cc:504] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } }
I20260812 19:26:14.617288 20411 leader_election.cc:288] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969)
I20260812 19:26:14.617411  4084 tablet_replica.cc:330] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.618921  4084 raft_consensus.cc:2229] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.619551  4084 raft_consensus.cc:2258] T 42ff4c3d452047f29f09437fda663aed P bdfa5579d4534c618c00db6b4a841c81 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:14.621433  6416 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:14.622151  4084 tablet_replica.cc:330] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.622884  4084 raft_consensus.cc:2229] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.623579  4084 raft_consensus.cc:2258] T b02969fd01604c6eb8dad2ecb92d0224 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.625448  4084 tablet_replica.cc:330] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.626014  4084 raft_consensus.cc:2229] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.626466  4084 raft_consensus.cc:2258] T 08db676d084c41abaa2e196e5c2653b5 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:14.628407  7553 consensus_peers.cc:487] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:14.628613  4084 tablet_replica.cc:330] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.629328  4084 raft_consensus.cc:2229] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 26 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.630076  4084 raft_consensus.cc:2258] T 529ed979cd2842acb5bc24debb151b93 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.632017  4084 tablet_replica.cc:330] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.632578  4084 raft_consensus.cc:2229] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.633068  4084 raft_consensus.cc:2258] T 89d6b10f5ff448f592a41c3a77692cfe P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.634969  4084 tablet_replica.cc:330] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.635496  4084 raft_consensus.cc:2229] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.635918  4084 raft_consensus.cc:2258] T 0b2666b0bd6d48eaac74445d6da5cf58 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.637604  4084 tablet_replica.cc:330] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.638197  4084 raft_consensus.cc:2229] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.638634  4084 raft_consensus.cc:2258] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.640627  4084 tablet_replica.cc:330] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.641157  4084 raft_consensus.cc:2229] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.641856  4084 raft_consensus.cc:2258] T 67c9cd7e3397473ba76fb87340b6c6e0 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.643784  4084 tablet_replica.cc:330] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.644404  4084 raft_consensus.cc:2229] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.644866  4084 raft_consensus.cc:2258] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.646612  4084 tablet_replica.cc:330] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.647248  4084 raft_consensus.cc:2229] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.647850  4084 raft_consensus.cc:2258] T 9e3bf4ae67ff4aaa9287a253c6db6575 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.650182  4084 tablet_replica.cc:330] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
W20260812 19:26:14.650146  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:14.651121  4084 raft_consensus.cc:2229] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.651597  4084 raft_consensus.cc:2258] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.653571  4084 tablet_replica.cc:330] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.654086  4084 raft_consensus.cc:2229] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.654520  4084 raft_consensus.cc:2258] T 5d49af1f98624af48adc92f25f5a2be7 P bdfa5579d4534c618c00db6b4a841c81 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.656754  4084 tablet_replica.cc:330] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.657435  4084 raft_consensus.cc:2229] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.658136  4084 raft_consensus.cc:2258] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.660163  4084 tablet_replica.cc:330] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.660698  4084 raft_consensus.cc:2229] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 27 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.661535  4084 raft_consensus.cc:2258] T 95d32ece4a8c43b6a779d59f9981db43 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.663439  4084 tablet_replica.cc:330] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.663981  4084 raft_consensus.cc:2229] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.664412  4084 raft_consensus.cc:2258] T d1275ccc06f94fcdaa82a73420569651 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.666193  4084 tablet_replica.cc:330] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.666782  4084 raft_consensus.cc:2229] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.667268  4084 raft_consensus.cc:2258] T aa4b7bb14bdb4198a276add34849a84e P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.669183  4084 tablet_replica.cc:330] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.669710  4084 raft_consensus.cc:2229] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 13 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.670461  4084 raft_consensus.cc:2258] T 6f50bde12f2b4852a014b508724cf2ca P bdfa5579d4534c618c00db6b4a841c81 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.672287  4084 tablet_replica.cc:330] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.672838  4084 raft_consensus.cc:2229] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 19 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.673521  4084 raft_consensus.cc:2258] T 5bf9c8ef81414ede8e942ee03b95a816 P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.675422  4084 tablet_replica.cc:330] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.675956  4084 raft_consensus.cc:2229] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 22 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.676808  4084 raft_consensus.cc:2258] T 1e69ce57e6c74dea9e207b6ae03c43b2 P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.678726  4084 tablet_replica.cc:330] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.679271  4084 raft_consensus.cc:2229] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.679730  4084 raft_consensus.cc:2258] T f7798b18b2fb4b0baa349294c1006e91 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.681375  4084 tablet_replica.cc:330] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.681804  4084 raft_consensus.cc:2229] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.682180  4084 raft_consensus.cc:2258] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.683962  4084 tablet_replica.cc:330] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.684484  4084 raft_consensus.cc:2229] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 21 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.685396  4084 raft_consensus.cc:2258] T 2661573faf994c8f9bb837f55af974d9 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.687165  4084 tablet_replica.cc:330] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.687601  4084 raft_consensus.cc:2229] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.688052  4084 raft_consensus.cc:2258] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.689700  4084 tablet_replica.cc:330] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.690187  4084 raft_consensus.cc:2229] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.690903  4084 raft_consensus.cc:2258] T d2d336a1bcca41809d1c89b7833de9a5 P bdfa5579d4534c618c00db6b4a841c81 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.692633  4084 tablet_replica.cc:330] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.693116  4084 raft_consensus.cc:2229] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.693491  4084 raft_consensus.cc:2258] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.695293  4084 tablet_replica.cc:330] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.695756  4084 raft_consensus.cc:2229] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.696226  4084 raft_consensus.cc:2258] T bacc9fc105004c639dc9ed487bd8dd97 P bdfa5579d4534c618c00db6b4a841c81 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.697896  4084 tablet_replica.cc:330] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.698360  4084 raft_consensus.cc:2229] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.698772  4084 raft_consensus.cc:2258] T fe2a7dc98f92406fbf459b7c9d812bf7 P bdfa5579d4534c618c00db6b4a841c81 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.700457  4084 tablet_replica.cc:330] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.700924  4084 raft_consensus.cc:2229] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 25 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.701617  4084 raft_consensus.cc:2258] T 0715e834130d426f8038cf97eecb0687 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.703258  4084 tablet_replica.cc:330] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.703718  4084 raft_consensus.cc:2229] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.704406  4084 raft_consensus.cc:2258] T f4ae22a8efcc4f26bdc2d4cc4266111a P bdfa5579d4534c618c00db6b4a841c81 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.706713  4084 tablet_replica.cc:330] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.707409  4084 raft_consensus.cc:2229] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.708135  4084 raft_consensus.cc:2258] T ff48be70624f412e9bf485b5e489adf3 P bdfa5579d4534c618c00db6b4a841c81 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:14.708959  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260812 19:26:14.710152  4084 tablet_replica.cc:330] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.710942  4084 raft_consensus.cc:2229] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.711517  4084 raft_consensus.cc:2258] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.713924  4084 tablet_replica.cc:330] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
W20260812 19:26:14.713967  7553 consensus_peers.cc:487] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:14.714510  4084 raft_consensus.cc:2229] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.715252  4084 raft_consensus.cc:2258] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.717326  4084 tablet_replica.cc:330] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.718020  4084 raft_consensus.cc:2229] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 25 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.718885  4084 raft_consensus.cc:2258] T d3d1eb75377449c8b2ea3ee9e6622404 P bdfa5579d4534c618c00db6b4a841c81 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.721403  4084 tablet_replica.cc:330] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.721897  4084 raft_consensus.cc:2229] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.722501  4084 raft_consensus.cc:2258] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.724296  4084 tablet_replica.cc:330] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.724768  4084 raft_consensus.cc:2229] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:14.725441  4084 raft_consensus.cc:2258] T c8fcb9244e2242f0bb95ee6cb9a69d50 P bdfa5579d4534c618c00db6b4a841c81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:14.727255  4084 tablet_replica.cc:330] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: stopping tablet replica
I20260812 19:26:14.727715  4084 raft_consensus.cc:2229] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:14.728196  4084 raft_consensus.cc:2258] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:14.736459  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 19:26:14.739945  7553 consensus_peers.cc:487] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:14.746635  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:14.760310  7553 consensus_peers.cc:487] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Couldn't send request to peer bdfa5579d4534c618c00db6b4a841c81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:15.041633  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260812 19:26:15.171299 20415 leader_election.cc:334] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.171762 20415 leader_election.cc:302] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.172338 20415 raft_consensus.cc:2670] T c7441e51865745dea6bedf82183de6c0 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260812 19:26:15.173960  4084 leader_election.cc:334] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Aborted: reactor is shutting down (error 108)
I20260812 19:26:15.174412  4084 leader_election.cc:302] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.174688 20415 leader_election.cc:334] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
W20260812 19:26:15.175043  4084 raft_consensus.cc:2670] T 4995e2d6140a4fa3a2dadad444b9a924 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260812 19:26:15.175951 20415 leader_election.cc:302] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.177901 20415 raft_consensus.cc:2670] T 545108632fab48129db7f032619a1e55 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260812 19:26:15.180688 20415 leader_election.cc:334] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.181139 20415 leader_election.cc:302] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.181775 20415 raft_consensus.cc:2670] T fd2a75ee87424ce9809bec32f2ae38fa P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.183781 20415 leader_election.cc:334] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.184113 20415 leader_election.cc:302] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.184589 20415 raft_consensus.cc:2670] T 9444dc5105264169a510f4261e7a1f40 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.186079 20415 leader_election.cc:334] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.186430 20415 leader_election.cc:302] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.186969 20415 raft_consensus.cc:2670] T 9e38bc4707784979b4d00b45879a8f0b P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.188714 20415 leader_election.cc:334] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.189054 20415 leader_election.cc:302] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.189494 20415 raft_consensus.cc:2670] T 8b1f6c5d06f046a1818f453d9b609502 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.191011 20415 leader_election.cc:334] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.191723 20415 leader_election.cc:302] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.192731 20415 raft_consensus.cc:2670] T 7e0797ad50cb46cfb10b4a38cc815917 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.194960 20415 leader_election.cc:334] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.195413 20415 leader_election.cc:302] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.195983 20415 raft_consensus.cc:2670] T c59df69987ce4bc38077cd7681552414 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.197500 20415 leader_election.cc:334] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.197835 20415 leader_election.cc:302] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.198303 20415 raft_consensus.cc:2670] T b6ca6db9aa4e4bdd829dc087e97096a0 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.200053 20415 leader_election.cc:334] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.200418 20415 leader_election.cc:302] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.200868 20415 raft_consensus.cc:2670] T 82ee24e5b3dd4df3bd9647d68d3ced5e P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.203533 20415 leader_election.cc:334] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.203876 20415 leader_election.cc:302] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.204324 20415 raft_consensus.cc:2670] T d0976a98f9404c3d8150d0de9a8b385c P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.205822 20415 leader_election.cc:334] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.206158 20415 leader_election.cc:302] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.206629 20415 raft_consensus.cc:2670] T 3bc485edcf4e4bbc84bff9c14c471284 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.208277 20415 leader_election.cc:334] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.208633 20415 leader_election.cc:302] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.209182 20415 raft_consensus.cc:2670] T 93caa3d3062a45cbad94ff4ba511f2e0 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.211783 20415 leader_election.cc:334] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.212169 20415 leader_election.cc:302] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.212682 20415 raft_consensus.cc:2670] T c3c085c12bc74f5b8a4f6f69990e1a82 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.215992 20415 leader_election.cc:334] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Service unavailable: reactor is shutting down (error 108)
I20260812 19:26:15.216487 20415 leader_election.cc:302] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfa5579d4534c618c00db6b4a841c81; no voters: 54f83319db6b49929cc8f18a66a66975, a1541d11be514114966dc1e92a345298
W20260812 19:26:15.216965 20415 raft_consensus.cc:2670] T 4eac496b52764773a5bb2dceffc30dc3 P bdfa5579d4534c618c00db6b4a841c81: unable to run election callback: Service unavailable: The pool has been shut down.
W20260812 19:26:15.271050  7553 consensus_peers.cc:487] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260812 19:26:15.364024  7553 consensus_peers.cc:487] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:15.370203  6113 debug-util.cc:398] Leaking SignalData structure 0x7b080016ba40 after lost signal to thread 4090
W20260812 19:26:15.371330  6113 debug-util.cc:398] Leaking SignalData structure 0x7b0800327240 after lost signal to thread 6116
W20260812 19:26:15.372690  6113 debug-util.cc:398] Leaking SignalData structure 0x7b080037e560 after lost signal to thread 6521
W20260812 19:26:15.373991  6113 debug-util.cc:398] Leaking SignalData structure 0x7b08003a9ba0 after lost signal to thread 7647
W20260812 19:26:15.452916  7553 consensus_peers.cc:487] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.453604  7553 consensus_peers.cc:487] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.606698  6138 auto_rebalancer.cc:254] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.3.253.3:42599: connect: Connection refused (error 111)
W20260812 19:26:15.613917  6138 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.3.253.3:42599: connect: Connection refused (error 111)
W20260812 19:26:15.614271  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.3.253.3:42599: connect: Connection refused (error 111)
W20260812 19:26:15.619335  6138 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:15.619668  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:15.624780  6138 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:15.625093  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
W20260812 19:26:15.632162  6138 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.3.253.3:42599: connect: Connection refused (error 111)
W20260812 19:26:15.632472  6138 auto_rebalancer.cc:264] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.3.253.3:42599: connect: Connection refused (error 111)
W20260812 19:26:15.636116  7553 consensus_peers.cc:487] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 19:26:15.638840  7553 consensus_peers.cc:487] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.730592  7553 consensus_peers.cc:487] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.752182  7553 consensus_peers.cc:487] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.803572  7553 consensus_peers.cc:487] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a -> Peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Couldn't send request to peer a1541d11be514114966dc1e92a345298. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260812 19:26:15.843850  4084 tablet_server.cc:194] TabletServer@127.3.253.3:0 shutdown complete.
W20260812 19:26:15.856714  7553 consensus_peers.cc:487] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.871548  7553 consensus_peers.cc:487] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.926015  7553 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111) [suppressed 610 similar messages]
W20260812 19:26:15.928864  7553 consensus_peers.cc:487] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 19:26:15.939970  7553 consensus_peers.cc:487] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:26:15.940749  4084 tablet_server.cc:178] TabletServer@127.3.253.4:0 shutting down...
I20260812 19:26:15.979390 20414 raft_consensus.cc:482] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:26:15.980628 20414 raft_consensus.cc:504] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:26:15.984196 20414 leader_election.cc:288] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
I20260812 19:26:15.984968 20414 raft_consensus.cc:482] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdfa5579d4534c618c00db6b4a841c81)
I20260812 19:26:15.985428 20414 raft_consensus.cc:504] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: false } }
I20260812 19:26:15.988224 20414 leader_election.cc:288] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a1541d11be514114966dc1e92a345298 (127.3.253.1:46707), 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969), bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599)
W20260812 19:26:15.991370  7553 leader_election.cc:334] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:15.992439  7553 leader_election.cc:334] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Network error: Client connection negotiation failed: client connection to 127.3.253.3:42599: connect: Connection refused (error 111)
I20260812 19:26:15.992889  7553 leader_election.cc:302] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:26:15.993777 20414 raft_consensus.cc:2726] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260812 19:26:15.998932  7553 leader_election.cc:334] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a1541d11be514114966dc1e92a345298 (127.3.253.1:46707): Network error: Client connection negotiation failed: client connection to 127.3.253.1:46707: connect: Connection refused (error 111)
W20260812 19:26:15.999928  7553 leader_election.cc:334] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bdfa5579d4534c618c00db6b4a841c81 (127.3.253.3:42599): Network error: Client connection negotiation failed: client connection to 127.3.253.3:42599: connect: Connection refused (error 111)
I20260812 19:26:16.000270  7553 leader_election.cc:302] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ef77b3328a44e8a21dd902b370e25a; no voters: a1541d11be514114966dc1e92a345298, bdfa5579d4534c618c00db6b4a841c81
I20260812 19:26:16.000960 20362 raft_consensus.cc:2726] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260812 19:26:16.001058  7553 leader_election.cc:334] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111)
I20260812 19:26:16.003633  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:26:16.004735  4084 tablet_replica.cc:330] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.006201  4084 raft_consensus.cc:2229] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Raft consensus shutting down.
W20260812 19:26:16.006852  7553 consensus_peers.cc:487] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a -> Peer 54f83319db6b49929cc8f18a66a66975 (127.3.253.2:39969): Couldn't send request to peer 54f83319db6b49929cc8f18a66a66975. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39969: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:26:16.006973  4084 raft_consensus.cc:2258] T 2661573faf994c8f9bb837f55af974d9 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.009757  4084 tablet_replica.cc:330] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.010345  4084 raft_consensus.cc:2229] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.011266  4084 raft_consensus.cc:2258] T 42ff4c3d452047f29f09437fda663aed P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.013417  4084 tablet_replica.cc:330] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.014045  4084 raft_consensus.cc:2229] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:16.014524  4084 raft_consensus.cc:2258] T e76f36493d454308b43951f8eb142b7e P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.016753  4084 tablet_replica.cc:330] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.017356  4084 raft_consensus.cc:2229] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.018183  4084 raft_consensus.cc:2258] T 982b09b6d3b34920ac161f2649012c72 P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.020289  4084 tablet_replica.cc:330] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.020840  4084 raft_consensus.cc:2229] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.021723  4084 raft_consensus.cc:2258] T c4c2eb0bf29b48b3ae29c175fe03718f P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.023841  4084 tablet_replica.cc:330] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.024418  4084 raft_consensus.cc:2229] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 19 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.025390  4084 raft_consensus.cc:2258] T aa4b7bb14bdb4198a276add34849a84e P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.027560  4084 tablet_replica.cc:330] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.028110  4084 raft_consensus.cc:2229] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 23 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.028923  4084 raft_consensus.cc:2258] T 0b2666b0bd6d48eaac74445d6da5cf58 P f4ef77b3328a44e8a21dd902b370e25a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.031052  4084 tablet_replica.cc:330] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.031600  4084 raft_consensus.cc:2229] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.032502  4084 raft_consensus.cc:2258] T bacc9fc105004c639dc9ed487bd8dd97 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.034581  4084 tablet_replica.cc:330] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.035168  4084 raft_consensus.cc:2229] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a [term 3 LEARNER]: Raft consensus shutting down.
I20260812 19:26:16.035590  4084 pending_rounds.cc:62] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: Trying to abort 2 pending ops.
I20260812 19:26:16.035748  4084 pending_rounds.cc:68] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7317760215552921600 op_type: NO_OP noop_request { }
I20260812 19:26:16.036101  4084 raft_consensus.cc:2866] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a [term 3 LEARNER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:26:16.036334  4084 pending_rounds.cc:68] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7317760165250699264 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "6454eb944afe4306b52388febd0f82bb" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } } new_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } } }
I20260812 19:26:16.037030  4084 raft_consensus.cc:2894] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a [term 3 LEARNER]: Aborting config change with OpId 1.2: Aborted: Op aborted
I20260812 19:26:16.037374  4084 raft_consensus.cc:2866] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a [term 3 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260812 19:26:16.037624  4084 raft_consensus.cc:2258] T 6454eb944afe4306b52388febd0f82bb P f4ef77b3328a44e8a21dd902b370e25a [term 3 NON_PARTICIPANT]: Raft consensus is shut down!
I20260812 19:26:16.039930  4084 tablet_replica.cc:330] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.040585  4084 raft_consensus.cc:2229] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEARNER]: Raft consensus shutting down.
I20260812 19:26:16.041078  4084 pending_rounds.cc:62] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: Trying to abort 1 pending ops.
I20260812 19:26:16.041277  4084 pending_rounds.cc:68] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a: Aborting op as it isn't in flight: id { term: 8 index: 7 } timestamp: 7317760428476964864 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "529ed979cd2842acb5bc24debb151b93" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } } new_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } } }
I20260812 19:26:16.042142  4084 raft_consensus.cc:2894] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a [term 9 LEARNER]: Aborting config change with OpId 8.7: Aborted: Op aborted
I20260812 19:26:16.042546  4084 raft_consensus.cc:2866] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a [term 9 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260812 19:26:16.042902  4084 raft_consensus.cc:2258] T 529ed979cd2842acb5bc24debb151b93 P f4ef77b3328a44e8a21dd902b370e25a [term 9 NON_PARTICIPANT]: Raft consensus is shut down!
I20260812 19:26:16.045552  4084 tablet_replica.cc:330] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.046213  4084 raft_consensus.cc:2229] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.047106  4084 raft_consensus.cc:2258] T b231cd9f80874e2dbe40dcd1f4c8e1f4 P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.049152  4084 tablet_replica.cc:330] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.049746  4084 raft_consensus.cc:2229] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEARNER]: Raft consensus shutting down.
I20260812 19:26:16.050127  4084 pending_rounds.cc:62] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: Trying to abort 1 pending ops.
I20260812 19:26:16.050310  4084 pending_rounds.cc:68] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a: Aborting op as it isn't in flight: id { term: 6 index: 4 } timestamp: 7317760333410623488 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "7e0797ad50cb46cfb10b4a38cc815917" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } } new_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1541d11be514114966dc1e92a345298" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 46707 } } peers { permanent_uuid: "54f83319db6b49929cc8f18a66a66975" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39969 } attrs { replace: true } } peers { permanent_uuid: "bdfa5579d4534c618c00db6b4a841c81" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 42599 } } peers { permanent_uuid: "f4ef77b3328a44e8a21dd902b370e25a" member_type: NON_VOTER last_known_addr { host: "127.3.253.4" port: 35891 } attrs { promote: true } } } }
I20260812 19:26:16.051033  4084 raft_consensus.cc:2894] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a [term 7 LEARNER]: Aborting config change with OpId 6.4: Aborted: Op aborted
I20260812 19:26:16.051319  4084 raft_consensus.cc:2866] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a [term 7 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260812 19:26:16.051560  4084 raft_consensus.cc:2258] T 7e0797ad50cb46cfb10b4a38cc815917 P f4ef77b3328a44e8a21dd902b370e25a [term 7 NON_PARTICIPANT]: Raft consensus is shut down!
I20260812 19:26:16.053759  4084 tablet_replica.cc:330] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.054306  4084 raft_consensus.cc:2229] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 21 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.055159  4084 raft_consensus.cc:2258] T fe2a7dc98f92406fbf459b7c9d812bf7 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.057164  4084 tablet_replica.cc:330] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.057703  4084 raft_consensus.cc:2229] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 21 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.058537  4084 raft_consensus.cc:2258] T 099703c7d52b4644ae3c1098ddcc0282 P f4ef77b3328a44e8a21dd902b370e25a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.060715  4084 tablet_replica.cc:330] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.061276  4084 raft_consensus.cc:2229] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:16.061777  4084 raft_consensus.cc:2258] T 6f50bde12f2b4852a014b508724cf2ca P f4ef77b3328a44e8a21dd902b370e25a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.063789  4084 tablet_replica.cc:330] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.064312  4084 raft_consensus.cc:2229] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.065205  4084 raft_consensus.cc:2258] T cb5046f0183a45f4a5ae164f4ff6792c P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.067301  4084 tablet_replica.cc:330] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.067823  4084 raft_consensus.cc:2229] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 24 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.068701  4084 raft_consensus.cc:2258] T 6554cc94d5d248589dde19ca72bd508a P f4ef77b3328a44e8a21dd902b370e25a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.070585  4084 tablet_replica.cc:330] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.071127  4084 raft_consensus.cc:2229] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.072023  4084 raft_consensus.cc:2258] T 0d8cbc6671344bd789fa2d3e4986c4b4 P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.074199  4084 tablet_replica.cc:330] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.074705  4084 raft_consensus.cc:2229] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.075559  4084 raft_consensus.cc:2258] T 5d49af1f98624af48adc92f25f5a2be7 P f4ef77b3328a44e8a21dd902b370e25a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.077625  4084 tablet_replica.cc:330] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.078131  4084 raft_consensus.cc:2229] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 20 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.079033  4084 raft_consensus.cc:2258] T f2920c51f14548a48637e645e719d9cd P f4ef77b3328a44e8a21dd902b370e25a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.081125  4084 tablet_replica.cc:330] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.081686  4084 raft_consensus.cc:2229] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 17 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.082489  4084 raft_consensus.cc:2258] T 4ed79a983adf41fb8e94a099bb3c0974 P f4ef77b3328a44e8a21dd902b370e25a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.084411  4084 tablet_replica.cc:330] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.084910  4084 raft_consensus.cc:2229] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 19 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.085744  4084 raft_consensus.cc:2258] T e47beaf4e3f74103977b8ba04492ff79 P f4ef77b3328a44e8a21dd902b370e25a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.087795  4084 tablet_replica.cc:330] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.088253  4084 raft_consensus.cc:2229] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 16 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.089046  4084 raft_consensus.cc:2258] T 9e3bf4ae67ff4aaa9287a253c6db6575 P f4ef77b3328a44e8a21dd902b370e25a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.091120  4084 tablet_replica.cc:330] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a: stopping tablet replica
I20260812 19:26:16.091543  4084 raft_consensus.cc:2229] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:16.092041  4084 raft_consensus.cc:2258] T d2d336a1bcca41809d1c89b7833de9a5 P f4ef77b3328a44e8a21dd902b370e25a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.326083  4084 tablet_server.cc:194] TabletServer@127.3.253.4:0 shutdown complete.
I20260812 19:26:16.374172  4084 master.cc:537] Master@127.3.253.62:46555 shutting down...
I20260812 19:26:16.417908  4084 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:16.418713  4084 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:16.419175  4084 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4483e3a69e644cbea699c6f7c9c1da9e: stopping tablet replica
I20260812 19:26:16.608448  4084 master.cc:552] Master@127.3.253.62:46555 shutdown complete.
I20260812 19:26:16.651647  4084 test_util.cc:175] -----------------------------------------------
I20260812 19:26:16.651877  4084 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786562432658360-4084-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (277601 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260812 19:26:16.655303  4084 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.253.62:36913
I20260812 19:26:16.656441  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:26:16.662987 20424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:16.663130 20421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:16.663897 20426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:16.664655  4084 server_base.cc:1034] running on GCE node
I20260812 19:26:16.669415  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:26:16.669656  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:26:16.669847  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562776669830 us; error 0 us; skew 500 ppm
I20260812 19:26:16.670384  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:16.673115  4084 webserver.cc:460] Webserver started at http://127.3.253.62:40855/ using document root <none> and password file <none>
I20260812 19:26:16.673645  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:16.673853  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:26:16.674173  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:26:16.675504  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/master-0-root/instance:
uuid: "f9d8c25eedc54b9382055c46c7a1310a"
format_stamp: "Formatted at 2026-08-12 19:26:16 on dist-test-slave-3kk6"
I20260812 19:26:16.680210  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260812 19:26:16.683724 20432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:16.684448  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260812 19:26:16.684790  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/master-0-root
uuid: "f9d8c25eedc54b9382055c46c7a1310a"
format_stamp: "Formatted at 2026-08-12 19:26:16 on dist-test-slave-3kk6"
I20260812 19:26:16.685086  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:26:16.699859  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:26:16.701103  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:26:16.743520  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.62:36913
I20260812 19:26:16.743645 20507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.62:36913 every 8 connection(s)
I20260812 19:26:16.747570 20508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:16.758281 20508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a: Bootstrap starting.
I20260812 19:26:16.762961 20508 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:16.767390 20508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a: No bootstrap required, opened a new log
I20260812 19:26:16.769459 20508 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9d8c25eedc54b9382055c46c7a1310a" member_type: VOTER }
I20260812 19:26:16.769884 20508 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:16.770134 20508 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d8c25eedc54b9382055c46c7a1310a, State: Initialized, Role: FOLLOWER
I20260812 19:26:16.770792 20508 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9d8c25eedc54b9382055c46c7a1310a" member_type: VOTER }
I20260812 19:26:16.771276 20508 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 19:26:16.771521 20508 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 19:26:16.771816 20508 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:16.776273 20508 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9d8c25eedc54b9382055c46c7a1310a" member_type: VOTER }
I20260812 19:26:16.776786 20508 leader_election.cc:302] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9d8c25eedc54b9382055c46c7a1310a; no voters: 
I20260812 19:26:16.777992 20508 leader_election.cc:288] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 19:26:16.778434 20513 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:16.780076 20513 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [term 1 LEADER]: Becoming Leader. State: Replica: f9d8c25eedc54b9382055c46c7a1310a, State: Running, Role: LEADER
I20260812 19:26:16.780779 20513 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9d8c25eedc54b9382055c46c7a1310a" member_type: VOTER }
I20260812 19:26:16.781257 20508 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 19:26:16.785931 20519 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9d8c25eedc54b9382055c46c7a1310a. Latest consensus state: current_term: 1 leader_uuid: "f9d8c25eedc54b9382055c46c7a1310a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9d8c25eedc54b9382055c46c7a1310a" member_type: VOTER } }
I20260812 19:26:16.786808 20519 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [sys.catalog]: This master's current role is: LEADER
I20260812 19:26:16.789904 20516 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9d8c25eedc54b9382055c46c7a1310a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9d8c25eedc54b9382055c46c7a1310a" member_type: VOTER } }
I20260812 19:26:16.792080 20516 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [sys.catalog]: This master's current role is: LEADER
I20260812 19:26:16.796461 20535 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 19:26:16.798722  4084 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 19:26:16.803344 20535 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 19:26:16.812631 20535 catalog_manager.cc:1347] Generated new cluster ID: f87e17690dfd4019a44959f9b59b4670
I20260812 19:26:16.812968 20535 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:26:16.848445 20535 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 19:26:16.850207 20535 catalog_manager.cc:1504] Loading token signing keys...
I20260812 19:26:16.863852 20535 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a: Generated new TSK 0
I20260812 19:26:16.864621 20535 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:26:16.930034  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:26:16.936753 20549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:16.938141 20550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:16.942409  4084 server_base.cc:1034] running on GCE node
W20260812 19:26:16.944906 20552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:16.948500  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:26:16.948770  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:26:16.948935  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562776948919 us; error 0 us; skew 500 ppm
I20260812 19:26:16.949489  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:16.952286  4084 webserver.cc:460] Webserver started at http://127.3.253.1:42023/ using document root <none> and password file <none>
I20260812 19:26:16.952796  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:16.953011  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:26:16.953291  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:26:16.954631  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-0-root/instance:
uuid: "171f67787a8348fb9c7b19bf09026039"
format_stamp: "Formatted at 2026-08-12 19:26:16 on dist-test-slave-3kk6"
I20260812 19:26:16.959507  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 19:26:16.963059 20563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:16.963827  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260812 19:26:16.964136  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-0-root
uuid: "171f67787a8348fb9c7b19bf09026039"
format_stamp: "Formatted at 2026-08-12 19:26:16 on dist-test-slave-3kk6"
I20260812 19:26:16.964416  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:26:16.974989  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:26:16.976222  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:26:16.977712  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:26:16.980144  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:26:16.980357  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:16.980602  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:26:16.980782  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:17.025843  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.1:33811
I20260812 19:26:17.026029 20671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.1:33811 every 8 connection(s)
I20260812 19:26:17.031205  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:26:17.039423 20677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:17.042366 20679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:17.044087 20681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:17.046813  4084 server_base.cc:1034] running on GCE node
I20260812 19:26:17.049022 20672 heartbeater.cc:347] Connected to a master server at 127.3.253.62:36913
I20260812 19:26:17.049501 20672 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:17.050274 20672 heartbeater.cc:511] Master 127.3.253.62:36913 requested a full tablet report, sending...
I20260812 19:26:17.050420  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:26:17.050765  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:26:17.050938  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562777050923 us; error 0 us; skew 500 ppm
I20260812 19:26:17.051525  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:17.052570 20456 ts_manager.cc:194] Registered new tserver with Master: 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:17.054625  4084 webserver.cc:460] Webserver started at http://127.3.253.2:43483/ using document root <none> and password file <none>
I20260812 19:26:17.054728 20456 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52630
I20260812 19:26:17.055378  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:17.055614  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:26:17.055912  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:26:17.057216  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-1-root/instance:
uuid: "efc1471911ec442396b400eed9d18036"
format_stamp: "Formatted at 2026-08-12 19:26:17 on dist-test-slave-3kk6"
I20260812 19:26:17.061619  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260812 19:26:17.065127 20687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:17.065975  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 19:26:17.066274  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-1-root
uuid: "efc1471911ec442396b400eed9d18036"
format_stamp: "Formatted at 2026-08-12 19:26:17 on dist-test-slave-3kk6"
I20260812 19:26:17.066584  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:26:17.099334  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:26:17.100687  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:26:17.102212  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:26:17.104530  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:26:17.104761  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:17.104991  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:26:17.105155  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:17.149405  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.2:39525
I20260812 19:26:17.149518 20786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.2:39525 every 8 connection(s)
I20260812 19:26:17.154378  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:26:17.162405 20791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:17.162861 20793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:17.165943  4084 server_base.cc:1034] running on GCE node
W20260812 19:26:17.167316 20800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:17.168467  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:26:17.168723  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:26:17.168917  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562777168902 us; error 0 us; skew 500 ppm
I20260812 19:26:17.169435  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:17.169486 20787 heartbeater.cc:347] Connected to a master server at 127.3.253.62:36913
I20260812 19:26:17.169945 20787 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:17.170796 20787 heartbeater.cc:511] Master 127.3.253.62:36913 requested a full tablet report, sending...
I20260812 19:26:17.172427  4084 webserver.cc:460] Webserver started at http://127.3.253.3:36749/ using document root <none> and password file <none>
I20260812 19:26:17.172850 20456 ts_manager.cc:194] Registered new tserver with Master: efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:17.172976  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:17.173333  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:26:17.173604  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:26:17.174574 20456 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52640
I20260812 19:26:17.174857  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-2-root/instance:
uuid: "8c9e33eee61649e18fe397e56bdddea3"
format_stamp: "Formatted at 2026-08-12 19:26:17 on dist-test-slave-3kk6"
I20260812 19:26:17.179659  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260812 19:26:17.183152 20807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:17.183923  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260812 19:26:17.184216  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-2-root
uuid: "8c9e33eee61649e18fe397e56bdddea3"
format_stamp: "Formatted at 2026-08-12 19:26:17 on dist-test-slave-3kk6"
I20260812 19:26:17.184506  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:26:17.203920  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:26:17.205353  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:26:17.206916  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:26:17.209223  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:26:17.209440  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:17.209708  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:26:17.209908  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:17.253494  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.3:38049
I20260812 19:26:17.253612 20897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.3:38049 every 8 connection(s)
I20260812 19:26:17.258531  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:26:17.267413 20903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:17.268296 20906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:17.270496 20908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:17.271459  4084 server_base.cc:1034] running on GCE node
I20260812 19:26:17.272606  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:26:17.272895  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:26:17.273113  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562777273095 us; error 0 us; skew 500 ppm
I20260812 19:26:17.273785  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:17.273837 20898 heartbeater.cc:347] Connected to a master server at 127.3.253.62:36913
I20260812 19:26:17.274312 20898 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:17.275101 20898 heartbeater.cc:511] Master 127.3.253.62:36913 requested a full tablet report, sending...
I20260812 19:26:17.276854  4084 webserver.cc:460] Webserver started at http://127.3.253.4:38183/ using document root <none> and password file <none>
I20260812 19:26:17.277278 20456 ts_manager.cc:194] Registered new tserver with Master: 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:17.277444  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:17.277805  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:26:17.278137  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:26:17.279213 20456 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52654
I20260812 19:26:17.279426  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-3-root/instance:
uuid: "d5ab425bcd82426387b1a5b02e55b64c"
format_stamp: "Formatted at 2026-08-12 19:26:17 on dist-test-slave-3kk6"
I20260812 19:26:17.284511  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260812 19:26:17.288374 20915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:17.289318  4084 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260812 19:26:17.289705  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-3-root
uuid: "d5ab425bcd82426387b1a5b02e55b64c"
format_stamp: "Formatted at 2026-08-12 19:26:17 on dist-test-slave-3kk6"
I20260812 19:26:17.290030  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:26:17.324134  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:26:17.325866  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:26:17.327397  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:26:17.329705  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:26:17.329936  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:17.330192  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:26:17.330331  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:17.376072  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.4:37307
I20260812 19:26:17.376196 21022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.4:37307 every 8 connection(s)
I20260812 19:26:17.393417 21024 heartbeater.cc:347] Connected to a master server at 127.3.253.62:36913
I20260812 19:26:17.393911 21024 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:17.394810 21024 heartbeater.cc:511] Master 127.3.253.62:36913 requested a full tablet report, sending...
I20260812 19:26:17.396937 20456 ts_manager.cc:194] Registered new tserver with Master: d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:17.397145  4084 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017973422s
I20260812 19:26:17.399425 20456 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52660
I20260812 19:26:17.400277  4084 test_util.cc:268] Using random seed: -1883814978
I20260812 19:26:17.427117 20456 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52662:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 19:26:17.691653 20618 tablet_service.cc:1467] Processing CreateTablet for tablet 7b35dda8c9ec45d783785ed1ebb70243 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260812 19:26:17.693212 20618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b35dda8c9ec45d783785ed1ebb70243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.698746 20617 tablet_service.cc:1467] Processing CreateTablet for tablet 65767121d73547f7b17d3a05b6de8a6c (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260812 19:26:17.700333 20617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65767121d73547f7b17d3a05b6de8a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.701671 20603 tablet_service.cc:1467] Processing CreateTablet for tablet e27156bde17147a6af9ddb1f23aa3ef8 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260812 19:26:17.703128 20603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e27156bde17147a6af9ddb1f23aa3ef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.703871 20613 tablet_service.cc:1467] Processing CreateTablet for tablet fb51472eb3314091aa30c515f1809f83 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260812 19:26:17.705199 20613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb51472eb3314091aa30c515f1809f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.707882 20608 tablet_service.cc:1467] Processing CreateTablet for tablet e5fc45bed8304c558e1aeb9f7ef05f2c (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260812 19:26:17.709203 20608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5fc45bed8304c558e1aeb9f7ef05f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.711859 20607 tablet_service.cc:1467] Processing CreateTablet for tablet 614ccc1f6aa847f5b874c88bb9e2587a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260812 19:26:17.713217 20607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 614ccc1f6aa847f5b874c88bb9e2587a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.715839 20605 tablet_service.cc:1467] Processing CreateTablet for tablet 0454a10a87ed4fd7a5ef01021940c016 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260812 19:26:17.717239 20605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0454a10a87ed4fd7a5ef01021940c016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.720896 20602 tablet_service.cc:1467] Processing CreateTablet for tablet 51d8a1b5f4e9425691ed304509f9d8a9 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260812 19:26:17.722352 20602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d8a1b5f4e9425691ed304509f9d8a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.727442 20601 tablet_service.cc:1467] Processing CreateTablet for tablet 1b3b75fc0d53420fa10f6f1dc8c16cb1 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260812 19:26:17.729156 20601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b3b75fc0d53420fa10f6f1dc8c16cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.743924 20600 tablet_service.cc:1467] Processing CreateTablet for tablet e4c0067c6bd74e33b1ebe3785dabf7d1 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260812 19:26:17.745507 20600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4c0067c6bd74e33b1ebe3785dabf7d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.754582 21055 tablet_bootstrap.cc:492] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:17.755885 20968 tablet_service.cc:1467] Processing CreateTablet for tablet 65767121d73547f7b17d3a05b6de8a6c (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260812 19:26:17.757405 20968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65767121d73547f7b17d3a05b6de8a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.759824 20965 tablet_service.cc:1467] Processing CreateTablet for tablet fb51472eb3314091aa30c515f1809f83 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260812 19:26:17.763866 20963 tablet_service.cc:1467] Processing CreateTablet for tablet 614ccc1f6aa847f5b874c88bb9e2587a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260812 19:26:17.764508 21055 tablet_bootstrap.cc:654] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:17.767930 20961 tablet_service.cc:1467] Processing CreateTablet for tablet 7a74b750f92947ff863276caab71a1df (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260812 19:26:17.766178 20962 tablet_service.cc:1467] Processing CreateTablet for tablet 0454a10a87ed4fd7a5ef01021940c016 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260812 19:26:17.762140 20964 tablet_service.cc:1467] Processing CreateTablet for tablet ede4dcd9659d422184a3873426f9e6c4 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260812 19:26:17.772454 20965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb51472eb3314091aa30c515f1809f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.774187 20964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ede4dcd9659d422184a3873426f9e6c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.775872 20724 tablet_service.cc:1467] Processing CreateTablet for tablet 7b35dda8c9ec45d783785ed1ebb70243 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260812 19:26:17.776765 21055 tablet_bootstrap.cc:492] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:17.777217 20724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b35dda8c9ec45d783785ed1ebb70243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.777325 21055 ts_tablet_manager.cc:1397] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.000s
I20260812 19:26:17.777493 20718 tablet_service.cc:1467] Processing CreateTablet for tablet e27156bde17147a6af9ddb1f23aa3ef8 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260812 19:26:17.778864 20718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e27156bde17147a6af9ddb1f23aa3ef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.779819 20723 tablet_service.cc:1467] Processing CreateTablet for tablet 65767121d73547f7b17d3a05b6de8a6c (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260812 19:26:17.781152 20723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65767121d73547f7b17d3a05b6de8a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.780751 21055 raft_consensus.cc:348] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:17.781821 21055 raft_consensus.cc:374] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:17.781607 20719 tablet_service.cc:1467] Processing CreateTablet for tablet 7a74b750f92947ff863276caab71a1df (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260812 19:26:17.782150 21055 raft_consensus.cc:729] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:17.782994 20719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a74b750f92947ff863276caab71a1df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.783157 21055 consensus_queue.cc:260] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:17.783787 20722 tablet_service.cc:1467] Processing CreateTablet for tablet ede4dcd9659d422184a3873426f9e6c4 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260812 19:26:17.785099 20722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ede4dcd9659d422184a3873426f9e6c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.787279 20717 tablet_service.cc:1467] Processing CreateTablet for tablet 51d8a1b5f4e9425691ed304509f9d8a9 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260812 19:26:17.787760 20721 tablet_service.cc:1467] Processing CreateTablet for tablet e5fc45bed8304c558e1aeb9f7ef05f2c (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260812 19:26:17.788651 20717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d8a1b5f4e9425691ed304509f9d8a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.789979 20720 tablet_service.cc:1467] Processing CreateTablet for tablet 614ccc1f6aa847f5b874c88bb9e2587a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260812 19:26:17.791368 20720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 614ccc1f6aa847f5b874c88bb9e2587a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:17.791404 20530 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:26:17.791930 20716 tablet_service.cc:1467] Processing CreateTablet for tablet 2a2c90e3f1d4440da993ec52cd2658f2 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260812 19:26:17.793263 20716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a2c90e3f1d4440da993ec52cd2658f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.796379 20962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0454a10a87ed4fd7a5ef01021940c016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.802762 20959 tablet_service.cc:1467] Processing CreateTablet for tablet 1b3b75fc0d53420fa10f6f1dc8c16cb1 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260812 19:26:17.804188 20959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b3b75fc0d53420fa10f6f1dc8c16cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.807883 20958 tablet_service.cc:1467] Processing CreateTablet for tablet 2a2c90e3f1d4440da993ec52cd2658f2 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260812 19:26:17.798032 20715 tablet_service.cc:1467] Processing CreateTablet for tablet e4c0067c6bd74e33b1ebe3785dabf7d1 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260812 19:26:17.798983 20960 tablet_service.cc:1467] Processing CreateTablet for tablet 51d8a1b5f4e9425691ed304509f9d8a9 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260812 19:26:17.813367 20848 tablet_service.cc:1467] Processing CreateTablet for tablet 7b35dda8c9ec45d783785ed1ebb70243 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260812 19:26:17.815124 20841 tablet_service.cc:1467] Processing CreateTablet for tablet e27156bde17147a6af9ddb1f23aa3ef8 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260812 19:26:17.815883 20847 tablet_service.cc:1467] Processing CreateTablet for tablet fb51472eb3314091aa30c515f1809f83 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260812 19:26:17.817751 20840 tablet_service.cc:1467] Processing CreateTablet for tablet 1b3b75fc0d53420fa10f6f1dc8c16cb1 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260812 19:26:17.818149 20846 tablet_service.cc:1467] Processing CreateTablet for tablet ede4dcd9659d422184a3873426f9e6c4 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260812 19:26:17.820132 20845 tablet_service.cc:1467] Processing CreateTablet for tablet e5fc45bed8304c558e1aeb9f7ef05f2c (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260812 19:26:17.820415 20839 tablet_service.cc:1467] Processing CreateTablet for tablet 2a2c90e3f1d4440da993ec52cd2658f2 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260812 19:26:17.822155 20843 tablet_service.cc:1467] Processing CreateTablet for tablet 0454a10a87ed4fd7a5ef01021940c016 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260812 19:26:17.822837 20836 tablet_service.cc:1467] Processing CreateTablet for tablet e4c0067c6bd74e33b1ebe3785dabf7d1 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260812 19:26:17.824257 20842 tablet_service.cc:1467] Processing CreateTablet for tablet 7a74b750f92947ff863276caab71a1df (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260812 19:26:17.826828 20848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b35dda8c9ec45d783785ed1ebb70243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.826604 20608 tablet_service.cc:1467] Processing CreateTablet for tablet a91aea69f88c43cb84d67ea8a6e8d8bf (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260812 19:26:17.827018 20607 tablet_service.cc:1467] Processing CreateTablet for tablet 5cb0f8eae7934850b4db442c32298bb3 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260812 19:26:17.828337 20608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a91aea69f88c43cb84d67ea8a6e8d8bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.801649 20721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5fc45bed8304c558e1aeb9f7ef05f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.831436 20840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b3b75fc0d53420fa10f6f1dc8c16cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.835495 20607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cb0f8eae7934850b4db442c32298bb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.840008 20605 tablet_service.cc:1467] Processing CreateTablet for tablet adf3a538c4d74dd0a1704de4cf4d3624 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260812 19:26:17.841440 20605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf3a538c4d74dd0a1704de4cf4d3624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.855436 20961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a74b750f92947ff863276caab71a1df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.859083 20963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 614ccc1f6aa847f5b874c88bb9e2587a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.868240 20718 tablet_service.cc:1467] Processing CreateTablet for tablet adf3a538c4d74dd0a1704de4cf4d3624 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260812 19:26:17.869767 20718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf3a538c4d74dd0a1704de4cf4d3624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.871061 20715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4c0067c6bd74e33b1ebe3785dabf7d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.875125 20618 tablet_service.cc:1467] Processing CreateTablet for tablet 5b112d71b0be429f977ba95ac9534b6b (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260812 19:26:17.876518 20618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b112d71b0be429f977ba95ac9534b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.876168 20955 tablet_service.cc:1467] Processing CreateTablet for tablet adf3a538c4d74dd0a1704de4cf4d3624 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260812 19:26:17.870472 20847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb51472eb3314091aa30c515f1809f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.879446 20846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ede4dcd9659d422184a3873426f9e6c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.880113 20841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e27156bde17147a6af9ddb1f23aa3ef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.880801 20613 tablet_service.cc:1467] Processing CreateTablet for tablet 6155c47e884e43498e968f83072b863a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260812 19:26:17.881332 20608 tablet_service.cc:1467] Processing CreateTablet for tablet 728993c4b9cc4b97935e507c167f6a62 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260812 19:26:17.882062 20842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a74b750f92947ff863276caab71a1df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.882169 20613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6155c47e884e43498e968f83072b863a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.883132 20839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a2c90e3f1d4440da993ec52cd2658f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.885641 20843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0454a10a87ed4fd7a5ef01021940c016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.886922 20845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5fc45bed8304c558e1aeb9f7ef05f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.887933 20836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4c0067c6bd74e33b1ebe3785dabf7d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.896433 21058 tablet_bootstrap.cc:492] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:17.901729 20958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a2c90e3f1d4440da993ec52cd2658f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.907384 20955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf3a538c4d74dd0a1704de4cf4d3624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.907635 20608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 728993c4b9cc4b97935e507c167f6a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.911281 20960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d8a1b5f4e9425691ed304509f9d8a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.897248 20719 tablet_service.cc:1467] Processing CreateTablet for tablet e3d48eec043e47bd9fd931ffd1ffe5e2 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260812 19:26:17.944370 20719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3d48eec043e47bd9fd931ffd1ffe5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.950412 20603 tablet_service.cc:1467] Processing CreateTablet for tablet 25f274ac8f124e7697711e0afcd0b058 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260812 19:26:17.959710 21055 ts_tablet_manager.cc:1428] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.182s	user 0.021s	sys 0.019s
I20260812 19:26:17.976131 20717 tablet_service.cc:1467] Processing CreateTablet for tablet a91aea69f88c43cb84d67ea8a6e8d8bf (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260812 19:26:17.977595 20717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a91aea69f88c43cb84d67ea8a6e8d8bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:17.995098 20603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25f274ac8f124e7697711e0afcd0b058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.006043 20672 heartbeater.cc:503] Master 127.3.253.62:36913 was elected leader, sending a full tablet report...
I20260812 19:26:18.022082 21058 tablet_bootstrap.cc:654] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:18.030864 20673 tablet.cc:2369] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:26:18.040722 20721 tablet_service.cc:1467] Processing CreateTablet for tablet 728993c4b9cc4b97935e507c167f6a62 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260812 19:26:18.026937 20968 tablet_service.cc:1467] Processing CreateTablet for tablet 5cb0f8eae7934850b4db442c32298bb3 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260812 19:26:18.053601 20721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 728993c4b9cc4b97935e507c167f6a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.054626 20968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cb0f8eae7934850b4db442c32298bb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.065557 20960 tablet_service.cc:1467] Processing CreateTablet for tablet e3d48eec043e47bd9fd931ffd1ffe5e2 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260812 19:26:18.067914 20960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3d48eec043e47bd9fd931ffd1ffe5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.043712 20613 tablet_service.cc:1467] Processing CreateTablet for tablet 3a347274cb334867b07c94e32b32f3ca (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260812 19:26:18.069669 20613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a347274cb334867b07c94e32b32f3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.055353 21055 tablet_bootstrap.cc:492] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:18.040802 20723 tablet_service.cc:1467] Processing CreateTablet for tablet fbb6b294d38f46c994858d9de86da083 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260812 19:26:18.077530 20723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbb6b294d38f46c994858d9de86da083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.082151 20722 tablet_service.cc:1467] Processing CreateTablet for tablet 6155c47e884e43498e968f83072b863a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260812 19:26:18.083132 20965 tablet_service.cc:1467] Processing CreateTablet for tablet 5b112d71b0be429f977ba95ac9534b6b (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260812 19:26:18.083693 20722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6155c47e884e43498e968f83072b863a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.084468 20965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b112d71b0be429f977ba95ac9534b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.087528 20603 tablet_service.cc:1467] Processing CreateTablet for tablet be4515819a7e4b5fa91def511f58fc4f (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260812 19:26:18.088972 20603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be4515819a7e4b5fa91def511f58fc4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.088932 20847 tablet_service.cc:1467] Processing CreateTablet for tablet 5cb0f8eae7934850b4db442c32298bb3 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260812 19:26:18.089460 20841 tablet_service.cc:1467] Processing CreateTablet for tablet e3d48eec043e47bd9fd931ffd1ffe5e2 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260812 19:26:18.090587 20847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cb0f8eae7934850b4db442c32298bb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.066751 20959 tablet_service.cc:1467] Processing CreateTablet for tablet 728993c4b9cc4b97935e507c167f6a62 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260812 19:26:18.093834 20845 tablet_service.cc:1467] Processing CreateTablet for tablet a91aea69f88c43cb84d67ea8a6e8d8bf (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260812 19:26:18.095227 21061 tablet_bootstrap.cc:492] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:18.096071 21060 tablet_bootstrap.cc:492] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:18.103771 21055 tablet_bootstrap.cc:654] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:18.103919 20716 tablet_service.cc:1467] Processing CreateTablet for tablet 25f274ac8f124e7697711e0afcd0b058 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260812 19:26:18.106635 20839 tablet_service.cc:1467] Processing CreateTablet for tablet fbb6b294d38f46c994858d9de86da083 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260812 19:26:18.107961 20716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25f274ac8f124e7697711e0afcd0b058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.093886 20959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 728993c4b9cc4b97935e507c167f6a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.106290 20843 tablet_service.cc:1467] Processing CreateTablet for tablet 5b112d71b0be429f977ba95ac9534b6b (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260812 19:26:18.112586 20715 tablet_service.cc:1467] Processing CreateTablet for tablet 57c6682d61b04b799643ea1c8b687787 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260812 19:26:18.095240 20845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a91aea69f88c43cb84d67ea8a6e8d8bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.119442 20715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57c6682d61b04b799643ea1c8b687787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.121229 21058 tablet_bootstrap.cc:492] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:18.121819 21058 ts_tablet_manager.cc:1397] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.226s	user 0.013s	sys 0.000s
I20260812 19:26:18.124680 21058 raft_consensus.cc:348] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:18.125411 21058 raft_consensus.cc:374] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:18.125692 21058 raft_consensus.cc:729] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:18.129925 20961 tablet_service.cc:1467] Processing CreateTablet for tablet fbb6b294d38f46c994858d9de86da083 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260812 19:26:18.144286 20955 tablet_service.cc:1467] Processing CreateTablet for tablet 3a347274cb334867b07c94e32b32f3ca (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260812 19:26:18.144376 20962 tablet_service.cc:1467] Processing CreateTablet for tablet 57c6682d61b04b799643ea1c8b687787 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260812 19:26:18.145395 21057 raft_consensus.cc:482] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:18.149914 20836 tablet_service.cc:1467] Processing CreateTablet for tablet be4515819a7e4b5fa91def511f58fc4f (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260812 19:26:18.150389 21057 raft_consensus.cc:504] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:18.153301 21057 leader_election.cc:288] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:18.126477 21058 consensus_queue.cc:260] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:18.156105 20963 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6cd88a19cf44aeabbec6b1d8e76630 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260812 19:26:18.158283 20720 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6cd88a19cf44aeabbec6b1d8e76630 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260812 19:26:18.159708 20720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b6cd88a19cf44aeabbec6b1d8e76630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.168550 20724 tablet_service.cc:1467] Processing CreateTablet for tablet be4515819a7e4b5fa91def511f58fc4f (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260812 19:26:18.169013 20607 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6cd88a19cf44aeabbec6b1d8e76630 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260812 19:26:18.173996 20839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbb6b294d38f46c994858d9de86da083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.174917 20846 tablet_service.cc:1467] Processing CreateTablet for tablet 6155c47e884e43498e968f83072b863a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260812 19:26:18.167500 20961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbb6b294d38f46c994858d9de86da083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.176281 20846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6155c47e884e43498e968f83072b863a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.177548 20787 heartbeater.cc:503] Master 127.3.253.62:36913 was elected leader, sending a full tablet report...
I20260812 19:26:18.137293 20840 tablet_service.cc:1467] Processing CreateTablet for tablet 3a347274cb334867b07c94e32b32f3ca (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260812 19:26:18.190482 20841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3d48eec043e47bd9fd931ffd1ffe5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.139284 20958 tablet_service.cc:1467] Processing CreateTablet for tablet 25f274ac8f124e7697711e0afcd0b058 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260812 19:26:18.191248 20840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a347274cb334867b07c94e32b32f3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.192755 20955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a347274cb334867b07c94e32b32f3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.200779 20848 tablet_service.cc:1467] Processing CreateTablet for tablet 57c6682d61b04b799643ea1c8b687787 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260812 19:26:18.187552 20717 tablet_service.cc:1467] Processing CreateTablet for tablet 27a1c1554b2d44ec849b89e817bd0a12 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260812 19:26:18.214991 20848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57c6682d61b04b799643ea1c8b687787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.219264 20842 tablet_service.cc:1467] Processing CreateTablet for tablet 8f536e291e9f46cb8ce550ae575e643a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260812 19:26:18.219535 20960 tablet_service.cc:1467] Processing CreateTablet for tablet ebcc2cf4057a4c8e82b0ee3dc8481257 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260812 19:26:18.220896 20842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f536e291e9f46cb8ce550ae575e643a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.221671 21061 tablet_bootstrap.cc:654] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:18.201720 20607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b6cd88a19cf44aeabbec6b1d8e76630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.227274 20836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be4515819a7e4b5fa91def511f58fc4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.229979 20968 tablet_service.cc:1467] Processing CreateTablet for tablet 27a1c1554b2d44ec849b89e817bd0a12 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260812 19:26:18.207015 20963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b6cd88a19cf44aeabbec6b1d8e76630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.207633 20964 tablet_service.cc:1467] Processing CreateTablet for tablet 8f536e291e9f46cb8ce550ae575e643a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260812 19:26:18.207015 20724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be4515819a7e4b5fa91def511f58fc4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.231422 20968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27a1c1554b2d44ec849b89e817bd0a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.231935 20717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27a1c1554b2d44ec849b89e817bd0a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.239001 20843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b112d71b0be429f977ba95ac9534b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.247750 20718 tablet_service.cc:1467] Processing CreateTablet for tablet 1a15940eed3e4cfb8cf7127a2cb2f757 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260812 19:26:18.248962 20605 tablet_service.cc:1467] Processing CreateTablet for tablet 8f536e291e9f46cb8ce550ae575e643a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260812 19:26:18.249593 20962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57c6682d61b04b799643ea1c8b687787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.250164 20718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a15940eed3e4cfb8cf7127a2cb2f757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.250377 20605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f536e291e9f46cb8ce550ae575e643a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.255263 20600 tablet_service.cc:1467] Processing CreateTablet for tablet 1a15940eed3e4cfb8cf7127a2cb2f757 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260812 19:26:18.262506 21055 tablet_bootstrap.cc:492] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:18.262753 20958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25f274ac8f124e7697711e0afcd0b058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.263123 21055 ts_tablet_manager.cc:1397] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.208s	user 0.018s	sys 0.002s
I20260812 19:26:18.263691 20600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a15940eed3e4cfb8cf7127a2cb2f757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.267601 21058 ts_tablet_manager.cc:1428] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.145s	user 0.020s	sys 0.000s
I20260812 19:26:18.268677 21058 tablet_bootstrap.cc:492] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:18.272441 20618 tablet_service.cc:1467] Processing CreateTablet for tablet ebcc2cf4057a4c8e82b0ee3dc8481257 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260812 19:26:18.273154 21055 raft_consensus.cc:348] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:18.273785 20618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebcc2cf4057a4c8e82b0ee3dc8481257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.273978 21055 raft_consensus.cc:374] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:18.274346 21055 raft_consensus.cc:729] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:18.298529 20898 heartbeater.cc:503] Master 127.3.253.62:36913 was elected leader, sending a full tablet report...
I20260812 19:26:18.302433 20719 tablet_service.cc:1467] Processing CreateTablet for tablet ebcc2cf4057a4c8e82b0ee3dc8481257 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260812 19:26:18.310937 20719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebcc2cf4057a4c8e82b0ee3dc8481257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.305943 20960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebcc2cf4057a4c8e82b0ee3dc8481257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.335695 20603 tablet_service.cc:1467] Processing CreateTablet for tablet 67cee93c25424387a17659df99d3ad3d (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260812 19:26:18.337182 20603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67cee93c25424387a17659df99d3ad3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.305655 21055 consensus_queue.cc:260] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:18.342941 21057 raft_consensus.cc:482] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:18.343412 21057 raft_consensus.cc:504] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:18.350106 20964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f536e291e9f46cb8ce550ae575e643a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.350210 21066 raft_consensus.cc:482] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:18.351074 21066 raft_consensus.cc:504] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:18.352442 20847 tablet_service.cc:1467] Processing CreateTablet for tablet 27a1c1554b2d44ec849b89e817bd0a12 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260812 19:26:18.354086 20847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27a1c1554b2d44ec849b89e817bd0a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.359661 21055 ts_tablet_manager.cc:1428] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.000s
I20260812 19:26:18.361162 21055 tablet_bootstrap.cc:492] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:18.361506 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b35dda8c9ec45d783785ed1ebb70243" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:18.359670 21066 leader_election.cc:288] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:18.372260 21057 leader_election.cc:288] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:18.374779 20965 tablet_service.cc:1467] Processing CreateTablet for tablet 67cee93c25424387a17659df99d3ad3d (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260812 19:26:18.417425 20608 tablet_service.cc:1467] Processing CreateTablet for tablet 8732d4883dce4b7d97faf3669bdbb006 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260812 19:26:18.419452 20608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8732d4883dce4b7d97faf3669bdbb006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.425420 20839 tablet_service.cc:1467] Processing CreateTablet for tablet 1a15940eed3e4cfb8cf7127a2cb2f757 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260812 19:26:18.379019 21060 tablet_bootstrap.cc:700] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c: Time spent opening tablet: real 0.108s	user 0.000s	sys 0.005s
I20260812 19:26:18.379640 21058 tablet_bootstrap.cc:654] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:18.381803 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b35dda8c9ec45d783785ed1ebb70243" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:18.403534 21024 heartbeater.cc:503] Master 127.3.253.62:36913 was elected leader, sending a full tablet report...
W20260812 19:26:18.444249 20566 leader_election.cc:341] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:18.413673 21061 tablet_bootstrap.cc:492] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:18.375646 20722 tablet_service.cc:1467] Processing CreateTablet for tablet 0af9baeb12a1400e8df29ae3d35377d5 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260812 19:26:18.433254 21055 tablet_bootstrap.cc:654] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:18.453158 21061 ts_tablet_manager.cc:1397] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.358s	user 0.014s	sys 0.017s
I20260812 19:26:18.462877 20965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67cee93c25424387a17659df99d3ad3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.463163 21061 raft_consensus.cc:348] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:18.463750 21061 raft_consensus.cc:374] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:18.463930 21061 raft_consensus.cc:729] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:18.464527 21061 consensus_queue.cc:260] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:18.454480 20722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0af9baeb12a1400e8df29ae3d35377d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.473431 20961 tablet_service.cc:1467] Processing CreateTablet for tablet 0af9baeb12a1400e8df29ae3d35377d5 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260812 19:26:18.475028 20961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0af9baeb12a1400e8df29ae3d35377d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.479000 21060 tablet_bootstrap.cc:654] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:18.459525 20842 tablet_service.cc:1467] Processing CreateTablet for tablet 67cee93c25424387a17659df99d3ad3d (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260812 19:26:18.488615 20842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67cee93c25424387a17659df99d3ad3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.488926 20836 tablet_service.cc:1467] Processing CreateTablet for tablet 0af9baeb12a1400e8df29ae3d35377d5 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260812 19:26:18.490288 20836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0af9baeb12a1400e8df29ae3d35377d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.499505 21061 ts_tablet_manager.cc:1428] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.004s
I20260812 19:26:18.567263 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8a1b5f4e9425691ed304509f9d8a9" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:18.567865 20716 tablet_service.cc:1467] Processing CreateTablet for tablet 8732d4883dce4b7d97faf3669bdbb006 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260812 19:26:18.572971 20716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8732d4883dce4b7d97faf3669bdbb006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.567880 20718 tablet_service.cc:1467] Processing CreateTablet for tablet 06f6e7dcac69477a99d44c3e039f7d36 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260812 19:26:18.577028 20718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06f6e7dcac69477a99d44c3e039f7d36. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:18.561878 20570 leader_election.cc:341] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:18.595327 20570 leader_election.cc:302] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036
I20260812 19:26:18.597462 20839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a15940eed3e4cfb8cf7127a2cb2f757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.604655 20968 tablet_service.cc:1467] Processing CreateTablet for tablet 06f6e7dcac69477a99d44c3e039f7d36 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260812 19:26:18.608641 21080 raft_consensus.cc:482] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:18.609546 20968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06f6e7dcac69477a99d44c3e039f7d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.609840 21061 tablet_bootstrap.cc:492] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:18.621556 21055 tablet_bootstrap.cc:492] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:18.610210 21080 raft_consensus.cc:504] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:18.634073 21060 tablet_bootstrap.cc:492] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:18.635123 21060 ts_tablet_manager.cc:1397] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.539s	user 0.013s	sys 0.019s
I20260812 19:26:18.639285 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:18.644307 20691 leader_election.cc:341] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:18.598532 20963 tablet_service.cc:1467] Processing CreateTablet for tablet 0eb60aaf78c64f9ebfdb6f535cc96363 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260812 19:26:18.648052 21058 tablet_bootstrap.cc:492] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:18.649736 21058 ts_tablet_manager.cc:1397] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.381s	user 0.003s	sys 0.014s
I20260812 19:26:18.650094 20963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0eb60aaf78c64f9ebfdb6f535cc96363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.658740 21080 leader_election.cc:288] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:18.647117 21055 ts_tablet_manager.cc:1397] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.286s	user 0.008s	sys 0.012s
W20260812 19:26:18.669399 20437 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 94440us
I20260812 19:26:18.660785 21060 raft_consensus.cc:348] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
W20260812 19:26:18.675742 20570 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 117326us
I20260812 19:26:18.675971 21060 raft_consensus.cc:374] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:18.676435 21060 raft_consensus.cc:729] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
W20260812 19:26:18.677495 20570 leader_election.cc:341] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:18.678714 20434 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.253.4:37307, user_credentials={real_user=slave}} blocked reactor thread for 51454.3us
I20260812 19:26:18.654227 21058 raft_consensus.cc:348] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:18.680564 21058 raft_consensus.cc:374] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:18.680974 21058 raft_consensus.cc:729] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:18.682296 21058 consensus_queue.cc:260] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
W20260812 19:26:18.683318 20439 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 132558us
I20260812 19:26:18.685739 21057 raft_consensus.cc:2726] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:18.687963 21055 raft_consensus.cc:348] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:18.688862 21055 raft_consensus.cc:374] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:18.689172 21055 raft_consensus.cc:729] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:18.704806 20960 tablet_service.cc:1467] Processing CreateTablet for tablet b2e5c58cd31f4eb8bd9092458140299a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260812 19:26:18.705597 20843 tablet_service.cc:1467] Processing CreateTablet for tablet 8732d4883dce4b7d97faf3669bdbb006 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260812 19:26:18.707062 20843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8732d4883dce4b7d97faf3669bdbb006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.708312 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8a1b5f4e9425691ed304509f9d8a9" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:18.714401 21060 consensus_queue.cc:260] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:18.706470 20960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2e5c58cd31f4eb8bd9092458140299a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.689961 21055 consensus_queue.cc:260] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
W20260812 19:26:18.715512 20565 leader_election.cc:341] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:18.719907 20965 tablet_service.cc:1467] Processing CreateTablet for tablet 2f8d3279bf00462799704042e3cb3966 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260812 19:26:18.720029 20721 tablet_service.cc:1467] Processing CreateTablet for tablet 2f8d3279bf00462799704042e3cb3966 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260812 19:26:18.722679 21058 ts_tablet_manager.cc:1428] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.072s	user 0.000s	sys 0.011s
I20260812 19:26:18.723379 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
W20260812 19:26:18.725664 20688 leader_election.cc:341] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:18.726133 20688 leader_election.cc:302] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:18.731730 20565 leader_election.cc:302] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
I20260812 19:26:18.732547 21066 raft_consensus.cc:2726] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:18.738895 21058 tablet_bootstrap.cc:492] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:18.740109 20721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f8d3279bf00462799704042e3cb3966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.740538 21061 tablet_bootstrap.cc:654] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:18.748998 21058 tablet_bootstrap.cc:654] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:18.752537 20965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f8d3279bf00462799704042e3cb3966. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:18.753912 20434 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.253.4:37307, user_credentials={real_user=slave}} blocked reactor thread for 50885.7us
I20260812 19:26:18.755014 21057 raft_consensus.cc:2726] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:18.755458 20842 tablet_service.cc:1467] Processing CreateTablet for tablet 0eb60aaf78c64f9ebfdb6f535cc96363 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260812 19:26:18.755764 20600 tablet_service.cc:1467] Processing CreateTablet for tablet 06f6e7dcac69477a99d44c3e039f7d36 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260812 19:26:18.756985 20842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0eb60aaf78c64f9ebfdb6f535cc96363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.758432 20600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06f6e7dcac69477a99d44c3e039f7d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.765877 20607 tablet_service.cc:1467] Processing CreateTablet for tablet 0eb60aaf78c64f9ebfdb6f535cc96363 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260812 19:26:18.767414 20607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0eb60aaf78c64f9ebfdb6f535cc96363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.780781 21093 raft_consensus.cc:482] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:18.781585 21093 raft_consensus.cc:504] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
W20260812 19:26:18.796545 20530 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:26:18.812371 20847 tablet_service.cc:1467] Processing CreateTablet for tablet 2f8d3279bf00462799704042e3cb3966 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260812 19:26:18.829710 21060 ts_tablet_manager.cc:1428] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.194s	user 0.008s	sys 0.010s
I20260812 19:26:18.832063 21060 tablet_bootstrap.cc:492] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:18.832751 21055 ts_tablet_manager.cc:1428] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.168s	user 0.008s	sys 0.000s
I20260812 19:26:18.847395 20847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f8d3279bf00462799704042e3cb3966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.848397 20618 tablet_service.cc:1467] Processing CreateTablet for tablet b2e5c58cd31f4eb8bd9092458140299a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260812 19:26:18.848361 20848 tablet_service.cc:1467] Processing CreateTablet for tablet 435900f76e8b41cdbc9f2f3ce6c425da (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260812 19:26:18.850142 20618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2e5c58cd31f4eb8bd9092458140299a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.855410 20603 tablet_service.cc:1467] Processing CreateTablet for tablet 435900f76e8b41cdbc9f2f3ce6c425da (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260812 19:26:18.856109 20716 tablet_service.cc:1467] Processing CreateTablet for tablet 435900f76e8b41cdbc9f2f3ce6c425da (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260812 19:26:18.856877 20603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 435900f76e8b41cdbc9f2f3ce6c425da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.858008 20716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 435900f76e8b41cdbc9f2f3ce6c425da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.866329 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b35dda8c9ec45d783785ed1ebb70243" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:18.866981 20846 tablet_service.cc:1467] Processing CreateTablet for tablet e2a274b81b0d4079852b8b1ea7c7592a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260812 19:26:18.868463 20815 leader_election.cc:341] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:18.850436 20848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 435900f76e8b41cdbc9f2f3ce6c425da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.834547 21055 tablet_bootstrap.cc:492] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:18.882210 21066 raft_consensus.cc:482] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:18.882807 21066 raft_consensus.cc:504] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
W20260812 19:26:18.825053 20565 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:37307, user_credentials={real_user=slave}} blocked reactor thread for 109785us
I20260812 19:26:18.896771 21066 leader_election.cc:288] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:18.897640 20608 tablet_service.cc:1467] Processing CreateTablet for tablet e2a274b81b0d4079852b8b1ea7c7592a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260812 19:26:18.898267 20719 tablet_service.cc:1467] Processing CreateTablet for tablet 200fb82ae5174fb184b44b3ea6f39a59 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260812 19:26:18.898590 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27156bde17147a6af9ddb1f23aa3ef8" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:18.899883 20719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 200fb82ae5174fb184b44b3ea6f39a59. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:18.900211 20691 leader_election.cc:341] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:18.903296 20608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2a274b81b0d4079852b8b1ea7c7592a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.907776 20846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2a274b81b0d4079852b8b1ea7c7592a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.933568 20836 tablet_service.cc:1467] Processing CreateTablet for tablet 200fb82ae5174fb184b44b3ea6f39a59 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260812 19:26:18.935036 20836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 200fb82ae5174fb184b44b3ea6f39a59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.881616 21093 leader_election.cc:288] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:18.950528 21108 raft_consensus.cc:482] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:18.951117 21108 raft_consensus.cc:504] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:18.955106 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27156bde17147a6af9ddb1f23aa3ef8" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:18.956817 20566 leader_election.cc:341] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:18.957965 21108 leader_election.cc:288] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:18.957791 20968 tablet_service.cc:1467] Processing CreateTablet for tablet 200fb82ae5174fb184b44b3ea6f39a59 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260812 19:26:18.958673 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27156bde17147a6af9ddb1f23aa3ef8" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:18.959342 20968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 200fb82ae5174fb184b44b3ea6f39a59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.959412 20745 raft_consensus.cc:2454] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:18.962126 20570 leader_election.cc:302] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:18.963364 21108 raft_consensus.cc:2781] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:18.963740 21108 raft_consensus.cc:482] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:18.964058 21108 raft_consensus.cc:3037] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:18.967226 20722 tablet_service.cc:1467] Processing CreateTablet for tablet b2e5c58cd31f4eb8bd9092458140299a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260812 19:26:18.968459 20722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2e5c58cd31f4eb8bd9092458140299a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.971244 20960 tablet_service.cc:1467] Processing CreateTablet for tablet e2a274b81b0d4079852b8b1ea7c7592a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260812 19:26:18.971626 21108 raft_consensus.cc:504] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:18.972693 20960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2a274b81b0d4079852b8b1ea7c7592a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:18.974702 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27156bde17147a6af9ddb1f23aa3ef8" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:18.975373 20745 raft_consensus.cc:3037] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:18.976951 21058 tablet_bootstrap.cc:492] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:18.977576 21058 ts_tablet_manager.cc:1397] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.239s	user 0.019s	sys 0.025s
I20260812 19:26:18.980831 21058 raft_consensus.cc:348] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:18.983809 20745 raft_consensus.cc:2454] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:18.984011 21060 tablet_bootstrap.cc:654] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:18.985702 21108 leader_election.cc:288] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:18.985958 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27156bde17147a6af9ddb1f23aa3ef8" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:19.021728 20570 leader_election.cc:302] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:18.996137 21055 tablet_bootstrap.cc:654] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:19.023329 20566 leader_election.cc:341] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:18.997892 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b35dda8c9ec45d783785ed1ebb70243" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:19.025924 20637 raft_consensus.cc:2454] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:18.996546 20603 tablet_service.cc:1467] Processing CreateTablet for tablet fa08d4efbda64360a2f987aab456fb04 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260812 19:26:19.010596 20839 tablet_service.cc:1467] Processing CreateTablet for tablet fa08d4efbda64360a2f987aab456fb04 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260812 19:26:19.027712 20603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa08d4efbda64360a2f987aab456fb04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.027947 20839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa08d4efbda64360a2f987aab456fb04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.028719 20812 leader_election.cc:302] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: efc1471911ec442396b400eed9d18036
I20260812 19:26:19.029688 21080 raft_consensus.cc:2781] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:19.030052 21080 raft_consensus.cc:482] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:19.030386 21080 raft_consensus.cc:3037] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:19.031204 20716 tablet_service.cc:1467] Processing CreateTablet for tablet 85e5e41bf96447d7a761378c54e8abff (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260812 19:26:19.032620 20716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85e5e41bf96447d7a761378c54e8abff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.034847 21108 raft_consensus.cc:2781] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:19.035392 21108 raft_consensus.cc:686] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:18.988015 21061 tablet_bootstrap.cc:492] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:19.036253 21061 ts_tablet_manager.cc:1397] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.427s	user 0.029s	sys 0.024s
I20260812 19:26:19.035290 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27156bde17147a6af9ddb1f23aa3ef8" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:19.015745 21058 raft_consensus.cc:374] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:19.043900 20965 tablet_service.cc:1467] Processing CreateTablet for tablet 85e5e41bf96447d7a761378c54e8abff (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260812 19:26:19.036417 21108 consensus_queue.cc:237] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:19.041553 21058 raft_consensus.cc:729] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:19.053268 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65767121d73547f7b17d3a05b6de8a6c" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:19.053777 21058 consensus_queue.cc:260] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
W20260812 19:26:19.058457 20922 leader_election.cc:341] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:19.058738 20965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85e5e41bf96447d7a761378c54e8abff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.059106 20691 leader_election.cc:302] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:19.060905 20968 tablet_service.cc:1467] Processing CreateTablet for tablet f906c95927b14410a6818ea15e9e089f (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260812 19:26:19.056171 21061 raft_consensus.cc:348] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:19.062284 20968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f906c95927b14410a6818ea15e9e089f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.063953 21058 ts_tablet_manager.cc:1428] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.001s
I20260812 19:26:19.064769 21066 raft_consensus.cc:2726] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:19.065469 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65767121d73547f7b17d3a05b6de8a6c" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:19.066754 21080 raft_consensus.cc:504] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
W20260812 19:26:19.067400 20918 leader_election.cc:341] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:19.067917 20918 leader_election.cc:302] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:19.069264 21093 raft_consensus.cc:2726] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:19.069770 21080 leader_election.cc:288] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:19.070232 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b35dda8c9ec45d783785ed1ebb70243" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:19.070880 20637 raft_consensus.cc:3037] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:19.071051 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b35dda8c9ec45d783785ed1ebb70243" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
W20260812 19:26:19.072592 20815 leader_election.cc:341] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:19.065488 20722 tablet_service.cc:1467] Processing CreateTablet for tablet fa08d4efbda64360a2f987aab456fb04 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260812 19:26:19.076571 20722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa08d4efbda64360a2f987aab456fb04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.062297 21061 raft_consensus.cc:374] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:19.080004 21061 raft_consensus.cc:729] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:19.080801 21061 consensus_queue.cc:260] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:19.083791 20637 raft_consensus.cc:2454] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:19.085014 20812 leader_election.cc:302] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: efc1471911ec442396b400eed9d18036
I20260812 19:26:19.087493 21058 tablet_bootstrap.cc:492] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:19.093566 21058 tablet_bootstrap.cc:654] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:19.104663 20842 tablet_service.cc:1467] Processing CreateTablet for tablet f906c95927b14410a6818ea15e9e089f (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260812 19:26:19.102020 21080 raft_consensus.cc:2781] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:19.099375 21061 ts_tablet_manager.cc:1428] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.003s
I20260812 19:26:19.107504 20842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f906c95927b14410a6818ea15e9e089f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.110080 21055 tablet_bootstrap.cc:492] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:19.113071 20603 tablet_service.cc:1467] Processing CreateTablet for tablet f906c95927b14410a6818ea15e9e089f (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260812 19:26:19.115584 21080 raft_consensus.cc:686] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:19.097208 20600 tablet_service.cc:1467] Processing CreateTablet for tablet 85e5e41bf96447d7a761378c54e8abff (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260812 19:26:19.117522 21055 ts_tablet_manager.cc:1397] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.283s	user 0.012s	sys 0.005s
I20260812 19:26:19.120695 21060 tablet_bootstrap.cc:492] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:19.122308 21060 ts_tablet_manager.cc:1397] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.291s	user 0.015s	sys 0.009s
I20260812 19:26:19.124460 21055 raft_consensus.cc:348] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:19.125252 21055 raft_consensus.cc:374] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:19.125540 21055 raft_consensus.cc:729] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:19.130749 21055 consensus_queue.cc:260] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:19.131338 20603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f906c95927b14410a6818ea15e9e089f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:19.138928 20812 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 54011.4us
I20260812 19:26:19.140177 20716 tablet_service.cc:1467] Processing CreateTablet for tablet 13bf498c0abe436988718e4c55535f09 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260812 19:26:19.140103 20960 tablet_service.cc:1467] Processing CreateTablet for tablet 13bf498c0abe436988718e4c55535f09 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260812 19:26:19.141736 20960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13bf498c0abe436988718e4c55535f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.141130 20719 tablet_service.cc:1467] Processing CreateTablet for tablet d6510fddf1024d71b387e8dfa568e96c (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260812 19:26:19.141265 21080 consensus_queue.cc:237] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:19.142985 20719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6510fddf1024d71b387e8dfa568e96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.126235 21060 raft_consensus.cc:348] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:19.155833 20965 tablet_service.cc:1467] Processing CreateTablet for tablet f54f896522e94977a1cee9bd74ce2303 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260812 19:26:19.156549 21061 tablet_bootstrap.cc:492] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:19.156706 20839 tablet_service.cc:1467] Processing CreateTablet for tablet d6510fddf1024d71b387e8dfa568e96c (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260812 19:26:19.157265 20965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f54f896522e94977a1cee9bd74ce2303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.158087 20839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6510fddf1024d71b387e8dfa568e96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.159586 20607 tablet_service.cc:1467] Processing CreateTablet for tablet d6510fddf1024d71b387e8dfa568e96c (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260812 19:26:19.162395 20721 tablet_service.cc:1467] Processing CreateTablet for tablet f54f896522e94977a1cee9bd74ce2303 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260812 19:26:19.164126 20721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f54f896522e94977a1cee9bd74ce2303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.148581 21060 raft_consensus.cc:374] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:19.167554 20600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85e5e41bf96447d7a761378c54e8abff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.170230 21060 raft_consensus.cc:729] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:19.168759 20846 tablet_service.cc:1467] Processing CreateTablet for tablet 13bf498c0abe436988718e4c55535f09 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260812 19:26:19.171171 21060 consensus_queue.cc:260] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:19.171901 20846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13bf498c0abe436988718e4c55535f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.173564 20963 tablet_service.cc:1467] Processing CreateTablet for tablet db43a23e01bd4d3abc5d92db87b6e98b (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260812 19:26:19.174873 20963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db43a23e01bd4d3abc5d92db87b6e98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.169615 20716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13bf498c0abe436988718e4c55535f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.170948 20607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6510fddf1024d71b387e8dfa568e96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.175468 21055 ts_tablet_manager.cc:1428] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260812 19:26:19.176712 21055 tablet_bootstrap.cc:492] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:19.169801 21058 tablet_bootstrap.cc:492] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:19.173931 21060 ts_tablet_manager.cc:1428] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260812 19:26:19.190303 20608 tablet_service.cc:1467] Processing CreateTablet for tablet f54f896522e94977a1cee9bd74ce2303 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260812 19:26:19.191830 20608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f54f896522e94977a1cee9bd74ce2303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.190598 20847 tablet_service.cc:1467] Processing CreateTablet for tablet db43a23e01bd4d3abc5d92db87b6e98b (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260812 19:26:19.194284 21055 tablet_bootstrap.cc:654] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:19.194912 20847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db43a23e01bd4d3abc5d92db87b6e98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.197129 21066 raft_consensus.cc:482] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:19.197657 21066 raft_consensus.cc:504] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:19.198786 21058 ts_tablet_manager.cc:1397] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.112s	user 0.020s	sys 0.007s
I20260812 19:26:19.199785 21066 leader_election.cc:288] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:19.203945 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8a1b5f4e9425691ed304509f9d8a9" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:19.207068 20618 tablet_service.cc:1467] Processing CreateTablet for tablet db43a23e01bd4d3abc5d92db87b6e98b (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260812 19:26:19.207526 20637 raft_consensus.cc:2454] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:19.207830 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8a1b5f4e9425691ed304509f9d8a9" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:19.193051 20454 catalog_manager.cc:5495] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:19.209084 20691 leader_election.cc:302] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:19.209708 21061 tablet_bootstrap.cc:654] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:19.210472 20688 leader_election.cc:341] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:19.202844 20453 catalog_manager.cc:5495] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:19.208521 20618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db43a23e01bd4d3abc5d92db87b6e98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.215193 21066 raft_consensus.cc:2781] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:19.215847 21066 raft_consensus.cc:482] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:19.216352 21066 raft_consensus.cc:3037] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:19.221853 21093 raft_consensus.cc:482] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:19.222512 21093 raft_consensus.cc:504] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:19.236756 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:19.237411 20722 tablet_service.cc:1467] Processing CreateTablet for tablet b8bf3b3e0e4c425e9d86c3e5b7a062cf (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260812 19:26:19.238456 20918 leader_election.cc:341] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:19.238902 20722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8bf3b3e0e4c425e9d86c3e5b7a062cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.242761 21093 leader_election.cc:288] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:19.244913 20836 tablet_service.cc:1467] Processing CreateTablet for tablet b8bf3b3e0e4c425e9d86c3e5b7a062cf (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260812 19:26:19.246273 20836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8bf3b3e0e4c425e9d86c3e5b7a062cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.247045 21060 tablet_bootstrap.cc:492] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:19.247643 20605 tablet_service.cc:1467] Processing CreateTablet for tablet 3044cbc7bbaa46858021ce0b610da983 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260812 19:26:19.248973 20605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3044cbc7bbaa46858021ce0b610da983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.252633 20961 tablet_service.cc:1467] Processing CreateTablet for tablet b8bf3b3e0e4c425e9d86c3e5b7a062cf (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260812 19:26:19.253993 20961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8bf3b3e0e4c425e9d86c3e5b7a062cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.227856 21058 raft_consensus.cc:348] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:19.270565 20718 tablet_service.cc:1467] Processing CreateTablet for tablet 3044cbc7bbaa46858021ce0b610da983 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260812 19:26:19.272035 20718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3044cbc7bbaa46858021ce0b610da983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.277936 21066 raft_consensus.cc:504] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:19.263376 21058 raft_consensus.cc:374] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:19.291101 21060 tablet_bootstrap.cc:654] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:19.292575 20963 tablet_service.cc:1467] Processing CreateTablet for tablet e37466bb31e941bfaea862a42aafe4a2 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260812 19:26:19.295337 20963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e37466bb31e941bfaea862a42aafe4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.296756 20848 tablet_service.cc:1467] Processing CreateTablet for tablet 3044cbc7bbaa46858021ce0b610da983 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260812 19:26:19.298170 20848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3044cbc7bbaa46858021ce0b610da983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.283001 21058 raft_consensus.cc:729] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:19.299811 20613 tablet_service.cc:1467] Processing CreateTablet for tablet e37466bb31e941bfaea862a42aafe4a2 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260812 19:26:19.302906 20613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e37466bb31e941bfaea862a42aafe4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.315342 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8a1b5f4e9425691ed304509f9d8a9" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
W20260812 19:26:19.319082 20688 leader_election.cc:341] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:19.327759 21058 consensus_queue.cc:260] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:19.338361 20843 tablet_service.cc:1467] Processing CreateTablet for tablet 8caaf0d4e2ed4d039a3635696107687a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260812 19:26:19.339887 20843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8caaf0d4e2ed4d039a3635696107687a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.373195 21066 leader_election.cc:288] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:19.376000 20722 tablet_service.cc:1467] Processing CreateTablet for tablet e37466bb31e941bfaea862a42aafe4a2 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260812 19:26:19.377787 20722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e37466bb31e941bfaea862a42aafe4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.380620 21060 tablet_bootstrap.cc:492] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:19.381307 21060 ts_tablet_manager.cc:1397] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.134s	user 0.026s	sys 0.033s
I20260812 19:26:19.382001 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8a1b5f4e9425691ed304509f9d8a9" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:19.382714 20637 raft_consensus.cc:3037] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:19.386355 20600 tablet_service.cc:1467] Processing CreateTablet for tablet 8caaf0d4e2ed4d039a3635696107687a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260812 19:26:19.387686 21061 tablet_bootstrap.cc:492] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:19.387801 20600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8caaf0d4e2ed4d039a3635696107687a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.388329 21061 ts_tablet_manager.cc:1397] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.236s	user 0.008s	sys 0.014s
I20260812 19:26:19.390731 20637 raft_consensus.cc:2454] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:19.392177 20691 leader_election.cc:302] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:19.393257 21061 raft_consensus.cc:348] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:19.393816 21066 raft_consensus.cc:2781] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:19.408800 21061 raft_consensus.cc:374] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:19.417987 20839 tablet_service.cc:1467] Processing CreateTablet for tablet f6acd85742e946ddb5bb17831fc226fe (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260812 19:26:19.419157 21055 tablet_bootstrap.cc:492] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:19.419389 20839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6acd85742e946ddb5bb17831fc226fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.419773 21055 ts_tablet_manager.cc:1397] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.243s	user 0.025s	sys 0.013s
I20260812 19:26:19.424577 21060 raft_consensus.cc:348] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:19.425331 20963 tablet_service.cc:1467] Processing CreateTablet for tablet f6acd85742e946ddb5bb17831fc226fe (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260812 19:26:19.425740 21060 raft_consensus.cc:374] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:19.426718 20963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6acd85742e946ddb5bb17831fc226fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.427276 20968 tablet_service.cc:1467] Processing CreateTablet for tablet 8caaf0d4e2ed4d039a3635696107687a (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260812 19:26:19.427984 21058 ts_tablet_manager.cc:1428] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.229s	user 0.017s	sys 0.022s
I20260812 19:26:19.428598 20968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8caaf0d4e2ed4d039a3635696107687a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.413353 21066 raft_consensus.cc:686] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:19.448416 21058 tablet_bootstrap.cc:492] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:19.448195 21066 consensus_queue.cc:237] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:19.429083 21055 raft_consensus.cc:348] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:19.450240 20960 tablet_service.cc:1467] Processing CreateTablet for tablet a777b602ae6d4dac9f1ac116e0a2e86e (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260812 19:26:19.450872 21055 raft_consensus.cc:374] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:19.451233 21055 raft_consensus.cc:729] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:19.453311 20842 tablet_service.cc:1467] Processing CreateTablet for tablet 3408c35d6e414cb4bb2aa3b96a742313 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260812 19:26:19.454793 20842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3408c35d6e414cb4bb2aa3b96a742313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.457229 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:19.457129 20718 tablet_service.cc:1467] Processing CreateTablet for tablet f6acd85742e946ddb5bb17831fc226fe (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260812 19:26:19.458992 20918 leader_election.cc:341] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:19.459457 20918 leader_election.cc:302] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:19.460566 21093 raft_consensus.cc:2726] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:19.460515 21055 consensus_queue.cc:260] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:19.462124 20960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a777b602ae6d4dac9f1ac116e0a2e86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.463217 21055 ts_tablet_manager.cc:1428] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.001s
I20260812 19:26:19.464478 21055 tablet_bootstrap.cc:492] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:19.417059 21061 raft_consensus.cc:729] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:19.426498 21060 raft_consensus.cc:729] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:19.466719 21060 consensus_queue.cc:260] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:19.432336 20719 tablet_service.cc:1467] Processing CreateTablet for tablet 3408c35d6e414cb4bb2aa3b96a742313 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260812 19:26:19.469204 21060 ts_tablet_manager.cc:1428] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.088s	user 0.009s	sys 0.000s
I20260812 19:26:19.466715 21133 raft_consensus.cc:482] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:19.467442 21061 consensus_queue.cc:260] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:19.470196 21133 raft_consensus.cc:504] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:19.472606 21133 leader_election.cc:288] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:19.436127 20603 tablet_service.cc:1467] Processing CreateTablet for tablet 3408c35d6e414cb4bb2aa3b96a742313 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260812 19:26:19.474291 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5fc45bed8304c558e1aeb9f7ef05f2c" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:19.474738 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5fc45bed8304c558e1aeb9f7ef05f2c" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:19.475332 21060 tablet_bootstrap.cc:492] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
W20260812 19:26:19.481491 20691 leader_election.cc:341] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:19.481755 20858 raft_consensus.cc:3037] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:19.476588 21061 ts_tablet_manager.cc:1428] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.003s
I20260812 19:26:19.470896 20718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6acd85742e946ddb5bb17831fc226fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.479863 20637 raft_consensus.cc:2454] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:19.487759 20691 leader_election.cc:302] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:19.488512 20719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3408c35d6e414cb4bb2aa3b96a742313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.491837 21057 consensus_queue.cc:1035] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:19.494921 21061 tablet_bootstrap.cc:492] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:19.496857 21055 tablet_bootstrap.cc:654] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:19.501780 21060 tablet_bootstrap.cc:654] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:19.504987 21058 tablet_bootstrap.cc:654] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:19.509984 20603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3408c35d6e414cb4bb2aa3b96a742313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.513607 21061 tablet_bootstrap.cc:654] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:19.514810 21133 raft_consensus.cc:2781] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:19.515280 21133 raft_consensus.cc:482] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:19.515643 21133 raft_consensus.cc:3037] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:19.517408 20846 tablet_service.cc:1467] Processing CreateTablet for tablet 69ed708096ce463aba0483b0487227ba (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260812 19:26:19.519539 20846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69ed708096ce463aba0483b0487227ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.535646 20963 tablet_service.cc:1467] Processing CreateTablet for tablet 69ed708096ce463aba0483b0487227ba (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260812 19:26:19.537892 20963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69ed708096ce463aba0483b0487227ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.545034 20613 tablet_service.cc:1467] Processing CreateTablet for tablet 69ed708096ce463aba0483b0487227ba (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260812 19:26:19.546525 20613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69ed708096ce463aba0483b0487227ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.558629 20716 tablet_service.cc:1467] Processing CreateTablet for tablet 7bae9c177422418c8b9b4e0aa24fbce2 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260812 19:26:19.560348 20716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bae9c177422418c8b9b4e0aa24fbce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.560714 20722 tablet_service.cc:1467] Processing CreateTablet for tablet a777b602ae6d4dac9f1ac116e0a2e86e (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260812 19:26:19.562024 20722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a777b602ae6d4dac9f1ac116e0a2e86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.562944 21057 raft_consensus.cc:482] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:19.563453 21057 raft_consensus.cc:504] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:19.563898 20836 tablet_service.cc:1467] Processing CreateTablet for tablet 7bae9c177422418c8b9b4e0aa24fbce2 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260812 19:26:19.565421 20836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bae9c177422418c8b9b4e0aa24fbce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.563915 21133 raft_consensus.cc:504] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:19.565764 21057 leader_election.cc:288] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:19.567348 21133 leader_election.cc:288] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:19.567790 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb51472eb3314091aa30c515f1809f83" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:19.569589 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5fc45bed8304c558e1aeb9f7ef05f2c" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:19.570212 20637 raft_consensus.cc:3037] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:19.577078 20858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5fc45bed8304c558e1aeb9f7ef05f2c" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
W20260812 19:26:19.584067 20565 leader_election.cc:341] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:19.594717 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb51472eb3314091aa30c515f1809f83" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:19.595530 20856 raft_consensus.cc:2454] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
W20260812 19:26:19.597059 20691 leader_election.cc:341] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:19.600209 20605 tablet_service.cc:1467] Processing CreateTablet for tablet a777b602ae6d4dac9f1ac116e0a2e86e (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260812 19:26:19.600697 20566 leader_election.cc:302] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:19.602268 20605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a777b602ae6d4dac9f1ac116e0a2e86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.605415 21057 raft_consensus.cc:2781] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:19.605860 21057 raft_consensus.cc:482] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:19.606207 21057 raft_consensus.cc:3037] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:19.615780 20637 raft_consensus.cc:2454] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:19.625499 20691 leader_election.cc:302] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:19.626667 21133 raft_consensus.cc:2781] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:19.627174 21133 raft_consensus.cc:686] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:19.627406 21058 tablet_bootstrap.cc:492] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:19.627987 21058 ts_tablet_manager.cc:1397] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.180s	user 0.015s	sys 0.000s
I20260812 19:26:19.627972 21133 consensus_queue.cc:237] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:19.629738 20961 tablet_service.cc:1467] Processing CreateTablet for tablet 7bae9c177422418c8b9b4e0aa24fbce2 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260812 19:26:19.631147 20961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bae9c177422418c8b9b4e0aa24fbce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.631913 21058 raft_consensus.cc:348] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:19.632944 21058 raft_consensus.cc:374] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:19.633320 21058 raft_consensus.cc:729] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:19.634402 21058 consensus_queue.cc:260] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:19.628942 21108 consensus_queue.cc:1035] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260812 19:26:19.637765 21058 ts_tablet_manager.cc:1428] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260812 19:26:19.639247 21058 tablet_bootstrap.cc:492] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:19.648474 21058 tablet_bootstrap.cc:654] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:19.667102 21061 tablet_bootstrap.cc:492] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:19.667834 21061 ts_tablet_manager.cc:1397] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.181s	user 0.011s	sys 0.017s
I20260812 19:26:19.677685 21055 tablet_bootstrap.cc:492] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:19.678459 21055 ts_tablet_manager.cc:1397] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.214s	user 0.009s	sys 0.015s
I20260812 19:26:19.683264 20600 tablet_service.cc:1467] Processing CreateTablet for tablet a0e4b77eb0b847f69ab95f45c1c3ed1e (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260812 19:26:19.684755 20600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0e4b77eb0b847f69ab95f45c1c3ed1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.686004 20719 tablet_service.cc:1467] Processing CreateTablet for tablet a0e4b77eb0b847f69ab95f45c1c3ed1e (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260812 19:26:19.687536 20719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0e4b77eb0b847f69ab95f45c1c3ed1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.687716 20451 catalog_manager.cc:5495] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } }
W20260812 19:26:19.693259 20815 consensus_peers.cc:487] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:19.694063 21055 raft_consensus.cc:348] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:19.676450 21133 raft_consensus.cc:482] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:19.700071 21133 raft_consensus.cc:504] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:19.701545 21060 tablet_bootstrap.cc:492] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:19.705585 21060 ts_tablet_manager.cc:1397] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.230s	user 0.018s	sys 0.013s
I20260812 19:26:19.708630 21060 raft_consensus.cc:348] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:19.709427 21060 raft_consensus.cc:374] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:19.709817 21060 raft_consensus.cc:729] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:19.701701 20846 tablet_service.cc:1467] Processing CreateTablet for tablet a0e4b77eb0b847f69ab95f45c1c3ed1e (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260812 19:26:19.711443 20846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0e4b77eb0b847f69ab95f45c1c3ed1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.713119 20607 tablet_service.cc:1467] Processing CreateTablet for tablet e57439ca2e634277b5b83494eddd4acb (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260812 19:26:19.713436 20721 tablet_service.cc:1467] Processing CreateTablet for tablet e57439ca2e634277b5b83494eddd4acb (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260812 19:26:19.714470 20607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e57439ca2e634277b5b83494eddd4acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.714959 21060 consensus_queue.cc:260] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:19.716434 20965 tablet_service.cc:1467] Processing CreateTablet for tablet 273e3feb623f4b0d8b3078f4a6a49ac6 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260812 19:26:19.717494 21060 ts_tablet_manager.cc:1428] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260812 19:26:19.717803 21057 raft_consensus.cc:504] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:19.714859 20721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e57439ca2e634277b5b83494eddd4acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.687819 21061 raft_consensus.cc:348] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:19.717767 20965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 273e3feb623f4b0d8b3078f4a6a49ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.695989 21055 raft_consensus.cc:374] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:19.745850 21055 raft_consensus.cc:729] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:19.733562 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb51472eb3314091aa30c515f1809f83" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:19.736644 20842 tablet_service.cc:1467] Processing CreateTablet for tablet 273e3feb623f4b0d8b3078f4a6a49ac6 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260812 19:26:19.747713 20856 raft_consensus.cc:3037] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:19.748391 20842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 273e3feb623f4b0d8b3078f4a6a49ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.718618 21060 tablet_bootstrap.cc:492] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:19.727814 20960 tablet_service.cc:1467] Processing CreateTablet for tablet e57439ca2e634277b5b83494eddd4acb (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260812 19:26:19.752394 20960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e57439ca2e634277b5b83494eddd4acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.732515 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65767121d73547f7b17d3a05b6de8a6c" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:19.730384 21061 raft_consensus.cc:374] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260812 19:26:19.755079 20691 leader_election.cc:341] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:19.755137 21061 raft_consensus.cc:729] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:19.756335 21061 consensus_queue.cc:260] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:19.758503 21080 consensus_queue.cc:1035] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:19.733843 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65767121d73547f7b17d3a05b6de8a6c" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:19.761443 20986 raft_consensus.cc:2454] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:19.730432 21133 leader_election.cc:288] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:19.763130 21061 ts_tablet_manager.cc:1428] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.095s	user 0.010s	sys 0.000s
I20260812 19:26:19.768388 20688 leader_election.cc:302] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:19.768814 20451 catalog_manager.cc:5495] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:19.734412 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb51472eb3314091aa30c515f1809f83" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:19.771214 21055 consensus_queue.cc:260] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:19.733033 21057 leader_election.cc:288] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:19.772953 21058 tablet_bootstrap.cc:492] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:19.776641 21060 tablet_bootstrap.cc:654] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:19.784475 21136 raft_consensus.cc:2781] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:19.785046 21136 raft_consensus.cc:482] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:19.785219 20985 raft_consensus.cc:3037] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:19.785418 21136 raft_consensus.cc:3037] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:19.789548 20613 tablet_service.cc:1467] Processing CreateTablet for tablet 273e3feb623f4b0d8b3078f4a6a49ac6 (DEFAULT_TABLE table=test-workload [id=920073ff43cc4e65b74a1e100da3cabf]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260812 19:26:19.784551 21058 ts_tablet_manager.cc:1397] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.146s	user 0.016s	sys 0.026s
I20260812 19:26:19.790987 20613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 273e3feb623f4b0d8b3078f4a6a49ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:19.797204 21136 raft_consensus.cc:504] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
W20260812 19:26:19.801280 20530 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:26:19.815626 21080 raft_consensus.cc:482] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:19.816444 21080 raft_consensus.cc:504] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:19.839522 21061 tablet_bootstrap.cc:492] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
W20260812 19:26:19.837199 20570 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 57270.5us
I20260812 19:26:19.871390 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5fc45bed8304c558e1aeb9f7ef05f2c" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:19.871771 20985 raft_consensus.cc:2454] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:19.872431 20636 raft_consensus.cc:2379] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c9e33eee61649e18fe397e56bdddea3 in current term 1: Already voted for candidate efc1471911ec442396b400eed9d18036 in this term.
I20260812 19:26:19.873204 20565 leader_election.cc:302] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:19.874902 21108 raft_consensus.cc:2781] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:19.875597 21108 raft_consensus.cc:686] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:19.875830 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5fc45bed8304c558e1aeb9f7ef05f2c" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:19.876652 21108 consensus_queue.cc:237] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:19.877595 20815 leader_election.cc:302] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:19.885942 21093 raft_consensus.cc:482] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:19.886579 21093 raft_consensus.cc:504] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:19.886718 21058 raft_consensus.cc:348] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:19.887851 21058 raft_consensus.cc:374] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:19.871428 21055 ts_tablet_manager.cc:1428] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.193s	user 0.003s	sys 0.008s
I20260812 19:26:19.868258 20856 raft_consensus.cc:2454] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:19.875643 21080 leader_election.cc:288] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:19.926360 21080 raft_consensus.cc:3037] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:19.928186 21093 leader_election.cc:288] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:19.929006 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8a1b5f4e9425691ed304509f9d8a9" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:19.931106 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8a1b5f4e9425691ed304509f9d8a9" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:19.933564 20637 raft_consensus.cc:2379] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d5ab425bcd82426387b1a5b02e55b64c in current term 1: Already voted for candidate efc1471911ec442396b400eed9d18036 in this term.
I20260812 19:26:19.934273 21061 tablet_bootstrap.cc:654] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:19.888271 21058 raft_consensus.cc:729] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:19.935684 21136 leader_election.cc:288] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:19.937687 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65767121d73547f7b17d3a05b6de8a6c" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:19.935873 20918 leader_election.cc:302] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:19.940156 20985 raft_consensus.cc:3037] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:19.944201 21055 tablet_bootstrap.cc:492] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
W20260812 19:26:19.937623 20812 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 56898.8us
I20260812 19:26:19.948006 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65767121d73547f7b17d3a05b6de8a6c" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:19.949236 21093 raft_consensus.cc:3037] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:19.950304 20691 leader_election.cc:341] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:19.939476 20815 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 61979.6us
I20260812 19:26:19.937139 21080 raft_consensus.cc:2726] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:19.961988 20985 raft_consensus.cc:2454] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:19.965476 20688 leader_election.cc:302] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:19.967408 21066 raft_consensus.cc:2781] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:19.972054 21093 raft_consensus.cc:2726] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:19.972929 21055 tablet_bootstrap.cc:654] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:19.957813 21136 consensus_queue.cc:1035] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260812 19:26:19.956084 21058 consensus_queue.cc:260] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:19.983701 21133 raft_consensus.cc:482] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:19.984354 21061 tablet_bootstrap.cc:492] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:19.984396 21133 raft_consensus.cc:504] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:19.985136 21061 ts_tablet_manager.cc:1397] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.146s	user 0.010s	sys 0.011s
I20260812 19:26:19.991458 20453 catalog_manager.cc:5495] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:19.998973 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ede4dcd9659d422184a3873426f9e6c4" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:20.002243 20691 leader_election.cc:341] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:19.997017 21066 raft_consensus.cc:686] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:20.005173 21133 leader_election.cc:288] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:20.007133 21066 consensus_queue.cc:237] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.007709 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ede4dcd9659d422184a3873426f9e6c4" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:20.015609 21133 consensus_queue.cc:1035] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:26:20.019563 20688 leader_election.cc:341] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.020565 20688 leader_election.cc:302] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:20.020977 21058 ts_tablet_manager.cc:1428] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.230s	user 0.014s	sys 0.011s
I20260812 19:26:20.022253 21133 raft_consensus.cc:2726] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:20.022300 21058 tablet_bootstrap.cc:492] T 2a2c90e3f1d4440da993ec52cd2658f2 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:20.022811 21055 tablet_bootstrap.cc:492] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:20.023494 21055 ts_tablet_manager.cc:1397] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.079s	user 0.022s	sys 0.006s
I20260812 19:26:20.030793 21060 tablet_bootstrap.cc:492] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:20.031375 21060 ts_tablet_manager.cc:1397] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.313s	user 0.018s	sys 0.006s
I20260812 19:26:20.033828 21055 raft_consensus.cc:348] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.034996 21055 raft_consensus.cc:374] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.034559 21060 raft_consensus.cc:348] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.035396 21055 raft_consensus.cc:729] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.035641 21060 raft_consensus.cc:374] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.036103 21060 raft_consensus.cc:729] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.036497 21055 consensus_queue.cc:260] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.037076 21060 consensus_queue.cc:260] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.038753 21061 raft_consensus.cc:348] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.039891 21061 raft_consensus.cc:374] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.040115 21060 ts_tablet_manager.cc:1428] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260812 19:26:20.044479 21055 ts_tablet_manager.cc:1428] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260812 19:26:20.040306 21061 raft_consensus.cc:729] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.046588 21108 raft_consensus.cc:482] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:20.047231 21108 raft_consensus.cc:504] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.046638 21060 tablet_bootstrap.cc:492] T 2a2c90e3f1d4440da993ec52cd2658f2 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:20.050875 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "614ccc1f6aa847f5b874c88bb9e2587a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:20.053560 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "614ccc1f6aa847f5b874c88bb9e2587a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:20.047364 21061 consensus_queue.cc:260] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.054081 21058 tablet_bootstrap.cc:654] T 2a2c90e3f1d4440da993ec52cd2658f2 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:20.053589 20565 leader_election.cc:341] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.055151 20453 catalog_manager.cc:5495] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } }
W20260812 19:26:20.056193 20570 leader_election.cc:341] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.056757 20570 leader_election.cc:302] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
I20260812 19:26:20.057922 21057 raft_consensus.cc:2726] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:20.060874 21066 consensus_queue.cc:1035] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:20.066016 21060 tablet_bootstrap.cc:654] T 2a2c90e3f1d4440da993ec52cd2658f2 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.057740 21108 leader_election.cc:288] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:20.066991 21055 tablet_bootstrap.cc:492] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:20.083941 21058 tablet_bootstrap.cc:492] T 2a2c90e3f1d4440da993ec52cd2658f2 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:20.085251 21058 ts_tablet_manager.cc:1397] T 2a2c90e3f1d4440da993ec52cd2658f2 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.010s
I20260812 19:26:20.082381 21061 ts_tablet_manager.cc:1428] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.092s	user 0.000s	sys 0.009s
I20260812 19:26:20.088409 21061 tablet_bootstrap.cc:492] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:20.089399 21060 tablet_bootstrap.cc:492] T 2a2c90e3f1d4440da993ec52cd2658f2 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:20.089949 21060 ts_tablet_manager.cc:1397] T 2a2c90e3f1d4440da993ec52cd2658f2 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.000s
I20260812 19:26:20.092069 21066 consensus_queue.cc:1035] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:20.094103 21060 raft_consensus.cc:348] T 2a2c90e3f1d4440da993ec52cd2658f2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.101207 21060 raft_consensus.cc:374] T 2a2c90e3f1d4440da993ec52cd2658f2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.101539 21060 raft_consensus.cc:729] T 2a2c90e3f1d4440da993ec52cd2658f2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.103497 21055 tablet_bootstrap.cc:654] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.105449 21060 consensus_queue.cc:260] T 2a2c90e3f1d4440da993ec52cd2658f2 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.108659 21060 ts_tablet_manager.cc:1428] T 2a2c90e3f1d4440da993ec52cd2658f2 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260812 19:26:20.108937 21061 tablet_bootstrap.cc:654] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.109895 21060 tablet_bootstrap.cc:492] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:20.113198 21058 raft_consensus.cc:348] T 2a2c90e3f1d4440da993ec52cd2658f2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.133795 21058 raft_consensus.cc:374] T 2a2c90e3f1d4440da993ec52cd2658f2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.134111 21058 raft_consensus.cc:729] T 2a2c90e3f1d4440da993ec52cd2658f2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.135037 21058 consensus_queue.cc:260] T 2a2c90e3f1d4440da993ec52cd2658f2 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.137843 21058 ts_tablet_manager.cc:1428] T 2a2c90e3f1d4440da993ec52cd2658f2 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.001s
I20260812 19:26:20.139122 21058 tablet_bootstrap.cc:492] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:20.146302 21058 tablet_bootstrap.cc:654] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.154098 21058 tablet_bootstrap.cc:492] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:20.154709 21058 ts_tablet_manager.cc:1397] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.008s
I20260812 19:26:20.156212 21060 tablet_bootstrap.cc:654] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.157513 21058 raft_consensus.cc:348] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.158322 21058 raft_consensus.cc:374] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.158593 21058 raft_consensus.cc:729] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.159466 21058 consensus_queue.cc:260] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.161597 21058 ts_tablet_manager.cc:1428] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260812 19:26:20.163128 21061 tablet_bootstrap.cc:492] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:20.163817 21061 ts_tablet_manager.cc:1397] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.005s
I20260812 19:26:20.165096 21058 tablet_bootstrap.cc:492] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:20.168051 21061 raft_consensus.cc:348] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.169114 21061 raft_consensus.cc:374] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.169489 21061 raft_consensus.cc:729] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.170517 21061 consensus_queue.cc:260] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.172183 21058 tablet_bootstrap.cc:654] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.175148 21055 tablet_bootstrap.cc:492] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:20.175719 21055 ts_tablet_manager.cc:1397] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.109s	user 0.018s	sys 0.012s
I20260812 19:26:20.177390 21183 raft_consensus.cc:482] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:20.178118 21183 raft_consensus.cc:504] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.187886 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a2c90e3f1d4440da993ec52cd2658f2" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:20.188850 20745 raft_consensus.cc:2454] T 2a2c90e3f1d4440da993ec52cd2658f2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:20.191699 20815 leader_election.cc:302] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:20.192847 21080 raft_consensus.cc:2781] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:20.193226 21080 raft_consensus.cc:482] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:20.193619 21080 raft_consensus.cc:3037] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.193334 21055 raft_consensus.cc:348] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.194468 21055 raft_consensus.cc:374] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.194882 21055 raft_consensus.cc:729] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.195082 21183 leader_election.cc:288] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:20.195809 21055 consensus_queue.cc:260] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.198828 21060 tablet_bootstrap.cc:492] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:20.199286 21055 ts_tablet_manager.cc:1428] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
I20260812 19:26:20.200824 21061 ts_tablet_manager.cc:1428] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260812 19:26:20.202006 21060 ts_tablet_manager.cc:1397] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.092s	user 0.020s	sys 0.023s
I20260812 19:26:20.203230 21055 tablet_bootstrap.cc:492] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:20.204077 21061 tablet_bootstrap.cc:492] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:20.204101 21058 tablet_bootstrap.cc:492] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:20.205862 21060 raft_consensus.cc:348] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.207046 21060 raft_consensus.cc:374] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.207454 21060 raft_consensus.cc:729] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.206748 21058 ts_tablet_manager.cc:1397] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.018s
I20260812 19:26:20.208477 21060 consensus_queue.cc:260] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.210479 21108 raft_consensus.cc:482] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:20.211238 21060 ts_tablet_manager.cc:1428] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
I20260812 19:26:20.211053 21108 raft_consensus.cc:504] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.213464 21108 leader_election.cc:288] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:20.214285 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0454a10a87ed4fd7a5ef01021940c016" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:20.218513 21093 raft_consensus.cc:482] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:20.211045 21058 raft_consensus.cc:348] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.223845 21058 raft_consensus.cc:374] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.224206 21058 raft_consensus.cc:729] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.223727 21093 raft_consensus.cc:504] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.224278 21080 raft_consensus.cc:504] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.224989 21058 consensus_queue.cc:260] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.223362 21055 tablet_bootstrap.cc:654] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.217298 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0454a10a87ed4fd7a5ef01021940c016" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
W20260812 19:26:20.228179 20565 leader_election.cc:341] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.228489 21080 leader_election.cc:288] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:20.231488 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "614ccc1f6aa847f5b874c88bb9e2587a" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:20.232376 20636 raft_consensus.cc:2454] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:20.233857 20918 leader_election.cc:302] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:20.234800 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a2c90e3f1d4440da993ec52cd2658f2" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:20.235807 20745 raft_consensus.cc:3037] T 2a2c90e3f1d4440da993ec52cd2658f2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.238792 21093 leader_election.cc:288] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:20.239377 21093 raft_consensus.cc:2781] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:20.239234 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "614ccc1f6aa847f5b874c88bb9e2587a" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:20.239727 21093 raft_consensus.cc:482] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:20.240085 21093 raft_consensus.cc:3037] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.239984 20742 raft_consensus.cc:2454] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:20.242173 21058 ts_tablet_manager.cc:1428] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260812 19:26:20.244165 21060 tablet_bootstrap.cc:492] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:20.215037 20856 raft_consensus.cc:2454] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:20.216964 21061 tablet_bootstrap.cc:654] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.247820 20566 leader_election.cc:302] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:20.249207 21108 raft_consensus.cc:2781] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:20.249717 21108 raft_consensus.cc:482] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:20.250174 21108 raft_consensus.cc:3037] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.256882 21058 tablet_bootstrap.cc:492] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:20.268471 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a2c90e3f1d4440da993ec52cd2658f2" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:20.269037 21058 tablet_bootstrap.cc:654] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.269335 20985 raft_consensus.cc:2454] T 2a2c90e3f1d4440da993ec52cd2658f2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:20.270866 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a2c90e3f1d4440da993ec52cd2658f2" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:20.271464 20985 raft_consensus.cc:3037] T 2a2c90e3f1d4440da993ec52cd2658f2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.272750 20745 raft_consensus.cc:2454] T 2a2c90e3f1d4440da993ec52cd2658f2 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:20.275081 20815 leader_election.cc:302] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:20.275689 21108 raft_consensus.cc:504] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.276135 21080 raft_consensus.cc:2781] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:20.276823 21080 raft_consensus.cc:686] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:20.277738 21080 consensus_queue.cc:237] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.278640 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0454a10a87ed4fd7a5ef01021940c016" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:20.279181 21108 leader_election.cc:288] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:20.279482 20856 raft_consensus.cc:3037] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.280478 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0454a10a87ed4fd7a5ef01021940c016" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
W20260812 19:26:20.282001 20565 leader_election.cc:341] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.283304 21060 tablet_bootstrap.cc:654] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.286366 21061 tablet_bootstrap.cc:492] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:20.287163 21061 ts_tablet_manager.cc:1397] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.083s	user 0.006s	sys 0.008s
I20260812 19:26:20.268513 21055 tablet_bootstrap.cc:492] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:20.289180 21055 ts_tablet_manager.cc:1397] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.086s	user 0.028s	sys 0.018s
I20260812 19:26:20.266513 21093 raft_consensus.cc:504] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.291759 21055 raft_consensus.cc:348] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.292471 21055 raft_consensus.cc:374] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.292836 20856 raft_consensus.cc:2454] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:20.293258 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "614ccc1f6aa847f5b874c88bb9e2587a" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:20.295034 20636 raft_consensus.cc:3037] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.295648 21058 tablet_bootstrap.cc:492] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:20.296159 21058 ts_tablet_manager.cc:1397] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.003s
I20260812 19:26:20.297550 21061 raft_consensus.cc:348] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.298321 21061 raft_consensus.cc:374] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.298599 21061 raft_consensus.cc:729] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.298892 21058 raft_consensus.cc:348] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.299654 21058 raft_consensus.cc:374] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.299377 21061 consensus_queue.cc:260] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.294030 21066 raft_consensus.cc:482] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:20.300549 21066 raft_consensus.cc:504] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.301991 21061 ts_tablet_manager.cc:1428] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.004s
I20260812 19:26:20.303197 21093 leader_election.cc:288] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:20.304556 20636 raft_consensus.cc:2454] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:20.292750 21055 raft_consensus.cc:729] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.304821 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "614ccc1f6aa847f5b874c88bb9e2587a" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:20.308516 20745 raft_consensus.cc:3037] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.308697 21055 consensus_queue.cc:260] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.310416 21055 ts_tablet_manager.cc:1428] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260812 19:26:20.305401 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c0067c6bd74e33b1ebe3785dabf7d1" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:20.305931 20566 leader_election.cc:302] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:20.306740 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c0067c6bd74e33b1ebe3785dabf7d1" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:20.311960 20691 leader_election.cc:341] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.313166 20918 leader_election.cc:302] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:20.302753 21066 leader_election.cc:288] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:20.315239 21108 raft_consensus.cc:2781] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:20.315922 21108 raft_consensus.cc:686] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:20.317068 21108 consensus_queue.cc:237] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
W20260812 19:26:20.317865 20691 leader_election.cc:341] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.307287 21061 tablet_bootstrap.cc:492] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:20.299957 21058 raft_consensus.cc:729] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.306587 20453 catalog_manager.cc:5495] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:20.321847 21058 consensus_queue.cc:260] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.325495 21061 tablet_bootstrap.cc:654] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.326864 21058 ts_tablet_manager.cc:1428] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.003s
I20260812 19:26:20.327642 20745 raft_consensus.cc:2454] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:20.320678 21093 raft_consensus.cc:2781] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:20.328436 21093 raft_consensus.cc:686] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:20.329907 21093 consensus_queue.cc:237] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.307644 20985 raft_consensus.cc:2454] T 2a2c90e3f1d4440da993ec52cd2658f2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:20.318369 20691 leader_election.cc:302] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:20.334069 21066 raft_consensus.cc:2726] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:20.313616 21055 tablet_bootstrap.cc:492] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:20.339148 21058 tablet_bootstrap.cc:492] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:20.342581 20456 catalog_manager.cc:5495] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:20.349578 21060 tablet_bootstrap.cc:492] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:20.350319 21060 ts_tablet_manager.cc:1397] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.132s	user 0.022s	sys 0.013s
I20260812 19:26:20.354357 21060 raft_consensus.cc:348] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.355365 21060 raft_consensus.cc:374] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.355697 21060 raft_consensus.cc:729] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.357789 21057 raft_consensus.cc:482] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:20.358490 21057 raft_consensus.cc:504] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.361532 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:20.362013 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:20.362620 21066 raft_consensus.cc:482] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:20.362793 20985 raft_consensus.cc:2454] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:20.363344 21066 raft_consensus.cc:504] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.365064 20565 leader_election.cc:302] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:20.365489 21066 leader_election.cc:288] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:20.366205 21175 raft_consensus.cc:2781] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:20.366631 21175 raft_consensus.cc:482] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:20.367014 21175 raft_consensus.cc:3037] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.367770 21058 tablet_bootstrap.cc:654] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.367995 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b35dda8c9ec45d783785ed1ebb70243" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
W20260812 19:26:20.370434 20566 leader_election.cc:341] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.371452 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b35dda8c9ec45d783785ed1ebb70243" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:20.373209 20691 leader_election.cc:302] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:20.370836 21057 leader_election.cc:288] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:20.375092 21055 tablet_bootstrap.cc:654] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.382364 21061 tablet_bootstrap.cc:492] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:20.383061 21061 ts_tablet_manager.cc:1397] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.076s	user 0.018s	sys 0.016s
I20260812 19:26:20.356658 21060 consensus_queue.cc:260] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.384506 21066 raft_consensus.cc:2726] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:20.384613 21175 raft_consensus.cc:504] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.386557 21061 raft_consensus.cc:348] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.387562 21061 raft_consensus.cc:374] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.387897 21061 raft_consensus.cc:729] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.388752 21061 consensus_queue.cc:260] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.392309 21060 ts_tablet_manager.cc:1428] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260812 19:26:20.393491 21060 tablet_bootstrap.cc:492] T adf3a538c4d74dd0a1704de4cf4d3624 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:20.397374 21061 ts_tablet_manager.cc:1428] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260812 19:26:20.398484 21061 tablet_bootstrap.cc:492] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:20.401616 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:20.402307 20985 raft_consensus.cc:3037] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.401964 20456 catalog_manager.cc:5495] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:20.407173 21061 tablet_bootstrap.cc:654] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.409782 21058 tablet_bootstrap.cc:492] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:20.410282 21058 ts_tablet_manager.cc:1397] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.004s
I20260812 19:26:20.400765 21175 leader_election.cc:288] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:20.400785 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:20.411204 20861 raft_consensus.cc:3037] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.413357 21058 raft_consensus.cc:348] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.414083 21058 raft_consensus.cc:374] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.414356 21058 raft_consensus.cc:729] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.415041 21058 consensus_queue.cc:260] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.417522 21058 ts_tablet_manager.cc:1428] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260812 19:26:20.418606 21058 tablet_bootstrap.cc:492] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:20.422564 20861 raft_consensus.cc:2454] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:20.423957 20566 leader_election.cc:302] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:20.424880 21175 raft_consensus.cc:2781] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:20.425376 21175 raft_consensus.cc:686] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:20.426249 21175 consensus_queue.cc:237] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.427922 21066 consensus_queue.cc:1035] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:20.431025 21058 tablet_bootstrap.cc:654] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.433095 21055 tablet_bootstrap.cc:492] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:20.433763 21055 ts_tablet_manager.cc:1397] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.008s
I20260812 19:26:20.437440 21108 raft_consensus.cc:482] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:20.437947 21108 raft_consensus.cc:504] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.399888 21060 tablet_bootstrap.cc:654] T adf3a538c4d74dd0a1704de4cf4d3624 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.440073 21108 leader_election.cc:288] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:20.410136 20985 raft_consensus.cc:2454] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:20.441809 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91aea69f88c43cb84d67ea8a6e8d8bf" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:20.444363 21055 raft_consensus.cc:348] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.445323 21055 raft_consensus.cc:374] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.445654 21055 raft_consensus.cc:729] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.449241 21055 consensus_queue.cc:260] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.451092 21058 tablet_bootstrap.cc:492] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:20.451594 21058 ts_tablet_manager.cc:1397] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.005s
I20260812 19:26:20.451774 21055 ts_tablet_manager.cc:1428] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260812 19:26:20.453962 21058 raft_consensus.cc:348] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.454502 21058 raft_consensus.cc:374] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.454775 21058 raft_consensus.cc:729] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
W20260812 19:26:20.457952 20566 leader_election.cc:341] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.457058 21058 consensus_queue.cc:260] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.460551 21058 ts_tablet_manager.cc:1428] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260812 19:26:20.460875 20456 catalog_manager.cc:5495] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:20.461755 21058 tablet_bootstrap.cc:492] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:20.462733 21066 raft_consensus.cc:482] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:20.463275 21066 raft_consensus.cc:504] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.456231 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91aea69f88c43cb84d67ea8a6e8d8bf" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:20.468362 20745 raft_consensus.cc:2454] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:20.469810 20570 leader_election.cc:302] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:20.470155 21058 tablet_bootstrap.cc:654] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.471364 21108 raft_consensus.cc:2781] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:20.471777 21108 raft_consensus.cc:482] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:20.472146 21108 raft_consensus.cc:3037] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.476078 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91aea69f88c43cb84d67ea8a6e8d8bf" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:20.478484 20691 leader_election.cc:341] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.481172 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91aea69f88c43cb84d67ea8a6e8d8bf" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:20.480871 21066 leader_election.cc:288] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:20.485859 21057 consensus_queue.cc:1035] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:20.488212 21055 tablet_bootstrap.cc:492] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:20.490269 21175 consensus_queue.cc:1035] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260812 19:26:20.496841 21093 raft_consensus.cc:482] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:20.497417 21093 raft_consensus.cc:504] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.499625 21093 leader_election.cc:288] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:20.503073 21060 tablet_bootstrap.cc:492] T adf3a538c4d74dd0a1704de4cf4d3624 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:20.503839 21060 ts_tablet_manager.cc:1397] T adf3a538c4d74dd0a1704de4cf4d3624 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.003s
I20260812 19:26:20.506129 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:20.506951 20745 raft_consensus.cc:2454] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:20.507963 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:20.514230 20636 raft_consensus.cc:3037] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.514446 20922 leader_election.cc:302] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:20.515848 21093 raft_consensus.cc:2781] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:20.516252 21093 raft_consensus.cc:482] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:20.516589 21093 raft_consensus.cc:3037] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:20.518003 20918 leader_election.cc:341] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.540851 21061 tablet_bootstrap.cc:492] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:20.541425 21061 ts_tablet_manager.cc:1397] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.143s	user 0.023s	sys 0.048s
I20260812 19:26:20.542881 21058 tablet_bootstrap.cc:492] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:20.543597 21058 ts_tablet_manager.cc:1397] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.082s	user 0.024s	sys 0.018s
I20260812 19:26:20.543664 20745 raft_consensus.cc:3037] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.546617 21093 raft_consensus.cc:504] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.539950 21108 raft_consensus.cc:504] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.547256 21058 raft_consensus.cc:348] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.550395 21058 raft_consensus.cc:374] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.550736 21061 raft_consensus.cc:348] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.551467 21061 raft_consensus.cc:374] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.551745 21061 raft_consensus.cc:729] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.552387 21061 consensus_queue.cc:260] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.550771 21058 raft_consensus.cc:729] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.554273 21058 consensus_queue.cc:260] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.554726 20635 raft_consensus.cc:2379] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc1471911ec442396b400eed9d18036 in current term 1: Already voted for candidate 171f67787a8348fb9c7b19bf09026039 in this term.
I20260812 19:26:20.558786 21058 ts_tablet_manager.cc:1428] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260812 19:26:20.559842 21058 tablet_bootstrap.cc:492] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:20.561681 20691 leader_election.cc:302] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:20.563527 21192 raft_consensus.cc:3037] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.567443 21058 tablet_bootstrap.cc:654] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.549631 21060 raft_consensus.cc:348] T adf3a538c4d74dd0a1704de4cf4d3624 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.557502 21061 ts_tablet_manager.cc:1428] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260812 19:26:20.570101 21061 tablet_bootstrap.cc:492] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:20.576782 21060 raft_consensus.cc:374] T adf3a538c4d74dd0a1704de4cf4d3624 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.577229 21060 raft_consensus.cc:729] T adf3a538c4d74dd0a1704de4cf4d3624 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.577083 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:20.578065 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
W20260812 19:26:20.578778 20918 leader_election.cc:341] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.578830 20742 raft_consensus.cc:3037] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.578306 21093 leader_election.cc:288] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:20.578053 21060 consensus_queue.cc:260] T adf3a538c4d74dd0a1704de4cf4d3624 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.583770 21055 tablet_bootstrap.cc:654] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.590196 21060 ts_tablet_manager.cc:1428] T adf3a538c4d74dd0a1704de4cf4d3624 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.003s
I20260812 19:26:20.591048 21066 consensus_queue.cc:1035] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:20.592599 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91aea69f88c43cb84d67ea8a6e8d8bf" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:20.593235 21108 leader_election.cc:288] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:20.592645 21060 tablet_bootstrap.cc:492] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:20.595647 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91aea69f88c43cb84d67ea8a6e8d8bf" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:20.596354 20742 raft_consensus.cc:2454] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
W20260812 19:26:20.597755 20566 leader_election.cc:341] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.598465 20922 leader_election.cc:302] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:20.599682 21093 raft_consensus.cc:2781] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:20.600412 21093 raft_consensus.cc:686] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:20.601349 21093 consensus_queue.cc:237] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.605775 21061 tablet_bootstrap.cc:654] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.606213 21218 raft_consensus.cc:482] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:20.609423 21218 raft_consensus.cc:504] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.606704 21192 raft_consensus.cc:2726] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:20.607239 21060 tablet_bootstrap.cc:654] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.612782 21218 leader_election.cc:288] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:20.613988 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ede4dcd9659d422184a3873426f9e6c4" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:20.614849 20856 raft_consensus.cc:2454] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:20.615991 21058 tablet_bootstrap.cc:492] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:20.616083 20918 leader_election.cc:302] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:20.616613 21058 ts_tablet_manager.cc:1397] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.005s
I20260812 19:26:20.617182 21218 raft_consensus.cc:2781] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:20.617739 21218 raft_consensus.cc:482] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:20.617877 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ede4dcd9659d422184a3873426f9e6c4" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:20.618211 21218 raft_consensus.cc:3037] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.622540 20742 raft_consensus.cc:2454] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:20.630031 20740 raft_consensus.cc:2454] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:20.645814 21058 raft_consensus.cc:348] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.646401 21058 raft_consensus.cc:374] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.646570 21058 raft_consensus.cc:729] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.647771 20570 leader_election.cc:302] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:20.648734 21218 raft_consensus.cc:504] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.657591 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ede4dcd9659d422184a3873426f9e6c4" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:20.658273 20740 raft_consensus.cc:3037] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.658890 21057 raft_consensus.cc:2781] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:20.649722 21055 tablet_bootstrap.cc:492] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:20.661772 21218 leader_election.cc:288] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:20.659672 21057 raft_consensus.cc:686] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:20.661787 21055 ts_tablet_manager.cc:1397] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.174s	user 0.012s	sys 0.010s
I20260812 19:26:20.661798 20456 catalog_manager.cc:5495] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:20.664940 21057 consensus_queue.cc:237] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.661047 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ede4dcd9659d422184a3873426f9e6c4" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:20.667327 20856 raft_consensus.cc:3037] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.671284 21058 consensus_queue.cc:260] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.672611 21055 raft_consensus.cc:348] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.673343 21055 raft_consensus.cc:374] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.673601 21055 raft_consensus.cc:729] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.651819 21061 tablet_bootstrap.cc:492] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:20.674481 21061 ts_tablet_manager.cc:1397] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.105s	user 0.017s	sys 0.001s
I20260812 19:26:20.678246 21058 ts_tablet_manager.cc:1428] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260812 19:26:20.678932 21055 consensus_queue.cc:260] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.683727 21061 raft_consensus.cc:348] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.684480 21061 raft_consensus.cc:374] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.684741 21061 raft_consensus.cc:729] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.685949 21058 tablet_bootstrap.cc:492] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:20.687789 21055 ts_tablet_manager.cc:1428] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260812 19:26:20.691551 21055 tablet_bootstrap.cc:492] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:20.693639 21060 tablet_bootstrap.cc:492] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:20.694196 21060 ts_tablet_manager.cc:1397] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.102s	user 0.025s	sys 0.027s
I20260812 19:26:20.692704 21061 consensus_queue.cc:260] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.697185 21058 tablet_bootstrap.cc:654] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.696887 21060 raft_consensus.cc:348] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.698091 21060 raft_consensus.cc:374] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.698400 21060 raft_consensus.cc:729] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.699110 21060 consensus_queue.cc:260] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.701244 21060 ts_tablet_manager.cc:1428] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260812 19:26:20.701157 20856 raft_consensus.cc:2454] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:20.702404 21060 tablet_bootstrap.cc:492] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:20.708914 21060 tablet_bootstrap.cc:654] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.711258 21254 raft_consensus.cc:482] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:20.711944 21254 raft_consensus.cc:504] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.714419 20740 raft_consensus.cc:2454] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:20.716054 20922 leader_election.cc:302] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:20.716634 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf3a538c4d74dd0a1704de4cf4d3624" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:20.717067 21218 raft_consensus.cc:2781] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:20.717449 20986 raft_consensus.cc:2454] T adf3a538c4d74dd0a1704de4cf4d3624 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:20.717645 21218 raft_consensus.cc:686] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:20.718746 21254 leader_election.cc:288] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:20.718600 21218 consensus_queue.cc:237] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.722689 20688 leader_election.cc:302] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:20.723188 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf3a538c4d74dd0a1704de4cf4d3624" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
W20260812 19:26:20.724711 20691 leader_election.cc:341] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.724849 21254 raft_consensus.cc:2781] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:20.725447 21254 raft_consensus.cc:482] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:20.729281 21254 raft_consensus.cc:3037] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.732894 21061 ts_tablet_manager.cc:1428] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260812 19:26:20.738957 21057 raft_consensus.cc:482] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:20.739569 21057 raft_consensus.cc:504] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.739996 20453 catalog_manager.cc:5495] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:20.744091 21057 leader_election.cc:288] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:20.744658 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6155c47e884e43498e968f83072b863a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:20.747434 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6155c47e884e43498e968f83072b863a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:20.750226 21254 raft_consensus.cc:504] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.752591 21254 leader_election.cc:288] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:20.753897 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf3a538c4d74dd0a1704de4cf4d3624" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:20.754475 20986 raft_consensus.cc:3037] T adf3a538c4d74dd0a1704de4cf4d3624 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:20.754959 20566 leader_election.cc:341] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.763151 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf3a538c4d74dd0a1704de4cf4d3624" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
W20260812 19:26:20.764818 20691 leader_election.cc:341] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.767650 20456 catalog_manager.cc:5495] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:20.780346 20985 raft_consensus.cc:3037] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.792393 21061 tablet_bootstrap.cc:492] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:20.792269 21218 consensus_queue.cc:1035] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:20.797030 20986 raft_consensus.cc:2454] T adf3a538c4d74dd0a1704de4cf4d3624 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:20.798617 20688 leader_election.cc:302] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:20.800102 21254 raft_consensus.cc:2781] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:20.800606 21254 raft_consensus.cc:686] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:20.801520 21254 consensus_queue.cc:237] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:20.802701 21058 tablet_bootstrap.cc:492] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:20.803261 21058 ts_tablet_manager.cc:1397] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.118s	user 0.032s	sys 0.024s
I20260812 19:26:20.806046 21061 tablet_bootstrap.cc:654] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.806147 21058 raft_consensus.cc:348] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.807010 21058 raft_consensus.cc:374] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.807293 21058 raft_consensus.cc:729] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.808053 21058 consensus_queue.cc:260] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.810222 21058 ts_tablet_manager.cc:1428] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260812 19:26:20.811337 21058 tablet_bootstrap.cc:492] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:20.817087 21060 tablet_bootstrap.cc:492] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:20.817694 21060 ts_tablet_manager.cc:1397] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.116s	user 0.032s	sys 0.058s
I20260812 19:26:20.820811 21060 raft_consensus.cc:348] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.821597 21060 raft_consensus.cc:374] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.821877 21060 raft_consensus.cc:729] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.823580 21058 tablet_bootstrap.cc:654] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:20.827518 20530 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:26:20.828392 21060 consensus_queue.cc:260] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.831419 21060 ts_tablet_manager.cc:1428] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260812 19:26:20.832516 21060 tablet_bootstrap.cc:492] T e3d48eec043e47bd9fd931ffd1ffe5e2 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:20.833994 21080 consensus_queue.cc:1035] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:20.835666 21061 tablet_bootstrap.cc:492] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:20.836176 21061 ts_tablet_manager.cc:1397] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.011s
I20260812 19:26:20.838194 21080 consensus_queue.cc:1035] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:20.839257 21061 raft_consensus.cc:348] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.839968 21061 raft_consensus.cc:374] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.840225 21061 raft_consensus.cc:729] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.825832 20453 catalog_manager.cc:5495] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:20.847641 21243 consensus_queue.cc:1035] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:20.849327 21060 tablet_bootstrap.cc:654] T e3d48eec043e47bd9fd931ffd1ffe5e2 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.840732 21058 tablet_bootstrap.cc:492] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:20.851145 21058 ts_tablet_manager.cc:1397] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.015s
I20260812 19:26:20.840935 21061 consensus_queue.cc:260] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:20.854090 21058 raft_consensus.cc:348] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.854797 21058 raft_consensus.cc:374] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.854910 21061 ts_tablet_manager.cc:1428] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260812 19:26:20.855096 21058 raft_consensus.cc:729] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.855995 21061 tablet_bootstrap.cc:492] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:20.855811 21058 consensus_queue.cc:260] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.857986 21058 ts_tablet_manager.cc:1428] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260812 19:26:20.859239 21058 tablet_bootstrap.cc:492] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:20.862083 21061 tablet_bootstrap.cc:654] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.867190 21058 tablet_bootstrap.cc:654] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.867726 21191 raft_consensus.cc:482] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:20.868289 21191 raft_consensus.cc:504] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.868510 21253 consensus_queue.cc:1035] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:20.874174 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3d48eec043e47bd9fd931ffd1ffe5e2" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:20.876984 20691 leader_election.cc:341] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.748224 20740 raft_consensus.cc:2454] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:20.794104 21057 consensus_queue.cc:1035] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:20.795219 21055 tablet_bootstrap.cc:654] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:20.898492 20570 leader_election.cc:302] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:20.900269 21108 raft_consensus.cc:2781] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:20.900731 21108 raft_consensus.cc:482] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:20.901113 21108 raft_consensus.cc:3037] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.921674 21254 raft_consensus.cc:482] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:20.922286 21254 raft_consensus.cc:504] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.924037 21108 raft_consensus.cc:504] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:20.924675 21254 leader_election.cc:288] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:20.927484 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57c6682d61b04b799643ea1c8b687787" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:20.927484 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57c6682d61b04b799643ea1c8b687787" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
W20260812 19:26:20.929152 20691 leader_election.cc:341] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:20.926527 20808 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:37307, user_credentials={real_user=slave}} blocked reactor thread for 90099.5us
W20260812 19:26:20.930413 20688 leader_election.cc:341] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:20.930886 20688 leader_election.cc:302] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:20.936494 21060 tablet_bootstrap.cc:492] T e3d48eec043e47bd9fd931ffd1ffe5e2 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:20.937223 21060 ts_tablet_manager.cc:1397] T e3d48eec043e47bd9fd931ffd1ffe5e2 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.105s	user 0.033s	sys 0.020s
I20260812 19:26:20.941025 21191 leader_election.cc:288] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:20.944996 21060 raft_consensus.cc:348] T e3d48eec043e47bd9fd931ffd1ffe5e2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.946035 21060 raft_consensus.cc:374] T e3d48eec043e47bd9fd931ffd1ffe5e2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:20.938558 21254 raft_consensus.cc:2726] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:20.955495 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3d48eec043e47bd9fd931ffd1ffe5e2" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:20.946370 21060 raft_consensus.cc:729] T e3d48eec043e47bd9fd931ffd1ffe5e2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:20.961678 21060 consensus_queue.cc:260] T e3d48eec043e47bd9fd931ffd1ffe5e2 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:20.962954 21243 consensus_queue.cc:1035] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:20.964871 21060 ts_tablet_manager.cc:1428] T e3d48eec043e47bd9fd931ffd1ffe5e2 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260812 19:26:20.967026 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6155c47e884e43498e968f83072b863a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:20.969369 20745 raft_consensus.cc:3037] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:20.969545 21108 leader_election.cc:288] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:20.967303 20984 raft_consensus.cc:2454] T e3d48eec043e47bd9fd931ffd1ffe5e2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:20.977248 21060 tablet_bootstrap.cc:492] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:21.000566 21061 tablet_bootstrap.cc:492] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:21.003902 21270 raft_consensus.cc:482] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.004185 21055 tablet_bootstrap.cc:492] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:21.004762 21055 ts_tablet_manager.cc:1397] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.313s	user 0.016s	sys 0.005s
I20260812 19:26:21.004527 21270 raft_consensus.cc:504] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.007597 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c0067c6bd74e33b1ebe3785dabf7d1" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
W20260812 19:26:21.009065 20812 leader_election.cc:341] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.015504 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6155c47e884e43498e968f83072b863a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:21.018891 20688 leader_election.cc:302] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:21.001478 21061 ts_tablet_manager.cc:1397] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.146s	user 0.017s	sys 0.029s
I20260812 19:26:21.016614 21292 raft_consensus.cc:482] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.022583 21055 raft_consensus.cc:348] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.022884 21292 raft_consensus.cc:504] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.023459 21055 raft_consensus.cc:374] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.023747 21055 raft_consensus.cc:729] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.025487 21292 leader_election.cc:288] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:21.030611 21061 raft_consensus.cc:348] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:21.031351 21061 raft_consensus.cc:374] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.031605 21061 raft_consensus.cc:729] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.032258 21061 consensus_queue.cc:260] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
W20260812 19:26:21.033573 20566 leader_election.cc:341] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.035234 21061 ts_tablet_manager.cc:1428] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260812 19:26:21.021448 21066 raft_consensus.cc:2781] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:21.036950 21061 tablet_bootstrap.cc:492] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:21.027251 21055 consensus_queue.cc:260] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.027297 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cb0f8eae7934850b4db442c32298bb3" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:21.020116 21057 consensus_queue.cc:1035] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260812 19:26:21.026623 21270 leader_election.cc:288] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:21.038985 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c0067c6bd74e33b1ebe3785dabf7d1" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:21.038182 21066 raft_consensus.cc:482] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:21.048719 21058 tablet_bootstrap.cc:492] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:21.049254 21058 ts_tablet_manager.cc:1397] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.190s	user 0.032s	sys 0.055s
I20260812 19:26:21.049417 21055 ts_tablet_manager.cc:1428] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260812 19:26:21.046625 20742 raft_consensus.cc:2454] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:21.051205 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cb0f8eae7934850b4db442c32298bb3" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
W20260812 19:26:21.051973 20812 leader_election.cc:341] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.052121 21218 raft_consensus.cc:482] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.053043 21218 raft_consensus.cc:504] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.054126 21061 tablet_bootstrap.cc:654] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.048545 21066 raft_consensus.cc:3037] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.058167 21288 raft_consensus.cc:482] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.058243 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cb0f8eae7934850b4db442c32298bb3" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:21.059041 21288 raft_consensus.cc:504] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.061075 20858 raft_consensus.cc:3037] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.063403 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "728993c4b9cc4b97935e507c167f6a62" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:21.064308 21055 tablet_bootstrap.cc:492] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
W20260812 19:26:21.065752 20565 leader_election.cc:341] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.067188 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cb0f8eae7934850b4db442c32298bb3" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:21.067903 20861 raft_consensus.cc:2454] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:21.068979 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "728993c4b9cc4b97935e507c167f6a62" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:21.055801 21218 leader_election.cc:288] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
W20260812 19:26:21.069401 20918 leader_election.cc:341] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.070833 21288 leader_election.cc:288] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:21.071058 20918 leader_election.cc:302] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:21.072608 21218 raft_consensus.cc:2781] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:21.073065 21218 raft_consensus.cc:482] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:21.073500 21218 raft_consensus.cc:3037] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:21.071112 20570 leader_election.cc:341] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.075155 20570 leader_election.cc:302] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
I20260812 19:26:21.054047 21058 raft_consensus.cc:348] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.076279 21058 raft_consensus.cc:374] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.076670 21058 raft_consensus.cc:729] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.077788 20815 leader_election.cc:302] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:21.077620 21058 consensus_queue.cc:260] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.079034 21270 raft_consensus.cc:2781] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:21.079502 21057 raft_consensus.cc:2726] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:21.080914 21058 ts_tablet_manager.cc:1428] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260812 19:26:21.079504 21270 raft_consensus.cc:482] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:21.082880 21270 raft_consensus.cc:3037] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.083623 21058 tablet_bootstrap.cc:492] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:21.083906 20745 raft_consensus.cc:2454] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:21.092558 20570 leader_election.cc:302] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:21.094780 21057 raft_consensus.cc:2781] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:21.095299 21057 raft_consensus.cc:686] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:21.096280 21057 consensus_queue.cc:237] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.098110 21292 raft_consensus.cc:482] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.098687 21292 raft_consensus.cc:504] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:21.102308 21292 leader_election.cc:288] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:21.104574 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:21.105548 20745 raft_consensus.cc:2454] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:21.107820 21253 consensus_queue.cc:1035] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:21.108179 20815 leader_election.cc:302] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:21.093019 21066 raft_consensus.cc:504] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:21.113979 21060 tablet_bootstrap.cc:654] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.122612 21058 tablet_bootstrap.cc:654] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.124063 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:21.115836 21080 raft_consensus.cc:2781] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:21.131173 21080 raft_consensus.cc:482] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:21.131701 21080 raft_consensus.cc:3037] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:21.135785 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3d48eec043e47bd9fd931ffd1ffe5e2" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:21.136543 20985 raft_consensus.cc:3037] T e3d48eec043e47bd9fd931ffd1ffe5e2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.136653 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3d48eec043e47bd9fd931ffd1ffe5e2" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:21.139382 21055 tablet_bootstrap.cc:654] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:21.139292 20691 leader_election.cc:341] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.133980 21066 leader_election.cc:288] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:21.143328 21270 raft_consensus.cc:504] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.145118 21253 consensus_queue.cc:1035] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:21.145439 20985 raft_consensus.cc:2454] T e3d48eec043e47bd9fd931ffd1ffe5e2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:21.147431 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c0067c6bd74e33b1ebe3785dabf7d1" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:21.148985 20688 leader_election.cc:302] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:21.150681 21191 raft_consensus.cc:2781] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:21.151304 21191 raft_consensus.cc:686] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:21.152381 21191 consensus_queue.cc:237] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
W20260812 19:26:21.159406 20812 leader_election.cc:341] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.196305 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c0067c6bd74e33b1ebe3785dabf7d1" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:21.197072 20742 raft_consensus.cc:3037] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.192509 21080 raft_consensus.cc:504] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:21.198961 20454 catalog_manager.cc:5495] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:21.213418 20858 raft_consensus.cc:1226] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Rejecting Update request from peer d5ab425bcd82426387b1a5b02e55b64c for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260812 19:26:21.213644 20566 consensus_peers.cc:487] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:21.215837 21218 raft_consensus.cc:504] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.216502 21270 leader_election.cc:288] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:21.217221 20986 raft_consensus.cc:2379] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c9e33eee61649e18fe397e56bdddea3 in current term 1: Already voted for candidate d5ab425bcd82426387b1a5b02e55b64c in this term.
I20260812 19:26:21.221812 20808 leader_election.cc:302] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:21.222163 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:21.218124 21253 consensus_queue.cc:1046] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:21.228466 21080 leader_election.cc:288] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:21.234912 21080 raft_consensus.cc:3037] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.249415 21306 consensus_queue.cc:1035] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:26:21.251443 20691 consensus_peers.cc:487] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:21.254243 21093 raft_consensus.cc:3032] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:21.258350 21093 raft_consensus.cc:729] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:21.258786 21055 tablet_bootstrap.cc:492] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:21.259295 21055 ts_tablet_manager.cc:1397] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.195s	user 0.013s	sys 0.000s
I20260812 19:26:21.259341 21093 consensus_queue.cc:260] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:21.254976 21061 tablet_bootstrap.cc:492] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:21.260577 21093 raft_consensus.cc:3037] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:21.261083 21061 ts_tablet_manager.cc:1397] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.225s	user 0.025s	sys 0.035s
I20260812 19:26:21.262336 21288 consensus_queue.cc:1035] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:21.256217 20742 raft_consensus.cc:2454] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:21.264196 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:21.264560 20815 leader_election.cc:302] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:21.266144 21055 raft_consensus.cc:348] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.266916 21055 raft_consensus.cc:374] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.267189 21055 raft_consensus.cc:729] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.267237 21270 raft_consensus.cc:2781] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:21.256846 21058 tablet_bootstrap.cc:492] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:21.268183 21058 ts_tablet_manager.cc:1397] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.185s	user 0.015s	sys 0.002s
I20260812 19:26:21.268262 21270 raft_consensus.cc:686] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:21.264106 21061 raft_consensus.cc:348] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.270164 21061 raft_consensus.cc:374] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.270493 21061 raft_consensus.cc:729] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.269531 21270 consensus_queue.cc:237] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.273072 21058 raft_consensus.cc:348] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:21.275168 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cb0f8eae7934850b4db442c32298bb3" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:21.275884 21058 raft_consensus.cc:374] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.276110 21066 raft_consensus.cc:482] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.276291 21058 raft_consensus.cc:729] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.276590 21066 raft_consensus.cc:504] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.277086 21058 consensus_queue.cc:260] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:21.273948 21055 consensus_queue.cc:260] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
W20260812 19:26:21.279414 20918 leader_election.cc:341] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.280782 20858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be4515819a7e4b5fa91def511f58fc4f" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:21.281081 21058 ts_tablet_manager.cc:1428] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260812 19:26:21.281653 21055 ts_tablet_manager.cc:1428] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
W20260812 19:26:21.282290 20691 leader_election.cc:341] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.272096 21061 consensus_queue.cc:260] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.282968 21066 leader_election.cc:288] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:21.283219 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be4515819a7e4b5fa91def511f58fc4f" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:21.284207 21061 ts_tablet_manager.cc:1428] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
W20260812 19:26:21.284821 20691 leader_election.cc:341] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.285715 21061 tablet_bootstrap.cc:492] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:21.286053 21058 tablet_bootstrap.cc:492] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:21.285306 20691 leader_election.cc:302] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:21.287206 21292 raft_consensus.cc:482] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.287731 21292 raft_consensus.cc:504] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:21.286602 21218 leader_election.cc:288] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:21.287756 21191 raft_consensus.cc:2726] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:21.292435 20986 raft_consensus.cc:2396] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c9e33eee61649e18fe397e56bdddea3 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260812 19:26:21.294498 21292 leader_election.cc:288] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:21.296990 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb6b294d38f46c994858d9de86da083" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:21.297508 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb6b294d38f46c994858d9de86da083" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
W20260812 19:26:21.298498 20808 leader_election.cc:341] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.300268 20808 leader_election.cc:302] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
I20260812 19:26:21.301163 21292 raft_consensus.cc:2726] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:26:21.305125 21055 tablet_bootstrap.cc:492] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:21.289132 21066 raft_consensus.cc:482] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.309522 21080 raft_consensus.cc:2726] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:21.307649 21066 raft_consensus.cc:504] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:21.315213 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb6b294d38f46c994858d9de86da083" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:21.317919 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb6b294d38f46c994858d9de86da083" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
W20260812 19:26:21.320065 20688 leader_election.cc:341] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.314373 21066 leader_election.cc:288] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:21.325309 21060 tablet_bootstrap.cc:492] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:21.337239 21060 ts_tablet_manager.cc:1397] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.362s	user 0.009s	sys 0.005s
I20260812 19:26:21.340104 21060 raft_consensus.cc:348] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.340829 21060 raft_consensus.cc:374] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.341109 21060 raft_consensus.cc:729] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.342033 21253 consensus_queue.cc:1035] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:21.330370 20861 raft_consensus.cc:2454] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:21.330634 21058 tablet_bootstrap.cc:654] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.341804 21060 consensus_queue.cc:260] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.331614 21055 tablet_bootstrap.cc:654] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.349187 21060 ts_tablet_manager.cc:1428] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260812 19:26:21.350430 21060 tablet_bootstrap.cc:492] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:21.332343 21061 tablet_bootstrap.cc:654] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.333669 20740 raft_consensus.cc:2454] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:21.352517 20815 leader_election.cc:302] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:21.332160 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cb0f8eae7934850b4db442c32298bb3" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:21.358855 21270 raft_consensus.cc:2781] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:21.359330 21270 raft_consensus.cc:482] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:21.349040 20691 leader_election.cc:302] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:21.360268 21191 consensus_queue.cc:1035] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:21.360646 21270 raft_consensus.cc:3037] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.361719 21191 raft_consensus.cc:2781] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:21.362130 21191 raft_consensus.cc:482] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:21.362498 21191 raft_consensus.cc:3037] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.375885 21270 raft_consensus.cc:504] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:21.376940 21191 raft_consensus.cc:504] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:21.378861 21270 leader_election.cc:288] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:21.379598 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb6b294d38f46c994858d9de86da083" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:21.380441 20740 raft_consensus.cc:2379] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c9e33eee61649e18fe397e56bdddea3 in current term 1: Already voted for candidate efc1471911ec442396b400eed9d18036 in this term.
I20260812 19:26:21.381559 20855 raft_consensus.cc:2454] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:21.382122 21060 tablet_bootstrap.cc:654] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.381986 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb6b294d38f46c994858d9de86da083" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:21.382902 20918 leader_election.cc:302] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:21.387419 21055 tablet_bootstrap.cc:492] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:21.384788 21058 tablet_bootstrap.cc:492] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:21.385632 20456 catalog_manager.cc:5495] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:21.394547 21058 ts_tablet_manager.cc:1397] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.112s	user 0.008s	sys 0.005s
I20260812 19:26:21.396231 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb6b294d38f46c994858d9de86da083" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
W20260812 19:26:21.385294 20808 leader_election.cc:341] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.391134 21055 ts_tablet_manager.cc:1397] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.002s
I20260812 19:26:21.397679 20808 leader_election.cc:302] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
W20260812 19:26:21.397836 20688 leader_election.cc:341] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.400262 21055 raft_consensus.cc:348] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.401382 21270 raft_consensus.cc:2726] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:26:21.405814 21055 raft_consensus.cc:374] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.406118 21055 raft_consensus.cc:729] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.403008 21058 raft_consensus.cc:348] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.406807 21058 raft_consensus.cc:374] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.407146 21058 raft_consensus.cc:729] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.407236 21191 leader_election.cc:288] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:21.384912 21253 raft_consensus.cc:2781] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:21.410421 21061 tablet_bootstrap.cc:492] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:21.410880 21253 raft_consensus.cc:686] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:21.411077 21061 ts_tablet_manager.cc:1397] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.126s	user 0.009s	sys 0.007s
I20260812 19:26:21.411841 21253 consensus_queue.cc:237] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.412333 20454 catalog_manager.cc:5495] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:21.414027 21060 tablet_bootstrap.cc:492] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:21.413946 21061 raft_consensus.cc:348] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.414582 21060 ts_tablet_manager.cc:1397] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.003s
I20260812 19:26:21.419610 21060 raft_consensus.cc:348] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.420114 21060 raft_consensus.cc:374] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.420380 21060 raft_consensus.cc:729] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.420981 21060 consensus_queue.cc:260] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.414951 21055 consensus_queue.cc:260] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.422961 21060 ts_tablet_manager.cc:1428] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260812 19:26:21.423663 20453 catalog_manager.cc:5495] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:21.424563 21055 ts_tablet_manager.cc:1428] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260812 19:26:21.425695 21055 tablet_bootstrap.cc:492] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:21.406430 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb6b294d38f46c994858d9de86da083" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:21.431730 21061 raft_consensus.cc:374] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.432080 21061 raft_consensus.cc:729] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.432307 20855 raft_consensus.cc:2379] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate efc1471911ec442396b400eed9d18036 in current term 1: Already voted for candidate 8c9e33eee61649e18fe397e56bdddea3 in this term.
I20260812 19:26:21.431403 21055 tablet_bootstrap.cc:654] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.432747 21061 consensus_queue.cc:260] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.433609 20691 leader_election.cc:302] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:21.435467 21061 ts_tablet_manager.cc:1428] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260812 19:26:21.435616 21253 raft_consensus.cc:482] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.435907 21254 raft_consensus.cc:2726] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:26:21.436620 21061 tablet_bootstrap.cc:492] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:21.436064 21253 raft_consensus.cc:504] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.438441 21253 leader_election.cc:288] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:21.440774 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a347274cb334867b07c94e32b32f3ca" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:21.441505 20855 raft_consensus.cc:2454] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:21.442950 20918 leader_election.cc:302] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:21.444543 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a347274cb334867b07c94e32b32f3ca" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:21.415740 21058 consensus_queue.cc:260] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
W20260812 19:26:21.446529 20918 leader_election.cc:341] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.447592 21253 raft_consensus.cc:2781] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:21.448071 21253 raft_consensus.cc:482] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:21.448513 21253 raft_consensus.cc:3037] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.448019 21058 ts_tablet_manager.cc:1428] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.003s
I20260812 19:26:21.450559 21058 tablet_bootstrap.cc:492] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:21.458343 21060 tablet_bootstrap.cc:492] T 728993c4b9cc4b97935e507c167f6a62 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:21.463186 21253 raft_consensus.cc:504] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.464491 21191 raft_consensus.cc:482] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.470371 21061 tablet_bootstrap.cc:654] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.470851 21055 tablet_bootstrap.cc:492] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:21.470487 21191 raft_consensus.cc:504] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.471386 21055 ts_tablet_manager.cc:1397] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.027s
I20260812 19:26:21.474452 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6cd88a19cf44aeabbec6b1d8e76630" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:21.474886 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6cd88a19cf44aeabbec6b1d8e76630" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
W20260812 19:26:21.476420 20688 leader_election.cc:341] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:21.477747 20691 leader_election.cc:341] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.478313 21191 leader_election.cc:288] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:21.466578 21060 tablet_bootstrap.cc:654] T 728993c4b9cc4b97935e507c167f6a62 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.478200 20691 leader_election.cc:302] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:21.483372 21066 raft_consensus.cc:2726] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:21.484184 21253 leader_election.cc:288] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:21.487357 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a347274cb334867b07c94e32b32f3ca" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:21.488009 20855 raft_consensus.cc:3037] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.474938 21055 raft_consensus.cc:348] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.489717 21055 raft_consensus.cc:374] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.490109 21055 raft_consensus.cc:729] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.491094 21055 consensus_queue.cc:260] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.492348 21057 consensus_queue.cc:1035] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:21.494086 21055 ts_tablet_manager.cc:1428] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260812 19:26:21.495527 21055 tablet_bootstrap.cc:492] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:21.497853 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a347274cb334867b07c94e32b32f3ca" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
W20260812 19:26:21.499521 20918 leader_election.cc:341] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.502903 21055 tablet_bootstrap.cc:654] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.513754 20855 raft_consensus.cc:2454] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:21.468933 21058 tablet_bootstrap.cc:654] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.521250 21055 tablet_bootstrap.cc:492] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:21.522002 21055 ts_tablet_manager.cc:1397] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.011s
I20260812 19:26:21.524094 20918 leader_election.cc:302] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:21.524698 21061 tablet_bootstrap.cc:492] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:21.525049 21253 raft_consensus.cc:2781] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:21.525223 21061 ts_tablet_manager.cc:1397] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.089s	user 0.008s	sys 0.002s
I20260812 19:26:21.525655 21253 raft_consensus.cc:686] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:21.526551 21253 consensus_queue.cc:237] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.528265 21061 raft_consensus.cc:348] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.528992 21061 raft_consensus.cc:374] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.529276 21061 raft_consensus.cc:729] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.529135 21055 raft_consensus.cc:348] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.529987 21055 raft_consensus.cc:374] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.530396 21055 raft_consensus.cc:729] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.530170 21061 consensus_queue.cc:260] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.531854 21058 tablet_bootstrap.cc:492] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:21.531451 21055 consensus_queue.cc:260] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.532459 21058 ts_tablet_manager.cc:1397] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.000s
I20260812 19:26:21.535233 21058 raft_consensus.cc:348] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.538713 21058 raft_consensus.cc:374] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.540126 21058 raft_consensus.cc:729] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.541913 21058 consensus_queue.cc:260] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.544067 21058 ts_tablet_manager.cc:1428] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260812 19:26:21.545423 21055 ts_tablet_manager.cc:1428] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260812 19:26:21.546085 21058 tablet_bootstrap.cc:492] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:21.546510 21055 tablet_bootstrap.cc:492] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:21.548777 21060 tablet_bootstrap.cc:492] T 728993c4b9cc4b97935e507c167f6a62 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:21.549317 21060 ts_tablet_manager.cc:1397] T 728993c4b9cc4b97935e507c167f6a62 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.028s
I20260812 19:26:21.552632 21060 raft_consensus.cc:348] T 728993c4b9cc4b97935e507c167f6a62 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.553354 21060 raft_consensus.cc:374] T 728993c4b9cc4b97935e507c167f6a62 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.553608 21060 raft_consensus.cc:729] T 728993c4b9cc4b97935e507c167f6a62 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.554370 21060 consensus_queue.cc:260] T 728993c4b9cc4b97935e507c167f6a62 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
W20260812 19:26:21.556191 20691 consensus_peers.cc:487] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:21.556882 21060 ts_tablet_manager.cc:1428] T 728993c4b9cc4b97935e507c167f6a62 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260812 19:26:21.557713 21055 tablet_bootstrap.cc:654] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.557956 21060 tablet_bootstrap.cc:492] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:21.559790 20456 catalog_manager.cc:5495] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } }
W20260812 19:26:21.562988 20566 consensus_peers.cc:487] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:21.564301 21060 tablet_bootstrap.cc:654] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.570451 21058 tablet_bootstrap.cc:654] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.572176 21061 ts_tablet_manager.cc:1428] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260812 19:26:21.586350 21055 tablet_bootstrap.cc:492] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:21.587172 21055 ts_tablet_manager.cc:1397] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.015s
I20260812 19:26:21.590804 21055 raft_consensus.cc:348] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.592087 21055 raft_consensus.cc:374] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.592455 21055 raft_consensus.cc:729] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.593616 21058 tablet_bootstrap.cc:492] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:21.594244 21058 ts_tablet_manager.cc:1397] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.006s
I20260812 19:26:21.594473 21061 tablet_bootstrap.cc:492] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:21.596977 21058 raft_consensus.cc:348] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.597926 21058 raft_consensus.cc:374] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.598344 21058 raft_consensus.cc:729] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.597975 21055 consensus_queue.cc:260] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.599342 21058 consensus_queue.cc:260] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.601893 21058 ts_tablet_manager.cc:1428] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260812 19:26:21.603451 21058 tablet_bootstrap.cc:492] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:21.606407 21055 ts_tablet_manager.cc:1428] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260812 19:26:21.607826 21055 tablet_bootstrap.cc:492] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:21.610896 21058 tablet_bootstrap.cc:654] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.615644 21055 tablet_bootstrap.cc:654] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.621135 21061 tablet_bootstrap.cc:654] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.629964 21058 tablet_bootstrap.cc:492] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:21.630610 21058 ts_tablet_manager.cc:1397] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.006s
I20260812 19:26:21.631765 21055 tablet_bootstrap.cc:492] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:21.632476 21055 ts_tablet_manager.cc:1397] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.007s
I20260812 19:26:21.633819 21058 raft_consensus.cc:348] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.634545 21058 raft_consensus.cc:374] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.634841 21058 raft_consensus.cc:729] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.635187 21060 tablet_bootstrap.cc:492] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:21.635320 21055 raft_consensus.cc:348] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.635775 21060 ts_tablet_manager.cc:1397] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.078s	user 0.029s	sys 0.032s
I20260812 19:26:21.636065 21055 raft_consensus.cc:374] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.635622 21058 consensus_queue.cc:260] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.636391 21055 raft_consensus.cc:729] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.636799 21061 tablet_bootstrap.cc:492] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:21.637339 21061 ts_tablet_manager.cc:1397] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.000s
I20260812 19:26:21.637202 21055 consensus_queue.cc:260] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.638597 21060 raft_consensus.cc:348] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:21.639309 21060 raft_consensus.cc:374] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.639557 21060 raft_consensus.cc:729] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.640192 21060 consensus_queue.cc:260] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:21.640317 21061 raft_consensus.cc:348] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.641176 21061 raft_consensus.cc:374] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.641522 21061 raft_consensus.cc:729] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.642339 21061 consensus_queue.cc:260] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.645788 21055 ts_tablet_manager.cc:1428] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260812 19:26:21.646879 21055 tablet_bootstrap.cc:492] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:21.651506 21191 raft_consensus.cc:482] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.651731 21058 ts_tablet_manager.cc:1428] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260812 19:26:21.652144 21191 raft_consensus.cc:504] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:21.653455 21060 ts_tablet_manager.cc:1428] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260812 19:26:21.654891 21058 tablet_bootstrap.cc:492] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:21.659494 21191 leader_election.cc:288] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:21.660723 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27a1c1554b2d44ec849b89e817bd0a12" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:21.663858 21055 tablet_bootstrap.cc:654] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.664171 21060 tablet_bootstrap.cc:492] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
W20260812 19:26:21.665107 20688 leader_election.cc:341] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.663094 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27a1c1554b2d44ec849b89e817bd0a12" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:21.667241 20691 leader_election.cc:341] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.667768 20691 leader_election.cc:302] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:21.669128 21253 raft_consensus.cc:482] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.669636 21253 raft_consensus.cc:504] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:21.665784 21061 ts_tablet_manager.cc:1428] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260812 19:26:21.671941 21253 leader_election.cc:288] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:21.673606 21058 tablet_bootstrap.cc:654] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.675323 21066 raft_consensus.cc:2726] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:21.675712 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb6b294d38f46c994858d9de86da083" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:21.676554 20745 raft_consensus.cc:2379] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d5ab425bcd82426387b1a5b02e55b64c in current term 1: Already voted for candidate efc1471911ec442396b400eed9d18036 in this term.
I20260812 19:26:21.681138 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb6b294d38f46c994858d9de86da083" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:21.682063 20855 raft_consensus.cc:2379] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d5ab425bcd82426387b1a5b02e55b64c in current term 1: Already voted for candidate 8c9e33eee61649e18fe397e56bdddea3 in this term.
I20260812 19:26:21.683507 20635 raft_consensus.cc:3037] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.684006 20918 leader_election.cc:302] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036
I20260812 19:26:21.686048 21253 raft_consensus.cc:3037] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.690380 21066 raft_consensus.cc:482] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.691025 21066 raft_consensus.cc:504] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.691630 21061 tablet_bootstrap.cc:492] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:21.693405 21066 leader_election.cc:288] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:21.695737 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25f274ac8f124e7697711e0afcd0b058" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:21.696573 20636 raft_consensus.cc:2454] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:21.698163 21060 tablet_bootstrap.cc:654] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.698086 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25f274ac8f124e7697711e0afcd0b058" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:21.701387 21080 consensus_queue.cc:1035] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:21.698926 21061 tablet_bootstrap.cc:654] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.699064 20691 leader_election.cc:302] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:21.680181 21191 consensus_queue.cc:1035] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
W20260812 19:26:21.704360 20688 leader_election.cc:341] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.705544 21191 raft_consensus.cc:2781] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:21.705978 21191 raft_consensus.cc:482] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:21.706328 21191 raft_consensus.cc:3037] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.720034 21253 raft_consensus.cc:2726] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:21.722029 21058 tablet_bootstrap.cc:492] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:21.725780 21058 ts_tablet_manager.cc:1397] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.000s
I20260812 19:26:21.723570 21191 raft_consensus.cc:504] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.731094 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25f274ac8f124e7697711e0afcd0b058" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:21.731205 21191 leader_election.cc:288] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:21.734459 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25f274ac8f124e7697711e0afcd0b058" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
W20260812 19:26:21.734992 20688 leader_election.cc:341] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.735222 20636 raft_consensus.cc:3037] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.743062 21080 raft_consensus.cc:482] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.748852 21080 raft_consensus.cc:504] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.752068 21055 tablet_bootstrap.cc:492] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:21.753659 21055 ts_tablet_manager.cc:1397] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.107s	user 0.042s	sys 0.041s
I20260812 19:26:21.755151 21292 raft_consensus.cc:482] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.759702 21292 raft_consensus.cc:504] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.761870 21292 leader_election.cc:288] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:21.763640 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be4515819a7e4b5fa91def511f58fc4f" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:21.763402 21055 raft_consensus.cc:348] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.759979 21080 leader_election.cc:288] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:21.764220 21055 raft_consensus.cc:374] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.764333 20637 raft_consensus.cc:2454] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:21.764591 21055 raft_consensus.cc:729] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.765295 21055 consensus_queue.cc:260] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.765802 20812 leader_election.cc:302] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:21.766286 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f536e291e9f46cb8ce550ae575e643a" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:21.767808 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f536e291e9f46cb8ce550ae575e643a" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:21.767055 21055 ts_tablet_manager.cc:1428] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260812 19:26:21.759716 21060 tablet_bootstrap.cc:492] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:21.768725 21060 ts_tablet_manager.cc:1397] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.105s	user 0.017s	sys 0.000s
I20260812 19:26:21.766816 21080 raft_consensus.cc:2781] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260812 19:26:21.770306 20808 leader_election.cc:341] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.771059 21080 raft_consensus.cc:482] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:21.771265 21191 raft_consensus.cc:482] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.771512 21080 raft_consensus.cc:3037] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.771564 21057 raft_consensus.cc:482] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.771833 21191 raft_consensus.cc:504] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.772215 21057 raft_consensus.cc:504] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.772794 21060 raft_consensus.cc:348] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.774152 21191 leader_election.cc:288] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:21.774380 21057 leader_election.cc:288] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:21.773554 21060 raft_consensus.cc:374] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.776429 21055 tablet_bootstrap.cc:492] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:21.776624 21060 raft_consensus.cc:729] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.780155 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cb0f8eae7934850b4db442c32298bb3" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:21.779956 21060 consensus_queue.cc:260] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.781412 21061 tablet_bootstrap.cc:492] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:21.781903 21061 ts_tablet_manager.cc:1397] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.022s
I20260812 19:26:21.783028 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be4515819a7e4b5fa91def511f58fc4f" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:21.783779 20740 raft_consensus.cc:2454] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:21.785907 21061 raft_consensus.cc:348] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.787032 21292 consensus_queue.cc:1035] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:21.786700 21061 raft_consensus.cc:374] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.788563 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "728993c4b9cc4b97935e507c167f6a62" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:21.788952 21061 raft_consensus.cc:729] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.789391 20637 raft_consensus.cc:2454] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:21.789721 21061 consensus_queue.cc:260] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.788663 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cb0f8eae7934850b4db442c32298bb3" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:21.789331 21058 raft_consensus.cc:348] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.792167 21058 raft_consensus.cc:374] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.792339 21061 ts_tablet_manager.cc:1428] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260812 19:26:21.792359 20855 raft_consensus.cc:2379] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 171f67787a8348fb9c7b19bf09026039 in current term 1: Already voted for candidate d5ab425bcd82426387b1a5b02e55b64c in this term.
I20260812 19:26:21.793403 21061 tablet_bootstrap.cc:492] T e3d48eec043e47bd9fd931ffd1ffe5e2 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:21.797801 20691 leader_election.cc:302] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:21.799376 21060 ts_tablet_manager.cc:1428] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260812 19:26:21.792464 21058 raft_consensus.cc:729] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.800535 21060 tablet_bootstrap.cc:492] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:21.802526 20565 leader_election.cc:302] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:21.803589 21108 raft_consensus.cc:3037] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:21.804592 20812 leader_election.cc:341] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.804733 21218 raft_consensus.cc:482] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.805130 20812 leader_election.cc:302] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:21.805365 21218 raft_consensus.cc:504] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.788494 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "728993c4b9cc4b97935e507c167f6a62" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:21.807330 20986 raft_consensus.cc:2454] T 728993c4b9cc4b97935e507c167f6a62 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:21.807627 21218 leader_election.cc:288] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:21.808228 21292 raft_consensus.cc:2726] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:21.810585 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b112d71b0be429f977ba95ac9534b6b" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:21.811340 20637 raft_consensus.cc:2454] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:21.812726 20918 leader_election.cc:302] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:21.813747 21218 raft_consensus.cc:2781] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:21.814109 21218 raft_consensus.cc:482] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:21.814476 21218 raft_consensus.cc:3037] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.814864 21191 raft_consensus.cc:2781] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:21.815331 21191 raft_consensus.cc:482] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:21.803144 21058 consensus_queue.cc:260] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.816821 21080 raft_consensus.cc:504] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.819124 21080 leader_election.cc:288] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:21.814364 21055 tablet_bootstrap.cc:654] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.820509 20858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b112d71b0be429f977ba95ac9534b6b" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:21.821650 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be4515819a7e4b5fa91def511f58fc4f" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:21.815676 21191 raft_consensus.cc:3037] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.822398 20742 raft_consensus.cc:3037] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.821372 20858 raft_consensus.cc:2454] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:21.814389 21108 raft_consensus.cc:2726] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:21.825474 21108 raft_consensus.cc:482] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.825955 21108 raft_consensus.cc:504] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.827019 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be4515819a7e4b5fa91def511f58fc4f" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:21.828023 20637 raft_consensus.cc:3037] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.828689 21108 leader_election.cc:288] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:21.830313 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a347274cb334867b07c94e32b32f3ca" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:21.832067 20858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a347274cb334867b07c94e32b32f3ca" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:21.832705 20635 raft_consensus.cc:3037] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.832958 20858 raft_consensus.cc:2379] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 171f67787a8348fb9c7b19bf09026039 in current term 1: Already voted for candidate d5ab425bcd82426387b1a5b02e55b64c in this term.
I20260812 19:26:21.845080 20636 raft_consensus.cc:2454] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:21.846796 20691 leader_election.cc:302] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:21.848074 21254 raft_consensus.cc:2781] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:21.848608 21254 raft_consensus.cc:686] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:21.849485 21254 consensus_queue.cc:237] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.850718 21253 raft_consensus.cc:482] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:21.851316 20566 leader_election.cc:302] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:21.851258 21253 raft_consensus.cc:504] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.853587 21253 leader_election.cc:288] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:21.854427 21057 raft_consensus.cc:3037] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.855649 20858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f536e291e9f46cb8ce550ae575e643a" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:21.855846 20633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f536e291e9f46cb8ce550ae575e643a" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:21.856338 21061 tablet_bootstrap.cc:654] T e3d48eec043e47bd9fd931ffd1ffe5e2 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:21.857363 20918 leader_election.cc:341] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:21.856377 20858 raft_consensus.cc:2454] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:21.859493 20918 leader_election.cc:302] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:21.860844 21253 raft_consensus.cc:2781] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:21.861276 21253 raft_consensus.cc:482] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:26:21.861038 20530 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:26:21.861758 21253 raft_consensus.cc:3037] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.852519 21218 raft_consensus.cc:504] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.866601 20858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b112d71b0be429f977ba95ac9534b6b" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:21.867419 20858 raft_consensus.cc:3037] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.863288 20742 raft_consensus.cc:2454] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:21.869481 20815 leader_election.cc:302] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:21.863571 20637 raft_consensus.cc:2454] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:21.870433 21080 raft_consensus.cc:2781] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:21.871065 21080 raft_consensus.cc:686] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:21.872265 21080 consensus_queue.cc:237] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:21.875908 21058 ts_tablet_manager.cc:1428] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.149s	user 0.006s	sys 0.001s
I20260812 19:26:21.869782 21253 raft_consensus.cc:504] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.877063 21058 tablet_bootstrap.cc:492] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:21.875238 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b112d71b0be429f977ba95ac9534b6b" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:21.879194 20637 raft_consensus.cc:3037] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.885794 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f536e291e9f46cb8ce550ae575e643a" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:21.886586 20855 raft_consensus.cc:3037] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.882699 21218 leader_election.cc:288] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:21.890309 21055 tablet_bootstrap.cc:492] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:21.891234 21055 ts_tablet_manager.cc:1397] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.015s
I20260812 19:26:21.894212 21253 leader_election.cc:288] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:21.897765 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f536e291e9f46cb8ce550ae575e643a" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:21.898504 21060 tablet_bootstrap.cc:654] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.898468 21055 raft_consensus.cc:348] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.899935 21055 raft_consensus.cc:374] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:21.900256 21055 raft_consensus.cc:729] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:21.883719 21057 raft_consensus.cc:2726] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:21.901486 21055 consensus_queue.cc:260] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.909795 20855 raft_consensus.cc:2454] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:21.909873 21191 raft_consensus.cc:504] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:21.904503 21253 consensus_queue.cc:1035] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260812 19:26:21.913513 20918 leader_election.cc:302] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:21.904942 20636 raft_consensus.cc:3037] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.920379 21055 ts_tablet_manager.cc:1428] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260812 19:26:21.920970 21093 raft_consensus.cc:2781] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:21.923858 21093 raft_consensus.cc:686] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:21.925133 21093 consensus_queue.cc:237] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:21.927045 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "728993c4b9cc4b97935e507c167f6a62" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:21.927278 21191 leader_election.cc:288] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:21.927775 20985 raft_consensus.cc:3037] T 728993c4b9cc4b97935e507c167f6a62 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.927054 20633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "728993c4b9cc4b97935e507c167f6a62" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:21.931504 20633 raft_consensus.cc:3037] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:21.941326 21055 tablet_bootstrap.cc:492] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:21.952280 20858 raft_consensus.cc:2454] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:21.965092 21218 consensus_queue.cc:1035] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:21.973872 20633 raft_consensus.cc:2454] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:21.966691 21058 tablet_bootstrap.cc:654] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:21.979043 20691 leader_election.cc:302] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:21.980264 21254 raft_consensus.cc:2781] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:21.942556 20985 raft_consensus.cc:2454] T 728993c4b9cc4b97935e507c167f6a62 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:21.985857 20456 catalog_manager.cc:5495] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:22.003561 20453 catalog_manager.cc:5495] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:21.999400 20637 raft_consensus.cc:2454] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:22.010748 21055 tablet_bootstrap.cc:654] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:22.017650 21254 raft_consensus.cc:686] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
W20260812 19:26:22.015497 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 68860us
I20260812 19:26:22.028290 21061 tablet_bootstrap.cc:492] T e3d48eec043e47bd9fd931ffd1ffe5e2 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:22.029335 21061 ts_tablet_manager.cc:1397] T e3d48eec043e47bd9fd931ffd1ffe5e2 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.236s	user 0.012s	sys 0.012s
I20260812 19:26:22.030441 20858 raft_consensus.cc:3037] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:22.030895 20636 raft_consensus.cc:2454] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:22.022409 21254 consensus_queue.cc:237] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.038218 21060 tablet_bootstrap.cc:492] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:22.038908 21060 ts_tablet_manager.cc:1397] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.239s	user 0.039s	sys 0.027s
I20260812 19:26:22.047833 21060 raft_consensus.cc:348] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.049268 21060 raft_consensus.cc:374] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.049626 21060 raft_consensus.cc:729] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.043210 20918 leader_election.cc:302] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:22.053535 21055 tablet_bootstrap.cc:492] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:22.050611 21066 raft_consensus.cc:482] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:22.054145 21055 ts_tablet_manager.cc:1397] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.016s
I20260812 19:26:22.054080 21066 raft_consensus.cc:504] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.056291 21066 leader_election.cc:288] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:22.057055 21055 raft_consensus.cc:348] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:22.057775 21055 raft_consensus.cc:374] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.058043 21055 raft_consensus.cc:729] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.059840 21055 consensus_queue.cc:260] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:22.060166 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebcc2cf4057a4c8e82b0ee3dc8481257" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:22.063198 21055 ts_tablet_manager.cc:1428] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260812 19:26:22.063016 21061 raft_consensus.cc:348] T e3d48eec043e47bd9fd931ffd1ffe5e2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.063971 21061 raft_consensus.cc:374] T e3d48eec043e47bd9fd931ffd1ffe5e2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.064206 21061 raft_consensus.cc:729] T e3d48eec043e47bd9fd931ffd1ffe5e2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.064816 21061 consensus_queue.cc:260] T e3d48eec043e47bd9fd931ffd1ffe5e2 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.066695 21191 raft_consensus.cc:482] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:22.067202 21191 raft_consensus.cc:504] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:22.069291 21191 leader_election.cc:288] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:22.070436 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a15940eed3e4cfb8cf7127a2cb2f757" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:22.072101 20691 leader_election.cc:341] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:22.072010 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a15940eed3e4cfb8cf7127a2cb2f757" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
W20260812 19:26:22.073777 20691 leader_election.cc:341] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:22.074244 20691 leader_election.cc:302] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
W20260812 19:26:22.067214 20688 leader_election.cc:341] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:22.076736 21055 tablet_bootstrap.cc:492] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:22.075436 21191 raft_consensus.cc:2726] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:22.078931 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebcc2cf4057a4c8e82b0ee3dc8481257" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
W20260812 19:26:22.080987 20691 leader_election.cc:341] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:22.066581 21061 ts_tablet_manager.cc:1428] T e3d48eec043e47bd9fd931ffd1ffe5e2 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.000s
I20260812 19:26:22.081627 20691 leader_election.cc:302] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:22.083456 21061 tablet_bootstrap.cc:492] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:22.051062 21060 consensus_queue.cc:260] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.082854 21191 raft_consensus.cc:2726] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:22.083895 20456 catalog_manager.cc:5495] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:22.085430 21376 raft_consensus.cc:2781] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:22.090420 21055 tablet_bootstrap.cc:654] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:22.093142 21060 ts_tablet_manager.cc:1428] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.001s
I20260812 19:26:22.094521 21060 tablet_bootstrap.cc:492] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
W20260812 19:26:22.087601 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 44531.2us
I20260812 19:26:22.108960 20861 raft_consensus.cc:3037] T e3d48eec043e47bd9fd931ffd1ffe5e2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:22.110982 21061 tablet_bootstrap.cc:654] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:22.119837 21360 log.cc:924] Time spent T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036: Append to log took a long time: real 0.138s	user 0.004s	sys 0.000s
I20260812 19:26:22.100924 21376 raft_consensus.cc:686] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:22.129073 21376 consensus_queue.cc:237] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:22.164289 21060 tablet_bootstrap.cc:654] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:22.165235 20453 catalog_manager.cc:5495] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:22.176719 21080 raft_consensus.cc:482] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:22.177479 21080 raft_consensus.cc:504] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:22.182381 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91aea69f88c43cb84d67ea8a6e8d8bf" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:22.182585 21080 leader_election.cc:288] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:22.183981 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91aea69f88c43cb84d67ea8a6e8d8bf" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:22.186609 20815 leader_election.cc:302] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:22.187870 21359 raft_consensus.cc:2726] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:22.195142 21218 consensus_queue.cc:1035] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:22.198097 21218 consensus_queue.cc:1035] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:22.199151 21061 tablet_bootstrap.cc:492] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:22.199728 21061 ts_tablet_manager.cc:1397] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.117s	user 0.031s	sys 0.030s
I20260812 19:26:22.201835 21058 tablet_bootstrap.cc:492] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:22.202368 21058 ts_tablet_manager.cc:1397] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.326s	user 0.034s	sys 0.025s
I20260812 19:26:22.205751 21058 raft_consensus.cc:348] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.207036 21058 raft_consensus.cc:374] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.207333 21058 raft_consensus.cc:729] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.208214 20454 catalog_manager.cc:5495] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:22.208788 21061 raft_consensus.cc:348] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:22.209872 21061 raft_consensus.cc:374] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.208000 21058 consensus_queue.cc:260] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.210161 21061 raft_consensus.cc:729] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.210992 21061 consensus_queue.cc:260] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:22.212170 21058 ts_tablet_manager.cc:1428] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260812 19:26:22.213165 21061 ts_tablet_manager.cc:1428] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.003s
I20260812 19:26:22.214576 21061 tablet_bootstrap.cc:492] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:22.213195 21058 tablet_bootstrap.cc:492] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:22.224248 21061 tablet_bootstrap.cc:654] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:22.228174 21055 tablet_bootstrap.cc:492] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:22.239312 21058 tablet_bootstrap.cc:654] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:22.254688 21061 tablet_bootstrap.cc:492] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:22.255249 21061 ts_tablet_manager.cc:1397] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.008s
W20260812 19:26:22.257208 20688 consensus_peers.cc:487] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 -> Peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Couldn't send request to peer d5ab425bcd82426387b1a5b02e55b64c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:22.258839 21376 raft_consensus.cc:482] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:22.259117 21061 raft_consensus.cc:348] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.259442 21376 raft_consensus.cc:504] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.260126 21061 raft_consensus.cc:374] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.261739 21376 leader_election.cc:288] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:22.263116 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6cd88a19cf44aeabbec6b1d8e76630" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:22.264118 21058 tablet_bootstrap.cc:492] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:22.264643 21058 ts_tablet_manager.cc:1397] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.010s
I20260812 19:26:22.264335 20745 raft_consensus.cc:2454] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:22.267640 21058 raft_consensus.cc:348] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:22.268378 21058 raft_consensus.cc:374] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.268651 21058 raft_consensus.cc:729] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.260545 21061 raft_consensus.cc:729] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.270567 21055 ts_tablet_manager.cc:1397] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.194s	user 0.013s	sys 0.001s
I20260812 19:26:22.271068 21058 consensus_queue.cc:260] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:22.269886 21061 consensus_queue.cc:260] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.266358 20922 leader_election.cc:302] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:22.283596 21061 ts_tablet_manager.cc:1428] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260812 19:26:22.282882 21376 raft_consensus.cc:2781] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:22.284415 21376 raft_consensus.cc:482] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:22.284778 21376 raft_consensus.cc:3037] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:22.284878 21061 tablet_bootstrap.cc:492] T 27a1c1554b2d44ec849b89e817bd0a12 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:22.291052 21377 raft_consensus.cc:482] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:22.291623 21377 raft_consensus.cc:504] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:22.293779 21377 leader_election.cc:288] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:22.294004 21061 tablet_bootstrap.cc:654] T 27a1c1554b2d44ec849b89e817bd0a12 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:22.295953 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8732d4883dce4b7d97faf3669bdbb006" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:22.297963 20691 leader_election.cc:341] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:22.298967 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6cd88a19cf44aeabbec6b1d8e76630" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:22.302392 21058 ts_tablet_manager.cc:1428] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
I20260812 19:26:22.302040 21080 consensus_queue.cc:1035] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:22.307049 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8732d4883dce4b7d97faf3669bdbb006" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:22.307617 21060 tablet_bootstrap.cc:492] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:22.307956 20636 raft_consensus.cc:2454] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:22.304114 21055 raft_consensus.cc:348] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.309146 21055 raft_consensus.cc:374] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.309170 20691 leader_election.cc:302] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:22.309538 21055 raft_consensus.cc:729] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.308182 21060 ts_tablet_manager.cc:1397] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.214s	user 0.032s	sys 0.027s
I20260812 19:26:22.310964 21191 raft_consensus.cc:2781] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:22.311395 21191 raft_consensus.cc:482] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:22.311827 21191 raft_consensus.cc:3037] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:22.312088 21055 consensus_queue.cc:260] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.316460 21055 ts_tablet_manager.cc:1428] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260812 19:26:22.318912 21060 raft_consensus.cc:348] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.319687 21060 raft_consensus.cc:374] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.319960 21060 raft_consensus.cc:729] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.320634 21060 consensus_queue.cc:260] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.322279 21060 ts_tablet_manager.cc:1428] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.001s
I20260812 19:26:22.324887 21055 tablet_bootstrap.cc:492] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:22.333845 21055 tablet_bootstrap.cc:654] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:22.336180 21060 tablet_bootstrap.cc:492] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:22.343423 21058 tablet_bootstrap.cc:492] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:22.378733 21376 raft_consensus.cc:504] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.400436 21061 tablet_bootstrap.cc:492] T 27a1c1554b2d44ec849b89e817bd0a12 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:22.408033 21061 ts_tablet_manager.cc:1397] T 27a1c1554b2d44ec849b89e817bd0a12 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.123s	user 0.022s	sys 0.027s
I20260812 19:26:22.400266 21057 raft_consensus.cc:482] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:22.413228 21057 raft_consensus.cc:504] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.414865 21060 tablet_bootstrap.cc:654] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:22.415495 21057 leader_election.cc:288] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:22.415380 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6cd88a19cf44aeabbec6b1d8e76630" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:22.416191 20742 raft_consensus.cc:3037] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:22.383360 21376 leader_election.cc:288] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
W20260812 19:26:22.371096 20918 leader_election.cc:341] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:22.424603 21058 tablet_bootstrap.cc:654] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:22.429931 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebcc2cf4057a4c8e82b0ee3dc8481257" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:22.439026 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebcc2cf4057a4c8e82b0ee3dc8481257" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:22.439841 20745 raft_consensus.cc:2454] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:22.442528 21377 consensus_queue.cc:1035] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:22.443835 21191 raft_consensus.cc:504] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:22.445937 21191 leader_election.cc:288] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
W20260812 19:26:22.446437 20565 leader_election.cc:341] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:22.447502 21055 tablet_bootstrap.cc:492] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:22.447583 20570 leader_election.cc:302] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:22.448076 21055 ts_tablet_manager.cc:1397] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.123s	user 0.022s	sys 0.025s
I20260812 19:26:22.450421 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8732d4883dce4b7d97faf3669bdbb006" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
W20260812 19:26:22.441903 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 72128.4us
I20260812 19:26:22.452401 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6cd88a19cf44aeabbec6b1d8e76630" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:22.454770 20630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8732d4883dce4b7d97faf3669bdbb006" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:22.455541 20630 raft_consensus.cc:3037] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:22.458868 20691 leader_election.cc:341] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:22.468333 21061 raft_consensus.cc:348] T 27a1c1554b2d44ec849b89e817bd0a12 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.469177 21061 raft_consensus.cc:374] T 27a1c1554b2d44ec849b89e817bd0a12 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.469447 21061 raft_consensus.cc:729] T 27a1c1554b2d44ec849b89e817bd0a12 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.473178 21057 raft_consensus.cc:2781] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:22.475687 21057 raft_consensus.cc:482] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:22.477559 21093 raft_consensus.cc:482] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:22.481316 21093 raft_consensus.cc:504] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.482846 21060 tablet_bootstrap.cc:492] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:22.483405 21060 ts_tablet_manager.cc:1397] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.147s	user 0.011s	sys 0.008s
I20260812 19:26:22.483929 21057 raft_consensus.cc:3037] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:22.485616 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:22.487214 21055 raft_consensus.cc:348] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.483656 21093 leader_election.cc:288] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:22.478621 21080 consensus_queue.cc:1035] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:26:22.479846 20918 leader_election.cc:341] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:22.490940 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:22.491670 20861 raft_consensus.cc:2454] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 2.
I20260812 19:26:22.492195 20742 raft_consensus.cc:2454] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:22.496086 20922 leader_election.cc:302] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:22.486253 21060 raft_consensus.cc:348] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.497567 21060 raft_consensus.cc:374] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.497643 21093 raft_consensus.cc:2781] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:22.470284 21061 consensus_queue.cc:260] T 27a1c1554b2d44ec849b89e817bd0a12 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.478294 21058 tablet_bootstrap.cc:492] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:22.511174 21058 ts_tablet_manager.cc:1397] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.176s	user 0.019s	sys 0.004s
I20260812 19:26:22.512010 21093 raft_consensus.cc:686] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:22.497892 20630 raft_consensus.cc:2454] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:22.488016 21055 raft_consensus.cc:374] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.497896 21060 raft_consensus.cc:729] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.516803 21055 raft_consensus.cc:729] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.516319 21061 ts_tablet_manager.cc:1428] T 27a1c1554b2d44ec849b89e817bd0a12 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.001s
I20260812 19:26:22.518985 20691 leader_election.cc:302] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:22.521006 21191 raft_consensus.cc:2781] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:22.520731 21093 consensus_queue.cc:237] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.521862 21191 raft_consensus.cc:686] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:22.525035 21191 consensus_queue.cc:237] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:22.521668 21060 consensus_queue.cc:260] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.531720 21061 tablet_bootstrap.cc:492] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:22.517717 21055 consensus_queue.cc:260] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.538723 21080 raft_consensus.cc:482] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:22.541461 21060 ts_tablet_manager.cc:1428] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.005s
I20260812 19:26:22.541873 21080 raft_consensus.cc:504] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:22.542948 21060 tablet_bootstrap.cc:492] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:22.544165 21080 leader_election.cc:288] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:22.545135 20630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6155c47e884e43498e968f83072b863a" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:22.546880 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6155c47e884e43498e968f83072b863a" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:22.547554 21057 raft_consensus.cc:504] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.549088 20815 leader_election.cc:302] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:22.552738 21055 ts_tablet_manager.cc:1428] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.000s
I20260812 19:26:22.566329 21055 tablet_bootstrap.cc:492] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:22.551255 21057 leader_election.cc:288] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:22.550923 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebcc2cf4057a4c8e82b0ee3dc8481257" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:22.569146 20985 raft_consensus.cc:3037] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:22.555174 20918 leader_election.cc:302] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: efc1471911ec442396b400eed9d18036
I20260812 19:26:22.572281 21058 raft_consensus.cc:348] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.573342 21306 raft_consensus.cc:2781] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:26:22.573541 21058 raft_consensus.cc:374] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.573827 21306 raft_consensus.cc:482] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:22.574095 21058 raft_consensus.cc:729] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.574294 21306 raft_consensus.cc:3037] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:22.576349 21060 tablet_bootstrap.cc:654] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:22.550887 21253 consensus_queue.cc:1035] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260812 19:26:22.551162 21080 raft_consensus.cc:2726] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:22.550972 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebcc2cf4057a4c8e82b0ee3dc8481257" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:22.586090 20740 raft_consensus.cc:3037] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:22.594345 21055 tablet_bootstrap.cc:654] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:22.594933 21253 raft_consensus.cc:482] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:22.577447 21058 consensus_queue.cc:260] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.618602 21058 ts_tablet_manager.cc:1428] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.102s	user 0.009s	sys 0.000s
I20260812 19:26:22.639073 21058 tablet_bootstrap.cc:492] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:22.613920 21191 raft_consensus.cc:482] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:22.641832 21376 consensus_queue.cc:1035] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:22.612811 21253 raft_consensus.cc:504] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.655543 20855 raft_consensus.cc:3037] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:22.674052 21061 tablet_bootstrap.cc:654] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:22.663489 21080 raft_consensus.cc:482] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:22.649109 21191 raft_consensus.cc:504] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.679446 21080 raft_consensus.cc:504] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.688025 21080 leader_election.cc:288] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:22.690968 20740 raft_consensus.cc:2454] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:22.692444 21253 leader_election.cc:288] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:22.662329 21093 consensus_queue.cc:1035] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260812 19:26:22.696417 21306 raft_consensus.cc:504] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.697372 21058 tablet_bootstrap.cc:654] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:22.700421 21422 raft_consensus.cc:482] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d5ab425bcd82426387b1a5b02e55b64c)
I20260812 19:26:22.715744 20456 catalog_manager.cc:5495] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:22.754233 20570 leader_election.cc:302] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:22.755517 21413 raft_consensus.cc:2781] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:22.756206 21413 raft_consensus.cc:686] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:22.757185 21413 consensus_queue.cc:237] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.758255 21060 tablet_bootstrap.cc:492] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:22.758853 21060 ts_tablet_manager.cc:1397] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.216s	user 0.016s	sys 0.004s
I20260812 19:26:22.759568 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27a1c1554b2d44ec849b89e817bd0a12" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:22.760304 20740 raft_consensus.cc:2454] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:22.761715 21191 leader_election.cc:288] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:22.761755 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0af9baeb12a1400e8df29ae3d35377d5" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:22.763985 20691 leader_election.cc:341] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:22.764353 21060 raft_consensus.cc:348] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:22.770255 21060 raft_consensus.cc:374] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.770452 21060 raft_consensus.cc:729] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.771145 21060 consensus_queue.cc:260] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:22.746639 20985 raft_consensus.cc:2454] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:22.724292 21422 raft_consensus.cc:504] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.774986 20922 leader_election.cc:302] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
W20260812 19:26:22.769960 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 98647.5us
I20260812 19:26:22.792169 21060 ts_tablet_manager.cc:1428] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260812 19:26:22.793625 21060 tablet_bootstrap.cc:492] T 57c6682d61b04b799643ea1c8b687787 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:22.792819 21253 raft_consensus.cc:2781] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:22.798444 20454 catalog_manager.cc:5495] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:22.795818 21253 raft_consensus.cc:482] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:22.800343 21306 leader_election.cc:288] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:22.800458 21253 raft_consensus.cc:3037] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:22.801564 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57c6682d61b04b799643ea1c8b687787" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:22.809065 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27a1c1554b2d44ec849b89e817bd0a12" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:22.809871 20856 raft_consensus.cc:2454] T 27a1c1554b2d44ec849b89e817bd0a12 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:22.802325 20745 raft_consensus.cc:2454] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:22.812103 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:22.812891 20740 raft_consensus.cc:3037] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:26:22.813597 21058 tablet_bootstrap.cc:492] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:22.814123 21058 ts_tablet_manager.cc:1397] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.194s	user 0.020s	sys 0.010s
I20260812 19:26:22.817698 21428 raft_consensus.cc:482] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:22.818061 20815 leader_election.cc:302] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:22.818507 21254 consensus_queue.cc:1035] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:22.818192 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0af9baeb12a1400e8df29ae3d35377d5" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:22.819504 21080 raft_consensus.cc:2781] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:22.819919 21080 raft_consensus.cc:482] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:22.820278 21080 raft_consensus.cc:3037] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:22.818313 21428 raft_consensus.cc:504] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.823855 21428 leader_election.cc:288] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:22.824795 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57c6682d61b04b799643ea1c8b687787" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
W20260812 19:26:22.833186 20808 leader_election.cc:341] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:22.836423 21060 tablet_bootstrap.cc:654] T 57c6682d61b04b799643ea1c8b687787 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:22.837069 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06f6e7dcac69477a99d44c3e039f7d36" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:22.838195 21055 tablet_bootstrap.cc:492] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:22.838747 21055 ts_tablet_manager.cc:1397] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.273s	user 0.014s	sys 0.016s
W20260812 19:26:22.838887 20691 leader_election.cc:341] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:22.841424 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06f6e7dcac69477a99d44c3e039f7d36" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:22.842696 21093 consensus_queue.cc:1035] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:22.844225 21422 leader_election.cc:288] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:22.847162 21055 raft_consensus.cc:348] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:22.848068 21055 raft_consensus.cc:374] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.848408 21055 raft_consensus.cc:729] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.849139 21055 consensus_queue.cc:260] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:22.853688 21057 raft_consensus.cc:482] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:22.838603 21058 raft_consensus.cc:348] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.854233 21057 raft_consensus.cc:504] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:22.854897 21058 raft_consensus.cc:374] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.855371 21058 raft_consensus.cc:729] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.855997 21254 consensus_queue.cc:1035] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:22.856241 21058 consensus_queue.cc:260] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.857349 21057 leader_election.cc:288] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:22.858439 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:22.859134 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a15940eed3e4cfb8cf7127a2cb2f757" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:22.860631 20566 leader_election.cc:341] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:22.859169 20855 raft_consensus.cc:3037] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:22.870254 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:22.880182 21058 ts_tablet_manager.cc:1428] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.004s
I20260812 19:26:22.881623 21058 tablet_bootstrap.cc:492] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:22.884629 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a74b750f92947ff863276caab71a1df" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:22.887418 21057 raft_consensus.cc:482] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:22.872871 21061 tablet_bootstrap.cc:492] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
W20260812 19:26:22.876693 20688 leader_election.cc:341] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:22.888839 20688 leader_election.cc:302] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:22.890058 21254 raft_consensus.cc:2726] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:26:22.890558 20688 leader_election.cc:341] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:22.891139 20688 leader_election.cc:302] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:22.892441 21254 raft_consensus.cc:2726] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:22.893462 20855 raft_consensus.cc:2454] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 3.
I20260812 19:26:22.894240 21061 ts_tablet_manager.cc:1397] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.363s	user 0.030s	sys 0.011s
I20260812 19:26:22.877238 21253 raft_consensus.cc:504] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.897197 21061 raft_consensus.cc:348] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:22.897928 21061 raft_consensus.cc:374] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.898197 21061 raft_consensus.cc:729] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.901585 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a15940eed3e4cfb8cf7127a2cb2f757" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:22.902411 20745 raft_consensus.cc:2454] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:22.885670 20985 raft_consensus.cc:2354] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc1471911ec442396b400eed9d18036 for earlier term 2. Current term is 3.
I20260812 19:26:22.887952 21057 raft_consensus.cc:504] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:22.907261 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27a1c1554b2d44ec849b89e817bd0a12" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:22.908038 20745 raft_consensus.cc:3037] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:22.909037 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6cd88a19cf44aeabbec6b1d8e76630" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:22.910040 21080 raft_consensus.cc:504] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.912591 21055 ts_tablet_manager.cc:1428] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.000s
I20260812 19:26:22.913914 20740 raft_consensus.cc:2454] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 3.
I20260812 19:26:22.915267 20922 leader_election.cc:302] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:22.916290 21057 leader_election.cc:288] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:22.917987 21376 raft_consensus.cc:2781] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:26:22.918570 21376 raft_consensus.cc:686] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 3 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:22.919509 21376 consensus_queue.cc:237] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.921231 20570 leader_election.cc:302] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:22.923796 21055 tablet_bootstrap.cc:492] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
W20260812 19:26:22.933358 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 92277.5us
I20260812 19:26:22.938329 21055 tablet_bootstrap.cc:654] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:22.955422 20530 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:26:22.957047 20745 raft_consensus.cc:2454] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:22.961784 21093 raft_consensus.cc:482] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:22.962589 21253 leader_election.cc:288] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:22.962373 21093 raft_consensus.cc:504] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:22.966144 21093 leader_election.cc:288] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:22.923151 21057 raft_consensus.cc:2781] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:22.967176 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57c6682d61b04b799643ea1c8b687787" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:22.967365 20453 catalog_manager.cc:5495] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:22.968492 20740 raft_consensus.cc:3037] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:22.969498 21060 tablet_bootstrap.cc:492] T 57c6682d61b04b799643ea1c8b687787 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:22.970131 21060 ts_tablet_manager.cc:1397] T 57c6682d61b04b799643ea1c8b687787 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.177s	user 0.036s	sys 0.055s
I20260812 19:26:22.967496 21057 raft_consensus.cc:482] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:22.979010 21058 tablet_bootstrap.cc:654] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:22.979732 21061 consensus_queue.cc:260] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:22.983956 21060 raft_consensus.cc:348] T 57c6682d61b04b799643ea1c8b687787 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.986824 21060 raft_consensus.cc:374] T 57c6682d61b04b799643ea1c8b687787 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:22.987159 21060 raft_consensus.cc:729] T 57c6682d61b04b799643ea1c8b687787 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:22.987985 21060 consensus_queue.cc:260] T 57c6682d61b04b799643ea1c8b687787 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.984724 21057 raft_consensus.cc:3037] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:22.986601 21292 raft_consensus.cc:482] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:22.990358 20688 leader_election.cc:398] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307) with higher term. Message: Invalid argument: T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc1471911ec442396b400eed9d18036 for earlier term 2. Current term is 3.
I20260812 19:26:22.992722 21060 ts_tablet_manager.cc:1428] T 57c6682d61b04b799643ea1c8b687787 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260812 19:26:22.993832 21060 tablet_bootstrap.cc:492] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:22.992944 20688 leader_election.cc:401] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 19:26:23.000056 21055 tablet_bootstrap.cc:492] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:23.000553 21055 ts_tablet_manager.cc:1397] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.077s	user 0.020s	sys 0.004s
I20260812 19:26:22.988432 20922 leader_election.cc:302] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:23.003486 21454 raft_consensus.cc:2781] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:23.003832 21430 raft_consensus.cc:2726] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307) with higher term. Message: Invalid argument: T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc1471911ec442396b400eed9d18036 for earlier term 2. Current term is 3.
I20260812 19:26:23.004040 21454 raft_consensus.cc:686] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:23.005093 21454 consensus_queue.cc:237] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:22.993618 21292 raft_consensus.cc:504] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:23.006800 21093 consensus_queue.cc:1035] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:22.995272 21080 leader_election.cc:288] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:23.010128 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27a1c1554b2d44ec849b89e817bd0a12" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:23.010946 20855 raft_consensus.cc:3037] T 27a1c1554b2d44ec849b89e817bd0a12 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.012766 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6cd88a19cf44aeabbec6b1d8e76630" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:23.014870 20745 raft_consensus.cc:2379] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 171f67787a8348fb9c7b19bf09026039 in current term 1: Already voted for candidate d5ab425bcd82426387b1a5b02e55b64c in this term.
I20260812 19:26:23.016233 21055 raft_consensus.cc:348] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:23.016911 21055 raft_consensus.cc:374] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.014382 21292 leader_election.cc:288] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:23.017156 21055 raft_consensus.cc:729] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.022970 20570 leader_election.cc:302] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
I20260812 19:26:23.033578 21061 ts_tablet_manager.cc:1428] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.139s	user 0.004s	sys 0.007s
I20260812 19:26:23.033735 21413 raft_consensus.cc:3037] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.023315 21428 raft_consensus.cc:482] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:23.034464 21428 raft_consensus.cc:504] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:23.037024 21428 leader_election.cc:288] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:23.038915 20740 raft_consensus.cc:2454] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:23.040930 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d3279bf00462799704042e3cb3966" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:23.041796 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d3279bf00462799704042e3cb3966" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:23.043020 20688 leader_election.cc:341] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:23.043248 21413 raft_consensus.cc:2726] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:23.024714 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67cee93c25424387a17659df99d3ad3d" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:23.028947 20855 raft_consensus.cc:2454] T 27a1c1554b2d44ec849b89e817bd0a12 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
W20260812 19:26:23.045969 20691 leader_election.cc:341] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:23.046342 21055 consensus_queue.cc:260] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:23.046907 20815 leader_election.cc:302] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:23.050364 21462 raft_consensus.cc:2781] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:23.050971 21462 raft_consensus.cc:686] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:23.051936 21462 consensus_queue.cc:237] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:23.052606 21055 ts_tablet_manager.cc:1428] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260812 19:26:23.054131 21055 tablet_bootstrap.cc:492] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:23.057201 21061 tablet_bootstrap.cc:492] T 0af9baeb12a1400e8df29ae3d35377d5 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:23.058930 21060 tablet_bootstrap.cc:654] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.056069 20691 leader_election.cc:302] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:23.069053 21430 raft_consensus.cc:2726] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:23.069541 21055 tablet_bootstrap.cc:654] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.056919 20636 raft_consensus.cc:2454] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:23.087612 21061 tablet_bootstrap.cc:654] T 0af9baeb12a1400e8df29ae3d35377d5 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.088835 20812 leader_election.cc:302] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:23.090204 21292 raft_consensus.cc:2781] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:23.090795 21292 raft_consensus.cc:482] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:23.091215 21292 raft_consensus.cc:3037] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.099083 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67cee93c25424387a17659df99d3ad3d" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:23.099936 20637 raft_consensus.cc:2454] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:23.106380 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67cee93c25424387a17659df99d3ad3d" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:23.106745 21058 tablet_bootstrap.cc:492] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:23.107394 21058 ts_tablet_manager.cc:1397] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.226s	user 0.029s	sys 0.003s
I20260812 19:26:23.107311 20986 raft_consensus.cc:2454] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:23.108561 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57c6682d61b04b799643ea1c8b687787" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:23.109316 20984 raft_consensus.cc:3037] T 57c6682d61b04b799643ea1c8b687787 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.110565 21058 raft_consensus.cc:348] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:23.111363 21058 raft_consensus.cc:374] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.111634 21058 raft_consensus.cc:729] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
W20260812 19:26:23.125046 20691 consensus_peers.cc:487] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:23.127923 20984 raft_consensus.cc:2454] T 57c6682d61b04b799643ea1c8b687787 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:23.112323 21058 consensus_queue.cc:260] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:23.116179 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67cee93c25424387a17659df99d3ad3d" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:23.131712 20451 catalog_manager.cc:5495] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:23.133414 20451 catalog_manager.cc:5495] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:23.135107 21058 ts_tablet_manager.cc:1428] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260812 19:26:23.136088 21058 tablet_bootstrap.cc:492] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:23.122238 21057 raft_consensus.cc:504] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.150648 21428 consensus_queue.cc:1035] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:23.152303 21292 raft_consensus.cc:504] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:23.165530 21462 raft_consensus.cc:482] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:23.166249 21462 raft_consensus.cc:504] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:23.171339 21055 tablet_bootstrap.cc:492] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:23.171973 21055 ts_tablet_manager.cc:1397] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.118s	user 0.020s	sys 0.022s
I20260812 19:26:23.175297 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb6b294d38f46c994858d9de86da083" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:23.176200 20745 raft_consensus.cc:2454] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:23.177443 20815 leader_election.cc:302] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:23.177989 21058 tablet_bootstrap.cc:654] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.178465 21080 raft_consensus.cc:2781] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:23.178931 21080 raft_consensus.cc:482] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:23.179291 21080 raft_consensus.cc:3037] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:23.194016 20855 raft_consensus.cc:2379] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d5ab425bcd82426387b1a5b02e55b64c in current term 1: Already voted for candidate 8c9e33eee61649e18fe397e56bdddea3 in this term.
I20260812 19:26:23.195327 21055 raft_consensus.cc:348] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.196430 21055 raft_consensus.cc:374] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.196732 21055 raft_consensus.cc:729] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.196895 21058 tablet_bootstrap.cc:492] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:23.197574 21058 ts_tablet_manager.cc:1397] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.001s
I20260812 19:26:23.200958 21057 leader_election.cc:288] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:23.203152 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a15940eed3e4cfb8cf7127a2cb2f757" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:23.196082 21080 raft_consensus.cc:504] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:23.198177 21055 consensus_queue.cc:260] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.233938 21061 tablet_bootstrap.cc:492] T 0af9baeb12a1400e8df29ae3d35377d5 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:23.236049 21292 leader_election.cc:288] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:23.235873 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a15940eed3e4cfb8cf7127a2cb2f757" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:23.251551 21055 ts_tablet_manager.cc:1428] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.079s	user 0.010s	sys 0.003s
I20260812 19:26:23.235162 21061 ts_tablet_manager.cc:1397] T 0af9baeb12a1400e8df29ae3d35377d5 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.186s	user 0.018s	sys 0.026s
I20260812 19:26:23.239517 21080 leader_election.cc:288] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:23.241189 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb6b294d38f46c994858d9de86da083" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:23.253784 20740 raft_consensus.cc:3037] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:23.257927 21058 raft_consensus.cc:348] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.258778 21058 raft_consensus.cc:374] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.259055 21058 raft_consensus.cc:729] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.260968 21058 consensus_queue.cc:260] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.243655 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67cee93c25424387a17659df99d3ad3d" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:23.252707 21055 tablet_bootstrap.cc:492] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:23.233482 21462 leader_election.cc:288] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:23.264793 21428 raft_consensus.cc:482] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:23.266328 20637 raft_consensus.cc:3037] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.266719 21428 raft_consensus.cc:504] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:23.268859 21428 leader_election.cc:288] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:23.270747 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200fb82ae5174fb184b44b3ea6f39a59" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:23.272493 20691 leader_election.cc:341] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:23.263418 21061 raft_consensus.cc:348] T 0af9baeb12a1400e8df29ae3d35377d5 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
W20260812 19:26:23.266137 20566 leader_election.cc:341] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:23.234980 20745 raft_consensus.cc:3037] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.273973 21061 raft_consensus.cc:374] T 0af9baeb12a1400e8df29ae3d35377d5 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.274580 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200fb82ae5174fb184b44b3ea6f39a59" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:23.278687 21058 ts_tablet_manager.cc:1428] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.000s
I20260812 19:26:23.279372 21061 raft_consensus.cc:729] T 0af9baeb12a1400e8df29ae3d35377d5 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.279759 21058 tablet_bootstrap.cc:492] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:23.280201 21061 consensus_queue.cc:260] T 0af9baeb12a1400e8df29ae3d35377d5 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:23.283484 21061 ts_tablet_manager.cc:1428] T 0af9baeb12a1400e8df29ae3d35377d5 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260812 19:26:23.284533 21061 tablet_bootstrap.cc:492] T 8732d4883dce4b7d97faf3669bdbb006 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:23.277213 21055 tablet_bootstrap.cc:654] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.277388 21413 consensus_queue.cc:1035] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:23.235144 20918 leader_election.cc:302] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:23.285356 21060 tablet_bootstrap.cc:492] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:23.290970 21060 ts_tablet_manager.cc:1397] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.297s	user 0.017s	sys 0.012s
I20260812 19:26:23.277426 20637 raft_consensus.cc:2454] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:23.276723 20740 raft_consensus.cc:2454] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 2.
I20260812 19:26:23.295013 21253 raft_consensus.cc:2781] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:23.295524 21253 raft_consensus.cc:482] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:23.295222 21060 raft_consensus.cc:348] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.295915 21253 raft_consensus.cc:3037] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.296103 21060 raft_consensus.cc:374] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.296504 21060 raft_consensus.cc:729] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.297191 21060 consensus_queue.cc:260] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.302246 21060 ts_tablet_manager.cc:1428] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
W20260812 19:26:23.301947 20688 leader_election.cc:341] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:23.303294 21060 tablet_bootstrap.cc:492] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:23.303547 20688 leader_election.cc:302] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:23.311328 20454 catalog_manager.cc:5495] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:23.314132 21058 tablet_bootstrap.cc:654] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.315995 20812 leader_election.cc:302] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:23.317261 21462 raft_consensus.cc:2781] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:23.317842 21462 raft_consensus.cc:686] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:23.319123 21462 consensus_queue.cc:237] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:23.319315 21253 raft_consensus.cc:504] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:23.321174 21060 tablet_bootstrap.cc:654] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.321645 21253 leader_election.cc:288] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:23.333967 21061 tablet_bootstrap.cc:654] T 8732d4883dce4b7d97faf3669bdbb006 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:23.293666 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 61654.3us
I20260812 19:26:23.329627 21422 raft_consensus.cc:2726] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:23.349287 21058 tablet_bootstrap.cc:492] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:23.349956 21058 ts_tablet_manager.cc:1397] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.002s
I20260812 19:26:23.354871 20745 raft_consensus.cc:2454] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:23.357539 21055 tablet_bootstrap.cc:492] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:23.359913 20815 leader_election.cc:302] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:23.345057 21253 consensus_queue.cc:1035] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260812 19:26:23.360992 21462 raft_consensus.cc:2781] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:23.360333 21055 ts_tablet_manager.cc:1397] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.108s	user 0.008s	sys 0.007s
I20260812 19:26:23.361856 21462 raft_consensus.cc:686] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:23.363094 21462 consensus_queue.cc:237] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:23.365705 21253 raft_consensus.cc:482] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:23.366389 21253 raft_consensus.cc:504] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.369464 21253 leader_election.cc:288] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:23.365046 21055 raft_consensus.cc:348] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.370548 21055 raft_consensus.cc:374] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.372313 21055 raft_consensus.cc:729] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.373368 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67cee93c25424387a17659df99d3ad3d" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:23.374228 21055 consensus_queue.cc:260] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.373063 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25f274ac8f124e7697711e0afcd0b058" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:23.375880 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67cee93c25424387a17659df99d3ad3d" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:23.376780 20636 raft_consensus.cc:2379] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d5ab425bcd82426387b1a5b02e55b64c in current term 1: Already voted for candidate 8c9e33eee61649e18fe397e56bdddea3 in this term.
I20260812 19:26:23.378574 21055 ts_tablet_manager.cc:1428] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260812 19:26:23.380143 21055 tablet_bootstrap.cc:492] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:23.383142 20570 leader_election.cc:302] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:23.383375 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67cee93c25424387a17659df99d3ad3d" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:23.384227 20986 raft_consensus.cc:2379] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c9e33eee61649e18fe397e56bdddea3 in current term 1: Already voted for candidate d5ab425bcd82426387b1a5b02e55b64c in this term.
I20260812 19:26:23.384505 21413 consensus_queue.cc:1035] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:23.385972 21413 raft_consensus.cc:2781] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:23.386441 21413 raft_consensus.cc:686] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:23.387126 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb6b294d38f46c994858d9de86da083" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:23.387838 20986 raft_consensus.cc:2454] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:23.388051 21413 consensus_queue.cc:237] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.390089 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb6b294d38f46c994858d9de86da083" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:23.390959 20986 raft_consensus.cc:3037] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:23.394204 21060 tablet_bootstrap.cc:492] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:23.396353 21060 ts_tablet_manager.cc:1397] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.005s
W20260812 19:26:23.403276 21495 log.cc:924] Time spent T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c: Append to log took a long time: real 0.056s	user 0.001s	sys 0.003s
I20260812 19:26:23.406093 21060 raft_consensus.cc:348] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:23.408388 21060 raft_consensus.cc:374] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.408806 21060 raft_consensus.cc:729] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.407053 20454 catalog_manager.cc:5495] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:23.421150 21058 raft_consensus.cc:348] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.422626 21058 raft_consensus.cc:374] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.409739 21060 consensus_queue.cc:260] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:23.423298 21058 raft_consensus.cc:729] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.433625 21060 ts_tablet_manager.cc:1428] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260812 19:26:23.432842 21108 raft_consensus.cc:482] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:23.434531 21108 raft_consensus.cc:504] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.436698 21108 leader_election.cc:288] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:23.437001 20986 raft_consensus.cc:2454] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 2.
I20260812 19:26:23.437458 20745 raft_consensus.cc:1261] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Refusing update from remote peer d5ab425bcd82426387b1a5b02e55b64c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:26:23.440774 21376 consensus_queue.cc:1035] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:23.442734 20630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25f274ac8f124e7697711e0afcd0b058" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:23.446240 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:23.453545 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:23.456900 20918 leader_election.cc:302] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
W20260812 19:26:23.458115 20566 leader_election.cc:341] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:23.464618 21454 raft_consensus.cc:2726] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:26:23.465613 21454 raft_consensus.cc:482] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:23.466210 21454 raft_consensus.cc:504] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:23.468598 21060 tablet_bootstrap.cc:492] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:23.471491 21055 tablet_bootstrap.cc:654] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.430449 21058 consensus_queue.cc:260] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.475782 20739 raft_consensus.cc:2454] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:23.475533 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0af9baeb12a1400e8df29ae3d35377d5" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:23.476526 21454 leader_election.cc:288] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:23.476838 20745 raft_consensus.cc:2454] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:23.478096 20922 leader_election.cc:302] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:23.478204 20570 leader_election.cc:302] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:23.479013 21454 raft_consensus.cc:2781] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:23.479130 20918 leader_election.cc:302] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:23.479435 21454 raft_consensus.cc:482] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:23.479805 21454 raft_consensus.cc:3037] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.479985 21253 raft_consensus.cc:2726] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:23.480067 21057 raft_consensus.cc:2781] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:23.480723 21057 raft_consensus.cc:482] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:23.481138 21057 raft_consensus.cc:3037] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.481739 21254 raft_consensus.cc:482] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:23.485949 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0af9baeb12a1400e8df29ae3d35377d5" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:23.486788 20856 raft_consensus.cc:2454] T 0af9baeb12a1400e8df29ae3d35377d5 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:23.482239 21254 raft_consensus.cc:504] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.487792 21253 consensus_queue.cc:1035] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:23.489763 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e5c58cd31f4eb8bd9092458140299a" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:23.495138 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e5c58cd31f4eb8bd9092458140299a" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
W20260812 19:26:23.495636 20688 leader_election.cc:341] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:23.495960 20637 raft_consensus.cc:2454] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:23.484479 20453 catalog_manager.cc:5495] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:23.497603 20691 leader_election.cc:302] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:23.499487 21254 leader_election.cc:288] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:23.502938 20451 catalog_manager.cc:5495] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 0 to 2, leader changed from <none> to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:23.506232 21428 raft_consensus.cc:2781] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:23.506748 21428 raft_consensus.cc:482] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:23.506970 20855 raft_consensus.cc:1261] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Refusing update from remote peer d5ab425bcd82426387b1a5b02e55b64c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:26:23.507128 21428 raft_consensus.cc:3037] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.516690 21093 consensus_queue.cc:1035] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:23.520808 21428 raft_consensus.cc:504] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.523487 21058 ts_tablet_manager.cc:1428] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.173s	user 0.010s	sys 0.000s
I20260812 19:26:23.530682 21058 tablet_bootstrap.cc:492] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:23.530771 21060 tablet_bootstrap.cc:654] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.528398 21061 tablet_bootstrap.cc:492] T 8732d4883dce4b7d97faf3669bdbb006 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:23.533987 21061 ts_tablet_manager.cc:1397] T 8732d4883dce4b7d97faf3669bdbb006 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.250s	user 0.040s	sys 0.058s
I20260812 19:26:23.537041 21061 raft_consensus.cc:348] T 8732d4883dce4b7d97faf3669bdbb006 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.537756 21061 raft_consensus.cc:374] T 8732d4883dce4b7d97faf3669bdbb006 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.538024 21061 raft_consensus.cc:729] T 8732d4883dce4b7d97faf3669bdbb006 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.538730 21061 consensus_queue.cc:260] T 8732d4883dce4b7d97faf3669bdbb006 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.540952 21061 ts_tablet_manager.cc:1428] T 8732d4883dce4b7d97faf3669bdbb006 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260812 19:26:23.541990 21061 tablet_bootstrap.cc:492] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:23.526950 21057 raft_consensus.cc:504] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.552220 21055 tablet_bootstrap.cc:492] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:23.553107 21055 ts_tablet_manager.cc:1397] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.173s	user 0.012s	sys 0.004s
I20260812 19:26:23.541000 21454 raft_consensus.cc:504] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:23.559482 20861 raft_consensus.cc:3037] T 8732d4883dce4b7d97faf3669bdbb006 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.561012 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:23.561771 20745 raft_consensus.cc:3037] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.562382 21454 leader_election.cc:288] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:23.575894 20858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0af9baeb12a1400e8df29ae3d35377d5" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:23.576628 20858 raft_consensus.cc:3037] T 0af9baeb12a1400e8df29ae3d35377d5 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.577225 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e5c58cd31f4eb8bd9092458140299a" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:23.577957 20637 raft_consensus.cc:3037] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.582775 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e5c58cd31f4eb8bd9092458140299a" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:23.584625 20858 raft_consensus.cc:2454] T 0af9baeb12a1400e8df29ae3d35377d5 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
W20260812 19:26:23.588492 20688 leader_election.cc:341] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:23.589301 21454 consensus_queue.cc:1035] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:23.591205 20918 leader_election.cc:302] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:23.594501 21093 raft_consensus.cc:2781] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:23.595222 21093 raft_consensus.cc:686] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:23.596496 20637 raft_consensus.cc:2454] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:23.596511 21093 consensus_queue.cc:237] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:23.600607 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:23.601070 21061 tablet_bootstrap.cc:654] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.601807 20745 raft_consensus.cc:2454] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
W20260812 19:26:23.602386 20566 leader_election.cc:341] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:23.608481 21060 tablet_bootstrap.cc:492] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:23.609114 21060 ts_tablet_manager.cc:1397] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.141s	user 0.005s	sys 0.007s
I20260812 19:26:23.611084 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0af9baeb12a1400e8df29ae3d35377d5" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:23.611814 20740 raft_consensus.cc:3037] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.598014 20691 leader_election.cc:302] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:23.612800 21254 raft_consensus.cc:2781] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:23.613314 21254 raft_consensus.cc:686] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:23.597982 21057 leader_election.cc:288] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:23.611580 20570 leader_election.cc:302] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:23.614183 21254 consensus_queue.cc:237] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.614789 21058 tablet_bootstrap.cc:654] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.614599 21413 raft_consensus.cc:2781] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:23.598620 21428 leader_election.cc:288] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:23.616762 21413 raft_consensus.cc:686] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:23.617749 21413 consensus_queue.cc:237] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.618881 21055 raft_consensus.cc:348] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:23.619755 21055 raft_consensus.cc:374] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.620016 21055 raft_consensus.cc:729] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.622581 21060 raft_consensus.cc:348] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.623420 21060 raft_consensus.cc:374] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.623696 21060 raft_consensus.cc:729] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.620862 21055 consensus_queue.cc:260] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:23.627564 21055 ts_tablet_manager.cc:1428] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260812 19:26:23.628495 21055 tablet_bootstrap.cc:492] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:23.629551 20984 raft_consensus.cc:3037] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.635380 21058 tablet_bootstrap.cc:492] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:23.636075 21058 ts_tablet_manager.cc:1397] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.106s	user 0.010s	sys 0.002s
I20260812 19:26:23.624462 21060 consensus_queue.cc:260] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.644537 21060 ts_tablet_manager.cc:1428] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.005s
I20260812 19:26:23.645864 21058 raft_consensus.cc:348] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.644594 21055 tablet_bootstrap.cc:654] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.647002 21058 raft_consensus.cc:374] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.646828 21462 consensus_queue.cc:1035] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:23.647428 21058 raft_consensus.cc:729] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.649541 21058 consensus_queue.cc:260] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.645831 21060 tablet_bootstrap.cc:492] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:23.658305 21061 tablet_bootstrap.cc:492] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:23.659164 21061 ts_tablet_manager.cc:1397] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.117s	user 0.015s	sys 0.003s
I20260812 19:26:23.663780 21058 ts_tablet_manager.cc:1428] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.004s
I20260812 19:26:23.665324 21058 tablet_bootstrap.cc:492] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:23.677783 20740 raft_consensus.cc:2454] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:23.680105 21061 raft_consensus.cc:348] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.683543 21058 tablet_bootstrap.cc:654] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.684420 20453 catalog_manager.cc:5495] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:23.687510 21055 tablet_bootstrap.cc:492] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:23.688251 21055 ts_tablet_manager.cc:1397] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.000s
I20260812 19:26:23.690997 21462 consensus_queue.cc:1035] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:23.692204 20451 catalog_manager.cc:5495] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:23.695094 21060 tablet_bootstrap.cc:654] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.695437 21061 raft_consensus.cc:374] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.695981 21061 raft_consensus.cc:729] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.696724 21061 consensus_queue.cc:260] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.703276 20454 catalog_manager.cc:5495] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:23.706120 21061 ts_tablet_manager.cc:1428] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260812 19:26:23.707231 21061 tablet_bootstrap.cc:492] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:23.713632 21061 tablet_bootstrap.cc:654] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.723466 21055 raft_consensus.cc:348] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.724057 21055 raft_consensus.cc:374] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.724231 21055 raft_consensus.cc:729] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.726001 21055 consensus_queue.cc:260] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.728045 21093 raft_consensus.cc:482] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:26:23.744140 21533 log.cc:924] Time spent T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260812 19:26:23.744366 21093 raft_consensus.cc:504] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.747830 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e5c58cd31f4eb8bd9092458140299a" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:23.747958 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e5c58cd31f4eb8bd9092458140299a" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:23.748687 20637 raft_consensus.cc:2379] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d5ab425bcd82426387b1a5b02e55b64c in current term 1: Already voted for candidate efc1471911ec442396b400eed9d18036 in this term.
I20260812 19:26:23.749831 20918 leader_election.cc:302] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:23.743021 21055 ts_tablet_manager.cc:1428] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260812 19:26:23.751622 21055 tablet_bootstrap.cc:492] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:23.752458 21093 leader_election.cc:288] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:23.761422 21292 consensus_queue.cc:1035] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:23.767694 21376 raft_consensus.cc:3037] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.776939 21058 tablet_bootstrap.cc:492] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:23.777550 21058 ts_tablet_manager.cc:1397] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.113s	user 0.006s	sys 0.020s
I20260812 19:26:23.789139 20861 raft_consensus.cc:3037] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.792400 21254 raft_consensus.cc:482] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:23.793093 21254 raft_consensus.cc:504] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.796746 21060 tablet_bootstrap.cc:492] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:23.797266 21060 ts_tablet_manager.cc:1397] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.152s	user 0.007s	sys 0.011s
I20260812 19:26:23.802227 21058 raft_consensus.cc:348] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.803002 21058 raft_consensus.cc:374] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.803243 21058 raft_consensus.cc:729] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.807363 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85e5e41bf96447d7a761378c54e8abff" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:23.808369 21254 leader_election.cc:288] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
W20260812 19:26:23.809489 20691 leader_election.cc:341] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:23.812091 20745 raft_consensus.cc:1261] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Refusing update from remote peer 8c9e33eee61649e18fe397e56bdddea3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260812 19:26:23.814133 21080 consensus_queue.cc:1035] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:23.814823 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85e5e41bf96447d7a761378c54e8abff" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:23.803978 21058 consensus_queue.cc:260] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.818215 21376 raft_consensus.cc:2726] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:23.820755 21060 raft_consensus.cc:348] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.822955 21061 tablet_bootstrap.cc:492] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
W20260812 19:26:23.818841 20688 leader_election.cc:341] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:23.825757 20688 leader_election.cc:302] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:23.823496 21061 ts_tablet_manager.cc:1397] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.116s	user 0.031s	sys 0.009s
I20260812 19:26:23.818262 21055 tablet_bootstrap.cc:654] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.831204 21060 raft_consensus.cc:374] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.832880 21060 raft_consensus.cc:729] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.834829 21058 ts_tablet_manager.cc:1428] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260812 19:26:23.833500 21413 consensus_queue.cc:1035] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260812 19:26:23.836023 21428 raft_consensus.cc:2726] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:23.844944 21413 raft_consensus.cc:482] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:23.847805 21061 raft_consensus.cc:348] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.848502 21413 raft_consensus.cc:504] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.851821 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06f6e7dcac69477a99d44c3e039f7d36" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:23.852109 21413 leader_election.cc:288] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:23.857352 21080 consensus_queue.cc:1035] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:23.860915 21428 raft_consensus.cc:482] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:23.861521 21428 raft_consensus.cc:504] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.865726 20630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa08d4efbda64360a2f987aab456fb04" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:23.866966 21428 leader_election.cc:288] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
W20260812 19:26:23.867653 20691 leader_election.cc:341] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:23.869508 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa08d4efbda64360a2f987aab456fb04" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:23.869537 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06f6e7dcac69477a99d44c3e039f7d36" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:23.848632 21061 raft_consensus.cc:374] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.872617 21061 raft_consensus.cc:729] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.873786 21060 consensus_queue.cc:260] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.875936 21061 consensus_queue.cc:260] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:23.876586 21058 tablet_bootstrap.cc:492] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:23.879930 20740 raft_consensus.cc:2454] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:23.887306 21060 ts_tablet_manager.cc:1428] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.090s	user 0.004s	sys 0.005s
I20260812 19:26:23.888717 21060 tablet_bootstrap.cc:492] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:23.891492 21061 ts_tablet_manager.cc:1428] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.001s
I20260812 19:26:23.878756 20984 raft_consensus.cc:2454] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:23.883841 20986 raft_consensus.cc:1261] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Refusing update from remote peer 8c9e33eee61649e18fe397e56bdddea3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260812 19:26:23.893128 20691 leader_election.cc:341] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:23.902767 20691 leader_election.cc:302] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:23.903913 21428 raft_consensus.cc:2726] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:23.907445 21462 consensus_queue.cc:1035] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:23.899876 20570 leader_election.cc:302] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:23.910555 21413 raft_consensus.cc:2781] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:23.913205 21057 raft_consensus.cc:482] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:23.917315 21415 consensus_queue.cc:1035] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:23.913926 21057 raft_consensus.cc:504] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:23.921649 21057 leader_election.cc:288] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:23.926328 21058 tablet_bootstrap.cc:654] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.926498 21055 tablet_bootstrap.cc:492] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:23.927075 21055 ts_tablet_manager.cc:1397] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.176s	user 0.014s	sys 0.000s
I20260812 19:26:23.911022 21413 raft_consensus.cc:482] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:23.927793 21413 raft_consensus.cc:3037] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:23.929662 21061 tablet_bootstrap.cc:492] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:23.927191 21060 tablet_bootstrap.cc:654] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.935714 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2a274b81b0d4079852b8b1ea7c7592a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:23.936553 21055 raft_consensus.cc:348] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:23.938526 21055 raft_consensus.cc:374] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:23.938859 21055 raft_consensus.cc:729] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:23.939579 21055 consensus_queue.cc:260] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
W20260812 19:26:23.939906 20565 leader_election.cc:341] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:23.941880 21055 ts_tablet_manager.cc:1428] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260812 19:26:23.942979 21055 tablet_bootstrap.cc:492] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:23.952091 21061 tablet_bootstrap.cc:654] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.967414 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2a274b81b0d4079852b8b1ea7c7592a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:23.989867 21055 tablet_bootstrap.cc:654] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:23.992969 21413 raft_consensus.cc:504] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:23.995283 21413 leader_election.cc:288] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:23.996994 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06f6e7dcac69477a99d44c3e039f7d36" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:24.009644 20985 raft_consensus.cc:3037] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.015915 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06f6e7dcac69477a99d44c3e039f7d36" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:24.016687 20739 raft_consensus.cc:3037] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.024969 21060 tablet_bootstrap.cc:492] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:24.025574 21060 ts_tablet_manager.cc:1397] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.137s	user 0.009s	sys 0.004s
I20260812 19:26:24.028311 21060 raft_consensus.cc:348] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.029064 21060 raft_consensus.cc:374] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.029359 21060 raft_consensus.cc:729] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
W20260812 19:26:24.029673 20530 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:26:24.031159 21060 consensus_queue.cc:260] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
W20260812 19:26:24.036850 20566 leader_election.cc:341] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:24.039098 20566 leader_election.cc:302] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:24.040304 21415 raft_consensus.cc:2726] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:24.044286 20985 raft_consensus.cc:2454] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:24.047050 20565 leader_election.cc:302] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:24.047475 21428 consensus_queue.cc:1035] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:24.053555 20856 raft_consensus.cc:3037] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.059116 21376 consensus_queue.cc:1035] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:24.060948 21108 raft_consensus.cc:2781] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:24.062489 21108 raft_consensus.cc:686] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:24.065609 21108 consensus_queue.cc:237] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.071870 20739 raft_consensus.cc:2454] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:24.073704 21060 ts_tablet_manager.cc:1428] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.002s
I20260812 19:26:24.077196 21060 tablet_bootstrap.cc:492] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:24.092491 21376 consensus_queue.cc:1035] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:24.107643 21058 tablet_bootstrap.cc:492] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:24.108507 21058 ts_tablet_manager.cc:1397] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.234s	user 0.013s	sys 0.018s
I20260812 19:26:24.108892 21558 raft_consensus.cc:482] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:24.111640 21558 raft_consensus.cc:504] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.113916 21558 leader_election.cc:288] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:24.114989 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:24.115799 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:24.116775 20742 raft_consensus.cc:2454] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:24.120186 20815 leader_election.cc:302] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:24.121671 21108 consensus_queue.cc:1035] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:24.128928 21254 consensus_queue.cc:1035] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:24.132272 21055 tablet_bootstrap.cc:492] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:24.132882 21055 ts_tablet_manager.cc:1397] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.190s	user 0.013s	sys 0.016s
I20260812 19:26:24.135854 21055 raft_consensus.cc:348] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.136651 21055 raft_consensus.cc:374] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.136943 21055 raft_consensus.cc:729] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.139155 21055 consensus_queue.cc:260] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.141811 21055 ts_tablet_manager.cc:1428] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260812 19:26:24.142824 21055 tablet_bootstrap.cc:492] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:24.184556 21058 raft_consensus.cc:348] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.185362 21058 raft_consensus.cc:374] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.185632 21058 raft_consensus.cc:729] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.189021 21058 consensus_queue.cc:260] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.189383 21061 tablet_bootstrap.cc:492] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:24.190044 21061 ts_tablet_manager.cc:1397] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.261s	user 0.011s	sys 0.003s
I20260812 19:26:24.196966 21055 tablet_bootstrap.cc:654] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.197268 21060 tablet_bootstrap.cc:654] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.199250 21058 ts_tablet_manager.cc:1428] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.001s
I20260812 19:26:24.200317 21058 tablet_bootstrap.cc:492] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:24.201224 21556 raft_consensus.cc:2781] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:24.201640 21061 raft_consensus.cc:348] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.202703 21108 consensus_queue.cc:1035] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:24.202515 21061 raft_consensus.cc:374] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.204234 21061 raft_consensus.cc:729] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.203948 21566 raft_consensus.cc:482] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:24.205307 21566 raft_consensus.cc:504] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.208846 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0eb60aaf78c64f9ebfdb6f535cc96363" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:24.209540 20985 raft_consensus.cc:2454] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:24.212037 21428 raft_consensus.cc:482] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:24.212563 21428 raft_consensus.cc:504] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.212911 20565 leader_election.cc:302] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:24.213726 21566 leader_election.cc:288] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:24.214538 21061 consensus_queue.cc:260] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.215611 21428 leader_election.cc:288] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:24.215488 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8bf3b3e0e4c425e9d86c3e5b7a062cf" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:24.217119 20691 leader_election.cc:341] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:24.217334 21108 raft_consensus.cc:2781] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:24.217763 21108 raft_consensus.cc:482] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:24.217829 21058 tablet_bootstrap.cc:654] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.218148 21108 raft_consensus.cc:3037] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.222412 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8bf3b3e0e4c425e9d86c3e5b7a062cf" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:24.225719 21556 raft_consensus.cc:482] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:24.226336 21556 raft_consensus.cc:3037] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:26:24.231174 20688 leader_election.cc:341] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:24.231751 20688 leader_election.cc:302] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:24.233093 21428 raft_consensus.cc:2726] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:24.237459 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0eb60aaf78c64f9ebfdb6f535cc96363" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:24.238345 20861 raft_consensus.cc:2454] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:24.243368 21061 ts_tablet_manager.cc:1428] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260812 19:26:24.244787 21061 tablet_bootstrap.cc:492] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:24.256814 21108 raft_consensus.cc:504] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.271359 21061 tablet_bootstrap.cc:654] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.303243 21060 tablet_bootstrap.cc:492] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:24.303844 21060 ts_tablet_manager.cc:1397] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.227s	user 0.012s	sys 0.002s
I20260812 19:26:24.308876 21058 tablet_bootstrap.cc:492] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:24.309587 21058 ts_tablet_manager.cc:1397] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.109s	user 0.040s	sys 0.026s
I20260812 19:26:24.312415 21058 raft_consensus.cc:348] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.313226 21058 raft_consensus.cc:374] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.313573 21058 raft_consensus.cc:729] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.314302 21058 consensus_queue.cc:260] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.315280 21060 raft_consensus.cc:348] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.316043 21060 raft_consensus.cc:374] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.316303 21060 raft_consensus.cc:729] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.316813 21058 ts_tablet_manager.cc:1428] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260812 19:26:24.317340 21060 consensus_queue.cc:260] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.317873 21058 tablet_bootstrap.cc:492] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:24.320048 21060 ts_tablet_manager.cc:1428] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.002s
I20260812 19:26:24.321013 21060 tablet_bootstrap.cc:492] T 2f8d3279bf00462799704042e3cb3966 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:24.338690 21108 leader_election.cc:288] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:24.340824 20453 catalog_manager.cc:5495] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:24.348436 21055 tablet_bootstrap.cc:492] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:24.349195 21055 ts_tablet_manager.cc:1397] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.207s	user 0.037s	sys 0.027s
I20260812 19:26:24.350304 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0eb60aaf78c64f9ebfdb6f535cc96363" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:24.351320 20861 raft_consensus.cc:3037] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.355162 21058 tablet_bootstrap.cc:654] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.362774 21055 raft_consensus.cc:348] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.363705 21055 raft_consensus.cc:374] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.364035 21055 raft_consensus.cc:729] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.363394 21556 raft_consensus.cc:504] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.364814 21055 consensus_queue.cc:260] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.369786 21055 ts_tablet_manager.cc:1428] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.003s
I20260812 19:26:24.366715 21415 raft_consensus.cc:482] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:24.370879 21055 tablet_bootstrap.cc:492] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:24.370563 21415 raft_consensus.cc:504] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.372681 21415 leader_election.cc:288] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:24.379401 21055 tablet_bootstrap.cc:654] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.384016 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0eb60aaf78c64f9ebfdb6f535cc96363" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:24.384753 20985 raft_consensus.cc:3037] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.386159 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa08d4efbda64360a2f987aab456fb04" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:24.386909 20739 raft_consensus.cc:2454] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:24.391379 20570 leader_election.cc:302] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:24.400802 21060 tablet_bootstrap.cc:654] T 2f8d3279bf00462799704042e3cb3966 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.401201 21556 leader_election.cc:288] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:24.391312 21061 tablet_bootstrap.cc:492] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:24.402839 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:24.404121 20861 raft_consensus.cc:2454] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:24.404259 20630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:24.404557 21061 ts_tablet_manager.cc:1397] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.160s	user 0.024s	sys 0.014s
I20260812 19:26:24.410748 21568 raft_consensus.cc:2781] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:24.411211 21568 raft_consensus.cc:482] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:24.411535 21568 raft_consensus.cc:3037] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.415300 20815 leader_election.cc:302] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:24.417764 21556 raft_consensus.cc:2726] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:26:24.421839 20985 raft_consensus.cc:2454] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:24.423146 21061 raft_consensus.cc:348] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.423943 21061 raft_consensus.cc:374] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.424202 21061 raft_consensus.cc:729] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.425007 21061 consensus_queue.cc:260] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.425187 20566 leader_election.cc:302] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:24.427896 21061 ts_tablet_manager.cc:1428] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260812 19:26:24.427915 20856 raft_consensus.cc:1226] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Rejecting Update request from peer 171f67787a8348fb9c7b19bf09026039 for earlier term 1. Current term is 2. Ops: []
I20260812 19:26:24.429061 21061 tablet_bootstrap.cc:492] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:24.429797 21568 raft_consensus.cc:504] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.432837 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa08d4efbda64360a2f987aab456fb04" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:24.433041 21566 raft_consensus.cc:2781] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:24.433586 21055 tablet_bootstrap.cc:492] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:24.434146 21055 ts_tablet_manager.cc:1397] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.022s
I20260812 19:26:24.434525 20739 raft_consensus.cc:3037] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.434636 21566 raft_consensus.cc:686] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:24.435667 21566 consensus_queue.cc:237] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.443033 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa08d4efbda64360a2f987aab456fb04" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:24.445159 20861 raft_consensus.cc:2454] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:24.447645 21058 tablet_bootstrap.cc:492] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:24.448221 21058 ts_tablet_manager.cc:1397] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.131s	user 0.011s	sys 0.001s
I20260812 19:26:24.450496 21058 raft_consensus.cc:348] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.452092 21058 raft_consensus.cc:374] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.452914 21055 raft_consensus.cc:348] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.453714 21055 raft_consensus.cc:374] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.454010 21055 raft_consensus.cc:729] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.452361 21058 raft_consensus.cc:729] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.456959 21058 consensus_queue.cc:260] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.460466 21061 tablet_bootstrap.cc:654] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.472141 21568 leader_election.cc:288] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:24.475047 20739 raft_consensus.cc:2454] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:24.481873 21058 ts_tablet_manager.cc:1428] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260812 19:26:24.484105 21058 tablet_bootstrap.cc:492] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:24.454922 21055 consensus_queue.cc:260] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.493656 20570 leader_election.cc:302] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:24.494752 21057 raft_consensus.cc:2781] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:24.495277 21057 raft_consensus.cc:686] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:24.496167 21057 consensus_queue.cc:237] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.487761 21413 consensus_queue.cc:1046] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.014s
I20260812 19:26:24.502161 21413 raft_consensus.cc:3032] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:24.502454 21568 consensus_queue.cc:1035] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:24.504976 21108 raft_consensus.cc:482] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:24.505476 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa08d4efbda64360a2f987aab456fb04" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:24.502550 21413 raft_consensus.cc:729] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:24.523227 21055 ts_tablet_manager.cc:1428] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.000s
I20260812 19:26:24.524155 21055 tablet_bootstrap.cc:492] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:24.526786 21413 consensus_queue.cc:260] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.528227 21413 raft_consensus.cc:3037] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:24.505492 21108 raft_consensus.cc:504] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.532863 21108 leader_election.cc:288] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:24.521413 20856 raft_consensus.cc:3037] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.539371 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db43a23e01bd4d3abc5d92db87b6e98b" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:24.539386 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db43a23e01bd4d3abc5d92db87b6e98b" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:24.548286 20566 leader_election.cc:341] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:24.551290 20565 leader_election.cc:341] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:24.551803 20565 leader_election.cc:302] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:24.555294 21061 tablet_bootstrap.cc:492] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:24.555881 21061 ts_tablet_manager.cc:1397] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.127s	user 0.022s	sys 0.033s
I20260812 19:26:24.558930 20856 raft_consensus.cc:2454] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:24.558840 20451 catalog_manager.cc:5495] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:24.559945 21058 tablet_bootstrap.cc:654] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.559631 21061 raft_consensus.cc:348] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.561527 21061 raft_consensus.cc:374] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.561832 21061 raft_consensus.cc:729] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.562448 21061 consensus_queue.cc:260] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.564641 21061 ts_tablet_manager.cc:1428] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260812 19:26:24.565624 21061 tablet_bootstrap.cc:492] T 2f8d3279bf00462799704042e3cb3966 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:24.568856 21055 tablet_bootstrap.cc:654] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.571597 21061 tablet_bootstrap.cc:654] T 2f8d3279bf00462799704042e3cb3966 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.572837 21556 raft_consensus.cc:482] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:24.573355 21556 raft_consensus.cc:504] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.560637 21413 raft_consensus.cc:2726] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:24.576768 21556 leader_election.cc:288] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:24.577441 21093 raft_consensus.cc:482] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:24.578198 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200fb82ae5174fb184b44b3ea6f39a59" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:24.579263 21060 tablet_bootstrap.cc:492] T 2f8d3279bf00462799704042e3cb3966 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:24.578027 21093 raft_consensus.cc:504] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.579792 21060 ts_tablet_manager.cc:1397] T 2f8d3279bf00462799704042e3cb3966 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.259s	user 0.025s	sys 0.021s
I20260812 19:26:24.583587 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200fb82ae5174fb184b44b3ea6f39a59" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:24.584489 20745 raft_consensus.cc:2454] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:24.583801 20985 raft_consensus.cc:2454] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:24.587669 21060 raft_consensus.cc:348] T 2f8d3279bf00462799704042e3cb3966 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.588267 20815 leader_election.cc:302] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:24.588531 21060 raft_consensus.cc:374] T 2f8d3279bf00462799704042e3cb3966 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.589998 21060 raft_consensus.cc:729] T 2f8d3279bf00462799704042e3cb3966 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.590013 21292 raft_consensus.cc:2781] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:24.590615 21292 raft_consensus.cc:482] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:24.591143 21292 raft_consensus.cc:3037] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.583595 21093 leader_election.cc:288] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:24.591817 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200fb82ae5174fb184b44b3ea6f39a59" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:24.590819 21060 consensus_queue.cc:260] T 2f8d3279bf00462799704042e3cb3966 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.592849 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200fb82ae5174fb184b44b3ea6f39a59" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:24.593510 20745 raft_consensus.cc:2454] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:24.594492 21060 ts_tablet_manager.cc:1428] T 2f8d3279bf00462799704042e3cb3966 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260812 19:26:24.594694 20922 leader_election.cc:302] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:24.595624 21060 tablet_bootstrap.cc:492] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:24.595902 21253 raft_consensus.cc:2781] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:24.596354 21253 raft_consensus.cc:482] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:24.596692 21253 raft_consensus.cc:3037] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.607951 21060 tablet_bootstrap.cc:654] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.609831 21292 raft_consensus.cc:504] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.611235 20856 raft_consensus.cc:2379] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d5ab425bcd82426387b1a5b02e55b64c in current term 1: Already voted for candidate 8c9e33eee61649e18fe397e56bdddea3 in this term.
I20260812 19:26:24.618775 21415 consensus_queue.cc:1035] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:24.621258 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200fb82ae5174fb184b44b3ea6f39a59" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:24.621721 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200fb82ae5174fb184b44b3ea6f39a59" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:24.622512 20740 raft_consensus.cc:3037] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.623413 21292 leader_election.cc:288] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:24.648856 20454 catalog_manager.cc:5495] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:24.660943 21055 tablet_bootstrap.cc:492] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:24.661056 21060 tablet_bootstrap.cc:492] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:24.661635 21055 ts_tablet_manager.cc:1397] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.138s	user 0.008s	sys 0.008s
I20260812 19:26:24.660768 21061 tablet_bootstrap.cc:492] T 2f8d3279bf00462799704042e3cb3966 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:24.662343 21594 raft_consensus.cc:482] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:24.662948 21594 raft_consensus.cc:504] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.667847 20630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6510fddf1024d71b387e8dfa568e96c" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
W20260812 19:26:24.670373 20691 leader_election.cc:341] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:24.664842 21055 raft_consensus.cc:348] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.672268 21055 raft_consensus.cc:374] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.672605 21055 raft_consensus.cc:729] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.673444 21055 consensus_queue.cc:260] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.674767 21594 leader_election.cc:288] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:24.676453 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6510fddf1024d71b387e8dfa568e96c" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:24.661810 21060 ts_tablet_manager.cc:1397] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.008s
W20260812 19:26:24.678254 20691 leader_election.cc:341] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:24.678820 20691 leader_election.cc:302] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:24.676368 21253 raft_consensus.cc:504] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.680574 20985 raft_consensus.cc:2379] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c9e33eee61649e18fe397e56bdddea3 in current term 1: Already voted for candidate d5ab425bcd82426387b1a5b02e55b64c in this term.
I20260812 19:26:24.676937 21058 tablet_bootstrap.cc:492] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:24.681250 21060 raft_consensus.cc:348] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.681943 21058 ts_tablet_manager.cc:1397] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.198s	user 0.005s	sys 0.015s
I20260812 19:26:24.682343 21060 raft_consensus.cc:374] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.682878 21594 raft_consensus.cc:2726] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:24.682730 21060 raft_consensus.cc:729] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.684062 21060 consensus_queue.cc:260] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.685063 21058 raft_consensus.cc:348] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.685858 21058 raft_consensus.cc:374] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.686098 21060 ts_tablet_manager.cc:1428] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260812 19:26:24.686277 21058 raft_consensus.cc:729] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.687552 21060 tablet_bootstrap.cc:492] T e2a274b81b0d4079852b8b1ea7c7592a P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:24.687418 21058 consensus_queue.cc:260] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.690239 21058 ts_tablet_manager.cc:1428] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260812 19:26:24.692317 21055 ts_tablet_manager.cc:1428] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.002s
I20260812 19:26:24.693842 21058 tablet_bootstrap.cc:492] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:24.694420 21060 tablet_bootstrap.cc:654] T e2a274b81b0d4079852b8b1ea7c7592a P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.694643 21055 tablet_bootstrap.cc:492] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:24.703387 21253 leader_election.cc:288] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:24.703375 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200fb82ae5174fb184b44b3ea6f39a59" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:24.704560 21058 tablet_bootstrap.cc:654] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.705441 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200fb82ae5174fb184b44b3ea6f39a59" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:24.706257 20856 raft_consensus.cc:2379] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d5ab425bcd82426387b1a5b02e55b64c in current term 1: Already voted for candidate 8c9e33eee61649e18fe397e56bdddea3 in this term.
I20260812 19:26:24.673921 21061 ts_tablet_manager.cc:1397] T 2f8d3279bf00462799704042e3cb3966 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.003s
I20260812 19:26:24.707774 20918 leader_election.cc:302] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036
I20260812 19:26:24.709586 21253 raft_consensus.cc:2726] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:26:24.712301 21061 raft_consensus.cc:348] T 2f8d3279bf00462799704042e3cb3966 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.713073 21061 raft_consensus.cc:374] T 2f8d3279bf00462799704042e3cb3966 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.713649 21061 raft_consensus.cc:729] T 2f8d3279bf00462799704042e3cb3966 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.718535 20740 raft_consensus.cc:2454] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:24.721055 21060 tablet_bootstrap.cc:492] T e2a274b81b0d4079852b8b1ea7c7592a P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:24.723923 20815 leader_election.cc:302] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:24.724326 21061 consensus_queue.cc:260] T 2f8d3279bf00462799704042e3cb3966 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.725183 21292 raft_consensus.cc:2781] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:24.725701 21292 raft_consensus.cc:686] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:24.726691 21061 ts_tablet_manager.cc:1428] T 2f8d3279bf00462799704042e3cb3966 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260812 19:26:24.726497 21292 consensus_queue.cc:237] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.728417 21055 tablet_bootstrap.cc:654] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.724356 21060 ts_tablet_manager.cc:1397] T e2a274b81b0d4079852b8b1ea7c7592a P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.008s
I20260812 19:26:24.734113 21060 raft_consensus.cc:348] T e2a274b81b0d4079852b8b1ea7c7592a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.734625 21060 raft_consensus.cc:374] T e2a274b81b0d4079852b8b1ea7c7592a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.734902 21060 raft_consensus.cc:729] T e2a274b81b0d4079852b8b1ea7c7592a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.735549 21060 consensus_queue.cc:260] T e2a274b81b0d4079852b8b1ea7c7592a P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.736721 21061 tablet_bootstrap.cc:492] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:24.738243 21060 ts_tablet_manager.cc:1428] T e2a274b81b0d4079852b8b1ea7c7592a P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260812 19:26:24.741462 21061 tablet_bootstrap.cc:654] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.742362 21060 tablet_bootstrap.cc:492] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:24.751628 20448 catalog_manager.cc:5495] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:24.753882 21060 tablet_bootstrap.cc:654] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.755862 21061 tablet_bootstrap.cc:492] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:24.757738 21058 tablet_bootstrap.cc:492] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:24.758476 21058 ts_tablet_manager.cc:1397] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.008s
I20260812 19:26:24.760099 21055 tablet_bootstrap.cc:492] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:24.760572 21055 ts_tablet_manager.cc:1397] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.001s
I20260812 19:26:24.761166 21061 ts_tablet_manager.cc:1397] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.006s
I20260812 19:26:24.763324 21055 raft_consensus.cc:348] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.764077 21055 raft_consensus.cc:374] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.764478 21055 raft_consensus.cc:729] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.763837 21061 raft_consensus.cc:348] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.764945 21061 raft_consensus.cc:374] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.765357 21061 raft_consensus.cc:729] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.765265 21055 consensus_queue.cc:260] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.766498 21061 consensus_queue.cc:260] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.767930 21055 ts_tablet_manager.cc:1428] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260812 19:26:24.769310 21055 tablet_bootstrap.cc:492] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:24.770082 21061 ts_tablet_manager.cc:1428] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260812 19:26:24.774849 21055 tablet_bootstrap.cc:654] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.775287 21061 tablet_bootstrap.cc:492] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:24.778771 21292 raft_consensus.cc:482] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:24.779541 21292 raft_consensus.cc:504] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.783985 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2a274b81b0d4079852b8b1ea7c7592a" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:24.785048 20985 raft_consensus.cc:2454] T e2a274b81b0d4079852b8b1ea7c7592a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:24.788483 21057 raft_consensus.cc:482] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:24.788381 20808 leader_election.cc:302] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:24.789121 21057 raft_consensus.cc:504] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.789898 21556 raft_consensus.cc:2781] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:24.790434 21556 raft_consensus.cc:482] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:24.791265 21057 leader_election.cc:288] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:24.791817 21057 raft_consensus.cc:482] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:24.792224 21057 raft_consensus.cc:504] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.796267 20630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2a274b81b0d4079852b8b1ea7c7592a" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:24.796983 20630 raft_consensus.cc:2454] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:24.798168 21594 raft_consensus.cc:482] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:24.798712 21594 raft_consensus.cc:504] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.791322 21556 raft_consensus.cc:3037] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.800942 21594 leader_election.cc:288] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:24.798880 21253 raft_consensus.cc:482] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:24.803129 21253 raft_consensus.cc:504] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.804013 21594 raft_consensus.cc:482] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:24.804589 21594 raft_consensus.cc:504] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.807418 20630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3044cbc7bbaa46858021ce0b610da983" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
W20260812 19:26:24.809044 20691 leader_election.cc:341] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:24.794309 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f54f896522e94977a1cee9bd74ce2303" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:24.811383 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d3279bf00462799704042e3cb3966" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:24.812403 20856 raft_consensus.cc:2454] T 2f8d3279bf00462799704042e3cb3966 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:24.799991 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85e5e41bf96447d7a761378c54e8abff" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:24.814407 20691 leader_election.cc:302] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:24.814924 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85e5e41bf96447d7a761378c54e8abff" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:24.815346 21428 raft_consensus.cc:2781] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:24.815650 20635 raft_consensus.cc:2454] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:24.815796 21428 raft_consensus.cc:482] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:24.815874 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85e5e41bf96447d7a761378c54e8abff" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:24.816296 21428 raft_consensus.cc:3037] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.816691 20745 raft_consensus.cc:2454] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:24.817106 20918 leader_election.cc:302] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:24.814535 20984 raft_consensus.cc:2454] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:24.819989 21093 raft_consensus.cc:2781] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260812 19:26:24.820673 20570 leader_election.cc:341] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:24.821393 21093 raft_consensus.cc:482] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:24.822063 21093 raft_consensus.cc:3037] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.809150 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85e5e41bf96447d7a761378c54e8abff" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:24.825510 21594 leader_election.cc:288] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:24.825873 20739 raft_consensus.cc:2454] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:24.821488 20570 leader_election.cc:302] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:24.827651 21413 raft_consensus.cc:2781] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:24.828094 21413 raft_consensus.cc:482] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:24.828022 21058 raft_consensus.cc:348] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.828930 21058 raft_consensus.cc:374] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.827755 21253 leader_election.cc:288] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:24.828555 21413 raft_consensus.cc:3037] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.829290 21058 raft_consensus.cc:729] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.830770 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f54f896522e94977a1cee9bd74ce2303" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:24.831686 21058 consensus_queue.cc:260] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.833264 21060 tablet_bootstrap.cc:492] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:24.833884 21060 ts_tablet_manager.cc:1397] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.092s	user 0.043s	sys 0.026s
I20260812 19:26:24.838313 21058 ts_tablet_manager.cc:1428] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.001s
I20260812 19:26:24.833684 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d3279bf00462799704042e3cb3966" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:24.838910 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3044cbc7bbaa46858021ce0b610da983" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:24.839421 21058 tablet_bootstrap.cc:492] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
W20260812 19:26:24.840524 20691 leader_election.cc:341] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:24.840603 20565 leader_election.cc:341] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:24.841059 20691 leader_election.cc:302] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:24.841230 20565 leader_election.cc:302] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
I20260812 19:26:24.842131 21415 raft_consensus.cc:2726] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:24.843595 21292 leader_election.cc:288] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:24.839185 20984 raft_consensus.cc:2454] T 2f8d3279bf00462799704042e3cb3966 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:24.845861 21254 raft_consensus.cc:2726] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:24.849184 21058 tablet_bootstrap.cc:654] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.809334 21057 leader_election.cc:288] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:24.852543 21060 raft_consensus.cc:348] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.859582 21060 raft_consensus.cc:374] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.860039 21060 raft_consensus.cc:729] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.860896 21060 consensus_queue.cc:260] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.870280 21060 ts_tablet_manager.cc:1428] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260812 19:26:24.871440 21060 tablet_bootstrap.cc:492] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:24.873004 21055 tablet_bootstrap.cc:492] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:24.864887 21093 raft_consensus.cc:504] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.875910 21413 raft_consensus.cc:504] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.883183 21060 tablet_bootstrap.cc:654] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.885272 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85e5e41bf96447d7a761378c54e8abff" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:24.885637 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85e5e41bf96447d7a761378c54e8abff" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:24.886294 20635 raft_consensus.cc:2379] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d5ab425bcd82426387b1a5b02e55b64c in current term 1: Already voted for candidate 171f67787a8348fb9c7b19bf09026039 in this term.
I20260812 19:26:24.886833 20984 raft_consensus.cc:2379] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 171f67787a8348fb9c7b19bf09026039 in current term 1: Already voted for candidate d5ab425bcd82426387b1a5b02e55b64c in this term.
I20260812 19:26:24.882166 21055 ts_tablet_manager.cc:1397] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.113s	user 0.009s	sys 0.011s
I20260812 19:26:24.890239 21058 tablet_bootstrap.cc:492] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:24.890879 21058 ts_tablet_manager.cc:1397] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.006s
I20260812 19:26:24.888947 21556 raft_consensus.cc:504] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:24.891131 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85e5e41bf96447d7a761378c54e8abff" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:24.892113 20739 raft_consensus.cc:3037] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.893721 21058 raft_consensus.cc:348] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.893966 21055 raft_consensus.cc:348] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.894614 21055 raft_consensus.cc:374] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.901067 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85e5e41bf96447d7a761378c54e8abff" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:24.901576 21556 leader_election.cc:288] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:24.900817 21413 leader_election.cc:288] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:24.908779 21253 raft_consensus.cc:482] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:26:24.897023 20815 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 97036.5us
I20260812 19:26:24.909839 21253 raft_consensus.cc:504] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.912276 21253 leader_election.cc:288] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:24.914004 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f54f896522e94977a1cee9bd74ce2303" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:24.902588 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2a274b81b0d4079852b8b1ea7c7592a" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:24.908790 20570 leader_election.cc:302] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
I20260812 19:26:24.894460 21058 raft_consensus.cc:374] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:24.904048 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2a274b81b0d4079852b8b1ea7c7592a" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:24.915771 21058 raft_consensus.cc:729] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.916174 20635 raft_consensus.cc:3037] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.916595 21058 consensus_queue.cc:260] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:24.917238 21057 raft_consensus.cc:2726] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:26:24.918367 21058 ts_tablet_manager.cc:1428] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.000s
I20260812 19:26:24.919407 21058 tablet_bootstrap.cc:492] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:24.916023 20740 raft_consensus.cc:2454] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:24.915436 20984 raft_consensus.cc:3037] T e2a274b81b0d4079852b8b1ea7c7592a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.927943 20922 leader_election.cc:302] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:24.929013 21376 raft_consensus.cc:2781] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:24.929422 21376 raft_consensus.cc:482] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:24.929788 21376 raft_consensus.cc:3037] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.932927 21061 tablet_bootstrap.cc:654] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.867164 21428 raft_consensus.cc:504] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:24.906975 21055 raft_consensus.cc:729] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:24.936861 21058 tablet_bootstrap.cc:654] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:24.915496 20630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f54f896522e94977a1cee9bd74ce2303" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:24.939453 20630 raft_consensus.cc:2454] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:24.940832 20635 raft_consensus.cc:2454] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:24.932212 21093 leader_election.cc:288] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:24.948480 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d3279bf00462799704042e3cb3966" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:24.948933 20739 raft_consensus.cc:2454] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:24.949998 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d3279bf00462799704042e3cb3966" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:24.934122 21055 consensus_queue.cc:260] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.958105 21415 raft_consensus.cc:482] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:24.958810 21415 raft_consensus.cc:504] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:24.960631 21055 ts_tablet_manager.cc:1428] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260812 19:26:24.966845 20985 raft_consensus.cc:3037] T 2f8d3279bf00462799704042e3cb3966 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.953409 20856 raft_consensus.cc:3037] T 2f8d3279bf00462799704042e3cb3966 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:24.952484 21428 leader_election.cc:288] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:24.972908 21055 tablet_bootstrap.cc:492] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:24.980733 20984 raft_consensus.cc:2454] T e2a274b81b0d4079852b8b1ea7c7592a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:24.979310 20812 leader_election.cc:302] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:24.995031 20922 leader_election.cc:302] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:24.953303 21108 consensus_queue.cc:1035] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260812 19:26:24.997936 21558 raft_consensus.cc:2781] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:24.998746 21558 raft_consensus.cc:686] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:24.999783 21558 consensus_queue.cc:237] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:25.008927 21093 raft_consensus.cc:2781] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:25.008782 21376 raft_consensus.cc:504] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:25.014743 21415 leader_election.cc:288] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:25.016728 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6510fddf1024d71b387e8dfa568e96c" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:25.017042 21376 leader_election.cc:288] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:25.017583 20739 raft_consensus.cc:2454] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:24.993880 21060 tablet_bootstrap.cc:492] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:25.020578 21060 ts_tablet_manager.cc:1397] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.149s	user 0.030s	sys 0.010s
I20260812 19:26:25.027609 20570 leader_election.cc:302] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:25.027582 21060 raft_consensus.cc:348] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:25.034613 21060 raft_consensus.cc:374] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:25.035077 21060 raft_consensus.cc:729] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:25.037132 21060 consensus_queue.cc:260] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:25.040500 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f54f896522e94977a1cee9bd74ce2303" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:25.041340 20739 raft_consensus.cc:3037] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:25.053004 21108 raft_consensus.cc:2781] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:25.053727 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6510fddf1024d71b387e8dfa568e96c" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:25.053735 21108 raft_consensus.cc:482] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:25.055400 21108 raft_consensus.cc:3037] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:25.055635 20739 raft_consensus.cc:2454] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:25.057118 21057 consensus_queue.cc:1035] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:26:25.066275 20566 leader_election.cc:341] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:25.079399 21060 ts_tablet_manager.cc:1428] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.058s	user 0.004s	sys 0.004s
I20260812 19:26:25.080824 21060 tablet_bootstrap.cc:492] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:25.086143 21568 consensus_queue.cc:1035] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:25.093065 20856 raft_consensus.cc:2454] T 2f8d3279bf00462799704042e3cb3966 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:25.094406 21594 raft_consensus.cc:482] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:25.095077 21594 raft_consensus.cc:504] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:25.097520 21594 leader_election.cc:288] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:25.097420 21060 tablet_bootstrap.cc:654] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:25.114068 20530 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:26:25.098446 20922 leader_election.cc:302] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:25.128000 20986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13bf498c0abe436988718e4c55535f09" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:25.129276 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13bf498c0abe436988718e4c55535f09" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:25.129529 20688 leader_election.cc:341] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:25.116402 20691 leader_election.cc:302] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:25.136150 21061 tablet_bootstrap.cc:492] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
W20260812 19:26:25.136818 20691 leader_election.cc:341] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:25.136909 21645 raft_consensus.cc:2781] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:25.137511 20691 leader_election.cc:302] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:25.137689 21645 raft_consensus.cc:686] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:25.136821 21061 ts_tablet_manager.cc:1397] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.362s	user 0.044s	sys 0.030s
I20260812 19:26:25.134467 21058 tablet_bootstrap.cc:492] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:25.139576 21058 ts_tablet_manager.cc:1397] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.220s	user 0.030s	sys 0.077s
I20260812 19:26:25.116039 21093 raft_consensus.cc:686] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:25.148931 21253 raft_consensus.cc:2781] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:25.140770 21428 raft_consensus.cc:2726] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:25.157437 21061 raft_consensus.cc:348] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:25.158377 21061 raft_consensus.cc:374] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:25.158748 21061 raft_consensus.cc:729] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:25.159916 21061 consensus_queue.cc:260] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:25.162537 21061 ts_tablet_manager.cc:1428] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260812 19:26:25.163467 21060 tablet_bootstrap.cc:492] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:25.163610 21061 tablet_bootstrap.cc:492] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:25.164029 21060 ts_tablet_manager.cc:1397] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.003s
W20260812 19:26:25.143023 20922 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 44687.4us
I20260812 19:26:25.151727 21253 raft_consensus.cc:686] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:25.143270 21108 raft_consensus.cc:504] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:25.138767 21645 consensus_queue.cc:237] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:25.189616 21058 raft_consensus.cc:348] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:25.193747 21058 raft_consensus.cc:374] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:25.194160 21058 raft_consensus.cc:729] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:25.195014 21058 consensus_queue.cc:260] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:25.197857 20985 raft_consensus.cc:2454] T 2f8d3279bf00462799704042e3cb3966 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
W20260812 19:26:25.296991 20570 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 48352.2us
I20260812 19:26:25.299427 21060 raft_consensus.cc:348] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:25.286916 21055 tablet_bootstrap.cc:654] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:25.310110 21060 raft_consensus.cc:374] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:25.310571 21060 raft_consensus.cc:729] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:25.311762 21060 consensus_queue.cc:260] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:25.189172 21253 consensus_queue.cc:237] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:25.176405 21093 consensus_queue.cc:237] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:25.288111 21415 raft_consensus.cc:482] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:25.291671 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f54f896522e94977a1cee9bd74ce2303" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
W20260812 19:26:25.303996 20691 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 84457.8us
I20260812 19:26:25.307698 20451 catalog_manager.cc:5495] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:25.286119 21061 tablet_bootstrap.cc:654] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:25.331212 21060 ts_tablet_manager.cc:1428] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.167s	user 0.010s	sys 0.000s
I20260812 19:26:25.333197 21058 ts_tablet_manager.cc:1428] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.193s	user 0.008s	sys 0.007s
I20260812 19:26:25.341683 21108 leader_election.cc:288] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:25.347297 20635 raft_consensus.cc:3037] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:25.350096 21060 tablet_bootstrap.cc:492] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:25.349817 21108 consensus_queue.cc:1035] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:25.360966 21556 consensus_queue.cc:1035] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:25.351517 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6510fddf1024d71b387e8dfa568e96c" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:25.364038 21671 raft_consensus.cc:482] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:25.378854 20740 raft_consensus.cc:3037] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:25.341234 21415 raft_consensus.cc:504] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:25.385989 21657 raft_consensus.cc:482] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:25.386184 21671 raft_consensus.cc:504] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:25.447248 21058 tablet_bootstrap.cc:492] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:25.428301 21657 raft_consensus.cc:504] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:25.441998 20635 raft_consensus.cc:2454] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:25.463127 21673 raft_consensus.cc:482] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:25.480664 21055 tablet_bootstrap.cc:492] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:25.481283 21055 ts_tablet_manager.cc:1397] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.509s	user 0.019s	sys 0.017s
I20260812 19:26:25.481552 21415 leader_election.cc:288] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:25.492972 21055 raft_consensus.cc:348] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:25.493762 21671 leader_election.cc:288] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:25.493992 21055 raft_consensus.cc:374] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:25.494582 21055 raft_consensus.cc:729] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:25.495504 21636 consensus_queue.cc:1035] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:25.495564 21055 consensus_queue.cc:260] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:25.498416 21055 ts_tablet_manager.cc:1428] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260812 19:26:25.499377 21055 tablet_bootstrap.cc:492] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
W20260812 19:26:25.471833 20566 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 126760us
I20260812 19:26:25.521728 21061 tablet_bootstrap.cc:492] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:25.523087 21061 ts_tablet_manager.cc:1397] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.360s	user 0.019s	sys 0.002s
I20260812 19:26:25.526929 21061 raft_consensus.cc:348] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:25.531008 21061 raft_consensus.cc:374] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:25.531299 21061 raft_consensus.cc:729] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:25.484090 21673 raft_consensus.cc:504] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:25.532423 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f906c95927b14410a6818ea15e9e089f" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:25.539341 21061 consensus_queue.cc:260] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:25.549412 21061 ts_tablet_manager.cc:1428] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260812 19:26:25.541013 21558 raft_consensus.cc:482] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:25.546581 20861 raft_consensus.cc:2454] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:25.553336 21060 tablet_bootstrap.cc:654] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:25.557029 21061 tablet_bootstrap.cc:492] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
W20260812 19:26:25.540382 20808 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:37307, user_credentials={real_user=slave}} blocked reactor thread for 46496.5us
I20260812 19:26:25.559651 21558 raft_consensus.cc:504] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:25.561105 20853 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3408c35d6e414cb4bb2aa3b96a742313" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:25.562106 20630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37466bb31e941bfaea862a42aafe4a2" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:25.563508 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3408c35d6e414cb4bb2aa3b96a742313" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
W20260812 19:26:25.565613 20691 leader_election.cc:341] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:25.566336 20691 leader_election.cc:341] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:25.567202 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6510fddf1024d71b387e8dfa568e96c" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:25.547642 21651 raft_consensus.cc:482] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:25.562399 21558 leader_election.cc:288] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:25.543995 21673 leader_election.cc:288] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:25.547441 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6510fddf1024d71b387e8dfa568e96c" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:25.585528 21651 raft_consensus.cc:504] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:25.588282 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37466bb31e941bfaea862a42aafe4a2" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:25.588804 20980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f906c95927b14410a6818ea15e9e089f" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:25.589695 21058 tablet_bootstrap.cc:654] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:25.590592 21657 leader_election.cc:288] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
W20260812 19:26:25.610214 20688 leader_election.cc:341] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:25.610759 20688 leader_election.cc:302] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:25.600445 20856 raft_consensus.cc:3037] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:25.625737 21061 tablet_bootstrap.cc:654] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:25.632185 21055 tablet_bootstrap.cc:654] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:25.639328 21672 raft_consensus.cc:2726] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:26:25.632427 20691 leader_election.cc:341] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:25.648341 20691 leader_election.cc:302] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:25.649587 20740 raft_consensus.cc:2454] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:25.655238 20570 leader_election.cc:302] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:25.657187 21651 leader_election.cc:288] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:25.661535 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13bf498c0abe436988718e4c55535f09" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:25.662470 20735 raft_consensus.cc:2454] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:25.651391 21671 raft_consensus.cc:2726] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:26:25.668349 20565 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:37307, user_credentials={real_user=slave}} blocked reactor thread for 47615.9us
I20260812 19:26:25.669909 21568 raft_consensus.cc:2781] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:25.673250 20922 leader_election.cc:302] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:25.686565 21651 raft_consensus.cc:2781] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:25.687036 21651 raft_consensus.cc:482] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:25.687443 21651 raft_consensus.cc:3037] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:25.694078 20858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db43a23e01bd4d3abc5d92db87b6e98b" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:25.696394 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13bf498c0abe436988718e4c55535f09" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:25.698699 20918 leader_election.cc:341] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:25.700557 20565 leader_election.cc:341] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:25.701128 21568 raft_consensus.cc:686] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:25.702152 21568 consensus_queue.cc:237] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
W20260812 19:26:25.706284 20918 leader_election.cc:341] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:25.709798 21060 tablet_bootstrap.cc:492] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:25.705286 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6510fddf1024d71b387e8dfa568e96c" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:25.712100 21060 ts_tablet_manager.cc:1397] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.362s	user 0.011s	sys 0.015s
I20260812 19:26:25.716244 21060 raft_consensus.cc:348] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:25.716913 21060 raft_consensus.cc:374] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:25.717150 21060 raft_consensus.cc:729] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:25.717748 21060 consensus_queue.cc:260] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:25.720068 21060 ts_tablet_manager.cc:1428] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260812 19:26:25.721252 21060 tablet_bootstrap.cc:492] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:25.708099 21556 consensus_queue.cc:1035] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260812 19:26:25.730464 21060 tablet_bootstrap.cc:654] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:25.705152 20566 leader_election.cc:302] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:25.759351 21701 raft_consensus.cc:2781] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:25.759907 21701 raft_consensus.cc:482] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:25.759500 21642 consensus_queue.cc:1035] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:25.760314 21701 raft_consensus.cc:3037] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:25.762856 20856 raft_consensus.cc:2454] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
W20260812 19:26:25.759377 20566 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 60752.5us
I20260812 19:26:25.771796 21651 raft_consensus.cc:504] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:25.775064 21055 tablet_bootstrap.cc:492] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:25.783867 21055 ts_tablet_manager.cc:1397] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.285s	user 0.013s	sys 0.008s
I20260812 19:26:25.785115 21376 consensus_queue.cc:1035] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:25.777547 21673 consensus_queue.cc:1035] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:25.779811 20454 catalog_manager.cc:5495] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:25.809082 21058 tablet_bootstrap.cc:492] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:25.809705 21058 ts_tablet_manager.cc:1397] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.363s	user 0.015s	sys 0.012s
I20260812 19:26:25.795647 20448 catalog_manager.cc:5495] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:25.811991 21428 consensus_queue.cc:1035] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:25.823904 21058 raft_consensus.cc:348] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:25.827857 21058 raft_consensus.cc:374] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:25.828135 21058 raft_consensus.cc:729] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:25.842796 20812 leader_election.cc:302] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:25.846262 21058 consensus_queue.cc:260] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:25.848817 21058 ts_tablet_manager.cc:1428] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260812 19:26:25.850003 21058 tablet_bootstrap.cc:492] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:25.850523 21055 raft_consensus.cc:348] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:25.851313 21055 raft_consensus.cc:374] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:25.851564 21055 raft_consensus.cc:729] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:25.856865 21376 consensus_queue.cc:1035] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:25.860463 21674 raft_consensus.cc:482] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:25.861024 21674 raft_consensus.cc:504] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:25.853420 21055 consensus_queue.cc:260] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:25.882622 21055 ts_tablet_manager.cc:1428] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.003s
I20260812 19:26:25.883000 21642 raft_consensus.cc:2726] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:25.884696 21060 tablet_bootstrap.cc:492] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:25.885233 21060 ts_tablet_manager.cc:1397] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.164s	user 0.029s	sys 0.049s
I20260812 19:26:25.892613 21061 tablet_bootstrap.cc:492] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:25.893182 21061 ts_tablet_manager.cc:1397] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.337s	user 0.018s	sys 0.033s
I20260812 19:26:25.893646 21055 tablet_bootstrap.cc:492] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:25.895315 21428 raft_consensus.cc:482] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:25.897928 20453 catalog_manager.cc:5495] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
W20260812 19:26:25.891362 20812 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 56488.6us
I20260812 19:26:25.901517 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db43a23e01bd4d3abc5d92db87b6e98b" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:25.920540 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13bf498c0abe436988718e4c55535f09" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:25.921279 20740 raft_consensus.cc:3037] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:25.923390 20636 raft_consensus.cc:2454] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:25.924624 21674 leader_election.cc:288] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:25.911993 20736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3044cbc7bbaa46858021ce0b610da983" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:25.919176 21060 raft_consensus.cc:348] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:25.901932 21428 raft_consensus.cc:504] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:25.932837 21060 raft_consensus.cc:374] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:25.936689 21060 raft_consensus.cc:729] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:25.902452 21701 raft_consensus.cc:504] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:25.937436 21060 consensus_queue.cc:260] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:25.932152 21651 leader_election.cc:288] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:25.935803 20736 raft_consensus.cc:2454] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:25.948428 21428 leader_election.cc:288] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:25.953640 20740 raft_consensus.cc:2454] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:25.957669 20570 leader_election.cc:302] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:25.958735 21674 raft_consensus.cc:2781] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:25.959124 21674 raft_consensus.cc:482] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:25.959273 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:25.955351 21061 raft_consensus.cc:348] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:25.959522 21674 raft_consensus.cc:3037] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:25.960233 21061 raft_consensus.cc:374] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:25.961571 21061 raft_consensus.cc:729] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:25.962146 21061 consensus_queue.cc:260] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:25.950475 21058 tablet_bootstrap.cc:654] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:25.960016 20635 raft_consensus.cc:2454] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 2.
I20260812 19:26:25.967239 21060 ts_tablet_manager.cc:1428] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.001s
I20260812 19:26:25.968608 21060 tablet_bootstrap.cc:492] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:25.973618 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13bf498c0abe436988718e4c55535f09" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:25.974130 20858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:25.975026 20858 raft_consensus.cc:2379] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc1471911ec442396b400eed9d18036 in current term 2: Already voted for candidate 8c9e33eee61649e18fe397e56bdddea3 in this term.
I20260812 19:26:25.972620 21061 ts_tablet_manager.cc:1428] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260812 19:26:25.981993 20691 leader_election.cc:302] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
W20260812 19:26:25.979187 20918 leader_election.cc:341] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:25.983678 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3044cbc7bbaa46858021ce0b610da983" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:25.984433 20861 raft_consensus.cc:2454] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:25.987386 21061 tablet_bootstrap.cc:492] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:25.988682 21701 leader_election.cc:288] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:25.990392 21659 consensus_queue.cc:1035] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:25.991787 21673 raft_consensus.cc:2781] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:25.992286 21673 raft_consensus.cc:482] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:25.992679 21673 raft_consensus.cc:3037] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:25.994823 20918 leader_election.cc:302] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:25.995793 21253 raft_consensus.cc:2781] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:25.996214 21253 raft_consensus.cc:482] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:25.996584 21253 raft_consensus.cc:3037] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.017015 20980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f906c95927b14410a6818ea15e9e089f" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:26.017768 20980 raft_consensus.cc:3037] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.035153 21055 tablet_bootstrap.cc:654] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:26.039536 21253 raft_consensus.cc:504] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.041551 21253 leader_election.cc:288] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:26.032986 21635 raft_consensus.cc:482] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:26.043182 21635 raft_consensus.cc:504] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:26.043625 21061 tablet_bootstrap.cc:654] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:26.045780 21635 leader_election.cc:288] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
W20260812 19:26:26.034168 20922 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 60976us
I20260812 19:26:26.050016 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:26.052352 20922 leader_election.cc:302] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:26.053745 21093 raft_consensus.cc:2781] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:26.054255 21093 raft_consensus.cc:686] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:26.051400 21674 raft_consensus.cc:504] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:26.055253 21093 consensus_queue.cc:237] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.055521 20453 catalog_manager.cc:5495] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } }
I20260812 19:26:26.059376 21674 leader_election.cc:288] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:26.067160 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3044cbc7bbaa46858021ce0b610da983" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:26.068199 20735 raft_consensus.cc:3037] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.069422 20635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:26.070188 20635 raft_consensus.cc:2454] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 2.
I20260812 19:26:26.082231 21061 tablet_bootstrap.cc:492] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:26.083256 21061 ts_tablet_manager.cc:1397] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.097s	user 0.018s	sys 0.000s
I20260812 19:26:26.083992 21726 raft_consensus.cc:482] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:26.084533 21726 raft_consensus.cc:504] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:26.086619 21726 leader_election.cc:288] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:26.093752 21060 tablet_bootstrap.cc:654] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:26.105568 20812 leader_election.cc:302] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:26.110360 21058 tablet_bootstrap.cc:492] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:26.110894 21058 ts_tablet_manager.cc:1397] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.261s	user 0.015s	sys 0.000s
I20260812 19:26:26.111088 21635 raft_consensus.cc:2781] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:26:26.111532 21635 raft_consensus.cc:482] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:26.111873 21635 raft_consensus.cc:3037] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:26.121635 20735 raft_consensus.cc:2454] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:26.122874 20570 leader_election.cc:302] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:26.123291 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37466bb31e941bfaea862a42aafe4a2" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:26.125092 21057 raft_consensus.cc:2781] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:26.123958 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db43a23e01bd4d3abc5d92db87b6e98b" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:26.125680 21057 raft_consensus.cc:686] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:26.125731 20636 raft_consensus.cc:3037] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.126816 20858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3044cbc7bbaa46858021ce0b610da983" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:26.127485 20858 raft_consensus.cc:3037] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.126318 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f906c95927b14410a6818ea15e9e089f" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:26.128681 20856 raft_consensus.cc:3037] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.126581 21057 consensus_queue.cc:237] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:26.124037 20637 raft_consensus.cc:2454] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:26.141739 20980 raft_consensus.cc:2454] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:26.113497 21058 raft_consensus.cc:348] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.142845 21058 raft_consensus.cc:374] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:26.143220 21058 raft_consensus.cc:729] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:26.144073 21058 consensus_queue.cc:260] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.107297 21061 raft_consensus.cc:348] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.146203 21061 raft_consensus.cc:374] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:26.146586 21061 raft_consensus.cc:729] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:26.155666 21061 consensus_queue.cc:260] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.140671 21673 raft_consensus.cc:504] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:26.167395 21061 ts_tablet_manager.cc:1428] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260812 19:26:26.152873 20636 raft_consensus.cc:2454] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:26.172640 20740 raft_consensus.cc:2454] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 2.
I20260812 19:26:26.171955 20565 leader_election.cc:302] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:26.177434 21055 tablet_bootstrap.cc:492] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:26.177992 21055 ts_tablet_manager.cc:1397] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.285s	user 0.007s	sys 0.019s
I20260812 19:26:26.180508 21061 tablet_bootstrap.cc:492] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:26.181286 21568 raft_consensus.cc:2781] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:26.181856 21568 raft_consensus.cc:686] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:26.182760 21568 consensus_queue.cc:237] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.187922 21058 ts_tablet_manager.cc:1428] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260812 19:26:26.189463 21058 tablet_bootstrap.cc:492] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:26.192965 21055 raft_consensus.cc:348] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.193773 21055 raft_consensus.cc:374] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:26.194120 21055 raft_consensus.cc:729] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:26.169642 21651 consensus_queue.cc:1035] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260812 19:26:26.196055 21055 consensus_queue.cc:260] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.197892 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db43a23e01bd4d3abc5d92db87b6e98b" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:26.198244 21055 ts_tablet_manager.cc:1428] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260812 19:26:26.199405 21055 tablet_bootstrap.cc:492] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:26.199704 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37466bb31e941bfaea862a42aafe4a2" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:26.193599 20858 raft_consensus.cc:2454] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:26.200416 20735 raft_consensus.cc:2454] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:26.203117 21671 raft_consensus.cc:482] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:26.203670 20922 leader_election.cc:302] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:26.204241 21673 leader_election.cc:288] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:26.200129 21635 raft_consensus.cc:504] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:26.203663 21671 raft_consensus.cc:504] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.207056 21376 raft_consensus.cc:2781] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:26.207501 21376 raft_consensus.cc:482] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:26.207862 21376 raft_consensus.cc:3037] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.208798 21061 tablet_bootstrap.cc:654] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:26.209262 20976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6acd85742e946ddb5bb17831fc226fe" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:26.213071 20856 raft_consensus.cc:2454] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:26.214092 21671 leader_election.cc:288] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
W20260812 19:26:26.214969 20918 leader_election.cc:341] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:26.218489 20688 leader_election.cc:341] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:26.220329 20630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:26.230840 20918 leader_election.cc:302] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 8c9e33eee61649e18fe397e56bdddea3
W20260812 19:26:26.225136 20530 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:26:26.238793 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:26.239018 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6acd85742e946ddb5bb17831fc226fe" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:26.246002 21659 raft_consensus.cc:2781] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:26.246573 21659 raft_consensus.cc:686] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:26.247433 21659 consensus_queue.cc:237] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.248031 20861 raft_consensus.cc:2354] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc1471911ec442396b400eed9d18036 for earlier term 2. Current term is 3.
I20260812 19:26:26.250334 21635 leader_election.cc:288] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 3 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:26.275478 20448 catalog_manager.cc:5495] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:26.289179 21058 tablet_bootstrap.cc:654] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:26.290525 21060 tablet_bootstrap.cc:492] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:26.291054 21060 ts_tablet_manager.cc:1397] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.323s	user 0.020s	sys 0.023s
I20260812 19:26:26.297417 21055 tablet_bootstrap.cc:654] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:26.276160 20922 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 72582.5us
I20260812 19:26:26.303390 20633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
W20260812 19:26:26.307586 20691 leader_election.cc:341] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:26.297128 21376 raft_consensus.cc:504] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:26.308079 20691 leader_election.cc:302] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:26.309306 20691 leader_election.cc:398] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: Vote denied by peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049) with higher term. Message: Invalid argument: T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc1471911ec442396b400eed9d18036 for earlier term 2. Current term is 3.
I20260812 19:26:26.309616 20691 leader_election.cc:401] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260812 19:26:26.309437 21415 consensus_queue.cc:1035] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:26.311695 21673 raft_consensus.cc:2726] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:26.311893 20633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37466bb31e941bfaea862a42aafe4a2" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:26.312330 21673 raft_consensus.cc:3037] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:26.312654 20633 raft_consensus.cc:3037] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.312343 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:26.318955 21376 leader_election.cc:288] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:26.322084 20633 raft_consensus.cc:2454] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:26.324930 21060 raft_consensus.cc:348] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.328907 21060 raft_consensus.cc:374] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:26.327242 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37466bb31e941bfaea862a42aafe4a2" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:26.329481 20745 raft_consensus.cc:3037] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.336988 20745 raft_consensus.cc:2454] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:26.326438 20630 raft_consensus.cc:2454] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 2.
I20260812 19:26:26.338497 21415 consensus_queue.cc:1035] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:26.338898 20918 leader_election.cc:302] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:26.339679 21060 raft_consensus.cc:729] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:26.342509 21060 consensus_queue.cc:260] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.336174 20454 catalog_manager.cc:5495] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:26.361073 21060 ts_tablet_manager.cc:1428] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.002s
I20260812 19:26:26.362015 21667 raft_consensus.cc:482] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:26.363809 21060 tablet_bootstrap.cc:492] T f6acd85742e946ddb5bb17831fc226fe P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:26.355980 21651 raft_consensus.cc:2781] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:26.379634 21061 tablet_bootstrap.cc:492] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:26.380188 21061 ts_tablet_manager.cc:1397] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.200s	user 0.007s	sys 0.011s
I20260812 19:26:26.381163 21058 tablet_bootstrap.cc:492] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:26.382077 21058 ts_tablet_manager.cc:1397] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.193s	user 0.012s	sys 0.007s
I20260812 19:26:26.362596 21667 raft_consensus.cc:504] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.389817 21667 leader_election.cc:288] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:26.374472 21673 raft_consensus.cc:2726] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049) with higher term. Message: Invalid argument: T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc1471911ec442396b400eed9d18036 for earlier term 2. Current term is 3.
I20260812 19:26:26.392385 21568 raft_consensus.cc:482] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:26.392907 21568 raft_consensus.cc:504] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.396220 21058 raft_consensus.cc:348] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:26.376119 21635 raft_consensus.cc:482] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:26.397588 21058 raft_consensus.cc:374] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:26.398041 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8bf3b3e0e4c425e9d86c3e5b7a062cf" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:26.398103 20980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8bf3b3e0e4c425e9d86c3e5b7a062cf" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:26.398466 21058 raft_consensus.cc:729] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:26.399084 21568 leader_election.cc:288] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:26.399294 20980 raft_consensus.cc:2454] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:26.400257 20976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaf0d4e2ed4d039a3635696107687a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
W20260812 19:26:26.420300 20565 leader_election.cc:341] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:26.420468 21058 consensus_queue.cc:260] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:26.422274 21058 ts_tablet_manager.cc:1428] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.001s
I20260812 19:26:26.401641 20735 raft_consensus.cc:2454] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 3.
I20260812 19:26:26.401763 20858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaf0d4e2ed4d039a3635696107687a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:26.386641 21061 raft_consensus.cc:348] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.384662 21651 raft_consensus.cc:686] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:26.425490 21061 raft_consensus.cc:374] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:26.397977 21635 raft_consensus.cc:504] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.426561 21061 raft_consensus.cc:729] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
W20260812 19:26:26.407903 20691 leader_election.cc:341] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:26.427191 20858 raft_consensus.cc:2454] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:26.428373 21635 leader_election.cc:288] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:26.426036 21651 consensus_queue.cc:237] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:26.409040 21055 tablet_bootstrap.cc:492] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:26.430665 21055 ts_tablet_manager.cc:1397] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.231s	user 0.016s	sys 0.005s
I20260812 19:26:26.430521 20976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaf0d4e2ed4d039a3635696107687a" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:26.432065 20566 leader_election.cc:302] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:26.432534 20688 leader_election.cc:302] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:26.433676 21674 raft_consensus.cc:2781] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:26.408973 20448 catalog_manager.cc:5495] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:26.434114 21674 raft_consensus.cc:482] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:26.434480 21673 raft_consensus.cc:2781] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:26.434933 21673 raft_consensus.cc:482] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:26.435269 21673 raft_consensus.cc:3037] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:26.438024 20808 leader_election.cc:341] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:26.439168 21058 tablet_bootstrap.cc:492] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:26.438993 20630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaf0d4e2ed4d039a3635696107687a" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:26.411859 21060 tablet_bootstrap.cc:654] T f6acd85742e946ddb5bb17831fc226fe P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:26.434506 21674 raft_consensus.cc:3037] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.443132 21061 consensus_queue.cc:260] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.444022 20815 leader_election.cc:302] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:26.444823 21635 raft_consensus.cc:2781] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:26:26.445519 21635 raft_consensus.cc:686] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 3 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:26.446379 21635 consensus_queue.cc:237] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:26.448372 21061 ts_tablet_manager.cc:1428] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260812 19:26:26.451144 21061 tablet_bootstrap.cc:492] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:26.433427 21055 raft_consensus.cc:348] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:26.451785 21055 raft_consensus.cc:374] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:26.452167 21055 raft_consensus.cc:729] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:26.453099 21055 consensus_queue.cc:260] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:26.461023 21061 tablet_bootstrap.cc:654] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:26.465135 21055 ts_tablet_manager.cc:1428] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260812 19:26:26.469241 21055 tablet_bootstrap.cc:492] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:26.481355 21058 tablet_bootstrap.cc:654] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:26.487761 20454 catalog_manager.cc:5495] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:26.489388 21055 tablet_bootstrap.cc:654] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:26.498708 20448 catalog_manager.cc:5495] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:26.505038 21060 tablet_bootstrap.cc:492] T f6acd85742e946ddb5bb17831fc226fe P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:26.505564 21060 ts_tablet_manager.cc:1397] T f6acd85742e946ddb5bb17831fc226fe P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.142s	user 0.014s	sys 0.009s
I20260812 19:26:26.505260 21673 raft_consensus.cc:504] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.509127 21060 raft_consensus.cc:348] T f6acd85742e946ddb5bb17831fc226fe P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.509892 21060 raft_consensus.cc:374] T f6acd85742e946ddb5bb17831fc226fe P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:26.510176 21060 raft_consensus.cc:729] T f6acd85742e946ddb5bb17831fc226fe P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:26.510911 21060 consensus_queue.cc:260] T f6acd85742e946ddb5bb17831fc226fe P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.513206 21060 ts_tablet_manager.cc:1428] T f6acd85742e946ddb5bb17831fc226fe P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260812 19:26:26.514122 21060 tablet_bootstrap.cc:492] T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:26.520859 21060 tablet_bootstrap.cc:654] T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:26.528121 21674 raft_consensus.cc:504] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.529597 20630 raft_consensus.cc:2379] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c9e33eee61649e18fe397e56bdddea3 in current term 1: Already voted for candidate 171f67787a8348fb9c7b19bf09026039 in this term.
I20260812 19:26:26.540745 20453 catalog_manager.cc:5495] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 1 to 3, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 3 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:26.550897 20812 leader_election.cc:302] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:26.554512 21642 raft_consensus.cc:3037] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.559449 21701 consensus_queue.cc:1035] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:26.575016 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaf0d4e2ed4d039a3635696107687a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:26.579113 20858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8bf3b3e0e4c425e9d86c3e5b7a062cf" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:26.624981 21674 leader_election.cc:288] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:26.643893 21673 leader_election.cc:288] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:26.679551 21642 raft_consensus.cc:2726] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:26.681449 21667 raft_consensus.cc:482] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:26.682174 21672 raft_consensus.cc:482] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:26.684315 20976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8bf3b3e0e4c425e9d86c3e5b7a062cf" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:26.684965 20976 raft_consensus.cc:3037] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.684139 21672 raft_consensus.cc:504] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:26.685055 21667 raft_consensus.cc:504] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.688246 21672 leader_election.cc:288] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:26.688410 21667 leader_election.cc:288] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
W20260812 19:26:26.691557 20691 leader_election.cc:341] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:26.692108 20691 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 65686.8us
I20260812 19:26:26.694526 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a777b602ae6d4dac9f1ac116e0a2e86e" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:26.698105 21685 raft_consensus.cc:482] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:26.698733 21685 raft_consensus.cc:504] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.702301 20980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6acd85742e946ddb5bb17831fc226fe" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:26.703059 20980 raft_consensus.cc:2454] T f6acd85742e946ddb5bb17831fc226fe P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:26.704387 20808 leader_election.cc:302] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:26.705367 21685 leader_election.cc:288] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:26.705751 21642 raft_consensus.cc:2781] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:26.707487 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6acd85742e946ddb5bb17831fc226fe" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:26.708271 20745 raft_consensus.cc:2454] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 0.
I20260812 19:26:26.709427 21060 tablet_bootstrap.cc:492] T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:26.709990 21060 ts_tablet_manager.cc:1397] T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.196s	user 0.019s	sys 0.028s
I20260812 19:26:26.711391 21061 tablet_bootstrap.cc:492] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:26.711915 21061 ts_tablet_manager.cc:1397] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.261s	user 0.032s	sys 0.013s
W20260812 19:26:26.713227 20691 leader_election.cc:341] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:26.705361 20855 raft_consensus.cc:2454] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:26.716290 21060 raft_consensus.cc:348] T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:26.717397 21060 raft_consensus.cc:374] T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:26.717809 21060 raft_consensus.cc:729] T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:26.718834 21060 consensus_queue.cc:260] T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:26.744678 21061 raft_consensus.cc:348] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.745522 21061 raft_consensus.cc:374] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:26.745774 21061 raft_consensus.cc:729] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:26.746413 21061 consensus_queue.cc:260] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.706588 21642 raft_consensus.cc:482] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:26.750134 20980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaf0d4e2ed4d039a3635696107687a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:26.752501 21060 ts_tablet_manager.cc:1428] T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260812 19:26:26.753436 21060 tablet_bootstrap.cc:492] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:26.758482 21061 ts_tablet_manager.cc:1428] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
W20260812 19:26:26.740558 20922 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 150846us
I20260812 19:26:26.754194 21642 raft_consensus.cc:3037] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.763954 21061 tablet_bootstrap.cc:492] T 13bf498c0abe436988718e4c55535f09 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:26.777906 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:26.779358 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a777b602ae6d4dac9f1ac116e0a2e86e" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:26.780202 20984 raft_consensus.cc:2454] T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
W20260812 19:26:26.793309 20688 leader_election.cc:341] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:26.794183 20688 leader_election.cc:302] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:26.794374 20976 raft_consensus.cc:2454] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:26.789821 20566 leader_election.cc:302] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:26.795800 21428 raft_consensus.cc:2781] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:26.796001 20858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:26.796263 21428 raft_consensus.cc:482] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:26.797161 21428 raft_consensus.cc:3037] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.799086 20688 leader_election.cc:302] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:26.800140 21674 raft_consensus.cc:2781] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:26.800554 21673 raft_consensus.cc:2781] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:26.800906 21674 raft_consensus.cc:686] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:26.801074 21673 raft_consensus.cc:686] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:26.802424 21058 tablet_bootstrap.cc:492] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:26.803002 21058 ts_tablet_manager.cc:1397] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.366s	user 0.017s	sys 0.017s
I20260812 19:26:26.802053 21673 consensus_queue.cc:237] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.805848 21058 raft_consensus.cc:348] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:26.801893 21674 consensus_queue.cc:237] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.806615 21058 raft_consensus.cc:374] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:26.809789 21058 raft_consensus.cc:729] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:26.810098 21060 tablet_bootstrap.cc:654] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:26.810491 21058 consensus_queue.cc:260] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:26.813046 21058 ts_tablet_manager.cc:1428] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.002s
I20260812 19:26:26.813658 21636 raft_consensus.cc:482] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:26.814026 21058 tablet_bootstrap.cc:492] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036: Bootstrap starting.
I20260812 19:26:26.814185 21636 raft_consensus.cc:504] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.816824 21636 leader_election.cc:288] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:26.817694 20855 raft_consensus.cc:3037] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.820999 20977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db43a23e01bd4d3abc5d92db87b6e98b" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
W20260812 19:26:26.824290 20918 consensus_peers.cc:487] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:26.826382 21061 tablet_bootstrap.cc:654] T 13bf498c0abe436988718e4c55535f09 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:26.828191 21057 consensus_queue.cc:1035] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:26.849514 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db43a23e01bd4d3abc5d92db87b6e98b" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:26.850351 20636 raft_consensus.cc:2379] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c9e33eee61649e18fe397e56bdddea3 in current term 1: Already voted for candidate d5ab425bcd82426387b1a5b02e55b64c in this term.
I20260812 19:26:26.829468 21651 consensus_queue.cc:1035] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:26.830941 21701 consensus_queue.cc:1035] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:26.842058 21093 consensus_queue.cc:1035] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:26.852408 21428 raft_consensus.cc:504] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
W20260812 19:26:26.837479 20691 leader_election.cc:341] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:26.863785 20691 leader_election.cc:302] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:26.848161 21642 raft_consensus.cc:504] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.844336 20745 raft_consensus.cc:1261] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Refusing update from remote peer 8c9e33eee61649e18fe397e56bdddea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:26:26.865334 21671 raft_consensus.cc:2726] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:26.866851 21636 consensus_queue.cc:1035] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:26.860873 21058 tablet_bootstrap.cc:654] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:26.846627 20565 leader_election.cc:341] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:26.876227 21055 tablet_bootstrap.cc:492] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:26.878837 21055 ts_tablet_manager.cc:1397] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.410s	user 0.018s	sys 0.021s
I20260812 19:26:26.875748 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6acd85742e946ddb5bb17831fc226fe" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:26.880122 20745 raft_consensus.cc:3037] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.883193 21057 consensus_queue.cc:1035] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:26.890005 20812 leader_election.cc:302] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:26.891925 21685 raft_consensus.cc:2726] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:26.896588 21055 raft_consensus.cc:348] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.897408 21055 raft_consensus.cc:374] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:26.873626 21651 consensus_queue.cc:1035] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260812 19:26:26.897687 21055 raft_consensus.cc:729] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:26.902761 21642 leader_election.cc:288] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:26.898376 21055 consensus_queue.cc:260] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:26.923894 20745 raft_consensus.cc:2454] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:26.925531 20815 leader_election.cc:302] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:26.934774 21055 ts_tablet_manager.cc:1428] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260812 19:26:26.936239 21055 tablet_bootstrap.cc:492] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:26.918022 20977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6acd85742e946ddb5bb17831fc226fe" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:26.954174 21061 tablet_bootstrap.cc:492] T 13bf498c0abe436988718e4c55535f09 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:26.954967 21061 ts_tablet_manager.cc:1397] T 13bf498c0abe436988718e4c55535f09 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.191s	user 0.017s	sys 0.006s
I20260812 19:26:26.956986 20448 catalog_manager.cc:5495] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:26.955679 20977 raft_consensus.cc:3037] T f6acd85742e946ddb5bb17831fc226fe P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:26.976500 21428 leader_election.cc:288] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:26.974133 21635 raft_consensus.cc:2781] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:26.980881 21415 raft_consensus.cc:482] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:26.987187 21415 raft_consensus.cc:504] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:26.989375 21415 leader_election.cc:288] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:26.990273 21055 tablet_bootstrap.cc:654] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:26.991004 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3408c35d6e414cb4bb2aa3b96a742313" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:26.985900 21061 raft_consensus.cc:348] T 13bf498c0abe436988718e4c55535f09 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:26.995635 20745 raft_consensus.cc:2454] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:26.995659 21061 raft_consensus.cc:374] T 13bf498c0abe436988718e4c55535f09 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:27.010403 21061 raft_consensus.cc:729] T 13bf498c0abe436988718e4c55535f09 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:27.015216 20570 leader_election.cc:302] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:27.011358 21061 consensus_queue.cc:260] T 13bf498c0abe436988718e4c55535f09 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:27.022794 21701 raft_consensus.cc:2781] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:26.993574 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a777b602ae6d4dac9f1ac116e0a2e86e" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:27.035122 21701 raft_consensus.cc:482] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:27.065550 21061 ts_tablet_manager.cc:1428] T 13bf498c0abe436988718e4c55535f09 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.110s	user 0.009s	sys 0.005s
I20260812 19:26:27.076851 21061 tablet_bootstrap.cc:492] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:27.057847 20985 raft_consensus.cc:3037] T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:27.093840 21060 tablet_bootstrap.cc:492] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:27.094444 21060 ts_tablet_manager.cc:1397] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.341s	user 0.028s	sys 0.021s
I20260812 19:26:27.068944 21701 raft_consensus.cc:3037] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:27.098765 21777 log.cc:924] Time spent T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260812 19:26:27.106745 20977 raft_consensus.cc:2454] T f6acd85742e946ddb5bb17831fc226fe P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:27.131567 20454 catalog_manager.cc:5495] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:27.125502 20633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a777b602ae6d4dac9f1ac116e0a2e86e" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:27.153219 21093 consensus_queue.cc:1035] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:27.158977 20985 raft_consensus.cc:2454] T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
W20260812 19:26:27.162446 21789 log.cc:924] Time spent T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c: Append to log took a long time: real 0.160s	user 0.000s	sys 0.004s
I20260812 19:26:27.164593 21060 raft_consensus.cc:348] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:27.165432 21060 raft_consensus.cc:374] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:27.165781 21060 raft_consensus.cc:729] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:27.166595 21060 consensus_queue.cc:260] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
W20260812 19:26:27.170243 20691 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 77725.5us
I20260812 19:26:27.139856 21635 raft_consensus.cc:686] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:27.193346 20688 leader_election.cc:302] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
W20260812 19:26:27.234628 20570 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 114692us
W20260812 19:26:27.251511 20688 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:37307, user_credentials={real_user=slave}} blocked reactor thread for 58239.4us
I20260812 19:26:27.235944 21060 ts_tablet_manager.cc:1428] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.141s	user 0.007s	sys 0.000s
I20260812 19:26:27.183791 21568 raft_consensus.cc:482] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:27.184551 21673 raft_consensus.cc:482] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:27.259508 21060 tablet_bootstrap.cc:492] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:27.182675 20855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3408c35d6e414cb4bb2aa3b96a742313" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:27.251585 20691 leader_election.cc:341] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:27.232805 20922 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 52471.8us
I20260812 19:26:27.286935 21058 tablet_bootstrap.cc:492] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036: No bootstrap required, opened a new log
I20260812 19:26:27.289840 21058 ts_tablet_manager.cc:1397] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036: Time spent bootstrapping tablet: real 0.476s	user 0.033s	sys 0.051s
I20260812 19:26:27.296625 21635 consensus_queue.cc:237] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:27.298902 21822 raft_consensus.cc:2781] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:27.299504 21822 raft_consensus.cc:686] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:27.299963 21058 raft_consensus.cc:348] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:27.300370 21822 consensus_queue.cc:237] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:27.272559 21673 raft_consensus.cc:504] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:27.303186 21055 tablet_bootstrap.cc:492] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:27.303761 21055 ts_tablet_manager.cc:1397] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.368s	user 0.029s	sys 0.013s
I20260812 19:26:27.304524 21673 leader_election.cc:288] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:27.305691 21060 tablet_bootstrap.cc:654] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:27.300740 21058 raft_consensus.cc:374] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:27.306631 21058 raft_consensus.cc:729] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Initialized, Role: FOLLOWER
I20260812 19:26:27.270056 21568 raft_consensus.cc:504] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:27.296636 20854 raft_consensus.cc:3037] T 13bf498c0abe436988718e4c55535f09 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:27.309085 21568 leader_election.cc:288] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:27.307365 21058 consensus_queue.cc:260] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:27.312652 21061 tablet_bootstrap.cc:654] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:27.353291 21058 ts_tablet_manager.cc:1428] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260812 19:26:27.347329 21055 raft_consensus.cc:348] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:27.355808 21055 raft_consensus.cc:374] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:27.357450 21055 raft_consensus.cc:729] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:27.358053 21055 consensus_queue.cc:260] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:27.315740 21701 raft_consensus.cc:504] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:27.375010 20985 raft_consensus.cc:3037] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:27.380869 20566 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 108098us
I20260812 19:26:27.382871 21055 ts_tablet_manager.cc:1428] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260812 19:26:27.392340 21055 tablet_bootstrap.cc:492] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:27.399299 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e4b77eb0b847f69ab95f45c1c3ed1e" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:27.403890 20637 raft_consensus.cc:2454] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:27.421123 21055 tablet_bootstrap.cc:654] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:27.473603 20530 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260812 19:26:27.474095 20691 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 100577us
I20260812 19:26:27.509053 20977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ed708096ce463aba0483b0487227ba" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:27.509979 21060 tablet_bootstrap.cc:492] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:27.510536 21060 ts_tablet_manager.cc:1397] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.257s	user 0.023s	sys 0.016s
I20260812 19:26:27.514910 21060 raft_consensus.cc:348] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:27.515739 21060 raft_consensus.cc:374] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:27.516065 21060 raft_consensus.cc:729] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:27.516881 21060 consensus_queue.cc:260] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:27.536132 20636 raft_consensus.cc:3037] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:27.570164 21060 ts_tablet_manager.cc:1428] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260812 19:26:27.571482 21060 tablet_bootstrap.cc:492] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:27.574822 21093 raft_consensus.cc:482] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:27.575492 21093 raft_consensus.cc:504] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
W20260812 19:26:27.567955 20566 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 176390us
W20260812 19:26:27.599682 20691 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 89701.7us
I20260812 19:26:27.602258 21093 leader_election.cc:288] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:27.613004 20691 leader_election.cc:302] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:27.590009 21701 leader_election.cc:288] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:27.607903 20636 raft_consensus.cc:1261] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Refusing update from remote peer 8c9e33eee61649e18fe397e56bdddea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260812 19:26:27.606150 20566 leader_election.cc:341] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:27.634624 20852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e4b77eb0b847f69ab95f45c1c3ed1e" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:27.657058 21060 tablet_bootstrap.cc:654] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:27.667438 20566 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 61944.9us
W20260812 19:26:27.621495 20922 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 124943us
I20260812 19:26:27.641197 21701 consensus_queue.cc:1035] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260812 19:26:27.673542 21852 raft_consensus.cc:2781] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:27.674119 21852 raft_consensus.cc:482] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:27.674527 21852 raft_consensus.cc:3037] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:27.674618 20858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaf0d4e2ed4d039a3635696107687a" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:27.697463 20691 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 51025.8us
W20260812 19:26:27.697566 20688 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:37307, user_credentials={real_user=slave}} blocked reactor thread for 49531.1us
W20260812 19:26:27.665452 20565 leader_election.cc:341] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:27.712996 20691 leader_election.cc:341] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:27.710500 21822 raft_consensus.cc:482] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:27.715947 21822 raft_consensus.cc:504] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:27.720302 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57439ca2e634277b5b83494eddd4acb" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:27.701668 20858 raft_consensus.cc:2454] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:27.726837 20628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57439ca2e634277b5b83494eddd4acb" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
W20260812 19:26:27.729583 20688 leader_election.cc:341] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:27.733377 20627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaf0d4e2ed4d039a3635696107687a" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:27.735415 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3408c35d6e414cb4bb2aa3b96a742313" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:27.736076 20745 raft_consensus.cc:3037] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:27.742798 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ed708096ce463aba0483b0487227ba" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:27.752776 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 90744us
I20260812 19:26:27.760214 20745 raft_consensus.cc:2454] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:27.718569 21822 leader_election.cc:288] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
W20260812 19:26:27.768018 20691 leader_election.cc:341] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:27.768561 20570 leader_election.cc:302] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:27.769946 20691 leader_election.cc:302] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:27.772740 21057 raft_consensus.cc:2781] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
W20260812 19:26:27.739636 20565 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:37307, user_credentials={real_user=slave}} blocked reactor thread for 78792.4us
I20260812 19:26:27.783908 21833 raft_consensus.cc:2726] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:27.784098 20851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3408c35d6e414cb4bb2aa3b96a742313" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:27.819617 21055 tablet_bootstrap.cc:492] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:27.819296 21821 consensus_queue.cc:1035] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260812 19:26:27.820264 21055 ts_tablet_manager.cc:1397] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.428s	user 0.019s	sys 0.022s
W20260812 19:26:27.836237 20691 consensus_peers.cc:487] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:27.841305 21791 consensus_queue.cc:1035] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260812 19:26:27.843859 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 62585.9us
I20260812 19:26:27.844189 21061 tablet_bootstrap.cc:492] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:27.844794 21061 ts_tablet_manager.cc:1397] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.768s	user 0.048s	sys 0.064s
I20260812 19:26:27.850463 21060 tablet_bootstrap.cc:492] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:27.851078 21060 ts_tablet_manager.cc:1397] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.280s	user 0.012s	sys 0.003s
I20260812 19:26:27.853766 21060 raft_consensus.cc:348] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:27.856290 21093 consensus_queue.cc:1035] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:27.854486 21060 raft_consensus.cc:374] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:27.858047 21060 raft_consensus.cc:729] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:27.858745 21060 consensus_queue.cc:260] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:27.859598 21057 raft_consensus.cc:686] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
W20260812 19:26:27.859598 20566 leader_election.cc:341] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:27.860929 20566 leader_election.cc:302] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:27.860553 21057 consensus_queue.cc:237] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:27.864650 21061 raft_consensus.cc:348] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:27.865536 21061 raft_consensus.cc:374] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:27.865856 21061 raft_consensus.cc:729] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
W20260812 19:26:27.863152 20566 leader_election.cc:341] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:27.869869 21061 consensus_queue.cc:260] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:27.873672 21055 raft_consensus.cc:348] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:27.884621 21055 raft_consensus.cc:374] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:27.884958 21055 raft_consensus.cc:729] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:27.889235 21060 ts_tablet_manager.cc:1428] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260812 19:26:27.885612 21055 consensus_queue.cc:260] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:27.891527 21060 tablet_bootstrap.cc:492] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:27.895380 21061 ts_tablet_manager.cc:1428] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
W20260812 19:26:27.863817 20922 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 126275us
I20260812 19:26:27.934458 21061 tablet_bootstrap.cc:492] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:27.897544 21846 raft_consensus.cc:2726] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:27.961086 21839 consensus_queue.cc:1035] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.097s
I20260812 19:26:27.962931 21836 raft_consensus.cc:482] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:27.963539 21836 raft_consensus.cc:504] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
W20260812 19:26:27.986783 20566 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 115714us
I20260812 19:26:27.968439 21831 consensus_queue.cc:1035] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.096s
W20260812 19:26:27.996953 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 141575us
I20260812 19:26:27.999851 21852 raft_consensus.cc:504] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:28.016780 21060 tablet_bootstrap.cc:654] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:28.011065 20918 leader_election.cc:302] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:28.021034 21862 raft_consensus.cc:2781] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:28.021440 21862 raft_consensus.cc:482] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:28.021850 21862 raft_consensus.cc:3037] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:26:27.994083 20565 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:37307, user_credentials={real_user=slave}} blocked reactor thread for 92208.6us
I20260812 19:26:28.028286 21055 ts_tablet_manager.cc:1428] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.208s	user 0.011s	sys 0.000s
I20260812 19:26:28.031834 21055 tablet_bootstrap.cc:492] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:28.052727 21836 leader_election.cc:288] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
W20260812 19:26:28.057063 21903 log.cc:924] Time spent T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039: Append to log took a long time: real 0.091s	user 0.003s	sys 0.001s
W20260812 19:26:28.063141 21890 log.cc:924] Time spent T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039: Append to log took a long time: real 0.204s	user 0.001s	sys 0.001s
I20260812 19:26:28.069552 21061 tablet_bootstrap.cc:654] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:28.071237 21897 log.cc:924] Time spent T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039: Append to log took a long time: real 0.105s	user 0.003s	sys 0.000s
I20260812 19:26:28.079017 21852 leader_election.cc:288] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
W20260812 19:26:28.086783 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 43654.7us
I20260812 19:26:28.096359 20852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e4b77eb0b847f69ab95f45c1c3ed1e" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
W20260812 19:26:28.106248 20691 leader_election.cc:341] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:28.113041 21862 raft_consensus.cc:504] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:28.118165 21812 consensus_queue.cc:1035] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260812 19:26:28.121922 21862 leader_election.cc:288] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:28.125205 20851 raft_consensus.cc:3037] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:28.126788 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaf0d4e2ed4d039a3635696107687a" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:28.127712 20854 raft_consensus.cc:3037] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:26:28.137070 20570 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 162606us
W20260812 19:26:28.142256 20566 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 154660us
I20260812 19:26:28.143080 21055 tablet_bootstrap.cc:654] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:28.144999 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37466bb31e941bfaea862a42aafe4a2" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:28.152722 20454 catalog_manager.cc:5495] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:28.172601 21060 tablet_bootstrap.cc:492] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
W20260812 19:26:28.179618 21911 log.cc:924] Time spent T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.003s
I20260812 19:26:28.181313 20637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaf0d4e2ed4d039a3635696107687a" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:28.183279 21060 ts_tablet_manager.cc:1397] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.293s	user 0.018s	sys 0.006s
W20260812 19:26:28.157768 20565 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:37307, user_credentials={real_user=slave}} blocked reactor thread for 112200us
I20260812 19:26:28.220131 20633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e4b77eb0b847f69ab95f45c1c3ed1e" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:28.220903 20633 raft_consensus.cc:3037] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:28.228266 21061 tablet_bootstrap.cc:492] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:28.228899 21061 ts_tablet_manager.cc:1397] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.295s	user 0.023s	sys 0.011s
I20260812 19:26:28.231940 21061 raft_consensus.cc:348] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:28.236950 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37466bb31e941bfaea862a42aafe4a2" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:28.244598 20635 raft_consensus.cc:3037] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:28.259825 20970 raft_consensus.cc:1226] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Rejecting Update request from peer 171f67787a8348fb9c7b19bf09026039 for earlier term 1. Current term is 2. Ops: []
I20260812 19:26:28.264823 21671 consensus_queue.cc:1035] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:28.265740 20854 raft_consensus.cc:2454] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 2.
I20260812 19:26:28.265574 21817 consensus_queue.cc:1035] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:28.266626 20852 raft_consensus.cc:1226] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Rejecting Update request from peer 171f67787a8348fb9c7b19bf09026039 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260812 19:26:28.269377 21060 raft_consensus.cc:348] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:28.270114 21060 raft_consensus.cc:374] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:28.270385 21060 raft_consensus.cc:729] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:28.271291 21061 raft_consensus.cc:374] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:28.266952 20918 leader_election.cc:302] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:28.274139 21060 consensus_queue.cc:260] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:28.275410 21912 raft_consensus.cc:2781] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:28.278196 21057 consensus_queue.cc:1046] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:28.279393 21057 raft_consensus.cc:3032] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:28.279767 21057 raft_consensus.cc:729] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:28.273509 21061 raft_consensus.cc:729] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:28.287498 21057 consensus_queue.cc:260] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:28.288453 21057 raft_consensus.cc:3037] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:26:28.154083 20922 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 98497.6us
I20260812 19:26:28.291090 21060 ts_tablet_manager.cc:1428] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.107s	user 0.007s	sys 0.000s
I20260812 19:26:28.292454 21060 tablet_bootstrap.cc:492] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c: Bootstrap starting.
I20260812 19:26:28.281832 21061 consensus_queue.cc:260] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:28.291934 21657 raft_consensus.cc:482] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:28.301396 21657 raft_consensus.cc:504] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:28.305815 20633 raft_consensus.cc:2454] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:28.309847 21061 ts_tablet_manager.cc:1428] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260812 19:26:28.291028 21912 raft_consensus.cc:686] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [term 2 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:28.313699 20691 leader_election.cc:302] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:28.316953 21061 tablet_bootstrap.cc:492] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:28.325868 21671 raft_consensus.cc:2781] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:28.347078 21912 consensus_queue.cc:237] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:28.361370 20850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ed708096ce463aba0483b0487227ba" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:28.361634 20636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ed708096ce463aba0483b0487227ba" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:28.362217 20636 raft_consensus.cc:2454] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:28.363381 21657 leader_election.cc:288] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
W20260812 19:26:28.365595 20918 leader_election.cc:341] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:28.370103 20918 leader_election.cc:302] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:28.371127 21907 raft_consensus.cc:2781] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:28.371543 21907 raft_consensus.cc:482] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:28.371922 21907 raft_consensus.cc:3037] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:28.329092 20565 leader_election.cc:302] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
W20260812 19:26:28.379848 20565 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:37307, user_credentials={real_user=slave}} blocked reactor thread for 63675.3us
I20260812 19:26:28.380728 21830 raft_consensus.cc:2726] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:28.385317 21055 tablet_bootstrap.cc:492] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:28.385872 21055 ts_tablet_manager.cc:1397] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.354s	user 0.046s	sys 0.045s
I20260812 19:26:28.388782 21093 raft_consensus.cc:482] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:28.389237 21093 raft_consensus.cc:504] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:28.391201 21093 leader_election.cc:288] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:28.392748 20850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:28.329800 21887 consensus_queue.cc:1035] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.064s
W20260812 19:26:28.394120 20918 leader_election.cc:341] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:28.388608 21055 raft_consensus.cc:348] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:28.400606 21055 raft_consensus.cc:374] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:28.401166 21055 raft_consensus.cc:729] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:28.382397 21060 tablet_bootstrap.cc:654] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:28.419641 21811 raft_consensus.cc:482] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc1471911ec442396b400eed9d18036)
I20260812 19:26:28.420480 21811 raft_consensus.cc:504] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:28.426452 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8bf3b3e0e4c425e9d86c3e5b7a062cf" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:28.426811 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8bf3b3e0e4c425e9d86c3e5b7a062cf" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:28.428964 20808 leader_election.cc:302] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
I20260812 19:26:28.401824 21055 consensus_queue.cc:260] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:28.432143 21061 tablet_bootstrap.cc:654] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:28.359761 21671 raft_consensus.cc:686] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:28.448355 21797 raft_consensus.cc:2726] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:28.434535 21811 leader_election.cc:288] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:28.455772 21657 raft_consensus.cc:482] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:28.456537 21657 raft_consensus.cc:504] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:28.472132 21055 ts_tablet_manager.cc:1428] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.001s
I20260812 19:26:28.473894 21055 tablet_bootstrap.cc:492] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:28.482229 21671 consensus_queue.cc:237] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:28.489801 21822 raft_consensus.cc:482] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:28.490319 21822 raft_consensus.cc:504] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:28.492349 21822 leader_election.cc:288] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:28.496284 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:28.497157 20742 raft_consensus.cc:2454] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 0.
I20260812 19:26:28.513360 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:28.515300 20852 raft_consensus.cc:3037] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:28.519827 20850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:28.521549 20691 leader_election.cc:341] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:28.477201 21907 raft_consensus.cc:504] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:28.529206 21907 leader_election.cc:288] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:28.534840 20922 leader_election.cc:302] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:28.553297 20850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ed708096ce463aba0483b0487227ba" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:28.554847 20633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ed708096ce463aba0483b0487227ba" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:28.555653 20633 raft_consensus.cc:3037] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:28.514446 20970 raft_consensus.cc:2454] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 0.
I20260812 19:26:28.565006 21912 raft_consensus.cc:2781] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:28.566627 21912 raft_consensus.cc:482] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:28.567047 21912 raft_consensus.cc:3037] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:28.570765 20633 raft_consensus.cc:2454] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:28.572067 21657 leader_election.cc:288] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:28.573879 20688 leader_election.cc:302] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:28.574985 21839 raft_consensus.cc:2781] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:28.575511 21839 raft_consensus.cc:482] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:28.575910 21839 raft_consensus.cc:3037] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:28.576746 20918 leader_election.cc:302] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:28.578723 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "273e3feb623f4b0d8b3078f4a6a49ac6" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:28.580282 20627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "273e3feb623f4b0d8b3078f4a6a49ac6" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:28.584307 21093 raft_consensus.cc:2781] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:28.584857 21093 raft_consensus.cc:686] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:28.585659 21093 consensus_queue.cc:237] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:28.591500 21839 raft_consensus.cc:504] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:28.601625 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
W20260812 19:26:28.604585 20691 leader_election.cc:341] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:28.605602 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
W20260812 19:26:28.610078 20918 leader_election.cc:341] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:28.612197 20918 leader_election.cc:341] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:28.604445 21839 leader_election.cc:288] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:28.622699 21817 raft_consensus.cc:482] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:28.657325 21908 consensus_queue.cc:1035] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260812 19:26:28.670715 20918 leader_election.cc:341] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:28.671446 20918 leader_election.cc:302] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:28.660576 21817 raft_consensus.cc:504] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:28.682118 21055 tablet_bootstrap.cc:654] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:28.682993 21817 leader_election.cc:288] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:28.685143 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3408c35d6e414cb4bb2aa3b96a742313" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:28.703657 21830 raft_consensus.cc:482] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:28.704300 21830 raft_consensus.cc:504] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:28.708163 20448 catalog_manager.cc:5495] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:28.686463 20627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3408c35d6e414cb4bb2aa3b96a742313" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:28.687525 21880 raft_consensus.cc:2726] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:26:28.724560 20530 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:26:28.732312 21060 tablet_bootstrap.cc:492] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c: No bootstrap required, opened a new log
I20260812 19:26:28.732889 21060 ts_tablet_manager.cc:1397] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c: Time spent bootstrapping tablet: real 0.441s	user 0.017s	sys 0.018s
I20260812 19:26:28.735452 20812 leader_election.cc:302] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:28.753048 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57439ca2e634277b5b83494eddd4acb" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:28.756371 21830 leader_election.cc:288] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:28.767223 21060 raft_consensus.cc:348] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:28.768086 21060 raft_consensus.cc:374] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:28.768380 21060 raft_consensus.cc:729] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Initialized, Role: FOLLOWER
I20260812 19:26:28.768981 21060 consensus_queue.cc:260] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:28.776533 20985 raft_consensus.cc:2454] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:28.777467 21061 tablet_bootstrap.cc:492] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:28.778012 21061 ts_tablet_manager.cc:1397] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.467s	user 0.017s	sys 0.018s
I20260812 19:26:28.789978 21060 ts_tablet_manager.cc:1428] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.001s
I20260812 19:26:28.802618 21912 raft_consensus.cc:504] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:28.804811 21061 raft_consensus.cc:348] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:28.805688 21061 raft_consensus.cc:374] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:28.806005 21061 raft_consensus.cc:729] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:28.806056 21912 leader_election.cc:288] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:28.806902 21061 consensus_queue.cc:260] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:28.862257 20565 leader_election.cc:302] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
W20260812 19:26:28.864635 20566 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 107167us
I20260812 19:26:28.877990 20451 catalog_manager.cc:5495] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } }
W20260812 19:26:28.885202 20570 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 132305us
I20260812 19:26:28.894274 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57439ca2e634277b5b83494eddd4acb" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:28.896024 20745 raft_consensus.cc:2454] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
W20260812 19:26:28.903085 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 196075us
I20260812 19:26:28.916368 20970 raft_consensus.cc:2379] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate efc1471911ec442396b400eed9d18036 in current term 1: Already voted for candidate d5ab425bcd82426387b1a5b02e55b64c in this term.
I20260812 19:26:28.921959 21415 raft_consensus.cc:2781] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:28.922688 21415 raft_consensus.cc:482] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:28.923180 21415 raft_consensus.cc:3037] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:28.923955 21055 tablet_bootstrap.cc:492] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039: No bootstrap required, opened a new log
I20260812 19:26:28.925243 21055 ts_tablet_manager.cc:1397] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.452s	user 0.018s	sys 0.022s
I20260812 19:26:28.926151 21061 ts_tablet_manager.cc:1428] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.148s	user 0.010s	sys 0.003s
I20260812 19:26:28.931123 21061 tablet_bootstrap.cc:492] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:28.943086 21791 raft_consensus.cc:2726] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:28.977684 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:28.983688 20688 leader_election.cc:302] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:28.985136 21822 raft_consensus.cc:2726] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:26:28.991159 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:28.995359 20742 raft_consensus.cc:2379] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d5ab425bcd82426387b1a5b02e55b64c in current term 1: Already voted for candidate efc1471911ec442396b400eed9d18036 in this term.
W20260812 19:26:29.030035 20918 leader_election.cc:341] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:29.030880 20918 leader_election.cc:302] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036
I20260812 19:26:29.034530 21862 raft_consensus.cc:2726] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:26:29.035723 20454 catalog_manager.cc:5495] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:29.034025 21055 raft_consensus.cc:348] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:29.037799 21055 raft_consensus.cc:374] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:29.038228 21055 raft_consensus.cc:729] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:29.043102 21055 consensus_queue.cc:260] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
W20260812 19:26:29.051146 20691 consensus_peers.cc:487] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:29.092962 21817 raft_consensus.cc:482] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:29.093669 21817 raft_consensus.cc:504] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:29.098727 21817 leader_election.cc:288] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:29.103238 21841 consensus_queue.cc:1035] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:29.105587 20619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ed708096ce463aba0483b0487227ba" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:29.106194 21055 ts_tablet_manager.cc:1428] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.180s	user 0.009s	sys 0.003s
I20260812 19:26:29.106730 20619 raft_consensus.cc:2379] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c9e33eee61649e18fe397e56bdddea3 in current term 1: Already voted for candidate d5ab425bcd82426387b1a5b02e55b64c in this term.
I20260812 19:26:29.111537 21061 tablet_bootstrap.cc:654] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:29.117430 20566 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 50881.4us
I20260812 19:26:29.118278 20453 catalog_manager.cc:5495] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 1 to 2, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 2 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:29.135295 20628 raft_consensus.cc:1261] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Refusing update from remote peer d5ab425bcd82426387b1a5b02e55b64c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:29.164595 21061 tablet_bootstrap.cc:492] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:29.165446 21061 ts_tablet_manager.cc:1397] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.236s	user 0.012s	sys 0.008s
I20260812 19:26:29.169099 21061 raft_consensus.cc:348] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:29.169997 21061 raft_consensus.cc:374] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:29.172241 20852 raft_consensus.cc:1261] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Refusing update from remote peer d5ab425bcd82426387b1a5b02e55b64c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:29.173017 21061 raft_consensus.cc:729] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:29.173903 21061 consensus_queue.cc:260] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:29.176167 21061 ts_tablet_manager.cc:1428] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260812 19:26:29.177522 21061 tablet_bootstrap.cc:492] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:29.182998 21957 raft_consensus.cc:482] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:29.183763 21957 raft_consensus.cc:504] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:29.187942 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "273e3feb623f4b0d8b3078f4a6a49ac6" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:29.188805 20985 raft_consensus.cc:2454] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:29.190631 20565 leader_election.cc:302] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:29.191584 21957 leader_election.cc:288] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:29.191843 21949 raft_consensus.cc:2781] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:29.195865 21949 raft_consensus.cc:482] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:29.196257 21949 raft_consensus.cc:3037] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:29.199829 21061 tablet_bootstrap.cc:654] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:29.204952 20854 raft_consensus.cc:3037] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:29.206606 21061 tablet_bootstrap.cc:492] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:29.207185 21061 ts_tablet_manager.cc:1397] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260812 19:26:29.211622 20850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "273e3feb623f4b0d8b3078f4a6a49ac6" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:29.212461 20850 raft_consensus.cc:2454] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 0.
I20260812 19:26:29.213354 21061 raft_consensus.cc:348] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:29.214242 21061 raft_consensus.cc:374] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:29.214579 21061 raft_consensus.cc:729] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:29.215441 21061 consensus_queue.cc:260] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:29.218343 21061 ts_tablet_manager.cc:1428] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260812 19:26:29.219700 21061 tablet_bootstrap.cc:492] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3: Bootstrap starting.
I20260812 19:26:29.219254 21949 raft_consensus.cc:504] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:29.221971 21949 leader_election.cc:288] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:29.223009 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "273e3feb623f4b0d8b3078f4a6a49ac6" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:29.223660 20985 raft_consensus.cc:3037] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:29.229031 21797 raft_consensus.cc:482] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:29.229588 21797 raft_consensus.cc:504] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:29.232095 21797 leader_election.cc:288] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:29.126183 21415 raft_consensus.cc:504] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:29.238785 20850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "273e3feb623f4b0d8b3078f4a6a49ac6" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:29.224511 20451 catalog_manager.cc:5495] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 1 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:29.239394 20850 raft_consensus.cc:3037] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:29.258351 21061 tablet_bootstrap.cc:654] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:29.257444 20985 raft_consensus.cc:2454] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:29.261919 20850 raft_consensus.cc:2454] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:29.263329 20566 leader_election.cc:302] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:29.261981 21912 consensus_queue.cc:1035] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260812 19:26:29.267583 21057 raft_consensus.cc:2781] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:29.252712 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57439ca2e634277b5b83494eddd4acb" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:29.268096 21057 raft_consensus.cc:686] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:29.244966 20971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ed708096ce463aba0483b0487227ba" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:29.268321 20979 raft_consensus.cc:3037] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:29.269042 21057 consensus_queue.cc:237] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:29.281175 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:29.281632 21415 leader_election.cc:288] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:29.282153 20742 raft_consensus.cc:2379] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c9e33eee61649e18fe397e56bdddea3 in current term 1: Already voted for candidate efc1471911ec442396b400eed9d18036 in this term.
I20260812 19:26:29.294768 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57439ca2e634277b5b83494eddd4acb" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:29.295751 20742 raft_consensus.cc:3037] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:29.281263 20979 raft_consensus.cc:2454] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:29.297221 20565 leader_election.cc:302] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:29.296224 21862 consensus_queue.cc:1035] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:29.302112 21949 raft_consensus.cc:2781] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:29.302770 21949 raft_consensus.cc:686] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:29.303727 21949 consensus_queue.cc:237] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:29.318064 21912 consensus_queue.cc:1035] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:29.332049 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:29.332965 20979 raft_consensus.cc:2379] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c9e33eee61649e18fe397e56bdddea3 in current term 1: Already voted for candidate d5ab425bcd82426387b1a5b02e55b64c in this term.
I20260812 19:26:29.336200 20808 leader_election.cc:302] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:29.338284 21795 raft_consensus.cc:2726] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:29.338853 21061 tablet_bootstrap.cc:492] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3: No bootstrap required, opened a new log
I20260812 19:26:29.339468 21061 ts_tablet_manager.cc:1397] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3: Time spent bootstrapping tablet: real 0.120s	user 0.015s	sys 0.007s
I20260812 19:26:29.342267 21061 raft_consensus.cc:348] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:29.342991 21061 raft_consensus.cc:374] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:29.343267 21061 raft_consensus.cc:729] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Initialized, Role: FOLLOWER
I20260812 19:26:29.343950 21061 consensus_queue.cc:260] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:29.347529 21061 ts_tablet_manager.cc:1428] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260812 19:26:29.350384 20808 leader_election.cc:302] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
I20260812 19:26:29.351406 21797 raft_consensus.cc:3037] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:29.352553 21912 consensus_queue.cc:1035] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:29.358181 21795 raft_consensus.cc:482] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:29.358825 21795 raft_consensus.cc:504] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:29.349897 20454 catalog_manager.cc:5495] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:29.361088 21795 leader_election.cc:288] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:29.362931 20633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e4b77eb0b847f69ab95f45c1c3ed1e" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:29.364722 20742 raft_consensus.cc:2454] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 1.
I20260812 19:26:29.365937 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e4b77eb0b847f69ab95f45c1c3ed1e" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:29.368994 20815 leader_election.cc:302] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:29.372431 21812 raft_consensus.cc:2726] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:29.381084 21797 raft_consensus.cc:2726] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:29.426447 20454 catalog_manager.cc:5495] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:29.467007 20854 raft_consensus.cc:3037] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:29.692402 21057 consensus_queue.cc:1035] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:29.706969 21057 consensus_queue.cc:1035] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:26:29.777732 20530 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:26:29.889545 21057 consensus_queue.cc:1035] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:29.890439 21949 consensus_queue.cc:1035] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:26:30.820997 20530 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:26:31.107156 21912 raft_consensus.cc:482] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:31.107834 21912 raft_consensus.cc:504] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:31.109874 21912 leader_election.cc:288] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:31.110834 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:31.111462 20852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:31.111647 20742 raft_consensus.cc:2454] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:31.112236 20852 raft_consensus.cc:2454] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:31.113207 20922 leader_election.cc:302] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:31.114089 21912 raft_consensus.cc:2781] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:31.114532 21912 raft_consensus.cc:482] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:31.114936 21912 raft_consensus.cc:3037] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:31.121699 21912 raft_consensus.cc:504] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:31.123917 21912 leader_election.cc:288] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:31.124738 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:31.125065 20852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bae9c177422418c8b9b4e0aa24fbce2" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:31.125491 20742 raft_consensus.cc:3037] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:31.125833 20852 raft_consensus.cc:3037] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:31.134868 20742 raft_consensus.cc:2454] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 2.
I20260812 19:26:31.136341 20922 leader_election.cc:302] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:31.136920 20852 raft_consensus.cc:2454] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 2.
I20260812 19:26:31.137226 21912 raft_consensus.cc:2781] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:31.138092 21912 raft_consensus.cc:686] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 2 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:31.139187 21912 consensus_queue.cc:237] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:31.151413 20453 catalog_manager.cc:5495] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 0 to 2, leader changed from <none> to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 2 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:31.536723 20742 raft_consensus.cc:1261] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Refusing update from remote peer d5ab425bcd82426387b1a5b02e55b64c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260812 19:26:31.537776 21988 consensus_queue.cc:1035] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:31.552403 20852 raft_consensus.cc:1261] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Refusing update from remote peer d5ab425bcd82426387b1a5b02e55b64c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260812 19:26:31.563844 21988 consensus_queue.cc:1035] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:32.158587  4084 tablet_server.cc:178] TabletServer@127.3.253.1:0 shutting down...
W20260812 19:26:32.175259 20918 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260812 19:26:32.178725 20918 consensus_peers.cc:487] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:32.179523 20918 consensus_peers.cc:487] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:32.208027 20918 consensus_peers.cc:487] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:32.208480 20691 consensus_peers.cc:487] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:32.210351 20918 consensus_peers.cc:487] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:32.222158  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
W20260812 19:26:32.224542 20812 consensus_peers.cc:487] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:32.225255  4084 tablet_replica.cc:330] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.226147  4084 raft_consensus.cc:2229] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.227047  4084 raft_consensus.cc:2258] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.229982  4084 tablet_replica.cc:330] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.230954  4084 raft_consensus.cc:2229] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.231585  4084 raft_consensus.cc:2258] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:32.234381 20918 consensus_peers.cc:487] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:32.235251  4084 tablet_replica.cc:330] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.236073  4084 raft_consensus.cc:2229] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.237187  4084 raft_consensus.cc:2258] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.239441  4084 tablet_replica.cc:330] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.240067  4084 raft_consensus.cc:2229] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.240898  4084 raft_consensus.cc:2258] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.243074  4084 tablet_replica.cc:330] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.243744  4084 raft_consensus.cc:2229] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.244175  4084 raft_consensus.cc:2258] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.246345  4084 tablet_replica.cc:330] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.247009  4084 raft_consensus.cc:2229] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.247843  4084 raft_consensus.cc:2258] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.250236  4084 tablet_replica.cc:330] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.251297  4084 raft_consensus.cc:2229] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.251899  4084 raft_consensus.cc:2258] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.254635  4084 tablet_replica.cc:330] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
W20260812 19:26:32.254899 20812 consensus_peers.cc:487] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:32.255455  4084 raft_consensus.cc:2229] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.255997  4084 raft_consensus.cc:2258] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.258147  4084 tablet_replica.cc:330] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.258800  4084 raft_consensus.cc:2229] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.259282  4084 raft_consensus.cc:2258] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.261426  4084 tablet_replica.cc:330] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.262018  4084 raft_consensus.cc:2229] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.263149  4084 raft_consensus.cc:2258] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.265410  4084 tablet_replica.cc:330] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.266006  4084 raft_consensus.cc:2229] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.266521  4084 raft_consensus.cc:2258] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.268692  4084 tablet_replica.cc:330] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.269276  4084 raft_consensus.cc:2229] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.269749  4084 raft_consensus.cc:2258] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.271929  4084 tablet_replica.cc:330] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.272503  4084 raft_consensus.cc:2229] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.272943  4084 raft_consensus.cc:2258] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.275604  4084 tablet_replica.cc:330] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.276436  4084 raft_consensus.cc:2229] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.277693  4084 raft_consensus.cc:2258] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:32.279073 20918 consensus_peers.cc:487] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:32.280618  4084 tablet_replica.cc:330] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.281765  4084 raft_consensus.cc:2229] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.282394  4084 raft_consensus.cc:2258] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:32.283161 20918 consensus_peers.cc:487] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:32.285140  4084 tablet_replica.cc:330] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.285913  4084 raft_consensus.cc:2229] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.286782  4084 raft_consensus.cc:2258] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.289384  4084 tablet_replica.cc:330] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.290210  4084 raft_consensus.cc:2229] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.290731  4084 raft_consensus.cc:2258] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.293253  4084 tablet_replica.cc:330] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.293963  4084 raft_consensus.cc:2229] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.294906  4084 raft_consensus.cc:2258] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.297163  4084 tablet_replica.cc:330] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.297760  4084 raft_consensus.cc:2229] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.298370  4084 raft_consensus.cc:2258] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:32.300660 20691 consensus_peers.cc:487] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:32.301177  4084 tablet_replica.cc:330] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.301837  4084 raft_consensus.cc:2229] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.302263  4084 raft_consensus.cc:2258] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.305037  4084 tablet_replica.cc:330] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.305853  4084 raft_consensus.cc:2229] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.306483  4084 raft_consensus.cc:2258] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:32.308894 20918 consensus_peers.cc:487] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:32.309548  4084 tablet_replica.cc:330] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.310353  4084 raft_consensus.cc:2229] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.311326  4084 raft_consensus.cc:2258] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.313443  4084 tablet_replica.cc:330] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.314184  4084 raft_consensus.cc:2229] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.315214  4084 raft_consensus.cc:2258] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.317590  4084 tablet_replica.cc:330] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.318214  4084 raft_consensus.cc:2229] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.318624  4084 raft_consensus.cc:2258] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.320755  4084 tablet_replica.cc:330] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.321331  4084 raft_consensus.cc:2229] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.321806  4084 raft_consensus.cc:2258] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.324092  4084 tablet_replica.cc:330] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.324824  4084 raft_consensus.cc:2229] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.325296  4084 raft_consensus.cc:2258] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:32.326043 20691 consensus_peers.cc:487] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:32.327474  4084 tablet_replica.cc:330] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.328275  4084 raft_consensus.cc:2229] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.328687  4084 raft_consensus.cc:2258] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.331038  4084 tablet_replica.cc:330] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.331665  4084 raft_consensus.cc:2229] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.332546  4084 raft_consensus.cc:2258] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.334591  4084 tablet_replica.cc:330] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.335239  4084 raft_consensus.cc:2229] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.335733  4084 raft_consensus.cc:2258] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.338240  4084 tablet_replica.cc:330] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.339109  4084 raft_consensus.cc:2229] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.339785  4084 raft_consensus.cc:2258] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.342571  4084 tablet_replica.cc:330] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.343382  4084 raft_consensus.cc:2229] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.343880  4084 raft_consensus.cc:2258] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.346860  4084 tablet_replica.cc:330] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.347654  4084 raft_consensus.cc:2229] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.348235  4084 raft_consensus.cc:2258] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.351205  4084 tablet_replica.cc:330] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.352046  4084 raft_consensus.cc:2229] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.352587  4084 raft_consensus.cc:2258] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.354738  4084 tablet_replica.cc:330] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.355232  4084 raft_consensus.cc:2229] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.355756  4084 raft_consensus.cc:2258] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.357805  4084 tablet_replica.cc:330] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.358281  4084 raft_consensus.cc:2229] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.358688  4084 raft_consensus.cc:2258] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.360455  4084 tablet_replica.cc:330] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.361059  4084 raft_consensus.cc:2229] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.361616  4084 raft_consensus.cc:2258] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.364830  4084 tablet_replica.cc:330] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.365743  4084 raft_consensus.cc:2229] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.366866  4084 raft_consensus.cc:2258] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:32.368149 20812 consensus_peers.cc:487] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:32.369719  4084 tablet_replica.cc:330] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.370378  4084 raft_consensus.cc:2229] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.370865  4084 raft_consensus.cc:2258] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.373126  4084 tablet_replica.cc:330] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.373878  4084 raft_consensus.cc:2229] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.375053  4084 raft_consensus.cc:2258] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.377626  4084 tablet_replica.cc:330] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.378262  4084 raft_consensus.cc:2229] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.379160  4084 raft_consensus.cc:2258] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.381275  4084 tablet_replica.cc:330] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.381806  4084 raft_consensus.cc:2229] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.382314  4084 raft_consensus.cc:2258] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.384624  4084 tablet_replica.cc:330] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.385279  4084 raft_consensus.cc:2229] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.386149  4084 raft_consensus.cc:2258] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.388234  4084 tablet_replica.cc:330] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.388761  4084 raft_consensus.cc:2229] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.389638  4084 raft_consensus.cc:2258] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.391904  4084 tablet_replica.cc:330] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.392411  4084 raft_consensus.cc:2229] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:32.393456  4084 raft_consensus.cc:2258] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:32.396564  4084 tablet_replica.cc:330] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039: stopping tablet replica
I20260812 19:26:32.397085  4084 raft_consensus.cc:2229] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:32.397542  4084 raft_consensus.cc:2258] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:32.416255 20691 consensus_peers.cc:487] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:32.422160 20691 consensus_peers.cc:487] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:32.440838 20691 consensus_peers.cc:487] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:32.476293  4084 tablet_server.cc:194] TabletServer@127.3.253.1:0 shutdown complete.
W20260812 19:26:32.478809 20918 consensus_peers.cc:487] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:32.520666 20691 consensus_peers.cc:487] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:32.521466 20691 consensus_peers.cc:487] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:32.531927 20691 consensus_peers.cc:487] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:32.547575 20812 consensus_peers.cc:487] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:32.558706 20918 consensus_peers.cc:487] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:32.562829 20812 consensus_peers.cc:487] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:32.586313  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:26:32.594440 22029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:32.596400 22031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:32.599342 20918 consensus_peers.cc:487] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:32.625620 22037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:32.627310  4084 server_base.cc:1034] running on GCE node
I20260812 19:26:32.633765  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:26:32.634205  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:26:32.634502  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562792634487 us; error 0 us; skew 500 ppm
I20260812 19:26:32.635470  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:32.646944  4084 webserver.cc:460] Webserver started at http://127.3.253.1:42023/ using document root <none> and password file <none>
I20260812 19:26:32.648051  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:32.648329  4084 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260812 19:26:32.652845  4084 fs_manager.cc:709] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 19:26:32.661331 22047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:32.662919  4084 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260812 19:26:32.663280  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-0-root
uuid: "171f67787a8348fb9c7b19bf09026039"
format_stamp: "Formatted at 2026-08-12 19:26:16 on dist-test-slave-3kk6"
I20260812 19:26:32.663735  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786562432658360-4084-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260812 19:26:32.688330 20918 consensus_peers.cc:487] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:32.702757 20691 consensus_peers.cc:487] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:32.706427  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:26:32.709297  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260812 19:26:32.714402 20812 consensus_peers.cc:487] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:32.718536  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:26:32.741506 22069 ts_tablet_manager.cc:542] Loading tablet metadata (0/45 complete)
I20260812 19:26:33.032160  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260812 19:26:33.032514  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.299s	user 0.010s	sys 0.008s
I20260812 19:26:33.032877  4084 ts_tablet_manager.cc:594] Registering tablets (0/45 complete)
I20260812 19:26:33.043081 22069 tablet_bootstrap.cc:492] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.058800 22069 tablet_bootstrap.cc:492] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.059777 22069 tablet_bootstrap.cc:492] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:33.060444 22069 ts_tablet_manager.cc:1397] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260812 19:26:33.062999 22069 raft_consensus.cc:348] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.063715 22069 raft_consensus.cc:729] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.064443 22069 consensus_queue.cc:260] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.067297 22069 ts_tablet_manager.cc:1428] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260812 19:26:33.068109 22069 tablet_bootstrap.cc:492] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.082923 22069 tablet_bootstrap.cc:492] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.083928 22069 tablet_bootstrap.cc:492] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:33.084636 22069 ts_tablet_manager.cc:1397] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260812 19:26:33.086915 22069 raft_consensus.cc:348] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.087584 22069 raft_consensus.cc:729] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.088310 22069 consensus_queue.cc:260] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.090305 22069 ts_tablet_manager.cc:1428] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 19:26:33.091104 22069 tablet_bootstrap.cc:492] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.107975 22069 tablet_bootstrap.cc:492] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.108960 22069 tablet_bootstrap.cc:492] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:33.109615 22069 ts_tablet_manager.cc:1397] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260812 19:26:33.113014 22069 raft_consensus.cc:348] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.113696 22069 raft_consensus.cc:729] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.114339 22069 consensus_queue.cc:260] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.116528 22069 ts_tablet_manager.cc:1428] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260812 19:26:33.117316 22069 tablet_bootstrap.cc:492] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.138577 22069 tablet_bootstrap.cc:492] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.139432 22069 tablet_bootstrap.cc:492] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:33.139984 22069 ts_tablet_manager.cc:1397] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260812 19:26:33.141765 22069 raft_consensus.cc:348] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.142302 22069 raft_consensus.cc:729] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.142889 22069 consensus_queue.cc:260] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.144194 22069 ts_tablet_manager.cc:1428] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 19:26:33.144796 22069 tablet_bootstrap.cc:492] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.158697 22069 tablet_bootstrap.cc:492] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.159644 22069 tablet_bootstrap.cc:492] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:33.160461 22069 ts_tablet_manager.cc:1397] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260812 19:26:33.162812 22069 raft_consensus.cc:348] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.163492 22069 raft_consensus.cc:729] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.164151 22069 consensus_queue.cc:260] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.166571 22069 ts_tablet_manager.cc:1428] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260812 19:26:33.167384 22069 tablet_bootstrap.cc:492] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.194938 22069 tablet_bootstrap.cc:492] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.196017 22069 tablet_bootstrap.cc:492] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:33.196738 22069 ts_tablet_manager.cc:1397] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.030s	user 0.023s	sys 0.004s
I20260812 19:26:33.199158 22069 raft_consensus.cc:348] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.199965 22069 raft_consensus.cc:729] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.200775 22069 consensus_queue.cc:260] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.203135 22069 ts_tablet_manager.cc:1428] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 19:26:33.204008 22069 tablet_bootstrap.cc:492] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.236604 22069 tablet_bootstrap.cc:492] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.237597 22069 tablet_bootstrap.cc:492] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:33.238286 22069 ts_tablet_manager.cc:1397] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.016s
I20260812 19:26:33.240760 22069 raft_consensus.cc:348] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.241595 22069 raft_consensus.cc:729] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.242383 22069 consensus_queue.cc:260] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.244650 22069 ts_tablet_manager.cc:1428] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260812 19:26:33.245457 22069 tablet_bootstrap.cc:492] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.259797 22069 tablet_bootstrap.cc:492] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.260762 22069 tablet_bootstrap.cc:492] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:33.261427 22069 ts_tablet_manager.cc:1397] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.006s
I20260812 19:26:33.263705 22069 raft_consensus.cc:348] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.264415 22069 raft_consensus.cc:729] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.265056 22069 consensus_queue.cc:260] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.267099 22069 ts_tablet_manager.cc:1428] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.006s
I20260812 19:26:33.267887 22069 tablet_bootstrap.cc:492] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.279346 22072 raft_consensus.cc:482] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.279964 22072 raft_consensus.cc:504] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.282133 22072 leader_election.cc:288] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.283131 22069 tablet_bootstrap.cc:492] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.284143 22069 tablet_bootstrap.cc:492] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:33.284878 22069 ts_tablet_manager.cc:1397] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.001s
W20260812 19:26:33.286907 20691 leader_election.cc:334] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.284152 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57439ca2e634277b5b83494eddd4acb" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:33.288125 22069 raft_consensus.cc:348] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.288969 20688 leader_election.cc:302] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:33.288992 22069 raft_consensus.cc:729] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.290683 22072 raft_consensus.cc:2726] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:33.290954 22069 consensus_queue.cc:260] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.292810 22069 ts_tablet_manager.cc:1428] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260812 19:26:33.293432 22069 tablet_bootstrap.cc:492] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.306355 22069 tablet_bootstrap.cc:492] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.307389 22069 tablet_bootstrap.cc:492] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:33.308003 22069 ts_tablet_manager.cc:1397] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260812 19:26:33.309964 22069 raft_consensus.cc:348] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.310575 22069 raft_consensus.cc:729] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.311240 22069 consensus_queue.cc:260] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.314867 22069 ts_tablet_manager.cc:1428] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260812 19:26:33.315717 22069 tablet_bootstrap.cc:492] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.328416 21943 raft_consensus.cc:482] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.329063 21943 raft_consensus.cc:504] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.332007 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f906c95927b14410a6818ea15e9e089f" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:33.333277 22069 tablet_bootstrap.cc:492] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.334340 22069 tablet_bootstrap.cc:492] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:33.334299 22072 raft_consensus.cc:482] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.334836  4084 ts_tablet_manager.cc:610] Registered 45 tablets
I20260812 19:26:33.334901 21943 leader_election.cc:288] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.335306 22069 ts_tablet_manager.cc:1397] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260812 19:26:33.335364  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.303s	user 0.285s	sys 0.004s
I20260812 19:26:33.336090 22072 raft_consensus.cc:504] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.337988 22069 raft_consensus.cc:348] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.338559 22072 leader_election.cc:288] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:33.338693 22069 raft_consensus.cc:729] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.339872 22069 consensus_queue.cc:260] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.342161 22069 ts_tablet_manager.cc:1428] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 19:26:33.342700 21987 raft_consensus.cc:482] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.345227 21987 raft_consensus.cc:504] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
W20260812 19:26:33.346036 20918 leader_election.cc:334] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.346698 20918 leader_election.cc:302] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:33.347092 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3044cbc7bbaa46858021ce0b610da983" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:33.347892 21987 leader_election.cc:288] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
W20260812 19:26:33.343840 20691 leader_election.cc:334] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.348205 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3408c35d6e414cb4bb2aa3b96a742313" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:33.342993 22069 tablet_bootstrap.cc:492] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.350111 21797 raft_consensus.cc:482] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.354602 21797 raft_consensus.cc:504] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.356761 21797 leader_election.cc:288] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.358032 20691 leader_election.cc:302] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
W20260812 19:26:33.358837 20812 leader_election.cc:334] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.358959 22071 raft_consensus.cc:482] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.359284 20812 leader_election.cc:302] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:33.359752 22072 raft_consensus.cc:2726] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:33.359697 22071 raft_consensus.cc:504] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.360561 21797 raft_consensus.cc:2726] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:33.367446 22071 leader_election.cc:288] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.371312 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06f6e7dcac69477a99d44c3e039f7d36" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:33.350567 21943 raft_consensus.cc:2726] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:26:33.372296 20812 leader_election.cc:334] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.378144 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f906c95927b14410a6818ea15e9e089f" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:33.379207 20970 raft_consensus.cc:2454] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
W20260812 19:26:33.381007 20691 leader_election.cc:334] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.381919 20691 leader_election.cc:302] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:33.383090 22071 raft_consensus.cc:2726] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:33.384260 20808 leader_election.cc:302] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:33.386839 21987 raft_consensus.cc:2781] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:33.387279 21987 raft_consensus.cc:482] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.387717 21987 raft_consensus.cc:3037] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:33.390992 22069 tablet_bootstrap.cc:492] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.392079 22069 tablet_bootstrap.cc:492] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:33.392851 22069 ts_tablet_manager.cc:1397] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.050s	user 0.025s	sys 0.012s
I20260812 19:26:33.395813 22069 raft_consensus.cc:348] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.396559 21797 raft_consensus.cc:482] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.396868 22069 raft_consensus.cc:729] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.397210 21797 raft_consensus.cc:504] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.397922 22069 consensus_queue.cc:260] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.399816 21797 leader_election.cc:288] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.400260 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0eb60aaf78c64f9ebfdb6f535cc96363" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:33.402156 21987 raft_consensus.cc:504] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.402832 22069 ts_tablet_manager.cc:1428] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260812 19:26:33.404104 22069 tablet_bootstrap.cc:492] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.404760 21987 leader_election.cc:288] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
W20260812 19:26:33.405550 20812 leader_election.cc:334] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.405725 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f906c95927b14410a6818ea15e9e089f" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:33.406133 20812 leader_election.cc:302] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:33.406627 20970 raft_consensus.cc:3037] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:33.410981 21797 raft_consensus.cc:2726] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:26:33.412043 20812 leader_election.cc:334] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.418092 22072 raft_consensus.cc:482] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.418900 22072 raft_consensus.cc:504] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
W20260812 19:26:33.427177 20691 leader_election.cc:334] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.428678 22072 leader_election.cc:288] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:33.418030 20970 raft_consensus.cc:2454] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 2.
I20260812 19:26:33.431023 20808 leader_election.cc:302] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:33.432202 21987 raft_consensus.cc:2781] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:33.432904 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3408c35d6e414cb4bb2aa3b96a742313" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:33.433558 21987 raft_consensus.cc:686] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:33.433820 20854 raft_consensus.cc:2454] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:33.434124 22069 tablet_bootstrap.cc:492] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.434592 21987 consensus_queue.cc:237] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.435240 22069 tablet_bootstrap.cc:492] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:33.436030 22069 ts_tablet_manager.cc:1397] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.003s
I20260812 19:26:33.438738 22069 raft_consensus.cc:348] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.439698 22069 raft_consensus.cc:729] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.440802 22069 consensus_queue.cc:260] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.444022 22069 ts_tablet_manager.cc:1428] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260812 19:26:33.445129 22069 tablet_bootstrap.cc:492] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.447889 20691 leader_election.cc:302] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:33.449088 22072 raft_consensus.cc:2781] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:33.449494 22072 raft_consensus.cc:482] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.449891 22072 raft_consensus.cc:3037] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:33.466867 22071 raft_consensus.cc:482] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.467026 22072 raft_consensus.cc:504] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.467483 22071 raft_consensus.cc:504] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.469624 22071 leader_election.cc:288] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:33.468083 20453 catalog_manager.cc:5495] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 1 to 2, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:33.470956 21987 raft_consensus.cc:482] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.471508 21987 raft_consensus.cc:504] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.473542 21987 leader_election.cc:288] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.475234 20852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6155c47e884e43498e968f83072b863a" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:33.480159 21987 raft_consensus.cc:482] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.480856 21797 raft_consensus.cc:482] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.481386 21797 raft_consensus.cc:504] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.480877 21987 raft_consensus.cc:504] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.486107 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3044cbc7bbaa46858021ce0b610da983" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:33.486979 20740 raft_consensus.cc:2454] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:33.488194 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0454a10a87ed4fd7a5ef01021940c016" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:33.488432 20815 leader_election.cc:302] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:33.489694 22043 raft_consensus.cc:2781] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:33.490171 22043 raft_consensus.cc:482] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.490639 22043 raft_consensus.cc:3037] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:33.493417 21943 raft_consensus.cc:482] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.493961 21943 raft_consensus.cc:504] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.495472 21797 leader_election.cc:288] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.495908 21943 leader_election.cc:288] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.499221 21987 leader_election.cc:288] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
W20260812 19:26:33.481817 20691 leader_election.cc:334] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.505652 20691 leader_election.cc:302] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
W20260812 19:26:33.507238 20812 leader_election.cc:334] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.522780 20812 leader_election.cc:302] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:33.523615 21987 raft_consensus.cc:2726] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:33.507618 22069 tablet_bootstrap.cc:492] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.508296 22072 leader_election.cc:288] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:33.529121 21987 raft_consensus.cc:482] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.529299 22069 tablet_bootstrap.cc:492] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:33.530118 22069 ts_tablet_manager.cc:1397] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.085s	user 0.030s	sys 0.028s
I20260812 19:26:33.529642 21987 raft_consensus.cc:504] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.532768 22069 raft_consensus.cc:348] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.508620 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb51472eb3314091aa30c515f1809f83" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:33.513461 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb51472eb3314091aa30c515f1809f83" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:33.534014 20970 raft_consensus.cc:2454] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:33.535238 20854 raft_consensus.cc:2454] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:33.540234 21797 raft_consensus.cc:482] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.539014 21987 leader_election.cc:288] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:33.540777 21797 raft_consensus.cc:504] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.541749 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6155c47e884e43498e968f83072b863a" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:33.514192 22118 raft_consensus.cc:2726] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:33.514561 22065 raft_consensus.cc:482] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
W20260812 19:26:33.515020 20691 leader_election.cc:334] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.542737 22065 raft_consensus.cc:504] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.544214 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a15940eed3e4cfb8cf7127a2cb2f757" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:33.544847 22065 leader_election.cc:288] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.515076 22043 raft_consensus.cc:504] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.545709 20740 raft_consensus.cc:2454] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:33.547132 22043 leader_election.cc:288] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:33.548070 21797 leader_election.cc:288] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:33.548425 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3044cbc7bbaa46858021ce0b610da983" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:33.549049 20739 raft_consensus.cc:3037] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:33.549063 20815 leader_election.cc:302] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:33.550130 22043 raft_consensus.cc:2781] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:33.550499 22043 raft_consensus.cc:482] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.550890 22043 raft_consensus.cc:3037] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:26:33.515148 20918 leader_election.cc:334] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.519120 22071 raft_consensus.cc:482] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.533463 22069 raft_consensus.cc:729] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.553288 22071 raft_consensus.cc:504] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.553643 22069 consensus_queue.cc:260] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.555450 22071 leader_election.cc:288] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:33.556008 20742 raft_consensus.cc:2454] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:33.556313 22069 ts_tablet_manager.cc:1428] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.004s
I20260812 19:26:33.557174 22069 tablet_bootstrap.cc:492] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
W20260812 19:26:33.557401 20812 leader_election.cc:334] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
W20260812 19:26:33.558195 20812 leader_election.cc:334] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.561499 20815 leader_election.cc:302] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:33.562724 21987 raft_consensus.cc:2781] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:33.563099 21987 raft_consensus.cc:482] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.563462 21987 raft_consensus.cc:3037] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:26:33.563689 20691 leader_election.cc:334] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.566681 20808 leader_election.cc:302] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:33.569094 20852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3408c35d6e414cb4bb2aa3b96a742313" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:33.570219 20851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a15940eed3e4cfb8cf7127a2cb2f757" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:33.570135 20812 leader_election.cc:334] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.569734 20852 raft_consensus.cc:3037] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:33.574199 22117 raft_consensus.cc:2781] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:33.574623 22117 raft_consensus.cc:482] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.575037 22117 raft_consensus.cc:3037] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:26:33.577559 20812 leader_election.cc:334] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
W20260812 19:26:33.578370 20812 leader_election.cc:334] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.582381 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:33.583159 22069 tablet_bootstrap.cc:492] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.583323 22043 raft_consensus.cc:504] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.584213 22069 tablet_bootstrap.cc:492] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:33.585053 22069 ts_tablet_manager.cc:1397] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.009s
I20260812 19:26:33.587731 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6155c47e884e43498e968f83072b863a" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:33.588393 20742 raft_consensus.cc:3037] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:33.589176 22131 raft_consensus.cc:482] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.589751 22131 raft_consensus.cc:504] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
W20260812 19:26:33.591537 20812 leader_election.cc:334] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.591967 22131 leader_election.cc:288] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:33.588721 22069 raft_consensus.cc:348] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.593462 22069 raft_consensus.cc:729] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.593705 22065 raft_consensus.cc:482] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.594286 22065 raft_consensus.cc:504] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.594413 22069 consensus_queue.cc:260] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.594452 20918 leader_election.cc:302] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:33.596462 22060 raft_consensus.cc:2781] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:33.596844 22060 raft_consensus.cc:482] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.597164 22060 raft_consensus.cc:3037] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:33.596469 22065 leader_election.cc:288] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.598815 22069 ts_tablet_manager.cc:1428] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260812 19:26:33.599308 20742 raft_consensus.cc:2454] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 2.
W20260812 19:26:33.598709 20812 leader_election.cc:334] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.599874 22069 tablet_bootstrap.cc:492] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.600399 20815 leader_election.cc:302] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:33.601225 22131 raft_consensus.cc:2781] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:33.601716 22131 raft_consensus.cc:686] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:33.602797 22043 leader_election.cc:288] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:33.602558 22131 consensus_queue.cc:237] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.603719 22071 raft_consensus.cc:482] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.602358 20742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa08d4efbda64360a2f987aab456fb04" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:33.604475 21943 raft_consensus.cc:482] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.604279 22071 raft_consensus.cc:504] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.585947 21987 raft_consensus.cc:504] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.605109 21943 raft_consensus.cc:504] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.606581 22071 leader_election.cc:288] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:33.608539 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57439ca2e634277b5b83494eddd4acb" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:33.609177 20851 raft_consensus.cc:2379] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc1471911ec442396b400eed9d18036 in current term 2: Already voted for candidate 8c9e33eee61649e18fe397e56bdddea3 in this term.
I20260812 19:26:33.609329 22065 raft_consensus.cc:482] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.609905 22065 raft_consensus.cc:504] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.614574 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a15940eed3e4cfb8cf7127a2cb2f757" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:33.615329 20735 raft_consensus.cc:3037] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:33.613056 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06f6e7dcac69477a99d44c3e039f7d36" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:33.616274 20745 raft_consensus.cc:2454] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:33.617480 20922 leader_election.cc:302] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:33.618212 20739 raft_consensus.cc:2454] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 2.
W20260812 19:26:33.624261 20918 leader_election.cc:334] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.609193 20740 raft_consensus.cc:2454] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:33.627380 20918 leader_election.cc:302] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:33.628494 21943 leader_election.cc:288] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:33.628639 20691 leader_election.cc:302] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:33.629166 21943 raft_consensus.cc:2781] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:33.629683 21943 raft_consensus.cc:482] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.630152 21943 raft_consensus.cc:3037] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:33.629830 20742 raft_consensus.cc:2454] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:33.620924 21987 leader_election.cc:288] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:33.639110 20815 leader_election.cc:302] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:33.636252 20922 leader_election.cc:302] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:33.631282 22065 leader_election.cc:288] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:33.641561 20851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa08d4efbda64360a2f987aab456fb04" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:33.648550 20815 leader_election.cc:302] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:33.649708 21797 raft_consensus.cc:482] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
W20260812 19:26:33.662046 20808 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:37307, user_credentials={real_user=slave}} blocked reactor thread for 95460.1us
I20260812 19:26:33.643798 20852 raft_consensus.cc:2454] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 2.
I20260812 19:26:33.650589 22065 raft_consensus.cc:2726] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:33.656663 21987 raft_consensus.cc:2781] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:33.658293 20851 raft_consensus.cc:2454] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:33.671011 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "273e3feb623f4b0d8b3078f4a6a49ac6" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:33.664404 21797 raft_consensus.cc:504] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.674876 22127 raft_consensus.cc:482] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
W20260812 19:26:33.675385 20812 leader_election.cc:334] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.675438 22127 raft_consensus.cc:504] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.677006 21797 leader_election.cc:288] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:33.676892 22060 raft_consensus.cc:504] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
W20260812 19:26:33.678114 20691 leader_election.cc:334] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.678134 22127 leader_election.cc:288] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:33.670766 22134 raft_consensus.cc:482] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.680572 22134 raft_consensus.cc:504] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.680971 22043 raft_consensus.cc:2781] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:33.682785 22134 leader_election.cc:288] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.683212 22043 raft_consensus.cc:482] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.683688 22043 raft_consensus.cc:3037] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:33.685278 20735 raft_consensus.cc:2454] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 2.
I20260812 19:26:33.685920 22072 raft_consensus.cc:2726] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:33.674505 22065 raft_consensus.cc:2781] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:33.687929 22065 raft_consensus.cc:482] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.688352 20691 leader_election.cc:302] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:33.689370 22119 raft_consensus.cc:482] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.689805 20691 leader_election.cc:302] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:33.701825 22071 raft_consensus.cc:2781] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:33.702229 22070 raft_consensus.cc:2781] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:33.702819 22070 raft_consensus.cc:482] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.689865 22119 raft_consensus.cc:504] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.703238 22070 raft_consensus.cc:3037] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:33.686184 21943 raft_consensus.cc:504] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.693845 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91aea69f88c43cb84d67ea8a6e8d8bf" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
W20260812 19:26:33.706545 20922 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 70415.5us
I20260812 19:26:33.702414 22071 raft_consensus.cc:686] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:33.691830 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6510fddf1024d71b387e8dfa568e96c" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:33.690690 22117 raft_consensus.cc:504] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.708817 22071 consensus_queue.cc:237] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.711984 21943 leader_election.cc:288] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:33.714062 22117 leader_election.cc:288] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.718283 22141 raft_consensus.cc:482] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.719077 22141 raft_consensus.cc:504] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.714172 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06f6e7dcac69477a99d44c3e039f7d36" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:33.720665 20739 raft_consensus.cc:3037] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:26:33.721976 20812 leader_election.cc:334] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.688402 22065 raft_consensus.cc:3037] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:33.722450 20812 leader_election.cc:302] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
W20260812 19:26:33.719364 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 55158.2us
I20260812 19:26:33.723688 22072 raft_consensus.cc:482] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
W20260812 19:26:33.724437 20918 leader_election.cc:334] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.724269 22072 raft_consensus.cc:504] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
W20260812 19:26:33.725014 20918 leader_election.cc:334] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
W20260812 19:26:33.725632 20918 leader_election.cc:334] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.726313 22072 leader_election.cc:288] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:33.713352 21987 raft_consensus.cc:686] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
W20260812 19:26:33.734215 20812 leader_election.cc:334] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.737303 20971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb51472eb3314091aa30c515f1809f83" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:33.737958 22131 raft_consensus.cc:2726] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:33.737951 22060 leader_election.cc:288] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.738200 20971 raft_consensus.cc:2379] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c9e33eee61649e18fe397e56bdddea3 in current term 2: Already voted for candidate d5ab425bcd82426387b1a5b02e55b64c in this term.
I20260812 19:26:33.741376 22119 leader_election.cc:288] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.736176 20918 leader_election.cc:302] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:33.752496 20815 leader_election.cc:302] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:33.753639 22127 raft_consensus.cc:2781] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:33.753589 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0eb60aaf78c64f9ebfdb6f535cc96363" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:33.754370 22127 raft_consensus.cc:686] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:33.754490 20856 raft_consensus.cc:2454] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:33.752378 22131 raft_consensus.cc:482] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.755329 22127 consensus_queue.cc:237] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.755707 22131 raft_consensus.cc:504] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.757320 20815 leader_election.cc:302] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:33.767985 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb51472eb3314091aa30c515f1809f83" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:33.772135 20856 raft_consensus.cc:2379] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d5ab425bcd82426387b1a5b02e55b64c in current term 2: Already voted for candidate 8c9e33eee61649e18fe397e56bdddea3 in this term.
W20260812 19:26:33.767913 20812 leader_election.cc:334] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.777195 20918 leader_election.cc:302] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:33.762105 20852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91aea69f88c43cb84d67ea8a6e8d8bf" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:33.761924 22117 raft_consensus.cc:2726] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:33.786489 22117 raft_consensus.cc:482] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.786375 21987 consensus_queue.cc:237] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.787159 22117 raft_consensus.cc:504] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.787473 20739 raft_consensus.cc:2454] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 2.
I20260812 19:26:33.775203 20971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebcc2cf4057a4c8e82b0ee3dc8481257" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:33.789341 20971 raft_consensus.cc:2454] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:33.791035 20852 raft_consensus.cc:2454] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:33.791730 20688 leader_election.cc:302] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:33.792563 22072 raft_consensus.cc:2781] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:33.792943 22072 raft_consensus.cc:482] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.793321 22072 raft_consensus.cc:3037] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:33.793676 22133 raft_consensus.cc:2781] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:33.794080 22133 raft_consensus.cc:482] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.794425 22133 raft_consensus.cc:3037] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:26:33.795800 20691 leader_election.cc:334] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.798789 20451 catalog_manager.cc:5495] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 1 to 2, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
W20260812 19:26:33.800458 20918 leader_election.cc:334] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
W20260812 19:26:33.801831 20918 leader_election.cc:334] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.814044 22139 raft_consensus.cc:2726] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:33.837947 22043 raft_consensus.cc:504] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
W20260812 19:26:33.840104 20691 leader_election.cc:334] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.825037 22138 raft_consensus.cc:482] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.843971 22138 raft_consensus.cc:504] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.845717 22065 raft_consensus.cc:504] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.846858 22138 leader_election.cc:288] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.847819 22043 leader_election.cc:288] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
W20260812 19:26:33.863667 20808 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.4:37307, user_credentials={real_user=slave}} blocked reactor thread for 103928us
W20260812 19:26:33.849453 20918 leader_election.cc:334] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.849627 22119 raft_consensus.cc:482] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.849891 22072 raft_consensus.cc:504] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.855136 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa08d4efbda64360a2f987aab456fb04" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:33.848881 22131 leader_election.cc:288] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.858851 22065 leader_election.cc:288] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:33.868672 20691 leader_election.cc:302] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:33.870929 22072 leader_election.cc:288] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.871613 22072 raft_consensus.cc:2781] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:33.873268 20918 leader_election.cc:302] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:33.871984 22072 raft_consensus.cc:482] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.861833 22070 raft_consensus.cc:504] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.881568 22151 raft_consensus.cc:482] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.912007 22069 tablet_bootstrap.cc:492] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:33.913061 22069 tablet_bootstrap.cc:492] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
W20260812 19:26:33.913756 20691 leader_election.cc:334] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.916517 20808 leader_election.cc:302] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:33.918069 22069 ts_tablet_manager.cc:1397] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.318s	user 0.027s	sys 0.014s
I20260812 19:26:33.873075 22119 raft_consensus.cc:504] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.923494 22136 raft_consensus.cc:2726] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:26:33.883239 20971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:33.924618 20971 raft_consensus.cc:2454] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:33.907600 22072 raft_consensus.cc:3037] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:26:33.926925 20691 leader_election.cc:334] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.914978 20922 leader_election.cc:302] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:33.876364 22134 raft_consensus.cc:2726] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:26:33.877341 22149 raft_consensus.cc:482] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:33.917568 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebcc2cf4057a4c8e82b0ee3dc8481257" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:33.951550 20739 raft_consensus.cc:2379] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c9e33eee61649e18fe397e56bdddea3 in current term 2: Already voted for candidate efc1471911ec442396b400eed9d18036 in this term.
I20260812 19:26:33.953778 22070 leader_election.cc:288] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:33.954922 22119 leader_election.cc:288] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:33.911550 22151 raft_consensus.cc:504] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.956744 20979 raft_consensus.cc:3037] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:33.959973 22117 leader_election.cc:288] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
W20260812 19:26:33.970168 20812 leader_election.cc:334] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.973903 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27156bde17147a6af9ddb1f23aa3ef8" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:33.974574 20745 raft_consensus.cc:2454] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
W20260812 19:26:33.972055 20691 leader_election.cc:334] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:33.977399 22133 raft_consensus.cc:504] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:33.979110 22141 leader_election.cc:288] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:33.980434 22133 leader_election.cc:288] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:33.969324 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa08d4efbda64360a2f987aab456fb04" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:33.972468 22069 raft_consensus.cc:348] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.982788 22069 raft_consensus.cc:729] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:33.983080 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27156bde17147a6af9ddb1f23aa3ef8" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:33.983852 20854 raft_consensus.cc:2454] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:33.983541 22069 consensus_queue.cc:260] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.945351 22149 raft_consensus.cc:504] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.985625 20979 raft_consensus.cc:2454] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 2.
I20260812 19:26:33.982260 20861 raft_consensus.cc:2379] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate efc1471911ec442396b400eed9d18036 in current term 2: Already voted for candidate 8c9e33eee61649e18fe397e56bdddea3 in this term.
I20260812 19:26:33.988904 22072 raft_consensus.cc:504] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:33.987910 20851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0454a10a87ed4fd7a5ef01021940c016" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:33.991163 22072 leader_election.cc:288] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:33.991411 20851 raft_consensus.cc:2454] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 1.
I20260812 19:26:33.990679 22069 ts_tablet_manager.cc:1428] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260812 19:26:33.992596 22069 tablet_bootstrap.cc:492] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:33.994848 22133 raft_consensus.cc:2781] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:33.995882 22133 raft_consensus.cc:686] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 2 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
W20260812 19:26:33.997149 20922 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.2:39525, user_credentials={real_user=slave}} blocked reactor thread for 193022us
I20260812 19:26:33.997056 22133 consensus_queue.cc:237] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:33.986605 22149 leader_election.cc:288] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:33.999583 20688 leader_election.cc:302] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:34.001938 22149 raft_consensus.cc:2781] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:34.002434 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebcc2cf4057a4c8e82b0ee3dc8481257" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:34.002741 20745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57439ca2e634277b5b83494eddd4acb" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:34.003367 20745 raft_consensus.cc:3037] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:34.012810 20815 leader_election.cc:302] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:34.015952 20691 leader_election.cc:302] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
W20260812 19:26:34.017619 20918 leader_election.cc:334] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:34.020533 22169 raft_consensus.cc:2781] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:34.021024 22160 raft_consensus.cc:2781] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:34.021026 22169 raft_consensus.cc:482] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:34.021665 22160 raft_consensus.cc:482] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:34.021739 22169 raft_consensus.cc:3037] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:34.022094 22160 raft_consensus.cc:3037] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:34.002429 22149 raft_consensus.cc:686] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:34.030961 20851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0eb60aaf78c64f9ebfdb6f535cc96363" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:34.032032 20851 raft_consensus.cc:3037] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:34.037052 22149 consensus_queue.cc:237] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:34.039976 22160 raft_consensus.cc:504] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:34.042074 22160 leader_election.cc:288] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:34.045382 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27156bde17147a6af9ddb1f23aa3ef8" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:34.023094 20691 leader_election.cc:302] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:34.049149 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6510fddf1024d71b387e8dfa568e96c" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:34.050850 20854 raft_consensus.cc:2454] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 1.
I20260812 19:26:34.053951 22151 leader_election.cc:288] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:34.042172 22169 raft_consensus.cc:504] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:34.057296 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91aea69f88c43cb84d67ea8a6e8d8bf" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:34.058691 20745 raft_consensus.cc:2454] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 2.
W20260812 19:26:34.078755 20808 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.4:37307, user_credentials={real_user=slave}} blocked reactor thread for 162328us
I20260812 19:26:34.080578 20854 raft_consensus.cc:3037] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:26:34.073647 20812 leader_election.cc:334] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:34.088779 20735 raft_consensus.cc:2379] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c9e33eee61649e18fe397e56bdddea3 in current term 2: Already voted for candidate efc1471911ec442396b400eed9d18036 in this term.
W20260812 19:26:34.085311 20812 leader_election.cc:334] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:34.090902 20812 leader_election.cc:302] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:34.091331 20922 leader_election.cc:302] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:34.094492 20808 leader_election.cc:302] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:34.105104 20691 leader_election.cc:302] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:34.056823 22118 raft_consensus.cc:2726] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:26:34.131265 22156 raft_consensus.cc:2781] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260812 19:26:34.132077 22182 log.cc:924] Time spent T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260812 19:26:34.133769 20812 consensus_peers.cc:487] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:34.160005 20812 consensus_peers.cc:487] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:34.098858 22151 raft_consensus.cc:2726] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:26:34.128424 22071 raft_consensus.cc:2781] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:34.142867 22065 raft_consensus.cc:2781] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election won for term 2
W20260812 19:26:34.144758 20691 leader_election.cc:334] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
W20260812 19:26:34.153889 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 90237.5us
W20260812 19:26:34.164534 20691 leader_election.cc:334] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:34.135761 20735 raft_consensus.cc:1261] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Refusing update from remote peer 8c9e33eee61649e18fe397e56bdddea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:34.166956 20854 raft_consensus.cc:2454] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 2.
I20260812 19:26:34.174844 20851 raft_consensus.cc:2454] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 2.
I20260812 19:26:34.175191 20691 leader_election.cc:302] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:34.168897 20918 leader_election.cc:302] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:34.177929 21943 raft_consensus.cc:2781] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:34.178352 21943 raft_consensus.cc:482] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:34.178740 21943 raft_consensus.cc:3037] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:34.158828 22156 raft_consensus.cc:482] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
W20260812 19:26:34.186582 22176 log.cc:924] Time spent T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260812 19:26:34.187578 20856 raft_consensus.cc:1261] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Refusing update from remote peer efc1471911ec442396b400eed9d18036: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:34.172299 22065 raft_consensus.cc:686] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 2 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:34.163636 22071 raft_consensus.cc:482] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:34.188915 22071 raft_consensus.cc:3037] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:34.189092 22065 consensus_queue.cc:237] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:34.194016 22070 consensus_queue.cc:1035] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:34.194609 22169 leader_election.cc:288] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:34.182706 22072 raft_consensus.cc:2781] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:34.196038 22072 raft_consensus.cc:686] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:34.196954 22072 consensus_queue.cc:237] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:34.202349 21943 raft_consensus.cc:504] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:34.203292 21987 consensus_queue.cc:1035] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:34.204066 21943 leader_election.cc:288] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
W20260812 19:26:34.204391 20691 leader_election.cc:334] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:34.183449 22156 raft_consensus.cc:3037] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:34.213151 20451 catalog_manager.cc:5495] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 1 to 2, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:34.217545 20451 catalog_manager.cc:5495] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 1 to 2, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:34.225975 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27156bde17147a6af9ddb1f23aa3ef8" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:34.227208 20856 raft_consensus.cc:2379] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate efc1471911ec442396b400eed9d18036 in current term 2: Already voted for candidate 8c9e33eee61649e18fe397e56bdddea3 in this term.
W20260812 19:26:34.233145 20812 leader_election.cc:334] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:34.233625 20812 leader_election.cc:302] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
W20260812 19:26:34.234560 20812 leader_election.cc:334] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:34.234364 20691 leader_election.cc:302] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:34.226150 20454 catalog_manager.cc:5495] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 1 to 2, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } }
W20260812 19:26:34.239710 20691 consensus_peers.cc:487] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:34.234951 20451 catalog_manager.cc:5495] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 1 to 2, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:34.234768 22127 raft_consensus.cc:2726] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:26:34.251165 22118 raft_consensus.cc:2726] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:26:34.255411 20453 catalog_manager.cc:5495] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 1 to 2, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 2 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:34.264492 22071 raft_consensus.cc:504] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:34.312157 22071 leader_election.cc:288] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:34.273583 22156 raft_consensus.cc:504] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:34.314841 22156 leader_election.cc:288] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
W20260812 19:26:34.296561 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.3:38049, user_credentials={real_user=slave}} blocked reactor thread for 127714us
I20260812 19:26:34.314929 20454 catalog_manager.cc:5495] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 1 to 2, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 2 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:34.316298 20918 leader_election.cc:302] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:34.317629 22065 raft_consensus.cc:2781] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:34.318115 22065 raft_consensus.cc:686] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 2 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:34.319226 22065 consensus_queue.cc:237] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
W20260812 19:26:34.333050 20918 leader_election.cc:334] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:34.333516 20918 leader_election.cc:302] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:34.334285 22187 raft_consensus.cc:2726] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:26:34.335232 20918 leader_election.cc:334] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:34.305405 22069 tablet_bootstrap.cc:492] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:34.338843 22069 tablet_bootstrap.cc:492] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:34.339632 22069 ts_tablet_manager.cc:1397] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.347s	user 0.014s	sys 0.010s
I20260812 19:26:34.308529 20453 catalog_manager.cc:5495] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 1 to 2, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
W20260812 19:26:34.342115 20691 leader_election.cc:334] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:34.368760 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6510fddf1024d71b387e8dfa568e96c" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:34.369808 20861 raft_consensus.cc:3037] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:34.376367 22069 raft_consensus.cc:348] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:34.382058 22069 raft_consensus.cc:729] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:34.382927 22069 consensus_queue.cc:260] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:34.384487 20861 raft_consensus.cc:2454] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 2.
I20260812 19:26:34.385334 22069 ts_tablet_manager.cc:1428] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.045s	user 0.003s	sys 0.005s
I20260812 19:26:34.386299 22069 tablet_bootstrap.cc:492] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:34.397006 20851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0454a10a87ed4fd7a5ef01021940c016" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:34.401158 20735 raft_consensus.cc:1261] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Refusing update from remote peer d5ab425bcd82426387b1a5b02e55b64c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:34.397799 20851 raft_consensus.cc:3037] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:34.402995 22187 consensus_queue.cc:1035] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:34.415253 22075 raft_consensus.cc:482] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:34.416075 22075 raft_consensus.cc:504] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:34.423650 22075 leader_election.cc:288] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:34.463335 20691 leader_election.cc:302] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
W20260812 19:26:34.467566 22201 log.cc:924] Time spent T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260812 19:26:34.470940 22071 raft_consensus.cc:2781] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:34.471598 22071 raft_consensus.cc:686] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:34.472666 22071 consensus_queue.cc:237] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:34.474466 20985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "273e3feb623f4b0d8b3078f4a6a49ac6" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:34.475201 20985 raft_consensus.cc:2454] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:34.465667 20454 catalog_manager.cc:5495] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 1 to 2, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 2 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:34.480458 22075 raft_consensus.cc:482] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:34.480710 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:34.489293 20984 raft_consensus.cc:3037] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:34.483749 20979 raft_consensus.cc:1261] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Refusing update from remote peer 8c9e33eee61649e18fe397e56bdddea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260812 19:26:34.481827 20918 leader_election.cc:334] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
W20260812 19:26:34.482093 20812 leader_election.cc:334] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:34.505861 20984 raft_consensus.cc:2454] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 2.
I20260812 19:26:34.506377 20739 raft_consensus.cc:1261] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Refusing update from remote peer 8c9e33eee61649e18fe397e56bdddea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:34.518622 22075 raft_consensus.cc:504] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:34.519269 22151 consensus_queue.cc:1035] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:34.509869 20851 raft_consensus.cc:2454] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 2.
W20260812 19:26:34.525282 20812 consensus_peers.cc:487] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:34.529037 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 47245us
I20260812 19:26:34.532544 20735 raft_consensus.cc:1261] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Refusing update from remote peer 8c9e33eee61649e18fe397e56bdddea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:34.535094 22151 consensus_queue.cc:1035] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260812 19:26:34.537643 20812 consensus_peers.cc:487] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:34.559078 20454 catalog_manager.cc:5495] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 1 to 2, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:34.571091 22235 raft_consensus.cc:482] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:34.571943 22235 raft_consensus.cc:504] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:34.580214 20808 leader_election.cc:302] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:34.581604 22075 leader_election.cc:288] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:34.581996 22151 raft_consensus.cc:2781] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:26:34.582676 22151 raft_consensus.cc:482] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:34.583277 22151 raft_consensus.cc:3037] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:34.584501 22069 tablet_bootstrap.cc:492] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:34.586272 22069 tablet_bootstrap.cc:492] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:34.587116 22069 ts_tablet_manager.cc:1397] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.201s	user 0.025s	sys 0.022s
W20260812 19:26:34.586691 20691 consensus_peers.cc:487] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:34.612035 20984 raft_consensus.cc:1261] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Refusing update from remote peer efc1471911ec442396b400eed9d18036: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:34.613898 22071 consensus_queue.cc:1035] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:26:34.622816 20918 leader_election.cc:302] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:34.623826 22065 raft_consensus.cc:2781] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:34.631515 22065 raft_consensus.cc:686] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 2 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:34.632690 22065 consensus_queue.cc:237] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:34.638166 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf3a538c4d74dd0a1704de4cf4d3624" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:34.574476 22235 leader_election.cc:288] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:34.649451 22127 consensus_queue.cc:1035] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:34.652372 22069 raft_consensus.cc:348] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:34.653237 20808 leader_election.cc:302] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:34.654508 22127 raft_consensus.cc:2781] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:34.655261 22127 raft_consensus.cc:686] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:34.657696 22127 consensus_queue.cc:237] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
W20260812 19:26:34.663190 20691 consensus_peers.cc:487] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:34.653230 22069 raft_consensus.cc:729] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
W20260812 19:26:34.667105 20918 leader_election.cc:334] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:34.669991 22069 consensus_queue.cc:260] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:34.676312 22069 ts_tablet_manager.cc:1428] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.000s
I20260812 19:26:34.678043 22069 tablet_bootstrap.cc:492] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:34.683290 20739 raft_consensus.cc:1261] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Refusing update from remote peer d5ab425bcd82426387b1a5b02e55b64c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260812 19:26:34.689244 20918 consensus_peers.cc:487] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:34.719180 22235 raft_consensus.cc:482] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:34.724314 22235 raft_consensus.cc:504] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:34.730053 22235 leader_election.cc:288] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:34.730813 22075 raft_consensus.cc:482] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:34.738862 22075 raft_consensus.cc:504] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:34.731961 20451 catalog_manager.cc:5495] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 1 to 2, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:34.741406 22075 leader_election.cc:288] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:34.699100 22151 raft_consensus.cc:504] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:34.731736 20454 catalog_manager.cc:5495] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 1 to 2, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 2 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:34.703038 22065 consensus_queue.cc:1035] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260812 19:26:34.774032 20918 consensus_peers.cc:487] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:34.774482 20918 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:33811, user_credentials={real_user=slave}} blocked reactor thread for 45009.2us
I20260812 19:26:34.780117 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb51472eb3314091aa30c515f1809f83" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:34.781036 20856 raft_consensus.cc:2379] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 171f67787a8348fb9c7b19bf09026039 in current term 2: Already voted for candidate 8c9e33eee61649e18fe397e56bdddea3 in this term.
I20260812 19:26:34.781399 20851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f536e291e9f46cb8ce550ae575e643a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:34.781040 20850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaf0d4e2ed4d039a3635696107687a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:34.780272 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b112d71b0be429f977ba95ac9534b6b" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:34.788638 22075 raft_consensus.cc:482] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:34.789255 22075 raft_consensus.cc:504] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
W20260812 19:26:34.790822 20691 consensus_peers.cc:487] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:34.791488 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b112d71b0be429f977ba95ac9534b6b" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:34.793166 20861 raft_consensus.cc:1261] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Refusing update from remote peer d5ab425bcd82426387b1a5b02e55b64c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:34.795125 22075 leader_election.cc:288] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:34.796777 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f536e291e9f46cb8ce550ae575e643a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:34.797235 20976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb51472eb3314091aa30c515f1809f83" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:34.798316 20976 raft_consensus.cc:2379] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 171f67787a8348fb9c7b19bf09026039 in current term 2: Already voted for candidate d5ab425bcd82426387b1a5b02e55b64c in this term.
I20260812 19:26:34.797113 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf3a538c4d74dd0a1704de4cf4d3624" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:34.802642 20976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaf0d4e2ed4d039a3635696107687a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:34.804957 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85e5e41bf96447d7a761378c54e8abff" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:34.807396 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85e5e41bf96447d7a761378c54e8abff" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:34.810722 22065 consensus_queue.cc:1035] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:26:34.813952 22050 leader_election.cc:302] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:34.801707 22151 leader_election.cc:288] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:34.815485 22075 raft_consensus.cc:2726] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:34.815724 22235 raft_consensus.cc:482] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:34.816318 22235 raft_consensus.cc:504] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:34.817104 22050 leader_election.cc:302] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
W20260812 19:26:34.818225 20691 consensus_peers.cc:487] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:34.818435 22235 leader_election.cc:288] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:34.818826 22075 raft_consensus.cc:2726] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:34.820863 22050 leader_election.cc:302] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:34.821067 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a777b602ae6d4dac9f1ac116e0a2e86e" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
W20260812 19:26:34.822032 20918 consensus_peers.cc:487] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:34.824142 22075 raft_consensus.cc:3037] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:26:34.826398 20918 consensus_peers.cc:487] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:34.830981 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a777b602ae6d4dac9f1ac116e0a2e86e" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:34.821873 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "273e3feb623f4b0d8b3078f4a6a49ac6" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:34.834035 20970 raft_consensus.cc:3037] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:26:34.835005 20812 leader_election.cc:334] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:34.838027 22235 raft_consensus.cc:482] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:34.838856 22235 raft_consensus.cc:504] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:34.842972 22235 leader_election.cc:288] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:34.843813 22050 leader_election.cc:302] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:34.843276 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebcc2cf4057a4c8e82b0ee3dc8481257" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:34.847391 20850 raft_consensus.cc:1261] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Refusing update from remote peer efc1471911ec442396b400eed9d18036: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260812 19:26:34.848544 20812 consensus_peers.cc:487] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:34.849437 22050 leader_election.cc:302] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
I20260812 19:26:34.849973 22118 consensus_queue.cc:1035] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:34.852025 22235 raft_consensus.cc:2726] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:26:34.851569 20970 raft_consensus.cc:2454] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 2.
I20260812 19:26:34.854599 20808 leader_election.cc:302] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:34.852998 22235 raft_consensus.cc:2726] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:34.861876 22050 leader_election.cc:302] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
I20260812 19:26:34.859964 22127 raft_consensus.cc:2781] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:34.884138 22075 raft_consensus.cc:2726] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:34.877135 22235 raft_consensus.cc:2726] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:34.887729 22235 raft_consensus.cc:482] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:34.888168 22235 raft_consensus.cc:504] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:34.877357 22127 raft_consensus.cc:686] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:34.892091 22127 consensus_queue.cc:237] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
W20260812 19:26:34.896500 20918 consensus_peers.cc:487] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:34.898855 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8732d4883dce4b7d97faf3669bdbb006" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
W20260812 19:26:34.900777 20691 consensus_peers.cc:487] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:34.901204 22050 leader_election.cc:302] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
I20260812 19:26:34.904701 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8732d4883dce4b7d97faf3669bdbb006" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:34.915879 22235 leader_election.cc:288] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:34.916676 22235 raft_consensus.cc:2726] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:34.931705 22235 raft_consensus.cc:482] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:34.932288 22235 raft_consensus.cc:504] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
W20260812 19:26:34.934705 20812 consensus_peers.cc:487] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:34.936717 22052 leader_election.cc:302] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036
I20260812 19:26:34.940007 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebcc2cf4057a4c8e82b0ee3dc8481257" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:34.941910 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b35dda8c9ec45d783785ed1ebb70243" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:34.946141 22235 leader_election.cc:288] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:34.946380 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b35dda8c9ec45d783785ed1ebb70243" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:34.946916 22235 raft_consensus.cc:482] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:34.955044 22251 raft_consensus.cc:2726] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:34.956916 22251 raft_consensus.cc:482] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:34.957437 22251 raft_consensus.cc:504] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:34.959820 22251 leader_election.cc:288] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
W20260812 19:26:34.962805 20812 consensus_peers.cc:487] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:34.963954 22251 raft_consensus.cc:482] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:34.966689 22251 raft_consensus.cc:504] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
W20260812 19:26:34.971171 20691 consensus_peers.cc:487] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:34.974752 20691 consensus_peers.cc:487] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:34.975327 22251 leader_election.cc:288] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
W20260812 19:26:34.975732 20918 consensus_peers.cc:487] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:34.979413 22050 leader_election.cc:302] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
I20260812 19:26:34.986064 22258 raft_consensus.cc:2726] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:34.948081 22052 leader_election.cc:302] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036
I20260812 19:26:34.994989 20851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a347274cb334867b07c94e32b32f3ca" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:34.995191 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f906c95927b14410a6818ea15e9e089f" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:34.947446 22235 raft_consensus.cc:504] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
W20260812 19:26:34.999913 20691 consensus_peers.cc:487] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:35.000613 22075 raft_consensus.cc:2726] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:35.003504 22235 leader_election.cc:288] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
W20260812 19:26:35.007138 20691 consensus_peers.cc:487] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:35.010077 20850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ed708096ce463aba0483b0487227ba" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:35.004344 22075 raft_consensus.cc:482] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:35.015192 22075 raft_consensus.cc:504] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.020282 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:35.021450 22075 leader_election.cc:288] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:35.023689 20850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
W20260812 19:26:35.025640 20691 consensus_peers.cc:487] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:35.025360 22052 leader_election.cc:302] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036
I20260812 19:26:35.027493 22075 raft_consensus.cc:2726] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 19:26:35.027539 20691 consensus_peers.cc:487] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:35.028849 20812 consensus_peers.cc:487] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:35.040271 20453 catalog_manager.cc:5495] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 1 to 2, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:35.047303 22069 tablet_bootstrap.cc:492] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:35.085248 20850 raft_consensus.cc:1261] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Refusing update from remote peer efc1471911ec442396b400eed9d18036: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:35.086890 22069 tablet_bootstrap.cc:492] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:35.087744 22069 ts_tablet_manager.cc:1397] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.410s	user 0.019s	sys 0.017s
I20260812 19:26:35.088744 22071 consensus_queue.cc:1035] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:26:35.091544 22069 raft_consensus.cc:348] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:35.092621 22069 raft_consensus.cc:729] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:35.093429 22069 consensus_queue.cc:260] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:35.095836 22069 ts_tablet_manager.cc:1428] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260812 19:26:35.096728 22069 tablet_bootstrap.cc:492] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
W20260812 19:26:35.099339 20918 consensus_peers.cc:487] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:35.131925 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f906c95927b14410a6818ea15e9e089f" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:35.141041 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ed708096ce463aba0483b0487227ba" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
W20260812 19:26:35.142894 20918 consensus_peers.cc:487] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:35.144161 20918 consensus_peers.cc:487] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:35.144877 20812 consensus_peers.cc:487] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:35.147040 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a347274cb334867b07c94e32b32f3ca" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:35.152067 22050 leader_election.cc:302] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:35.153046 20851 raft_consensus.cc:1261] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Refusing update from remote peer d5ab425bcd82426387b1a5b02e55b64c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:35.153488 22075 raft_consensus.cc:2726] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:35.156482 22050 leader_election.cc:302] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:35.157771 22075 raft_consensus.cc:2726] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:35.161015 22050 leader_election.cc:302] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:35.162478 22075 raft_consensus.cc:2726] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:26:35.170387 20691 consensus_peers.cc:487] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:35.184505 22069 tablet_bootstrap.cc:492] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:35.185735 22069 tablet_bootstrap.cc:492] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:35.185828 22138 consensus_queue.cc:1035] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:26:35.186935 22069 ts_tablet_manager.cc:1397] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.090s	user 0.020s	sys 0.004s
I20260812 19:26:35.190871 22069 raft_consensus.cc:348] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:35.192164 22069 raft_consensus.cc:729] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:35.194169 22069 consensus_queue.cc:260] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:35.196513 22069 ts_tablet_manager.cc:1428] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260812 19:26:35.197430 22069 tablet_bootstrap.cc:492] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:35.201951 22075 raft_consensus.cc:482] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:35.202610 22075 raft_consensus.cc:504] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.207481 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c0067c6bd74e33b1ebe3785dabf7d1" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:35.210860 22075 leader_election.cc:288] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:35.218734 20850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c0067c6bd74e33b1ebe3785dabf7d1" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:35.220743 22052 leader_election.cc:302] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036
I20260812 19:26:35.221705 22075 raft_consensus.cc:2726] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:26:35.222276 20918 consensus_peers.cc:487] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:35.224653 20918 consensus_peers.cc:487] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:35.232097 20979 raft_consensus.cc:1261] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Refusing update from remote peer 8c9e33eee61649e18fe397e56bdddea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:35.234612 21987 consensus_queue.cc:1035] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:35.235006 22069 tablet_bootstrap.cc:492] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:35.236148 22069 tablet_bootstrap.cc:492] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:35.236889 22069 ts_tablet_manager.cc:1397] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.010s
I20260812 19:26:35.239549 22069 raft_consensus.cc:348] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.240286 22069 raft_consensus.cc:729] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:35.241096 22069 consensus_queue.cc:260] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
W20260812 19:26:35.242012 20918 consensus_peers.cc:487] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:35.243717 22069 ts_tablet_manager.cc:1428] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260812 19:26:35.244807 22069 tablet_bootstrap.cc:492] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
W20260812 19:26:35.277384 20812 consensus_peers.cc:487] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:35.279906 20691 consensus_peers.cc:487] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:35.362871 20812 consensus_peers.cc:487] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:35.368145 20812 consensus_peers.cc:487] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:35.384764 20918 consensus_peers.cc:487] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:35.387069 22069 tablet_bootstrap.cc:492] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:35.388172 22069 tablet_bootstrap.cc:492] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:35.388914 22069 ts_tablet_manager.cc:1397] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.144s	user 0.047s	sys 0.050s
I20260812 19:26:35.391595 22069 raft_consensus.cc:348] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:35.392324 22069 raft_consensus.cc:729] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:35.392953 22069 consensus_queue.cc:260] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:35.394938 22069 ts_tablet_manager.cc:1428] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260812 19:26:35.395709 22069 tablet_bootstrap.cc:492] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:35.416730 22069 tablet_bootstrap.cc:492] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:35.417779 22069 tablet_bootstrap.cc:492] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:35.420023 22069 ts_tablet_manager.cc:1397] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.008s
I20260812 19:26:35.423415 22069 raft_consensus.cc:348] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:35.424166 22069 raft_consensus.cc:729] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:35.424952 22069 consensus_queue.cc:260] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:35.428149 22069 ts_tablet_manager.cc:1428] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260812 19:26:35.429019 22069 tablet_bootstrap.cc:492] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:35.444958 22315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.1:33811 every 8 connection(s)
I20260812 19:26:35.445751  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.1:33811
I20260812 19:26:35.455572 22069 tablet_bootstrap.cc:492] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:35.457021 22069 tablet_bootstrap.cc:492] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:35.457894 22069 ts_tablet_manager.cc:1397] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.029s	user 0.025s	sys 0.000s
I20260812 19:26:35.462558 22069 raft_consensus.cc:348] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:35.463513 22069 raft_consensus.cc:729] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:35.464310 22069 consensus_queue.cc:260] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:35.467365 22069 ts_tablet_manager.cc:1428] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260812 19:26:35.468152 22069 tablet_bootstrap.cc:492] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:35.468364 20979 raft_consensus.cc:1261] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Refusing update from remote peer 8c9e33eee61649e18fe397e56bdddea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:35.469930 22156 consensus_queue.cc:1035] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:35.511497 22075 raft_consensus.cc:482] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:35.512341 22075 raft_consensus.cc:504] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:35.516467 22075 leader_election.cc:288] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:35.525465 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e5c58cd31f4eb8bd9092458140299a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:35.539139 20984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e5c58cd31f4eb8bd9092458140299a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:35.550737 22069 tablet_bootstrap.cc:492] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:35.551872 22069 tablet_bootstrap.cc:492] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:35.553933 22069 ts_tablet_manager.cc:1397] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.006s
I20260812 19:26:35.556581 22069 raft_consensus.cc:348] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.557338 22069 raft_consensus.cc:729] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:35.558121 22069 consensus_queue.cc:260] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.560425 22050 leader_election.cc:302] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: d5ab425bcd82426387b1a5b02e55b64c, efc1471911ec442396b400eed9d18036
I20260812 19:26:35.561739 22075 raft_consensus.cc:2726] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:35.565028 22069 ts_tablet_manager.cc:1428] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260812 19:26:35.566099 22069 tablet_bootstrap.cc:492] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:35.575634 22317 heartbeater.cc:347] Connected to a master server at 127.3.253.62:36913
I20260812 19:26:35.576175 22317 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:35.577131 22317 heartbeater.cc:511] Master 127.3.253.62:36913 requested a full tablet report, sending...
I20260812 19:26:35.578033 22248 raft_consensus.cc:3037] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:26:35.590018 20918 consensus_peers.cc:487] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:26:35.591847 20918 consensus_peers.cc:487] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:35.604249 22069 tablet_bootstrap.cc:492] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:35.605554 22069 tablet_bootstrap.cc:492] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:35.606315 22069 ts_tablet_manager.cc:1397] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.040s	user 0.025s	sys 0.003s
I20260812 19:26:35.609050 22069 raft_consensus.cc:348] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:35.609799 22069 raft_consensus.cc:729] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:35.610618 22069 consensus_queue.cc:260] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:35.613011 22069 ts_tablet_manager.cc:1428] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260812 19:26:35.613880 22069 tablet_bootstrap.cc:492] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:35.617864 22261 raft_consensus.cc:3037] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:35.672039 22248 raft_consensus.cc:3037] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:35.673435 22069 tablet_bootstrap.cc:492] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:35.674569 22069 tablet_bootstrap.cc:492] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:35.675324 22069 ts_tablet_manager.cc:1397] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.004s
I20260812 19:26:35.677857 22069 raft_consensus.cc:348] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:35.690979 22139 raft_consensus.cc:482] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:35.691613 22139 raft_consensus.cc:504] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:35.678560 22069 raft_consensus.cc:729] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:35.693655 22139 leader_election.cc:288] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:35.695107 22260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb51472eb3314091aa30c515f1809f83" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:35.695350 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb51472eb3314091aa30c515f1809f83" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:35.695842 22260 raft_consensus.cc:2454] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 2.
I20260812 19:26:35.695940 20856 raft_consensus.cc:2454] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 2.
I20260812 19:26:35.693645 22069 consensus_queue.cc:260] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:35.700361 22069 ts_tablet_manager.cc:1428] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260812 19:26:35.701224 22069 tablet_bootstrap.cc:492] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:35.702975 22338 raft_consensus.cc:482] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:35.703531 22338 raft_consensus.cc:504] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:35.705711 22338 leader_election.cc:288] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:35.704190 20918 leader_election.cc:302] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:35.708738 20850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:35.709321 22139 raft_consensus.cc:2781] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:26:35.709903 22139 raft_consensus.cc:482] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:35.710320 22139 raft_consensus.cc:3037] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:35.712145 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:35.719161 22050 leader_election.cc:302] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039; no voters: 8c9e33eee61649e18fe397e56bdddea3, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:35.720468 22338 raft_consensus.cc:2726] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:35.721298 22139 raft_consensus.cc:504] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:35.723834 22139 leader_election.cc:288] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:35.730082 22248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb51472eb3314091aa30c515f1809f83" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:35.730815 22248 raft_consensus.cc:3037] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:35.733440 20850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb51472eb3314091aa30c515f1809f83" candidate_uuid: "d5ab425bcd82426387b1a5b02e55b64c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:35.734377 20850 raft_consensus.cc:3037] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:35.737591 22248 raft_consensus.cc:2454] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 3.
I20260812 19:26:35.738931 20918 leader_election.cc:302] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:35.740010 22138 raft_consensus.cc:2781] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:26:35.740525 22138 raft_consensus.cc:686] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 3 LEADER]: Becoming Leader. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:35.741453 22138 consensus_queue.cc:237] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:35.772549 20850 raft_consensus.cc:2454] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ab425bcd82426387b1a5b02e55b64c in term 3.
I20260812 19:26:35.774492 20454 ts_manager.cc:194] Re-registered known tserver with Master: 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:35.780555 22069 tablet_bootstrap.cc:492] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:35.781716 22069 tablet_bootstrap.cc:492] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:35.782430 22069 ts_tablet_manager.cc:1397] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.081s	user 0.037s	sys 0.027s
I20260812 19:26:35.785244 22069 raft_consensus.cc:348] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.785974 22069 raft_consensus.cc:729] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:35.786736 22069 consensus_queue.cc:260] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.788343 22069 ts_tablet_manager.cc:1428] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 19:26:35.789170 22069 tablet_bootstrap.cc:492] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:35.795071 20453 catalog_manager.cc:5495] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c reported cstate change: term changed from 1 to 3, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4). New cstate: current_term: 3 leader_uuid: "d5ab425bcd82426387b1a5b02e55b64c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:35.798787 22261 raft_consensus.cc:3037] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:35.805068 22069 tablet_bootstrap.cc:492] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:35.806782 22069 tablet_bootstrap.cc:492] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:35.806969 22248 raft_consensus.cc:3037] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:35.807469 22069 ts_tablet_manager.cc:1397] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260812 19:26:35.810608 22069 raft_consensus.cc:348] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.811545 22069 raft_consensus.cc:729] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:35.812541 22069 consensus_queue.cc:260] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.814970 22069 ts_tablet_manager.cc:1428] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260812 19:26:35.816130 22069 tablet_bootstrap.cc:492] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:35.848024 22069 tablet_bootstrap.cc:492] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:35.849045 22069 tablet_bootstrap.cc:492] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:35.849726 22069 ts_tablet_manager.cc:1397] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.011s
I20260812 19:26:35.852147 22069 raft_consensus.cc:348] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:35.852720 22069 raft_consensus.cc:729] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:35.853229 22069 consensus_queue.cc:260] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:35.854979 22069 ts_tablet_manager.cc:1428] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260812 19:26:35.855005 20454 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38192
I20260812 19:26:35.855753 22069 tablet_bootstrap.cc:492] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:35.858279 22261 raft_consensus.cc:3037] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:35.861433 22317 heartbeater.cc:503] Master 127.3.253.62:36913 was elected leader, sending a full tablet report...
I20260812 19:26:35.872365 22069 tablet_bootstrap.cc:492] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:35.873302 22069 tablet_bootstrap.cc:492] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:35.873998 22069 ts_tablet_manager.cc:1397] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260812 19:26:35.876237 22069 raft_consensus.cc:348] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.876767 22069 raft_consensus.cc:729] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:35.877349 22069 consensus_queue.cc:260] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.879032 22069 ts_tablet_manager.cc:1428] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260812 19:26:35.879698 22069 tablet_bootstrap.cc:492] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:35.882402 22151 raft_consensus.cc:482] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:35.882995 22151 raft_consensus.cc:504] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.885023 22151 leader_election.cc:288] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:35.889212 22261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa08d4efbda64360a2f987aab456fb04" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:35.889670 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa08d4efbda64360a2f987aab456fb04" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036" is_pre_election: true
I20260812 19:26:35.889961 22261 raft_consensus.cc:2454] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 1.
I20260812 19:26:35.890695 20735 raft_consensus.cc:2454] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 2.
I20260812 19:26:35.893721 20812 leader_election.cc:302] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:35.895853 22151 raft_consensus.cc:2781] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:26:35.896246 22151 raft_consensus.cc:482] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:35.896559 22151 raft_consensus.cc:3037] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:35.902263 22072 raft_consensus.cc:482] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:35.903076 22072 raft_consensus.cc:504] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.905267 22072 leader_election.cc:288] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:35.906910 22261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27156bde17147a6af9ddb1f23aa3ef8" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039" is_pre_election: true
I20260812 19:26:35.908831 22069 tablet_bootstrap.cc:492] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260812 19:26:35.908946 20691 leader_election.cc:341] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:35.909883 22069 tablet_bootstrap.cc:492] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:35.910591 22069 ts_tablet_manager.cc:1397] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.004s
I20260812 19:26:35.912545 22069 raft_consensus.cc:348] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:35.913051 22069 raft_consensus.cc:729] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:35.912995 20850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27156bde17147a6af9ddb1f23aa3ef8" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3" is_pre_election: true
I20260812 19:26:35.913910 20850 raft_consensus.cc:2454] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 2.
I20260812 19:26:35.914028 22069 consensus_queue.cc:260] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:35.916343 22069 ts_tablet_manager.cc:1428] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 19:26:35.918331 22069 tablet_bootstrap.cc:492] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:35.920195 20691 leader_election.cc:302] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:35.924441 22070 raft_consensus.cc:2781] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:26:35.924846 22070 raft_consensus.cc:482] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:35.925189 22070 raft_consensus.cc:3037] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:35.929101 22151 raft_consensus.cc:504] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.932438 22261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa08d4efbda64360a2f987aab456fb04" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
I20260812 19:26:35.933286 22261 raft_consensus.cc:3037] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:26:35.934085 22070 raft_consensus.cc:504] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.937300 22248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27156bde17147a6af9ddb1f23aa3ef8" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "171f67787a8348fb9c7b19bf09026039"
W20260812 19:26:35.938912 20691 leader_election.cc:341] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:35.941682 22070 leader_election.cc:288] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 3 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:35.942384 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27156bde17147a6af9ddb1f23aa3ef8" candidate_uuid: "efc1471911ec442396b400eed9d18036" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:35.943022 20856 raft_consensus.cc:3037] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:35.949536 22248 raft_consensus.cc:3037] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:35.950713 20856 raft_consensus.cc:2454] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc1471911ec442396b400eed9d18036 in term 3.
I20260812 19:26:35.951925 20691 leader_election.cc:302] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:35.953483 22072 raft_consensus.cc:2781] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:26:35.954138 22072 raft_consensus.cc:686] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 3 LEADER]: Becoming Leader. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:35.955379 22072 consensus_queue.cc:237] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:35.959931 22151 leader_election.cc:288] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 3 election: Requested vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:35.960636 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa08d4efbda64360a2f987aab456fb04" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:35.961299 20735 raft_consensus.cc:3037] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:35.969517 20735 raft_consensus.cc:2454] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 3.
I20260812 19:26:36.036634 22069 tablet_bootstrap.cc:492] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:36.037767 22069 tablet_bootstrap.cc:492] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:36.038489 22069 ts_tablet_manager.cc:1397] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.120s	user 0.052s	sys 0.037s
I20260812 19:26:36.059939 20815 leader_election.cc:302] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:36.060650 22069 raft_consensus.cc:348] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:36.062541 22151 raft_consensus.cc:2781] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:26:36.061585 22069 raft_consensus.cc:729] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:36.064003 22151 raft_consensus.cc:686] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:36.065237 22151 consensus_queue.cc:237] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:36.071261 22069 consensus_queue.cc:260] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:36.073123 22069 ts_tablet_manager.cc:1428] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.005s
I20260812 19:26:36.073964 22069 tablet_bootstrap.cc:492] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:36.101724 20451 catalog_manager.cc:5495] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 1 to 3, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 3 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:36.112174 22069 tablet_bootstrap.cc:492] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:36.112725 22261 raft_consensus.cc:2454] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 3.
I20260812 19:26:36.113276 22069 tablet_bootstrap.cc:492] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:36.114212 22069 ts_tablet_manager.cc:1397] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.008s
I20260812 19:26:36.118496 22069 raft_consensus.cc:348] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:36.119952 22069 raft_consensus.cc:729] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:36.121206 22069 consensus_queue.cc:260] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:36.123710 22069 ts_tablet_manager.cc:1428] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260812 19:26:36.124543 22069 tablet_bootstrap.cc:492] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:36.160315 22260 raft_consensus.cc:3037] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:36.160770 22069 tablet_bootstrap.cc:492] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:36.163918 22069 tablet_bootstrap.cc:492] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:36.164722 22069 ts_tablet_manager.cc:1397] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.009s
I20260812 19:26:36.167358 20448 catalog_manager.cc:5495] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 reported cstate change: term changed from 1 to 3, leader changed from 171f67787a8348fb9c7b19bf09026039 (127.3.253.1) to efc1471911ec442396b400eed9d18036 (127.3.253.2). New cstate: current_term: 3 leader_uuid: "efc1471911ec442396b400eed9d18036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:36.204659 22069 raft_consensus.cc:348] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:36.205561 22069 raft_consensus.cc:729] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:36.206358 22069 consensus_queue.cc:260] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:36.208662 22069 ts_tablet_manager.cc:1428] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260812 19:26:36.209486 22069 tablet_bootstrap.cc:492] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:36.215801 22260 raft_consensus.cc:3037] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:36.238632 22069 tablet_bootstrap.cc:492] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:36.239698 22069 tablet_bootstrap.cc:492] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:36.240477 22069 ts_tablet_manager.cc:1397] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.008s
I20260812 19:26:36.242965 22069 raft_consensus.cc:348] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:36.243703 22069 raft_consensus.cc:729] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:36.244411 22069 consensus_queue.cc:260] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:36.246928 22069 ts_tablet_manager.cc:1428] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260812 19:26:36.247736 22069 tablet_bootstrap.cc:492] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:36.252736 22269 raft_consensus.cc:3037] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:36.267812 22069 tablet_bootstrap.cc:492] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:36.267968 22260 raft_consensus.cc:1261] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Refusing update from remote peer d5ab425bcd82426387b1a5b02e55b64c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:26:36.268998 22069 tablet_bootstrap.cc:492] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:36.269735 22069 ts_tablet_manager.cc:1397] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260812 19:26:36.272181 22069 raft_consensus.cc:348] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:36.272851 22069 raft_consensus.cc:729] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:36.273510 22069 consensus_queue.cc:260] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:36.277748 22069 ts_tablet_manager.cc:1428] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260812 19:26:36.280453 22069 tablet_bootstrap.cc:492] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:36.286289 22065 consensus_queue.cc:1035] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:26:36.289952 22260 raft_consensus.cc:3037] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:36.302106 20856 raft_consensus.cc:1261] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Refusing update from remote peer d5ab425bcd82426387b1a5b02e55b64c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:26:36.309437 22138 consensus_queue.cc:1035] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:26:36.321828 22069 tablet_bootstrap.cc:492] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:36.323091 22069 tablet_bootstrap.cc:492] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:36.323891 22069 ts_tablet_manager.cc:1397] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.008s
I20260812 19:26:36.326481 22069 raft_consensus.cc:348] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:36.327337 22069 raft_consensus.cc:729] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:36.361050 22069 consensus_queue.cc:260] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:36.364140 22069 ts_tablet_manager.cc:1428] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.000s
I20260812 19:26:36.367340 22069 tablet_bootstrap.cc:492] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:36.387494 22069 tablet_bootstrap.cc:492] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:36.388425 22069 tablet_bootstrap.cc:492] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:36.389083 22069 ts_tablet_manager.cc:1397] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260812 19:26:36.391597 22069 raft_consensus.cc:348] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:36.392216 22069 raft_consensus.cc:729] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:36.392879 22069 consensus_queue.cc:260] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:36.394534 22069 ts_tablet_manager.cc:1428] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 19:26:36.396378 22069 tablet_bootstrap.cc:492] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
W20260812 19:26:36.405474 20691 consensus_peers.cc:487] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:36.410184 22069 tablet_bootstrap.cc:492] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:36.411232 22069 tablet_bootstrap.cc:492] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:36.412019 22069 ts_tablet_manager.cc:1397] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.009s
I20260812 19:26:36.414239 22069 raft_consensus.cc:348] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:36.415000 22069 raft_consensus.cc:729] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:36.415709 22069 consensus_queue.cc:260] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:36.417812 22069 ts_tablet_manager.cc:1428] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260812 19:26:36.418758 22069 tablet_bootstrap.cc:492] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:36.431447 22069 tablet_bootstrap.cc:492] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:36.432468 22069 tablet_bootstrap.cc:492] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:36.433202 22069 ts_tablet_manager.cc:1397] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260812 19:26:36.435267 22069 raft_consensus.cc:348] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:36.435791 22069 raft_consensus.cc:729] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:36.436415 22069 consensus_queue.cc:260] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:36.438470 22069 ts_tablet_manager.cc:1428] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 19:26:36.439532 22069 tablet_bootstrap.cc:492] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:36.454916 22069 tablet_bootstrap.cc:492] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:36.455911 22069 tablet_bootstrap.cc:492] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:36.456629 22069 ts_tablet_manager.cc:1397] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260812 19:26:36.458877 22069 raft_consensus.cc:348] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:36.459547 22069 raft_consensus.cc:729] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:36.460194 22069 consensus_queue.cc:260] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:36.462250 22069 ts_tablet_manager.cc:1428] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 19:26:36.463563 22069 tablet_bootstrap.cc:492] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:36.481511 22069 tablet_bootstrap.cc:492] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:36.483536 22069 tablet_bootstrap.cc:492] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:36.484259 22069 ts_tablet_manager.cc:1397] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260812 19:26:36.486742 22069 raft_consensus.cc:348] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:36.487432 22069 raft_consensus.cc:729] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:36.488070 22069 consensus_queue.cc:260] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:36.490146 22069 ts_tablet_manager.cc:1428] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 19:26:36.492039 22069 tablet_bootstrap.cc:492] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:36.491935 20739 raft_consensus.cc:1261] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Refusing update from remote peer 8c9e33eee61649e18fe397e56bdddea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:26:36.497458 22151 consensus_queue.cc:1035] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:36.515722 22069 tablet_bootstrap.cc:492] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:36.516782 22069 tablet_bootstrap.cc:492] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:36.517477 22069 ts_tablet_manager.cc:1397] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.009s
I20260812 19:26:36.520016 22069 raft_consensus.cc:348] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:36.520720 22069 raft_consensus.cc:729] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:36.521409 22069 consensus_queue.cc:260] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:36.523715 22069 ts_tablet_manager.cc:1428] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260812 19:26:36.524961 22069 tablet_bootstrap.cc:492] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039: Bootstrap starting.
I20260812 19:26:36.557545 22069 tablet_bootstrap.cc:492] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:26:36.558578 22069 tablet_bootstrap.cc:492] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039: Bootstrap complete.
I20260812 19:26:36.559394 22069 ts_tablet_manager.cc:1397] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.015s
I20260812 19:26:36.561861 22069 raft_consensus.cc:348] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:36.562538 22069 raft_consensus.cc:729] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Initialized, Role: FOLLOWER
I20260812 19:26:36.563231 22069 consensus_queue.cc:260] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:36.565682 22069 ts_tablet_manager.cc:1428] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 19:26:36.571946 22248 raft_consensus.cc:3037] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:36.581243 22269 raft_consensus.cc:1261] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Refusing update from remote peer 8c9e33eee61649e18fe397e56bdddea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:26:36.583644 22386 consensus_queue.cc:1035] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:26:36.592881 20856 raft_consensus.cc:1261] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Refusing update from remote peer efc1471911ec442396b400eed9d18036: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 19:26:36.599802 22118 consensus_queue.cc:1035] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:26:36.670298 22269 raft_consensus.cc:3037] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:36.837463 22248 raft_consensus.cc:3037] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 3
I20260812 19:26:36.873471 22261 raft_consensus.cc:3037] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:45.477365  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:26:45.538307 20856 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1"
dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
mode: GRACEFUL
new_leader_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:53180
I20260812 19:26:45.539263 20856 raft_consensus.cc:595] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Received request to transfer leadership to TS 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:45.541867 20851 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "273e3feb623f4b0d8b3078f4a6a49ac6"
dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
mode: GRACEFUL
new_leader_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:53180
I20260812 19:26:45.542443 20851 raft_consensus.cc:595] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Received request to transfer leadership to TS 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:45.545192 20861 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3044cbc7bbaa46858021ce0b610da983"
dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
mode: GRACEFUL
new_leader_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:53180
I20260812 19:26:45.545673 20861 raft_consensus.cc:595] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Received request to transfer leadership to TS 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:45.563437 20979 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8f536e291e9f46cb8ce550ae575e643a"
dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
mode: GRACEFUL
new_leader_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:36172
I20260812 19:26:45.564043 20979 raft_consensus.cc:595] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Received request to transfer leadership to TS 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:45.580991 20735 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ebcc2cf4057a4c8e82b0ee3dc8481257"
dest_uuid: "efc1471911ec442396b400eed9d18036"
mode: GRACEFUL
new_leader_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:39918
I20260812 19:26:45.581646 20735 raft_consensus.cc:595] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Received request to transfer leadership to TS 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:45.582072 22451 raft_consensus.cc:979] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3: : Instructing follower 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:45.582854 22386 raft_consensus.cc:1067] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Signalling peer 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:45.584518 22269 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "273e3feb623f4b0d8b3078f4a6a49ac6"
dest_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:38862
I20260812 19:26:45.585104 22269 raft_consensus.cc:482] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:45.585489 22269 raft_consensus.cc:3037] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:45.592016 20976 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ede4dcd9659d422184a3873426f9e6c4"
dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
mode: GRACEFUL
new_leader_uuid: "8c9e33eee61649e18fe397e56bdddea3"
 from {username='slave'} at 127.0.0.1:36172
I20260812 19:26:45.592724 20976 raft_consensus.cc:595] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Received request to transfer leadership to TS 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:45.593961  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260812 19:26:45.610837 22269 raft_consensus.cc:504] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:45.612299  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:26:45.613277  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:26:45.620016 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "273e3feb623f4b0d8b3078f4a6a49ac6" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:45.620468 22269 leader_election.cc:288] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:45.621006 20861 raft_consensus.cc:3032] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:26:45.621389 20861 raft_consensus.cc:729] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:45.622136 20861 consensus_queue.cc:260] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:45.623512 20861 raft_consensus.cc:3037] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:45.624347 20976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "273e3feb623f4b0d8b3078f4a6a49ac6" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:45.625001 20976 raft_consensus.cc:3037] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:45.631700 20976 raft_consensus.cc:2454] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 3.
I20260812 19:26:45.633600 22050 leader_election.cc:302] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:45.636601 20861 raft_consensus.cc:2454] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 3.
I20260812 19:26:45.639657 22483 raft_consensus.cc:2781] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:26:45.641247 22483 raft_consensus.cc:686] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 3 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:45.643505 22483 consensus_queue.cc:237] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:45.657140 20454 catalog_manager.cc:5495] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 2 to 3, leader changed from 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3) to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 3 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:45.707821 22470 raft_consensus.cc:979] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036: : Instructing follower 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:45.708556 22378 raft_consensus.cc:1067] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Signalling peer 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:45.710325 22269 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ebcc2cf4057a4c8e82b0ee3dc8481257"
dest_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:38846
I20260812 19:26:45.710875 22269 raft_consensus.cc:482] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:45.711136 22269 raft_consensus.cc:3037] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:45.717942 22269 raft_consensus.cc:504] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:45.719940 22269 leader_election.cc:288] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:45.720844 20976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebcc2cf4057a4c8e82b0ee3dc8481257" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:45.721185 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebcc2cf4057a4c8e82b0ee3dc8481257" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:45.721586 20976 raft_consensus.cc:3037] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:45.721864 20735 raft_consensus.cc:3032] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:26:45.722182 20735 raft_consensus.cc:729] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:45.723061 20735 consensus_queue.cc:260] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:45.724479 20735 raft_consensus.cc:3037] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:45.729169 20976 raft_consensus.cc:2454] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 3.
I20260812 19:26:45.730337 22050 leader_election.cc:302] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:45.731284 22483 raft_consensus.cc:2781] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:26:45.731822 22483 raft_consensus.cc:686] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 3 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:45.732789 22483 consensus_queue.cc:237] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:45.734417 20735 raft_consensus.cc:2454] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 3.
I20260812 19:26:45.745043 20454 catalog_manager.cc:5495] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 2 to 3, leader changed from efc1471911ec442396b400eed9d18036 (127.3.253.2) to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 3 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:45.916925 22494 raft_consensus.cc:979] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3: : Instructing follower 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:45.917443 22386 raft_consensus.cc:1067] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Signalling peer 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:45.918845 22269 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3044cbc7bbaa46858021ce0b610da983"
dest_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:38862
I20260812 19:26:45.919323 22269 raft_consensus.cc:482] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:45.919595 22269 raft_consensus.cc:3037] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:45.924914 22269 raft_consensus.cc:504] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:45.926294 22269 leader_election.cc:288] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:45.927193 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3044cbc7bbaa46858021ce0b610da983" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:45.927563 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3044cbc7bbaa46858021ce0b610da983" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:45.927835 20735 raft_consensus.cc:3037] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:45.929150 20861 raft_consensus.cc:3032] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:26:45.929525 20861 raft_consensus.cc:729] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:45.930377 20861 consensus_queue.cc:260] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:45.931726 20861 raft_consensus.cc:3037] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:45.935109 20735 raft_consensus.cc:2454] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 3.
I20260812 19:26:45.936628 22056 leader_election.cc:302] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:45.937638 22483 raft_consensus.cc:2781] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:26:45.938138 22483 raft_consensus.cc:686] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 3 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:45.939355 20861 raft_consensus.cc:2454] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 3.
I20260812 19:26:45.939090 22483 consensus_queue.cc:237] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:45.953086 20454 catalog_manager.cc:5495] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 2 to 3, leader changed from 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3) to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 3 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:46.045357 22458 raft_consensus.cc:979] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c: : Instructing follower 8c9e33eee61649e18fe397e56bdddea3 to start an election
I20260812 19:26:46.046007 22458 raft_consensus.cc:1067] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Signalling peer 8c9e33eee61649e18fe397e56bdddea3 to start an election
I20260812 19:26:46.047569 20856 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ede4dcd9659d422184a3873426f9e6c4"
dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
 from {username='slave'} at 127.0.0.1:33982
I20260812 19:26:46.048122 20856 raft_consensus.cc:482] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:46.048442 20856 raft_consensus.cc:3037] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:46.054242 20856 raft_consensus.cc:504] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:46.056033 20856 leader_election.cc:288] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:46.056761 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ede4dcd9659d422184a3873426f9e6c4" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:46.057035 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ede4dcd9659d422184a3873426f9e6c4" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:46.057423 20735 raft_consensus.cc:3037] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:46.057770 20979 raft_consensus.cc:3032] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:46.058048 20979 raft_consensus.cc:729] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:46.058745 20979 consensus_queue.cc:260] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:46.059795 20979 raft_consensus.cc:3037] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:46.062348 20735 raft_consensus.cc:2454] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 2.
I20260812 19:26:46.063416 20815 leader_election.cc:302] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3, efc1471911ec442396b400eed9d18036; no voters: 
I20260812 19:26:46.064195 22386 raft_consensus.cc:2781] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:46.064687 22386 raft_consensus.cc:686] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Becoming Leader. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:46.065814 20979 raft_consensus.cc:2454] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9e33eee61649e18fe397e56bdddea3 in term 2.
I20260812 19:26:46.065531 22386 consensus_queue.cc:237] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } }
I20260812 19:26:46.075841 22494 raft_consensus.cc:979] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3: : Instructing follower 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:46.076399 22494 raft_consensus.cc:1067] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Signalling peer 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:46.076727 20454 catalog_manager.cc:5495] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 reported cstate change: term changed from 1 to 2, leader changed from d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4) to 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "8c9e33eee61649e18fe397e56bdddea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:46.078048 22261 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1"
dest_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:38862
I20260812 19:26:46.078640 22261 raft_consensus.cc:482] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:46.078985 22261 raft_consensus.cc:3037] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:46.085816 22261 raft_consensus.cc:504] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:46.088173 22261 leader_election.cc:288] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:46.088441 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:46.089218 20856 raft_consensus.cc:3032] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:26:46.089514 20856 raft_consensus.cc:729] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:46.090108 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:46.090250 20856 consensus_queue.cc:260] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:46.090905 20979 raft_consensus.cc:3037] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:46.091791 20856 raft_consensus.cc:3037] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:46.099495 20856 raft_consensus.cc:2454] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 3.
I20260812 19:26:46.101909 22052 leader_election.cc:302] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:46.102977 22483 raft_consensus.cc:2781] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:26:46.103452 22483 raft_consensus.cc:686] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 3 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:46.104353 22483 consensus_queue.cc:237] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:46.106786 20979 raft_consensus.cc:2454] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 3.
I20260812 19:26:46.130563 20454 catalog_manager.cc:5495] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 2 to 3, leader changed from 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3) to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 3 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:46.168092 22467 raft_consensus.cc:979] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c: : Instructing follower 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:46.168655 22458 raft_consensus.cc:1067] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Signalling peer 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:46.170125 22261 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8f536e291e9f46cb8ce550ae575e643a"
dest_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:38840
I20260812 19:26:46.170713 22261 raft_consensus.cc:482] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:46.171043 22261 raft_consensus.cc:3037] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:46.178493 22261 raft_consensus.cc:504] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:46.180348 22261 leader_election.cc:288] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:46.181304 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f536e291e9f46cb8ce550ae575e643a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:46.181943 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f536e291e9f46cb8ce550ae575e643a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:46.182140 20856 raft_consensus.cc:3037] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:46.182592 20735 raft_consensus.cc:1261] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:26:46.182588 20979 raft_consensus.cc:3032] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:46.183400 20979 raft_consensus.cc:729] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:46.184846 22483 consensus_queue.cc:1035] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:26:46.185113 20979 consensus_queue.cc:260] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:46.185695 20976 raft_consensus.cc:1261] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:26:46.187263 20979 raft_consensus.cc:3037] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:46.189213 22483 consensus_queue.cc:1035] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:26:46.190812 20856 raft_consensus.cc:2454] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 2.
I20260812 19:26:46.192185 22052 leader_election.cc:302] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:46.192993 22483 raft_consensus.cc:2781] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:46.193884 22483 raft_consensus.cc:686] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 2 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:46.194960 22483 consensus_queue.cc:237] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:46.198565 20979 raft_consensus.cc:2454] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 2.
I20260812 19:26:46.226722 20856 raft_consensus.cc:1261] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:26:46.229584 20454 catalog_manager.cc:5495] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 1 to 2, leader changed from d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4) to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:46.234422 22484 consensus_queue.cc:1035] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:26:46.254591 20976 raft_consensus.cc:1261] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:26:46.258028 22509 consensus_queue.cc:1035] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:26:46.368834 20735 raft_consensus.cc:1261] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:26:46.370188 22509 consensus_queue.cc:1035] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:26:46.380286 20856 raft_consensus.cc:1261] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:26:46.383018 22514 consensus_queue.cc:1035] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:26:46.515977 20976 raft_consensus.cc:1261] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Refusing update from remote peer 8c9e33eee61649e18fe397e56bdddea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:46.517268 22494 consensus_queue.cc:1035] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:46.531147 20739 raft_consensus.cc:1261] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Refusing update from remote peer 8c9e33eee61649e18fe397e56bdddea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:46.533252 22451 consensus_queue.cc:1035] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:26:46.572956 20861 raft_consensus.cc:1261] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:26:46.573483 20976 raft_consensus.cc:1261] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:26:46.574961 22514 consensus_queue.cc:1035] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:26:46.576342 20976 raft_consensus.cc:1261] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:46.576196 22509 consensus_queue.cc:1035] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:26:46.579923 22509 consensus_queue.cc:1035] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260812 19:26:46.610791 20861 raft_consensus.cc:1261] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:46.614851 22514 consensus_queue.cc:1035] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:46.662389  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:26:46.700261 20976 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0454a10a87ed4fd7a5ef01021940c016"
dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
mode: GRACEFUL
new_leader_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:36172
I20260812 19:26:46.700986 20976 raft_consensus.cc:595] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 2 LEADER]: Received request to transfer leadership to TS 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:46.704005 20976 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1b6cd88a19cf44aeabbec6b1d8e76630"
dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
mode: GRACEFUL
new_leader_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:36172
I20260812 19:26:46.704569 20976 raft_consensus.cc:595] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Received request to transfer leadership to TS 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:46.707266 20979 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3a347274cb334867b07c94e32b32f3ca"
dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
mode: GRACEFUL
new_leader_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:36172
I20260812 19:26:46.707886 20979 raft_consensus.cc:595] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Received request to transfer leadership to TS 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:46.710194 20861 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da"
dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
mode: GRACEFUL
new_leader_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:53180
I20260812 19:26:46.710698 20861 raft_consensus.cc:595] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 3 LEADER]: Received request to transfer leadership to TS 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:46.712939 20735 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a91aea69f88c43cb84d67ea8a6e8d8bf"
dest_uuid: "efc1471911ec442396b400eed9d18036"
mode: GRACEFUL
new_leader_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:39918
I20260812 19:26:46.713376 20735 raft_consensus.cc:595] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Received request to transfer leadership to TS 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:46.715726 20979 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "db43a23e01bd4d3abc5d92db87b6e98b"
dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
mode: GRACEFUL
new_leader_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:36172
I20260812 19:26:46.716185 20979 raft_consensus.cc:595] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Received request to transfer leadership to TS 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:46.717263  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260812 19:26:46.718644  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:26:46.719298  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:26:46.739969 22467 raft_consensus.cc:979] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c: : Instructing follower 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:46.740725 22542 raft_consensus.cc:1067] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Signalling peer 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:46.742334 22269 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1b6cd88a19cf44aeabbec6b1d8e76630"
dest_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:38840
I20260812 19:26:46.742828 22269 raft_consensus.cc:482] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:46.743177 22269 raft_consensus.cc:3037] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:46.753269 22269 raft_consensus.cc:504] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:46.756250 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6cd88a19cf44aeabbec6b1d8e76630" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:46.756891 20979 raft_consensus.cc:3032] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:46.757233 20979 raft_consensus.cc:729] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:46.757982 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6cd88a19cf44aeabbec6b1d8e76630" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:46.758625 20739 raft_consensus.cc:3037] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:46.758052 20979 consensus_queue.cc:260] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:46.761595 20979 raft_consensus.cc:3037] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:46.770360 22269 leader_election.cc:288] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:46.772464 20979 raft_consensus.cc:2454] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 2.
I20260812 19:26:46.773617 20739 raft_consensus.cc:2454] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 2.
I20260812 19:26:46.774075 22050 leader_election.cc:302] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:46.775239 22514 raft_consensus.cc:2781] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:46.775818 22514 raft_consensus.cc:686] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 2 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:46.776798 22514 consensus_queue.cc:237] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:46.789112 20451 catalog_manager.cc:5495] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 1 to 2, leader changed from d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4) to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:46.793290 22527 raft_consensus.cc:979] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036: : Instructing follower 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:46.793836 22470 raft_consensus.cc:1067] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Signalling peer 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:46.795332 22261 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a91aea69f88c43cb84d67ea8a6e8d8bf"
dest_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:38846
I20260812 19:26:46.795976 22261 raft_consensus.cc:482] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:46.796284 22261 raft_consensus.cc:3037] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:46.808777 22261 raft_consensus.cc:504] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:46.811651 22261 leader_election.cc:288] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:46.812546 20739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91aea69f88c43cb84d67ea8a6e8d8bf" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:46.813235 20739 raft_consensus.cc:3032] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:26:46.813621 22458 raft_consensus.cc:979] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c: : Instructing follower 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:46.813524 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91aea69f88c43cb84d67ea8a6e8d8bf" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:46.813603 20739 raft_consensus.cc:729] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:46.814433 20856 raft_consensus.cc:3037] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:46.815075 20739 consensus_queue.cc:260] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:46.816656 20739 raft_consensus.cc:3037] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:46.825724 20856 raft_consensus.cc:2454] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 3.
I20260812 19:26:46.826457 20739 raft_consensus.cc:2454] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 3.
I20260812 19:26:46.827149 22052 leader_election.cc:302] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:46.814422 22542 raft_consensus.cc:1067] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Signalling peer 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:46.828094 22514 raft_consensus.cc:2781] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:26:46.828682 22514 raft_consensus.cc:686] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 3 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:46.829437 22261 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "db43a23e01bd4d3abc5d92db87b6e98b"
dest_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:38840
I20260812 19:26:46.830017 22261 raft_consensus.cc:482] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:46.829681 22514 consensus_queue.cc:237] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:46.830334 22261 raft_consensus.cc:3037] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:46.838021 22261 raft_consensus.cc:504] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:46.839913 22261 leader_election.cc:288] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:46.840852 20976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db43a23e01bd4d3abc5d92db87b6e98b" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:46.843382 20976 raft_consensus.cc:3032] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:46.843694 20976 raft_consensus.cc:729] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:46.844455 20976 consensus_queue.cc:260] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:46.845605 20976 raft_consensus.cc:3037] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:46.841662 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db43a23e01bd4d3abc5d92db87b6e98b" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:46.852984 20856 raft_consensus.cc:3037] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:46.863909 22535 raft_consensus.cc:979] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3: : Instructing follower 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:46.864444 22535 raft_consensus.cc:1067] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 3 LEADER]: Signalling peer 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:46.867853 22248 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da"
dest_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:38862
I20260812 19:26:46.868402 22248 raft_consensus.cc:482] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:46.868719 22248 raft_consensus.cc:3037] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:26:46.871850 20976 raft_consensus.cc:2454] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 2.
I20260812 19:26:46.873459 20856 raft_consensus.cc:2454] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 2.
I20260812 19:26:46.874780 22052 leader_election.cc:302] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:46.875625 22484 raft_consensus.cc:2781] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:46.876164 22484 raft_consensus.cc:686] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 2 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:46.876951 22484 consensus_queue.cc:237] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:46.888697 22248 raft_consensus.cc:504] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:46.893030 20735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:46.892657 20451 catalog_manager.cc:5495] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 2 to 3, leader changed from efc1471911ec442396b400eed9d18036 (127.3.253.2) to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 3 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:46.893739 20735 raft_consensus.cc:3037] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:26:46.894276 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "435900f76e8b41cdbc9f2f3ce6c425da" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:46.895165 20856 raft_consensus.cc:3032] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:26:46.895517 20856 raft_consensus.cc:729] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c9e33eee61649e18fe397e56bdddea3, State: Running, Role: LEADER
I20260812 19:26:46.896368 20856 consensus_queue.cc:260] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:46.897630 20856 raft_consensus.cc:3037] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:26:46.902037 22248 leader_election.cc:288] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 4 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:46.905961 20856 raft_consensus.cc:2454] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 4.
I20260812 19:26:46.907148 22052 leader_election.cc:302] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:46.907984 22514 raft_consensus.cc:2781] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:26:46.908505 22514 raft_consensus.cc:686] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 4 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:46.909492 22514 consensus_queue.cc:237] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:46.914897 20735 raft_consensus.cc:2454] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 4.
I20260812 19:26:46.917775 20451 catalog_manager.cc:5495] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 1 to 2, leader changed from d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4) to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:46.936743 20451 catalog_manager.cc:5495] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 3 to 4, leader changed from 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3) to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 4 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:47.045761 22542 raft_consensus.cc:979] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c: : Instructing follower 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:47.046353 22458 raft_consensus.cc:1067] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Signalling peer 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:47.047802 22261 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3a347274cb334867b07c94e32b32f3ca"
dest_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:38840
I20260812 19:26:47.048271 22261 raft_consensus.cc:482] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:47.048579 22261 raft_consensus.cc:3037] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:47.054557 22261 raft_consensus.cc:504] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:47.056268 22261 leader_election.cc:288] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:47.057433 20976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a347274cb334867b07c94e32b32f3ca" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:47.057716 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a347274cb334867b07c94e32b32f3ca" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:47.058106 20976 raft_consensus.cc:3032] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:47.058346 20856 raft_consensus.cc:3037] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:47.058467 20976 raft_consensus.cc:729] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:47.059312 20976 consensus_queue.cc:260] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:47.060132 20976 raft_consensus.cc:3037] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:47.063540 20856 raft_consensus.cc:2454] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 2.
I20260812 19:26:47.064769 22052 leader_election.cc:302] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:47.065550 20976 raft_consensus.cc:2454] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 2.
I20260812 19:26:47.065644 22484 raft_consensus.cc:2781] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:47.066572 22484 raft_consensus.cc:686] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 2 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:47.067586 22484 consensus_queue.cc:237] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:47.077346 20451 catalog_manager.cc:5495] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 1 to 2, leader changed from d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4) to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:47.168213 22542 raft_consensus.cc:979] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c: : Instructing follower 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:47.168790 22542 raft_consensus.cc:1067] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 2 LEADER]: Signalling peer 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:47.170359 22269 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0454a10a87ed4fd7a5ef01021940c016"
dest_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:38840
I20260812 19:26:47.170903 22269 raft_consensus.cc:482] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:47.171222 22269 raft_consensus.cc:3037] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:47.178607 22269 raft_consensus.cc:504] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:47.180882 22269 leader_election.cc:288] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:47.181169 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0454a10a87ed4fd7a5ef01021940c016" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:47.181496 20976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0454a10a87ed4fd7a5ef01021940c016" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:47.181942 20856 raft_consensus.cc:3037] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:47.182072 20976 raft_consensus.cc:3032] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:26:47.182441 20976 raft_consensus.cc:729] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:47.183251 20976 consensus_queue.cc:260] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:47.184478 20976 raft_consensus.cc:3037] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:47.189234 20856 raft_consensus.cc:2454] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 3.
I20260812 19:26:47.190420 22052 leader_election.cc:302] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:47.191226 22483 raft_consensus.cc:2781] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:26:47.191407 20976 raft_consensus.cc:2454] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 3.
I20260812 19:26:47.191840 22483 raft_consensus.cc:686] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 3 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:47.192801 22483 consensus_queue.cc:237] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:47.194087 20979 raft_consensus.cc:1261] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:47.195675 22484 consensus_queue.cc:1035] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:47.204830 20451 catalog_manager.cc:5495] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 2 to 3, leader changed from d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4) to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 3 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:47.211966 20740 raft_consensus.cc:1261] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:47.213624 22514 consensus_queue.cc:1035] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:47.283566 20856 raft_consensus.cc:1261] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:26:47.284803 22514 consensus_queue.cc:1035] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:26:47.288558 20979 raft_consensus.cc:1261] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:47.291599 22514 consensus_queue.cc:1035] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:47.298309 20740 raft_consensus.cc:1261] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:26:47.302292 22483 consensus_queue.cc:1035] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:26:47.328039 20861 raft_consensus.cc:1261] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:47.329516 22484 consensus_queue.cc:1035] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:47.473534 20861 raft_consensus.cc:1261] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:47.474745 22484 consensus_queue.cc:1035] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:47.487672 20979 raft_consensus.cc:1261] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:47.489212 22484 consensus_queue.cc:1035] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:26:47.489673 20861 raft_consensus.cc:1261] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 4 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:26:47.491555 22484 consensus_queue.cc:1035] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:26:47.507486 20740 raft_consensus.cc:1261] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 4 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260812 19:26:47.509343 22514 consensus_queue.cc:1035] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:26:47.583799 20861 raft_consensus.cc:1261] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:26:47.585114 22514 consensus_queue.cc:1035] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:26:47.597025 20979 raft_consensus.cc:1261] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:26:47.598776 22514 consensus_queue.cc:1035] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:26:47.773022  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:26:47.814879 20979 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5b112d71b0be429f977ba95ac9534b6b"
dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
mode: GRACEFUL
new_leader_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:36172
I20260812 19:26:47.815423 20979 raft_consensus.cc:595] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Received request to transfer leadership to TS 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:47.818241 20976 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "614ccc1f6aa847f5b874c88bb9e2587a"
dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
mode: GRACEFUL
new_leader_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:36172
I20260812 19:26:47.818866 20976 raft_consensus.cc:595] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Received request to transfer leadership to TS 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:47.821836 20740 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d6510fddf1024d71b387e8dfa568e96c"
dest_uuid: "efc1471911ec442396b400eed9d18036"
mode: GRACEFUL
new_leader_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:39918
I20260812 19:26:47.822472 20740 raft_consensus.cc:595] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Received request to transfer leadership to TS 171f67787a8348fb9c7b19bf09026039
I20260812 19:26:47.823624  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260812 19:26:47.824949  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:26:47.825479  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:26:47.865993 22542 raft_consensus.cc:979] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c: : Instructing follower 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:47.866643 22458 raft_consensus.cc:1067] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Signalling peer 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:47.867960 22269 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5b112d71b0be429f977ba95ac9534b6b"
dest_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:38840
I20260812 19:26:47.868425 22269 raft_consensus.cc:482] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:47.868687 22269 raft_consensus.cc:3037] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:47.874150 22269 raft_consensus.cc:504] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:47.875617 22269 leader_election.cc:288] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 election: Requested vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307)
I20260812 19:26:47.876394 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b112d71b0be429f977ba95ac9534b6b" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:47.876641 20976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b112d71b0be429f977ba95ac9534b6b" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:47.877058 20861 raft_consensus.cc:3037] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:47.877264 20976 raft_consensus.cc:3032] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:47.877601 20976 raft_consensus.cc:729] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:47.878261 20976 consensus_queue.cc:260] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:47.879403 20976 raft_consensus.cc:3037] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:47.883262 20861 raft_consensus.cc:2454] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 2.
I20260812 19:26:47.884176 22052 leader_election.cc:302] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:47.884943 22484 raft_consensus.cc:2781] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:47.885424 22484 raft_consensus.cc:686] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 2 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:47.885668 20976 raft_consensus.cc:2454] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 2.
I20260812 19:26:47.886327 22484 consensus_queue.cc:237] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:47.896857 20451 catalog_manager.cc:5495] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 1 to 2, leader changed from d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4) to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:48.158777 22470 raft_consensus.cc:979] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036: : Instructing follower 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:48.159339 22554 raft_consensus.cc:1067] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Signalling peer 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:48.160802 22261 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d6510fddf1024d71b387e8dfa568e96c"
dest_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:38846
I20260812 19:26:48.161298 22261 raft_consensus.cc:482] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:48.161563 22261 raft_consensus.cc:3037] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:48.167531 22261 raft_consensus.cc:504] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:48.169309 22261 leader_election.cc:288] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 election: Requested vote from peers efc1471911ec442396b400eed9d18036 (127.3.253.2:39525), 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049)
I20260812 19:26:48.170218 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6510fddf1024d71b387e8dfa568e96c" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:48.170218 20861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6510fddf1024d71b387e8dfa568e96c" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8c9e33eee61649e18fe397e56bdddea3"
I20260812 19:26:48.171000 20740 raft_consensus.cc:3032] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:26:48.171115 20861 raft_consensus.cc:3037] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:48.171392 20740 raft_consensus.cc:729] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: efc1471911ec442396b400eed9d18036, State: Running, Role: LEADER
I20260812 19:26:48.172277 20740 consensus_queue.cc:260] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:48.173339 20740 raft_consensus.cc:3037] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:26:48.176930 20861 raft_consensus.cc:2454] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 3.
I20260812 19:26:48.178074 22052 leader_election.cc:302] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3; no voters: 
I20260812 19:26:48.178920 22514 raft_consensus.cc:2781] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:26:48.179287 20740 raft_consensus.cc:2454] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 3.
I20260812 19:26:48.179459 22514 raft_consensus.cc:686] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 3 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:48.180503 22514 consensus_queue.cc:237] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:48.191404 20451 catalog_manager.cc:5495] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 2 to 3, leader changed from efc1471911ec442396b400eed9d18036 (127.3.253.2) to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 3 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:48.275766 20861 raft_consensus.cc:1261] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:48.277130 22509 consensus_queue.cc:1035] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:48.290390 20976 raft_consensus.cc:1261] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:48.291924 22509 consensus_queue.cc:1035] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:48.399312 22458 raft_consensus.cc:979] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c: : Instructing follower 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:48.399812 22621 raft_consensus.cc:1067] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Signalling peer 171f67787a8348fb9c7b19bf09026039 to start an election
I20260812 19:26:48.401196 22269 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "614ccc1f6aa847f5b874c88bb9e2587a"
dest_uuid: "171f67787a8348fb9c7b19bf09026039"
 from {username='slave'} at 127.0.0.1:38840
I20260812 19:26:48.401700 22269 raft_consensus.cc:482] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:48.402055 22269 raft_consensus.cc:3037] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:48.407519 22269 raft_consensus.cc:504] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:48.409631 22269 leader_election.cc:288] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 election: Requested vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:48.409840 20976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "614ccc1f6aa847f5b874c88bb9e2587a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c"
I20260812 19:26:48.410100 20740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "614ccc1f6aa847f5b874c88bb9e2587a" candidate_uuid: "171f67787a8348fb9c7b19bf09026039" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc1471911ec442396b400eed9d18036"
I20260812 19:26:48.410533 20976 raft_consensus.cc:3032] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:48.410780 20740 raft_consensus.cc:3037] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:48.411003 20976 raft_consensus.cc:729] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5ab425bcd82426387b1a5b02e55b64c, State: Running, Role: LEADER
I20260812 19:26:48.411895 20976 consensus_queue.cc:260] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:48.412956 20976 raft_consensus.cc:3037] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:48.419822 20976 raft_consensus.cc:2454] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 2.
I20260812 19:26:48.420667 20740 raft_consensus.cc:2454] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171f67787a8348fb9c7b19bf09026039 in term 2.
I20260812 19:26:48.420912 22050 leader_election.cc:302] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c; no voters: 
I20260812 19:26:48.421890 22509 raft_consensus.cc:2781] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:48.422381 22509 raft_consensus.cc:686] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 2 LEADER]: Becoming Leader. State: Replica: 171f67787a8348fb9c7b19bf09026039, State: Running, Role: LEADER
I20260812 19:26:48.423375 22509 consensus_queue.cc:237] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:48.433410 20453 catalog_manager.cc:5495] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 reported cstate change: term changed from 1 to 2, leader changed from d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4) to 171f67787a8348fb9c7b19bf09026039 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "171f67787a8348fb9c7b19bf09026039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:48.603221 20740 raft_consensus.cc:1261] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:26:48.604501 22514 consensus_queue.cc:1035] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:26:48.615227 20856 raft_consensus.cc:1261] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:26:48.616628 22509 consensus_queue.cc:1035] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:26:48.812786 20740 raft_consensus.cc:1261] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:48.814198 22509 consensus_queue.cc:1035] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:48.827935 20976 raft_consensus.cc:1261] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Refusing update from remote peer 171f67787a8348fb9c7b19bf09026039: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:48.830892 22484 consensus_queue.cc:1035] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:48.863474  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:26:48.898974  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:26:48.900267  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:26:48.900758  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:26:48.936904  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:26:48.973801  4084 tablet_server.cc:178] TabletServer@127.3.253.1:33811 shutting down...
W20260812 19:26:49.017588 20812 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 254 similar messages]
W20260812 19:26:49.025061 20812 consensus_peers.cc:487] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.076151 20812 consensus_peers.cc:487] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.093564 20918 consensus_peers.cc:487] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.115131 20812 consensus_peers.cc:487] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.140793 20918 consensus_peers.cc:487] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.141820 20918 consensus_peers.cc:487] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.142946 20691 consensus_peers.cc:487] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.143779 20691 consensus_peers.cc:487] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.145843 20691 consensus_peers.cc:487] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.147527 20691 consensus_peers.cc:487] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.148105  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:26:49.150523  4084 tablet_replica.cc:330] stopping tablet replica
W20260812 19:26:49.151878 20812 consensus_peers.cc:487] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.154939  4084 raft_consensus.cc:2229] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.156457  4084 raft_consensus.cc:2258] T 6155c47e884e43498e968f83072b863a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.160595 20691 consensus_peers.cc:487] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.162829  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.165755  4084 raft_consensus.cc:2229] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.169251  4084 raft_consensus.cc:2258] T a91aea69f88c43cb84d67ea8a6e8d8bf P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.171577 20691 consensus_peers.cc:487] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.174190  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.176141  4084 raft_consensus.cc:2229] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.176739  4084 raft_consensus.cc:2258] T e57439ca2e634277b5b83494eddd4acb P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.180706  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.182482  4084 raft_consensus.cc:2229] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.183552  4084 raft_consensus.cc:2258] T e27156bde17147a6af9ddb1f23aa3ef8 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.189201  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.191649  4084 raft_consensus.cc:2229] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.193050  4084 raft_consensus.cc:2258] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.194531 20812 consensus_peers.cc:487] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.196456  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.198328  4084 raft_consensus.cc:2229] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.199280  4084 raft_consensus.cc:2258] T fa08d4efbda64360a2f987aab456fb04 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.203379  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.204803  4084 raft_consensus.cc:2229] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.207779  4084 raft_consensus.cc:2258] T 1b6cd88a19cf44aeabbec6b1d8e76630 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.213110  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.214166  4084 raft_consensus.cc:2229] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.215214  4084 raft_consensus.cc:2258] T 25f274ac8f124e7697711e0afcd0b058 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.220122  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.221191  4084 raft_consensus.cc:2229] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.221987  4084 raft_consensus.cc:2258] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.224054 20918 consensus_peers.cc:487] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.225399  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.226337  4084 raft_consensus.cc:2229] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.226963  4084 raft_consensus.cc:2258] T f54f896522e94977a1cee9bd74ce2303 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.230012  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.231024  4084 raft_consensus.cc:2229] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.231588  4084 raft_consensus.cc:2258] T 85e5e41bf96447d7a761378c54e8abff P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.235780  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.237317  4084 raft_consensus.cc:2229] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.238076  4084 raft_consensus.cc:2258] T 06f6e7dcac69477a99d44c3e039f7d36 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.240933  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.242004  4084 raft_consensus.cc:2229] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.242698  4084 raft_consensus.cc:2258] T e2a274b81b0d4079852b8b1ea7c7592a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.245996  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.246783  4084 raft_consensus.cc:2229] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.248626  4084 raft_consensus.cc:2258] T d6510fddf1024d71b387e8dfa568e96c P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.253985  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.255218  4084 raft_consensus.cc:2229] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 3 LEADER]: Raft consensus shutting down.
W20260812 19:26:49.256721 20918 consensus_peers.cc:487] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.257194  4084 raft_consensus.cc:2258] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.261220  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.262378  4084 raft_consensus.cc:2229] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.263202  4084 raft_consensus.cc:2258] T e5fc45bed8304c558e1aeb9f7ef05f2c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.266291  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.267094  4084 raft_consensus.cc:2229] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.267573  4084 raft_consensus.cc:2258] T 8caaf0d4e2ed4d039a3635696107687a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.271844  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.272773  4084 raft_consensus.cc:2229] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.273674  4084 raft_consensus.cc:2258] T a777b602ae6d4dac9f1ac116e0a2e86e P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.275400 20918 consensus_peers.cc:487] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.278169  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.279605  4084 raft_consensus.cc:2229] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.282238  4084 raft_consensus.cc:2258] T 3044cbc7bbaa46858021ce0b610da983 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.287045  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.289649  4084 raft_consensus.cc:2229] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.290603  4084 raft_consensus.cc:2258] T 51d8a1b5f4e9425691ed304509f9d8a9 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.297117  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.298327  4084 raft_consensus.cc:2229] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 2 LEADER]: Raft consensus shutting down.
W20260812 19:26:49.298427 20918 consensus_peers.cc:487] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.301110  4084 raft_consensus.cc:2258] T 614ccc1f6aa847f5b874c88bb9e2587a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.309562  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.310891  4084 raft_consensus.cc:2229] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.311944  4084 raft_consensus.cc:2258] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.312628 20812 consensus_peers.cc:487] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.316681  4084 tablet_replica.cc:330] stopping tablet replica
W20260812 19:26:49.317199 20812 consensus_peers.cc:487] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.318058 20812 consensus_peers.cc:487] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.318148  4084 raft_consensus.cc:2229] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.319108  4084 raft_consensus.cc:2258] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.325485  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.326762  4084 raft_consensus.cc:2229] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.327662  4084 raft_consensus.cc:2258] T adf3a538c4d74dd0a1704de4cf4d3624 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.331766  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.332508  4084 raft_consensus.cc:2229] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.333666  4084 raft_consensus.cc:2258] T 3a347274cb334867b07c94e32b32f3ca P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.338323 20691 consensus_peers.cc:487] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.338634  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.339778  4084 raft_consensus.cc:2229] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.340417  4084 raft_consensus.cc:2258] T 65767121d73547f7b17d3a05b6de8a6c P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.342442 20691 consensus_peers.cc:487] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.343701  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.344419  4084 raft_consensus.cc:2229] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.345024  4084 raft_consensus.cc:2258] T be4515819a7e4b5fa91def511f58fc4f P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.348564  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.349479  4084 raft_consensus.cc:2229] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.351338  4084 raft_consensus.cc:2258] T 5b112d71b0be429f977ba95ac9534b6b P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.355199  4084 tablet_replica.cc:330] stopping tablet replica
W20260812 19:26:49.355839 20691 consensus_peers.cc:487] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.355901  4084 raft_consensus.cc:2229] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.357337  4084 raft_consensus.cc:2258] T db43a23e01bd4d3abc5d92db87b6e98b P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.360888  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.361634  4084 raft_consensus.cc:2229] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.362442  4084 raft_consensus.cc:2258] T f906c95927b14410a6818ea15e9e089f P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.365231  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.365842  4084 raft_consensus.cc:2229] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.366413  4084 raft_consensus.cc:2258] T 3408c35d6e414cb4bb2aa3b96a742313 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.369594  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.370424  4084 raft_consensus.cc:2229] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.371888  4084 raft_consensus.cc:2258] T 8f536e291e9f46cb8ce550ae575e643a P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.374228 20918 consensus_peers.cc:487] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.375918  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.377004  4084 raft_consensus.cc:2229] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.378342  4084 raft_consensus.cc:2258] T 0454a10a87ed4fd7a5ef01021940c016 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.382730  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.383795  4084 raft_consensus.cc:2229] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.385382  4084 raft_consensus.cc:2258] T ebcc2cf4057a4c8e82b0ee3dc8481257 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.389326  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.390344  4084 raft_consensus.cc:2229] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.391054  4084 raft_consensus.cc:2258] T 67cee93c25424387a17659df99d3ad3d P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.395320  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.396348  4084 raft_consensus.cc:2229] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 4 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.398036  4084 raft_consensus.cc:2258] T 435900f76e8b41cdbc9f2f3ce6c425da P 171f67787a8348fb9c7b19bf09026039 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.401860  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.402981  4084 raft_consensus.cc:2229] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.403702  4084 raft_consensus.cc:2258] T 7b35dda8c9ec45d783785ed1ebb70243 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.407956  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.408852  4084 raft_consensus.cc:2229] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.409498  4084 raft_consensus.cc:2258] T e37466bb31e941bfaea862a42aafe4a2 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.413396  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.414319  4084 raft_consensus.cc:2229] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.415045  4084 raft_consensus.cc:2258] T 5cb0f8eae7934850b4db442c32298bb3 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.418231 20918 consensus_peers.cc:487] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.418728  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.419867  4084 raft_consensus.cc:2229] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.420544  4084 raft_consensus.cc:2258] T b2e5c58cd31f4eb8bd9092458140299a P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.424293  4084 tablet_replica.cc:330] stopping tablet replica
W20260812 19:26:49.424417 20691 consensus_peers.cc:487] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.425100  4084 raft_consensus.cc:2229] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.425882  4084 raft_consensus.cc:2258] T 728993c4b9cc4b97935e507c167f6a62 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.425103 20691 consensus_peers.cc:487] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.429940  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.430975  4084 raft_consensus.cc:2229] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.431697  4084 raft_consensus.cc:2258] T 69ed708096ce463aba0483b0487227ba P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.435259  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.436334  4084 raft_consensus.cc:2229] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.437314  4084 raft_consensus.cc:2258] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 171f67787a8348fb9c7b19bf09026039 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.443071  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.443876  4084 raft_consensus.cc:2229] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.444487  4084 raft_consensus.cc:2258] T 8732d4883dce4b7d97faf3669bdbb006 P 171f67787a8348fb9c7b19bf09026039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.447795  4084 tablet_replica.cc:330] stopping tablet replica
I20260812 19:26:49.448491  4084 raft_consensus.cc:2229] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.449126  4084 raft_consensus.cc:2258] T fb51472eb3314091aa30c515f1809f83 P 171f67787a8348fb9c7b19bf09026039 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.461891 20691 consensus_peers.cc:487] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.513175 20812 consensus_peers.cc:487] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.555712  4084 tablet_server.cc:194] TabletServer@127.3.253.1:33811 shutdown complete.
W20260812 19:26:49.581142 20918 consensus_peers.cc:487] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Couldn't send request to peer 171f67787a8348fb9c7b19bf09026039. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.668848  4084 tablet_server.cc:178] TabletServer@127.3.253.2:0 shutting down...
W20260812 19:26:49.693478 20815 consensus_peers.cc:487] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.707436 20815 consensus_peers.cc:487] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.727035 20922 consensus_peers.cc:487] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.729102  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:26:49.730198  4084 tablet_replica.cc:330] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.731536  4084 raft_consensus.cc:2229] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.732250  4084 raft_consensus.cc:2258] T 7bae9c177422418c8b9b4e0aa24fbce2 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.735865  4084 tablet_replica.cc:330] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.736753  4084 raft_consensus.cc:2229] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.737342  4084 raft_consensus.cc:2258] T f6acd85742e946ddb5bb17831fc226fe P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.740728  4084 tablet_replica.cc:330] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.741708  4084 raft_consensus.cc:2229] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.742913  4084 raft_consensus.cc:2258] T e37466bb31e941bfaea862a42aafe4a2 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.746543  4084 tablet_replica.cc:330] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.747583  4084 raft_consensus.cc:2229] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.748345  4084 raft_consensus.cc:2258] T 3044cbc7bbaa46858021ce0b610da983 P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.751720  4084 tablet_replica.cc:330] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.752602  4084 raft_consensus.cc:2229] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.753157  4084 raft_consensus.cc:2258] T d6510fddf1024d71b387e8dfa568e96c P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.756457  4084 tablet_replica.cc:330] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.757339  4084 raft_consensus.cc:2229] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.757927  4084 raft_consensus.cc:2258] T e57439ca2e634277b5b83494eddd4acb P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.760784  4084 tablet_replica.cc:330] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.761798  4084 raft_consensus.cc:2229] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.762439  4084 raft_consensus.cc:2258] T 13bf498c0abe436988718e4c55535f09 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.766317  4084 tablet_replica.cc:330] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.767546  4084 raft_consensus.cc:2229] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.768486  4084 raft_consensus.cc:2258] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.770589  4084 tablet_replica.cc:330] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.771256  4084 raft_consensus.cc:2229] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.771715  4084 raft_consensus.cc:2258] T fa08d4efbda64360a2f987aab456fb04 P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.773898  4084 tablet_replica.cc:330] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.774614  4084 raft_consensus.cc:2229] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.775358  4084 raft_consensus.cc:2258] T 435900f76e8b41cdbc9f2f3ce6c425da P efc1471911ec442396b400eed9d18036 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.778339  4084 tablet_replica.cc:330] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.779201  4084 raft_consensus.cc:2229] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.779781  4084 raft_consensus.cc:2258] T 200fb82ae5174fb184b44b3ea6f39a59 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.782903  4084 tablet_replica.cc:330] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.783844  4084 raft_consensus.cc:2229] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.785063  4084 raft_consensus.cc:2258] T 2f8d3279bf00462799704042e3cb3966 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.788033  4084 tablet_replica.cc:330] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.789024  4084 raft_consensus.cc:2229] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.790357  4084 raft_consensus.cc:2258] T a0e4b77eb0b847f69ab95f45c1c3ed1e P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.793465  4084 tablet_replica.cc:330] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.794255  4084 raft_consensus.cc:2229] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.794813  4084 raft_consensus.cc:2258] T f54f896522e94977a1cee9bd74ce2303 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.798206  4084 tablet_replica.cc:330] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.799191  4084 raft_consensus.cc:2229] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.799818  4084 raft_consensus.cc:2258] T 85e5e41bf96447d7a761378c54e8abff P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.800593 20922 consensus_peers.cc:487] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.803228  4084 tablet_replica.cc:330] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.804047  4084 raft_consensus.cc:2229] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.804530  4084 raft_consensus.cc:2258] T 06f6e7dcac69477a99d44c3e039f7d36 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.806918  4084 tablet_replica.cc:330] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.807591  4084 raft_consensus.cc:2229] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.808454  4084 raft_consensus.cc:2258] T 8732d4883dce4b7d97faf3669bdbb006 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.810422  4084 tablet_replica.cc:330] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.811031  4084 raft_consensus.cc:2229] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.811885  4084 raft_consensus.cc:2258] T 65767121d73547f7b17d3a05b6de8a6c P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.813918  4084 tablet_replica.cc:330] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.814450  4084 raft_consensus.cc:2229] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.815354  4084 raft_consensus.cc:2258] T adf3a538c4d74dd0a1704de4cf4d3624 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.817570  4084 tablet_replica.cc:330] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.818221  4084 raft_consensus.cc:2229] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.818621  4084 raft_consensus.cc:2258] T 1a15940eed3e4cfb8cf7127a2cb2f757 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.821451  4084 tablet_replica.cc:330] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.822062  4084 raft_consensus.cc:2229] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.822710  4084 raft_consensus.cc:2258] T ebcc2cf4057a4c8e82b0ee3dc8481257 P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.825121  4084 tablet_replica.cc:330] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.825968  4084 raft_consensus.cc:2229] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.827077  4084 raft_consensus.cc:2258] T 728993c4b9cc4b97935e507c167f6a62 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.828876 20815 consensus_peers.cc:487] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.830161  4084 tablet_replica.cc:330] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.831172  4084 raft_consensus.cc:2229] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.831838  4084 raft_consensus.cc:2258] T 1b6cd88a19cf44aeabbec6b1d8e76630 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.834820  4084 tablet_replica.cc:330] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.835700  4084 raft_consensus.cc:2229] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.836911  4084 raft_consensus.cc:2258] T 51d8a1b5f4e9425691ed304509f9d8a9 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.839949  4084 tablet_replica.cc:330] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.840796  4084 raft_consensus.cc:2229] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.841719  4084 raft_consensus.cc:2258] T e3d48eec043e47bd9fd931ffd1ffe5e2 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.845620  4084 tablet_replica.cc:330] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.846297  4084 raft_consensus.cc:2229] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.846932  4084 raft_consensus.cc:2258] T 27a1c1554b2d44ec849b89e817bd0a12 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.849383  4084 tablet_replica.cc:330] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.850147  4084 raft_consensus.cc:2229] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.850734  4084 raft_consensus.cc:2258] T 0af9baeb12a1400e8df29ae3d35377d5 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.854858 20922 consensus_peers.cc:487] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.856742  4084 tablet_replica.cc:330] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.857793  4084 raft_consensus.cc:2229] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.858353  4084 raft_consensus.cc:2258] T 57c6682d61b04b799643ea1c8b687787 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.861871  4084 tablet_replica.cc:330] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.862891  4084 raft_consensus.cc:2229] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.864197  4084 raft_consensus.cc:2258] T 3408c35d6e414cb4bb2aa3b96a742313 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.867636  4084 tablet_replica.cc:330] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.868522  4084 raft_consensus.cc:2229] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.869167  4084 raft_consensus.cc:2258] T fbb6b294d38f46c994858d9de86da083 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.869917 20815 consensus_peers.cc:487] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.872367  4084 tablet_replica.cc:330] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.873389  4084 raft_consensus.cc:2229] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.874544  4084 raft_consensus.cc:2258] T 25f274ac8f124e7697711e0afcd0b058 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.877254 20922 consensus_peers.cc:487] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.877480  4084 tablet_replica.cc:330] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036: stopping tablet replica
W20260812 19:26:49.877985 20922 consensus_peers.cc:487] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.878418  4084 raft_consensus.cc:2229] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.879137  4084 raft_consensus.cc:2258] T 6155c47e884e43498e968f83072b863a P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.881860  4084 tablet_replica.cc:330] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.882795  4084 raft_consensus.cc:2229] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.883435  4084 raft_consensus.cc:2258] T 7a74b750f92947ff863276caab71a1df P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.885983  4084 tablet_replica.cc:330] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.886559  4084 raft_consensus.cc:2229] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.887092  4084 raft_consensus.cc:2258] T 614ccc1f6aa847f5b874c88bb9e2587a P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.889036  4084 tablet_replica.cc:330] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.889510  4084 raft_consensus.cc:2229] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.889977  4084 raft_consensus.cc:2258] T e4c0067c6bd74e33b1ebe3785dabf7d1 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.892383  4084 tablet_replica.cc:330] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.892884  4084 raft_consensus.cc:2229] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.893275  4084 raft_consensus.cc:2258] T 7b35dda8c9ec45d783785ed1ebb70243 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.895320  4084 tablet_replica.cc:330] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.895821  4084 raft_consensus.cc:2229] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.896663  4084 raft_consensus.cc:2258] T a777b602ae6d4dac9f1ac116e0a2e86e P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.898702  4084 tablet_replica.cc:330] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.899235  4084 raft_consensus.cc:2229] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.900139  4084 raft_consensus.cc:2258] T e5fc45bed8304c558e1aeb9f7ef05f2c P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.902297  4084 tablet_replica.cc:330] T 2a2c90e3f1d4440da993ec52cd2658f2 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.902853  4084 raft_consensus.cc:2229] T 2a2c90e3f1d4440da993ec52cd2658f2 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.903244  4084 raft_consensus.cc:2258] T 2a2c90e3f1d4440da993ec52cd2658f2 P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.905102  4084 tablet_replica.cc:330] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.905642  4084 raft_consensus.cc:2229] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.906203  4084 raft_consensus.cc:2258] T be4515819a7e4b5fa91def511f58fc4f P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.908454  4084 tablet_replica.cc:330] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.908991  4084 raft_consensus.cc:2229] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.909468  4084 raft_consensus.cc:2258] T a91aea69f88c43cb84d67ea8a6e8d8bf P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.909825 20815 consensus_peers.cc:487] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.911739  4084 tablet_replica.cc:330] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.912397  4084 raft_consensus.cc:2229] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.913430  4084 raft_consensus.cc:2258] T b2e5c58cd31f4eb8bd9092458140299a P efc1471911ec442396b400eed9d18036 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.915728 20922 consensus_peers.cc:487] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.916095  4084 tablet_replica.cc:330] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.916708  4084 raft_consensus.cc:2229] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.917129  4084 raft_consensus.cc:2258] T ede4dcd9659d422184a3873426f9e6c4 P efc1471911ec442396b400eed9d18036 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.919363  4084 tablet_replica.cc:330] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036: stopping tablet replica
I20260812 19:26:49.919883  4084 raft_consensus.cc:2229] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.920966  4084 raft_consensus.cc:2258] T e27156bde17147a6af9ddb1f23aa3ef8 P efc1471911ec442396b400eed9d18036 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.958716 20815 consensus_peers.cc:487] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.965902 20922 consensus_peers.cc:487] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.971001 20922 consensus_peers.cc:487] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:49.992256 20922 consensus_peers.cc:487] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:50.020599  4084 tablet_server.cc:194] TabletServer@127.3.253.2:0 shutdown complete.
W20260812 19:26:50.039613 20815 consensus_peers.cc:487] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39525: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:50.066402 20922 consensus_peers.cc:487] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39525: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:50.100376  4084 tablet_server.cc:178] TabletServer@127.3.253.3:0 shutting down...
W20260812 19:26:50.117261 20815 consensus_peers.cc:487] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39525: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:50.117437 20918 consensus_peers.cc:487] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:50.117906 20815 consensus_peers.cc:487] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39525: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:50.119504 20918 consensus_peers.cc:487] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:50.157683  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:26:50.158692  4084 tablet_replica.cc:330] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.159593  4084 raft_consensus.cc:2229] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.160171  4084 raft_consensus.cc:2258] T a0e4b77eb0b847f69ab95f45c1c3ed1e P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.163468  4084 tablet_replica.cc:330] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.164314  4084 raft_consensus.cc:2229] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.164819  4084 raft_consensus.cc:2258] T 7bae9c177422418c8b9b4e0aa24fbce2 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.167383  4084 tablet_replica.cc:330] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.168326  4084 raft_consensus.cc:2229] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.169006  4084 raft_consensus.cc:2258] T 69ed708096ce463aba0483b0487227ba P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.171890  4084 tablet_replica.cc:330] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.172632  4084 raft_consensus.cc:2229] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.173185  4084 raft_consensus.cc:2258] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.176143  4084 tablet_replica.cc:330] T 13bf498c0abe436988718e4c55535f09 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.176963  4084 raft_consensus.cc:2229] T 13bf498c0abe436988718e4c55535f09 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.177448  4084 raft_consensus.cc:2258] T 13bf498c0abe436988718e4c55535f09 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.179508  4084 tablet_replica.cc:330] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.180096  4084 raft_consensus.cc:2229] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.181039  4084 raft_consensus.cc:2258] T f6acd85742e946ddb5bb17831fc226fe P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.183126  4084 tablet_replica.cc:330] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.183713  4084 raft_consensus.cc:2229] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.184211  4084 raft_consensus.cc:2258] T 3044cbc7bbaa46858021ce0b610da983 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.186326  4084 tablet_replica.cc:330] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.186985  4084 raft_consensus.cc:2229] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.187443  4084 raft_consensus.cc:2258] T db43a23e01bd4d3abc5d92db87b6e98b P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.189921  4084 tablet_replica.cc:330] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.190601  4084 raft_consensus.cc:2229] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.191591  4084 raft_consensus.cc:2258] T f906c95927b14410a6818ea15e9e089f P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.193745  4084 tablet_replica.cc:330] T 2f8d3279bf00462799704042e3cb3966 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.194392  4084 raft_consensus.cc:2229] T 2f8d3279bf00462799704042e3cb3966 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.194893  4084 raft_consensus.cc:2258] T 2f8d3279bf00462799704042e3cb3966 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.196957  4084 tablet_replica.cc:330] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.197750  4084 raft_consensus.cc:2229] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.198877  4084 raft_consensus.cc:2258] T 200fb82ae5174fb184b44b3ea6f39a59 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.201608  4084 tablet_replica.cc:330] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.202261  4084 raft_consensus.cc:2229] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.203208  4084 raft_consensus.cc:2258] T fa08d4efbda64360a2f987aab456fb04 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.205440  4084 tablet_replica.cc:330] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.206046  4084 raft_consensus.cc:2229] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.206492  4084 raft_consensus.cc:2258] T 0eb60aaf78c64f9ebfdb6f535cc96363 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.208529  4084 tablet_replica.cc:330] T 8732d4883dce4b7d97faf3669bdbb006 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.209096  4084 raft_consensus.cc:2229] T 8732d4883dce4b7d97faf3669bdbb006 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.209508  4084 raft_consensus.cc:2258] T 8732d4883dce4b7d97faf3669bdbb006 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.211670  4084 tablet_replica.cc:330] T e3d48eec043e47bd9fd931ffd1ffe5e2 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.212272  4084 raft_consensus.cc:2229] T e3d48eec043e47bd9fd931ffd1ffe5e2 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.212692  4084 raft_consensus.cc:2258] T e3d48eec043e47bd9fd931ffd1ffe5e2 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.214612  4084 tablet_replica.cc:330] T 27a1c1554b2d44ec849b89e817bd0a12 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.215314  4084 raft_consensus.cc:2229] T 27a1c1554b2d44ec849b89e817bd0a12 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.215734  4084 raft_consensus.cc:2258] T 27a1c1554b2d44ec849b89e817bd0a12 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.218428  4084 tablet_replica.cc:330] T 0af9baeb12a1400e8df29ae3d35377d5 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.219271  4084 raft_consensus.cc:2229] T 0af9baeb12a1400e8df29ae3d35377d5 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.219794  4084 raft_consensus.cc:2258] T 0af9baeb12a1400e8df29ae3d35377d5 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.222107  4084 tablet_replica.cc:330] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.222637  4084 raft_consensus.cc:2229] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.223520  4084 raft_consensus.cc:2258] T 57c6682d61b04b799643ea1c8b687787 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.225533  4084 tablet_replica.cc:330] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.226121  4084 raft_consensus.cc:2229] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.227017  4084 raft_consensus.cc:2258] T 6155c47e884e43498e968f83072b863a P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.229049  4084 tablet_replica.cc:330] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.229908  4084 raft_consensus.cc:2229] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.230324  4084 raft_consensus.cc:2258] T 435900f76e8b41cdbc9f2f3ce6c425da P 8c9e33eee61649e18fe397e56bdddea3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.232450  4084 tablet_replica.cc:330] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.232975  4084 raft_consensus.cc:2229] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.233801  4084 raft_consensus.cc:2258] T 67cee93c25424387a17659df99d3ad3d P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.236276  4084 tablet_replica.cc:330] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.237047  4084 raft_consensus.cc:2229] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.238170  4084 raft_consensus.cc:2258] T 1a15940eed3e4cfb8cf7127a2cb2f757 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:50.240047 20918 consensus_peers.cc:487] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:50.241196  4084 tablet_replica.cc:330] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.242134  4084 raft_consensus.cc:2229] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.242645  4084 raft_consensus.cc:2258] T 3a347274cb334867b07c94e32b32f3ca P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.242867 22642 raft_consensus.cc:482] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
W20260812 19:26:50.243867 20815 consensus_peers.cc:487] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 -> Peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Couldn't send request to peer efc1471911ec442396b400eed9d18036. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:39525: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:50.243789 22642 raft_consensus.cc:504] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:50.245723  4084 tablet_replica.cc:330] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.246708  4084 raft_consensus.cc:2229] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.246644 22642 leader_election.cc:288] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d5ab425bcd82426387b1a5b02e55b64c (127.3.253.4:37307), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:50.247514  4084 raft_consensus.cc:2258] T 3408c35d6e414cb4bb2aa3b96a742313 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.247503 20979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3b75fc0d53420fa10f6f1dc8c16cb1" candidate_uuid: "8c9e33eee61649e18fe397e56bdddea3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d5ab425bcd82426387b1a5b02e55b64c" is_pre_election: true
I20260812 19:26:50.250746  4084 tablet_replica.cc:330] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
W20260812 19:26:50.250862 20812 leader_election.cc:334] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:50.251434 20812 leader_election.cc:302] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, d5ab425bcd82426387b1a5b02e55b64c
I20260812 19:26:50.251678  4084 raft_consensus.cc:2229] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.252300  4084 raft_consensus.cc:2258] T 8f536e291e9f46cb8ce550ae575e643a P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.252647 22642 raft_consensus.cc:2726] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:26:50.254959  4084 tablet_replica.cc:330] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.255581  4084 raft_consensus.cc:2229] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.256428  4084 raft_consensus.cc:2258] T fbb6b294d38f46c994858d9de86da083 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.258553  4084 tablet_replica.cc:330] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.259188  4084 raft_consensus.cc:2229] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.259620  4084 raft_consensus.cc:2258] T 7a74b750f92947ff863276caab71a1df P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.261436 22642 raft_consensus.cc:482] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:50.262295  4084 tablet_replica.cc:330] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.261979 22642 raft_consensus.cc:504] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } } peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } }
I20260812 19:26:50.266115 22642 leader_election.cc:288] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
W20260812 19:26:50.269795 20812 leader_election.cc:334] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
W20260812 19:26:50.272331 20918 consensus_peers.cc:487] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:50.263250  4084 raft_consensus.cc:2229] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Raft consensus shutting down.
W20260812 19:26:50.275242 20815 leader_election.cc:334] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39525: connect: Connection refused (error 111)
I20260812 19:26:50.275677  4084 raft_consensus.cc:2258] T e4c0067c6bd74e33b1ebe3785dabf7d1 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.275741 20815 leader_election.cc:302] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9e33eee61649e18fe397e56bdddea3; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:50.277254 22594 raft_consensus.cc:2726] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:26:50.278930  4084 tablet_replica.cc:330] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.279781  4084 raft_consensus.cc:2229] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.280884  4084 raft_consensus.cc:2258] T 2a2c90e3f1d4440da993ec52cd2658f2 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.283890  4084 tablet_replica.cc:330] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.284755  4084 raft_consensus.cc:2229] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.285380  4084 raft_consensus.cc:2258] T 8caaf0d4e2ed4d039a3635696107687a P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.288175  4084 tablet_replica.cc:330] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.288898  4084 raft_consensus.cc:2229] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.289424  4084 raft_consensus.cc:2258] T e5fc45bed8304c558e1aeb9f7ef05f2c P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.292171  4084 tablet_replica.cc:330] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.292902  4084 raft_consensus.cc:2229] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.293435  4084 raft_consensus.cc:2258] T fb51472eb3314091aa30c515f1809f83 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.296173  4084 tablet_replica.cc:330] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.296653  4084 raft_consensus.cc:2229] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.297458  4084 raft_consensus.cc:2258] T ede4dcd9659d422184a3873426f9e6c4 P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.299582  4084 tablet_replica.cc:330] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.300333  4084 raft_consensus.cc:2229] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.300819  4084 raft_consensus.cc:2258] T 5cb0f8eae7934850b4db442c32298bb3 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.303471  4084 tablet_replica.cc:330] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.304064  4084 raft_consensus.cc:2229] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.304960  4084 raft_consensus.cc:2258] T 7b35dda8c9ec45d783785ed1ebb70243 P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.307504  4084 tablet_replica.cc:330] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.308070  4084 raft_consensus.cc:2229] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.308516  4084 raft_consensus.cc:2258] T 0454a10a87ed4fd7a5ef01021940c016 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.310400  4084 tablet_replica.cc:330] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.310987  4084 raft_consensus.cc:2229] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.311450  4084 raft_consensus.cc:2258] T a91aea69f88c43cb84d67ea8a6e8d8bf P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.313361  4084 tablet_replica.cc:330] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.313886  4084 raft_consensus.cc:2229] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.315030  4084 raft_consensus.cc:2258] T be4515819a7e4b5fa91def511f58fc4f P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.316984  4084 tablet_replica.cc:330] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.317509  4084 raft_consensus.cc:2229] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.317955  4084 raft_consensus.cc:2258] T 5b112d71b0be429f977ba95ac9534b6b P 8c9e33eee61649e18fe397e56bdddea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.319947  4084 tablet_replica.cc:330] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.320465  4084 raft_consensus.cc:2229] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.320907  4084 raft_consensus.cc:2258] T d6510fddf1024d71b387e8dfa568e96c P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.322926  4084 tablet_replica.cc:330] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.323591  4084 raft_consensus.cc:2229] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.324712  4084 raft_consensus.cc:2258] T e2a274b81b0d4079852b8b1ea7c7592a P 8c9e33eee61649e18fe397e56bdddea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:50.326382 20918 consensus_peers.cc:487] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:50.327353  4084 tablet_replica.cc:330] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.327942  4084 raft_consensus.cc:2229] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.328388  4084 raft_consensus.cc:2258] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.330480  4084 tablet_replica.cc:330] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.331035  4084 raft_consensus.cc:2229] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.331501  4084 raft_consensus.cc:2258] T 273e3feb623f4b0d8b3078f4a6a49ac6 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.334475  4084 tablet_replica.cc:330] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3: stopping tablet replica
I20260812 19:26:50.335067  4084 raft_consensus.cc:2229] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.335618  4084 raft_consensus.cc:2258] T e27156bde17147a6af9ddb1f23aa3ef8 P 8c9e33eee61649e18fe397e56bdddea3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.335570 22647 raft_consensus.cc:482] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:50.336370 22647 raft_consensus.cc:504] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:50.338512 22647 leader_election.cc:288] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:50.350399 22621 raft_consensus.cc:482] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:50.351107 22621 raft_consensus.cc:504] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:50.353479 22621 leader_election.cc:288] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
W20260812 19:26:50.354305 20922 leader_election.cc:334] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39525: connect: Connection refused (error 111)
W20260812 19:26:50.356003 20918 leader_election.cc:334] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:50.356532 20918 leader_election.cc:302] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:50.357471 22650 raft_consensus.cc:2726] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 19:26:50.359122 20918 consensus_peers.cc:487] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:50.361665 20922 leader_election.cc:334] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39525: connect: Connection refused (error 111)
W20260812 19:26:50.363667 20918 leader_election.cc:334] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:50.364090 20918 leader_election.cc:302] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:50.364849 22650 raft_consensus.cc:2726] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 19:26:50.365324 20918 consensus_peers.cc:487] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:50.388628 20918 consensus_peers.cc:487] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:50.421593  4084 tablet_server.cc:194] TabletServer@127.3.253.3:0 shutdown complete.
I20260812 19:26:50.458076 22650 raft_consensus.cc:482] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:50.458931 22650 raft_consensus.cc:504] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:50.461457 22650 leader_election.cc:288] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
W20260812 19:26:50.465579 20918 leader_election.cc:334] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Network error: Client connection negotiation failed: client connection to 127.3.253.3:38049: connect: Connection refused (error 111)
W20260812 19:26:50.466369 20918 leader_election.cc:334] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:50.466735 20918 leader_election.cc:302] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:50.467378 22650 raft_consensus.cc:2726] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 19:26:50.470976 20918 consensus_peers.cc:487] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.3:38049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:50.494732  4084 tablet_server.cc:178] TabletServer@127.3.253.4:0 shutting down...
I20260812 19:26:50.566572  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:26:50.567642  4084 tablet_replica.cc:330] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.568715  4084 raft_consensus.cc:2229] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.569988  4084 raft_consensus.cc:2258] T 7bae9c177422418c8b9b4e0aa24fbce2 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.572496  4084 tablet_replica.cc:330] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.573149  4084 raft_consensus.cc:2229] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.573663  4084 raft_consensus.cc:2258] T 273e3feb623f4b0d8b3078f4a6a49ac6 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.576053  4084 tablet_replica.cc:330] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.576668  4084 raft_consensus.cc:2229] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.577553  4084 raft_consensus.cc:2258] T 8caaf0d4e2ed4d039a3635696107687a P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.580183  4084 tablet_replica.cc:330] T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.580996  4084 raft_consensus.cc:2229] T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.581513  4084 raft_consensus.cc:2258] T a777b602ae6d4dac9f1ac116e0a2e86e P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.581785 22650 raft_consensus.cc:482] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:50.582458 22650 raft_consensus.cc:504] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:50.584583 22650 leader_election.cc:288] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:50.584646  4084 tablet_replica.cc:330] T f6acd85742e946ddb5bb17831fc226fe P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.585744  4084 raft_consensus.cc:2229] T f6acd85742e946ddb5bb17831fc226fe P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.586354  4084 raft_consensus.cc:2258] T f6acd85742e946ddb5bb17831fc226fe P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.589099  4084 tablet_replica.cc:330] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.589708  4084 raft_consensus.cc:2229] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Raft consensus shutting down.
W20260812 19:26:50.589892 20918 leader_election.cc:334] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Network error: Client connection negotiation failed: client connection to 127.3.253.3:38049: connect: Connection refused (error 111)
W20260812 19:26:50.590539 20918 leader_election.cc:334] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:50.590754  4084 raft_consensus.cc:2258] T e37466bb31e941bfaea862a42aafe4a2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.590910 20918 leader_election.cc:302] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:50.591826 22650 raft_consensus.cc:2726] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:26:50.593498  4084 tablet_replica.cc:330] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.594208  4084 raft_consensus.cc:2229] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.595167  4084 raft_consensus.cc:2258] T e57439ca2e634277b5b83494eddd4acb P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.597234  4084 tablet_replica.cc:330] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.598079  4084 raft_consensus.cc:2229] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.598702  4084 raft_consensus.cc:2258] T b8bf3b3e0e4c425e9d86c3e5b7a062cf P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.601419  4084 tablet_replica.cc:330] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
W20260812 19:26:50.602276 20918 consensus_peers.cc:487] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c -> Peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Couldn't send request to peer 8c9e33eee61649e18fe397e56bdddea3. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.3:38049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:50.602303  4084 raft_consensus.cc:2229] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.603507  4084 raft_consensus.cc:2258] T 13bf498c0abe436988718e4c55535f09 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.605708  4084 tablet_replica.cc:330] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.606421  4084 raft_consensus.cc:2229] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.606870  4084 raft_consensus.cc:2258] T f906c95927b14410a6818ea15e9e089f P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.608757  4084 tablet_replica.cc:330] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.609346  4084 raft_consensus.cc:2229] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.609766  4084 raft_consensus.cc:2258] T db43a23e01bd4d3abc5d92db87b6e98b P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.611804  4084 tablet_replica.cc:330] T 2f8d3279bf00462799704042e3cb3966 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.612406  4084 raft_consensus.cc:2229] T 2f8d3279bf00462799704042e3cb3966 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.612813  4084 raft_consensus.cc:2258] T 2f8d3279bf00462799704042e3cb3966 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.614952  4084 tablet_replica.cc:330] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.615525  4084 raft_consensus.cc:2229] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.615943  4084 raft_consensus.cc:2258] T 200fb82ae5174fb184b44b3ea6f39a59 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.617856  4084 tablet_replica.cc:330] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.618427  4084 raft_consensus.cc:2229] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.619246  4084 raft_consensus.cc:2258] T 0eb60aaf78c64f9ebfdb6f535cc96363 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.621248  4084 tablet_replica.cc:330] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.621835  4084 raft_consensus.cc:2229] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.622632  4084 raft_consensus.cc:2258] T f54f896522e94977a1cee9bd74ce2303 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.624601  4084 tablet_replica.cc:330] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.625180  4084 raft_consensus.cc:2229] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.625964  4084 raft_consensus.cc:2258] T 85e5e41bf96447d7a761378c54e8abff P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.627918  4084 tablet_replica.cc:330] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.628480  4084 raft_consensus.cc:2229] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.629245  4084 raft_consensus.cc:2258] T 06f6e7dcac69477a99d44c3e039f7d36 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.631237  4084 tablet_replica.cc:330] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.631791  4084 raft_consensus.cc:2229] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.632221  4084 raft_consensus.cc:2258] T 25f274ac8f124e7697711e0afcd0b058 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.633628 22650 raft_consensus.cc:482] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:50.634109 22650 raft_consensus.cc:504] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:50.634527  4084 tablet_replica.cc:330] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.635434  4084 raft_consensus.cc:2229] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.636255 22650 leader_election.cc:288] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:50.636484  4084 raft_consensus.cc:2258] T 0af9baeb12a1400e8df29ae3d35377d5 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.639058  4084 tablet_replica.cc:330] T 57c6682d61b04b799643ea1c8b687787 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.639842  4084 raft_consensus.cc:2229] T 57c6682d61b04b799643ea1c8b687787 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260812 19:26:50.640066 20918 leader_election.cc:334] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Network error: Client connection negotiation failed: client connection to 127.3.253.3:38049: connect: Connection refused (error 111)
I20260812 19:26:50.640311  4084 raft_consensus.cc:2258] T 57c6682d61b04b799643ea1c8b687787 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:50.640777 20918 leader_election.cc:334] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:50.641083 20918 leader_election.cc:302] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:50.641706 22650 raft_consensus.cc:2726] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:26:50.642907  4084 tablet_replica.cc:330] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.643501  4084 raft_consensus.cc:2229] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.643872  4084 raft_consensus.cc:2258] T 51d8a1b5f4e9425691ed304509f9d8a9 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.645756  4084 tablet_replica.cc:330] T e3d48eec043e47bd9fd931ffd1ffe5e2 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.646338  4084 raft_consensus.cc:2229] T e3d48eec043e47bd9fd931ffd1ffe5e2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.646800  4084 raft_consensus.cc:2258] T e3d48eec043e47bd9fd931ffd1ffe5e2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.648912  4084 tablet_replica.cc:330] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.649670  4084 raft_consensus.cc:2229] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.650701  4084 raft_consensus.cc:2258] T 27a1c1554b2d44ec849b89e817bd0a12 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.652952  4084 tablet_replica.cc:330] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.653450  4084 raft_consensus.cc:2229] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.653816  4084 raft_consensus.cc:2258] T 1b6cd88a19cf44aeabbec6b1d8e76630 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.655673  4084 tablet_replica.cc:330] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.656174  4084 raft_consensus.cc:2229] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.656622  4084 raft_consensus.cc:2258] T 8f536e291e9f46cb8ce550ae575e643a P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.657780 22650 raft_consensus.cc:482] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:50.658239 22650 raft_consensus.cc:504] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } } peers { permanent_uuid: "efc1471911ec442396b400eed9d18036" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 39525 } }
I20260812 19:26:50.658635  4084 tablet_replica.cc:330] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.659409  4084 raft_consensus.cc:2229] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.659916  4084 raft_consensus.cc:2258] T fbb6b294d38f46c994858d9de86da083 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.660208 22650 leader_election.cc:288] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811), efc1471911ec442396b400eed9d18036 (127.3.253.2:39525)
I20260812 19:26:50.662629  4084 tablet_replica.cc:330] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.663331  4084 raft_consensus.cc:2229] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Raft consensus shutting down.
W20260812 19:26:50.663430 20918 leader_election.cc:334] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:50.663810  4084 raft_consensus.cc:2258] T 0454a10a87ed4fd7a5ef01021940c016 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:50.664808 20922 leader_election.cc:334] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer efc1471911ec442396b400eed9d18036 (127.3.253.2:39525): Network error: Client connection negotiation failed: client connection to 127.3.253.2:39525: connect: Connection refused (error 111)
I20260812 19:26:50.665189 20922 leader_election.cc:302] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, efc1471911ec442396b400eed9d18036
I20260812 19:26:50.665838 22650 raft_consensus.cc:2726] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:26:50.666610  4084 tablet_replica.cc:330] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.667308  4084 raft_consensus.cc:2229] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.667800  4084 raft_consensus.cc:2258] T ebcc2cf4057a4c8e82b0ee3dc8481257 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.669762  4084 tablet_replica.cc:330] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.670357  4084 raft_consensus.cc:2229] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.671248  4084 raft_consensus.cc:2258] T 69ed708096ce463aba0483b0487227ba P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.673290  4084 tablet_replica.cc:330] T 728993c4b9cc4b97935e507c167f6a62 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.673843  4084 raft_consensus.cc:2229] T 728993c4b9cc4b97935e507c167f6a62 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.674254  4084 raft_consensus.cc:2258] T 728993c4b9cc4b97935e507c167f6a62 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.676146  4084 tablet_replica.cc:330] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.676671  4084 raft_consensus.cc:2229] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.677101  4084 raft_consensus.cc:2258] T 67cee93c25424387a17659df99d3ad3d P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.679044  4084 tablet_replica.cc:330] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.679608  4084 raft_consensus.cc:2229] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.680022  4084 raft_consensus.cc:2258] T 65767121d73547f7b17d3a05b6de8a6c P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.681964  4084 tablet_replica.cc:330] T adf3a538c4d74dd0a1704de4cf4d3624 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.682487  4084 raft_consensus.cc:2229] T adf3a538c4d74dd0a1704de4cf4d3624 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.682924  4084 raft_consensus.cc:2258] T adf3a538c4d74dd0a1704de4cf4d3624 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.684782  4084 tablet_replica.cc:330] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.685333  4084 raft_consensus.cc:2229] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.685741  4084 raft_consensus.cc:2258] T 3a347274cb334867b07c94e32b32f3ca P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.687863  4084 tablet_replica.cc:330] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.688405  4084 raft_consensus.cc:2229] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.688655 22650 raft_consensus.cc:482] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:50.689368  4084 raft_consensus.cc:2258] T fb51472eb3314091aa30c515f1809f83 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.689215 22650 raft_consensus.cc:504] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:50.691380 22650 leader_election.cc:288] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:50.691975  4084 tablet_replica.cc:330] T 2a2c90e3f1d4440da993ec52cd2658f2 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.692752  4084 raft_consensus.cc:2229] T 2a2c90e3f1d4440da993ec52cd2658f2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.693291  4084 raft_consensus.cc:2258] T 2a2c90e3f1d4440da993ec52cd2658f2 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:50.694744 20918 leader_election.cc:334] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Network error: Client connection negotiation failed: client connection to 127.3.253.3:38049: connect: Connection refused (error 111)
W20260812 19:26:50.695322 20918 leader_election.cc:334] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:50.695618 20918 leader_election.cc:302] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:50.695847  4084 tablet_replica.cc:330] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.696229 22650 raft_consensus.cc:2726] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:26:50.697127  4084 raft_consensus.cc:2229] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.697650  4084 raft_consensus.cc:2258] T b2e5c58cd31f4eb8bd9092458140299a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.699844  4084 tablet_replica.cc:330] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.700169 22650 raft_consensus.cc:482] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 171f67787a8348fb9c7b19bf09026039)
I20260812 19:26:50.700394  4084 raft_consensus.cc:2229] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.700947  4084 raft_consensus.cc:2258] T ede4dcd9659d422184a3873426f9e6c4 P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.700625 22650 raft_consensus.cc:504] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9e33eee61649e18fe397e56bdddea3" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38049 } } peers { permanent_uuid: "d5ab425bcd82426387b1a5b02e55b64c" member_type: VOTER last_known_addr { host: "127.3.253.4" port: 37307 } } peers { permanent_uuid: "171f67787a8348fb9c7b19bf09026039" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 33811 } }
I20260812 19:26:50.702642 22650 leader_election.cc:288] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049), 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811)
I20260812 19:26:50.703617  4084 tablet_replica.cc:330] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.704456  4084 raft_consensus.cc:2229] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.705510  4084 raft_consensus.cc:2258] T 5cb0f8eae7934850b4db442c32298bb3 P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:50.706456 20918 leader_election.cc:334] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8c9e33eee61649e18fe397e56bdddea3 (127.3.253.3:38049): Network error: Client connection negotiation failed: client connection to 127.3.253.3:38049: connect: Connection refused (error 111)
W20260812 19:26:50.707177 20918 leader_election.cc:334] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 171f67787a8348fb9c7b19bf09026039 (127.3.253.1:33811): Network error: Client connection negotiation failed: client connection to 127.3.253.1:33811: connect: Connection refused (error 111)
I20260812 19:26:50.707544 20918 leader_election.cc:302] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5ab425bcd82426387b1a5b02e55b64c; no voters: 171f67787a8348fb9c7b19bf09026039, 8c9e33eee61649e18fe397e56bdddea3
I20260812 19:26:50.708263 22650 raft_consensus.cc:2726] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:26:50.708313  4084 tablet_replica.cc:330] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.709059  4084 raft_consensus.cc:2229] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.709573  4084 raft_consensus.cc:2258] T 614ccc1f6aa847f5b874c88bb9e2587a P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.712263  4084 tablet_replica.cc:330] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.713020  4084 raft_consensus.cc:2229] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.713846  4084 raft_consensus.cc:2258] T 7a74b750f92947ff863276caab71a1df P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.715883  4084 tablet_replica.cc:330] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.716408  4084 raft_consensus.cc:2229] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.716828  4084 raft_consensus.cc:2258] T 5b112d71b0be429f977ba95ac9534b6b P d5ab425bcd82426387b1a5b02e55b64c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.718641  4084 tablet_replica.cc:330] T e2a274b81b0d4079852b8b1ea7c7592a P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.719153  4084 raft_consensus.cc:2229] T e2a274b81b0d4079852b8b1ea7c7592a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.719604  4084 raft_consensus.cc:2258] T e2a274b81b0d4079852b8b1ea7c7592a P d5ab425bcd82426387b1a5b02e55b64c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.721405  4084 tablet_replica.cc:330] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c: stopping tablet replica
I20260812 19:26:50.721839  4084 raft_consensus.cc:2229] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.722299  4084 raft_consensus.cc:2258] T 1b3b75fc0d53420fa10f6f1dc8c16cb1 P d5ab425bcd82426387b1a5b02e55b64c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.795910  4084 tablet_server.cc:194] TabletServer@127.3.253.4:0 shutdown complete.
I20260812 19:26:50.863425  4084 master.cc:537] Master@127.3.253.62:36913 shutting down...
I20260812 19:26:50.892664  4084 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.893332  4084 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.893658  4084 tablet_replica.cc:330] T 00000000000000000000000000000000 P f9d8c25eedc54b9382055c46c7a1310a: stopping tablet replica
I20260812 19:26:50.917079  4084 master.cc:552] Master@127.3.253.62:36913 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (34357 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:471: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
[  SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode (7 ms)
[----------] 5 tests from LeaderRebalancerTest (378131 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260812 19:26:51.021160  4084 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.253.62:46515
I20260812 19:26:51.022475  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:26:51.029193 22663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:51.029357 22664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:51.030185 22669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:51.031334  4084 server_base.cc:1034] running on GCE node
I20260812 19:26:51.032636  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:26:51.032850  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:26:51.033033  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562811033017 us; error 0 us; skew 500 ppm
I20260812 19:26:51.033610  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:51.039618  4084 webserver.cc:460] Webserver started at http://127.3.253.62:33551/ using document root <none> and password file <none>
I20260812 19:26:51.040169  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:51.040373  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:26:51.040696  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:26:51.042023  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/master-0-root/instance:
uuid: "459fc665cea447b3a941333f6ebcafa1"
format_stamp: "Formatted at 2026-08-12 19:26:51 on dist-test-slave-3kk6"
I20260812 19:26:51.046914  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260812 19:26:51.050366 22679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:51.051227  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 19:26:51.051587  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/master-0-root
uuid: "459fc665cea447b3a941333f6ebcafa1"
format_stamp: "Formatted at 2026-08-12 19:26:51 on dist-test-slave-3kk6"
I20260812 19:26:51.052042  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:26:51.081081  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:26:51.082455  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:26:51.124962  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.62:46515
I20260812 19:26:51.125138 22770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.62:46515 every 8 connection(s)
I20260812 19:26:51.129412 22771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.142563 22771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1: Bootstrap starting.
I20260812 19:26:51.148192 22771 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:51.152868 22771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1: No bootstrap required, opened a new log
I20260812 19:26:51.155336 22771 raft_consensus.cc:348] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459fc665cea447b3a941333f6ebcafa1" member_type: VOTER }
I20260812 19:26:51.155776 22771 raft_consensus.cc:374] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:51.155963 22771 raft_consensus.cc:729] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459fc665cea447b3a941333f6ebcafa1, State: Initialized, Role: FOLLOWER
I20260812 19:26:51.156495 22771 consensus_queue.cc:260] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459fc665cea447b3a941333f6ebcafa1" member_type: VOTER }
I20260812 19:26:51.156956 22771 raft_consensus.cc:388] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 19:26:51.157197 22771 raft_consensus.cc:482] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 19:26:51.157429 22771 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:51.163002 22771 raft_consensus.cc:504] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459fc665cea447b3a941333f6ebcafa1" member_type: VOTER }
I20260812 19:26:51.163527 22771 leader_election.cc:302] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 459fc665cea447b3a941333f6ebcafa1; no voters: 
I20260812 19:26:51.164726 22771 leader_election.cc:288] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 19:26:51.165254 22775 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:51.166875 22775 raft_consensus.cc:686] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [term 1 LEADER]: Becoming Leader. State: Replica: 459fc665cea447b3a941333f6ebcafa1, State: Running, Role: LEADER
I20260812 19:26:51.167625 22775 consensus_queue.cc:237] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459fc665cea447b3a941333f6ebcafa1" member_type: VOTER }
I20260812 19:26:51.167959 22771 sys_catalog.cc:564] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 19:26:51.172528 22777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 459fc665cea447b3a941333f6ebcafa1. Latest consensus state: current_term: 1 leader_uuid: "459fc665cea447b3a941333f6ebcafa1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459fc665cea447b3a941333f6ebcafa1" member_type: VOTER } }
I20260812 19:26:51.173460 22777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [sys.catalog]: This master's current role is: LEADER
I20260812 19:26:51.172528 22776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "459fc665cea447b3a941333f6ebcafa1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459fc665cea447b3a941333f6ebcafa1" member_type: VOTER } }
I20260812 19:26:51.174288 22776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [sys.catalog]: This master's current role is: LEADER
I20260812 19:26:51.177716 22785 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 19:26:51.183195 22785 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 19:26:51.187281  4084 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 19:26:51.192970 22785 catalog_manager.cc:1347] Generated new cluster ID: ff465c4217f645b1be75581f6bcb424e
I20260812 19:26:51.193302 22785 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:26:51.210623 22785 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 19:26:51.212551 22785 catalog_manager.cc:1504] Loading token signing keys...
I20260812 19:26:51.231362 22785 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1: Generated new TSK 0
I20260812 19:26:51.232127 22785 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:26:51.255246  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:26:51.261904 22807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:51.263384 22809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:51.265136 22811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:51.267156  4084 server_base.cc:1034] running on GCE node
I20260812 19:26:51.273619  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:26:51.273908  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:26:51.274092  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562811274077 us; error 0 us; skew 500 ppm
I20260812 19:26:51.274734  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:51.277424  4084 webserver.cc:460] Webserver started at http://127.3.253.1:40619/ using document root <none> and password file <none>
I20260812 19:26:51.277935  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:51.278152  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:26:51.278424  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:26:51.279832  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/ts-0-root/instance:
uuid: "271fa24c603a441fa865c54511adbdc3"
format_stamp: "Formatted at 2026-08-12 19:26:51 on dist-test-slave-3kk6"
I20260812 19:26:51.284715  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260812 19:26:51.288426 22818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:51.289405  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 19:26:51.289801  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/ts-0-root
uuid: "271fa24c603a441fa865c54511adbdc3"
format_stamp: "Formatted at 2026-08-12 19:26:51 on dist-test-slave-3kk6"
I20260812 19:26:51.290084  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:26:51.335696  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:26:51.337335  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:26:51.339035  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:26:51.341782  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:26:51.342015  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:51.342305  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:26:51.342516  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:51.390404  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.1:44945
I20260812 19:26:51.390538 22928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.1:44945 every 8 connection(s)
I20260812 19:26:51.396375  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:26:51.404795 22936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:51.407238 22937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:51.408473 22941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:51.409510  4084 server_base.cc:1034] running on GCE node
I20260812 19:26:51.411147  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:26:51.411432  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:26:51.411651  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562811411633 us; error 0 us; skew 500 ppm
I20260812 19:26:51.412387  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:51.414211 22929 heartbeater.cc:347] Connected to a master server at 127.3.253.62:46515
I20260812 19:26:51.414692 22929 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:51.415359  4084 webserver.cc:460] Webserver started at http://127.3.253.2:33595/ using document root <none> and password file <none>
I20260812 19:26:51.415594 22929 heartbeater.cc:511] Master 127.3.253.62:46515 requested a full tablet report, sending...
I20260812 19:26:51.415930  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:51.416216  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:26:51.416500  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:26:51.417768 22711 ts_manager.cc:194] Registered new tserver with Master: 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945)
I20260812 19:26:51.417886  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/ts-1-root/instance:
uuid: "71c459a9ab8f405283add8f5c2e1f17f"
format_stamp: "Formatted at 2026-08-12 19:26:51 on dist-test-slave-3kk6"
I20260812 19:26:51.420578 22711 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40426
I20260812 19:26:51.423696  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260812 19:26:51.427240 22954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:51.428009  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260812 19:26:51.428303  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/ts-1-root
uuid: "71c459a9ab8f405283add8f5c2e1f17f"
format_stamp: "Formatted at 2026-08-12 19:26:51 on dist-test-slave-3kk6"
I20260812 19:26:51.428586  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:26:51.441856  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:26:51.443238  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:26:51.444747  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:26:51.447073  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:26:51.447299  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:51.447546  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:26:51.447708  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:51.493062  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.2:33857
I20260812 19:26:51.493182 23067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.2:33857 every 8 connection(s)
I20260812 19:26:51.498266  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:26:51.505982 23074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:51.508386 23075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:51.510063 23078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:51.511863  4084 server_base.cc:1034] running on GCE node
I20260812 19:26:51.513211  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:26:51.513407  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:26:51.513629  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562811513613 us; error 0 us; skew 500 ppm
I20260812 19:26:51.514277  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:51.514339 23069 heartbeater.cc:347] Connected to a master server at 127.3.253.62:46515
I20260812 19:26:51.514842 23069 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:51.515702 23069 heartbeater.cc:511] Master 127.3.253.62:46515 requested a full tablet report, sending...
I20260812 19:26:51.517122  4084 webserver.cc:460] Webserver started at http://127.3.253.3:41397/ using document root <none> and password file <none>
I20260812 19:26:51.517794  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:51.518033  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:26:51.518038 22711 ts_manager.cc:194] Registered new tserver with Master: 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:51.518474  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:26:51.520165  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/ts-2-root/instance:
uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
format_stamp: "Formatted at 2026-08-12 19:26:51 on dist-test-slave-3kk6"
I20260812 19:26:51.520539 22711 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40442
I20260812 19:26:51.525436  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260812 19:26:51.529238 23086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:51.530200  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 19:26:51.530588  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/ts-2-root
uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
format_stamp: "Formatted at 2026-08-12 19:26:51 on dist-test-slave-3kk6"
I20260812 19:26:51.531093  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786562432658360-4084-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:26:51.555169  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:26:51.556509  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:26:51.557895  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:26:51.560237  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:26:51.560464  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:51.560702  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:26:51.560894  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:26:51.605362  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.3:38205
I20260812 19:26:51.605499 23201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.3:38205 every 8 connection(s)
I20260812 19:26:51.621697 23202 heartbeater.cc:347] Connected to a master server at 127.3.253.62:46515
I20260812 19:26:51.622118 23202 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:51.622946 23202 heartbeater.cc:511] Master 127.3.253.62:46515 requested a full tablet report, sending...
I20260812 19:26:51.624922 22711 ts_manager.cc:194] Registered new tserver with Master: d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:51.625909  4084 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017100388s
I20260812 19:26:51.626710 22711 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40452
I20260812 19:26:51.628494  4084 test_util.cc:268] Using random seed: -1849586758
I20260812 19:26:51.655606 22711 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40460:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 19:26:51.658572 22711 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:51.751349 22864 tablet_service.cc:1467] Processing CreateTablet for tablet 99ce053aa9074a4db2d554efe9d02f64 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260812 19:26:51.751875 22863 tablet_service.cc:1467] Processing CreateTablet for tablet 831b499ce47b4c518e0fc5e9c5a7c77f (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260812 19:26:51.753021 22864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99ce053aa9074a4db2d554efe9d02f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.753738 22857 tablet_service.cc:1467] Processing CreateTablet for tablet 65e13bc2fc304b11b8a9ebc589db2e96 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260812 19:26:51.754230 22859 tablet_service.cc:1467] Processing CreateTablet for tablet 8316bd251de448b78b562f94941532c9 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260812 19:26:51.755195 22857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65e13bc2fc304b11b8a9ebc589db2e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.756548 22858 tablet_service.cc:1467] Processing CreateTablet for tablet 411ac8056d5645a5801868c0940bc406 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260812 19:26:51.757899 22858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 411ac8056d5645a5801868c0940bc406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.759438 22859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8316bd251de448b78b562f94941532c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.759727 22856 tablet_service.cc:1467] Processing CreateTablet for tablet 954401c5c5994738a6b10c07868f0dd4 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260812 19:26:51.761121 22856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 954401c5c5994738a6b10c07868f0dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.763139 22863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 831b499ce47b4c518e0fc5e9c5a7c77f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.764629 23006 tablet_service.cc:1467] Processing CreateTablet for tablet 99ce053aa9074a4db2d554efe9d02f64 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260812 19:26:51.765187 22854 tablet_service.cc:1467] Processing CreateTablet for tablet 419c163281434479a70870e9b1a61faa (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260812 19:26:51.766031 23006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99ce053aa9074a4db2d554efe9d02f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.766571 22854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 419c163281434479a70870e9b1a61faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.767895 22852 tablet_service.cc:1467] Processing CreateTablet for tablet 20d9fce7ef4748cfbcce47addf7c709c (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260812 19:26:51.769270 22852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20d9fce7ef4748cfbcce47addf7c709c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.771818 22851 tablet_service.cc:1467] Processing CreateTablet for tablet e7342bbe3c864a43a9d7cdf0fa091324 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260812 19:26:51.773262 22851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7342bbe3c864a43a9d7cdf0fa091324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.795954 23231 tablet_bootstrap.cc:492] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:51.799901 23135 tablet_service.cc:1467] Processing CreateTablet for tablet 8316bd251de448b78b562f94941532c9 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260812 19:26:51.801517 23135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8316bd251de448b78b562f94941532c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.801805 23138 tablet_service.cc:1467] Processing CreateTablet for tablet 831b499ce47b4c518e0fc5e9c5a7c77f (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260812 19:26:51.800014 23141 tablet_service.cc:1467] Processing CreateTablet for tablet 99ce053aa9074a4db2d554efe9d02f64 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260812 19:26:51.806766 23141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99ce053aa9074a4db2d554efe9d02f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.808579 23005 tablet_service.cc:1467] Processing CreateTablet for tablet 831b499ce47b4c518e0fc5e9c5a7c77f (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260812 19:26:51.809974 23001 tablet_service.cc:1467] Processing CreateTablet for tablet 411ac8056d5645a5801868c0940bc406 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260812 19:26:51.810089 23005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 831b499ce47b4c518e0fc5e9c5a7c77f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.823581 23001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 411ac8056d5645a5801868c0940bc406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.823721 23231 tablet_bootstrap.cc:654] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:51.811463 23003 tablet_service.cc:1467] Processing CreateTablet for tablet 8316bd251de448b78b562f94941532c9 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260812 19:26:51.825500 23003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8316bd251de448b78b562f94941532c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.813277 22999 tablet_service.cc:1467] Processing CreateTablet for tablet 65e13bc2fc304b11b8a9ebc589db2e96 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260812 19:26:51.828217 22999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65e13bc2fc304b11b8a9ebc589db2e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.830888 23236 tablet_bootstrap.cc:492] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
I20260812 19:26:51.814136 23134 tablet_service.cc:1467] Processing CreateTablet for tablet 411ac8056d5645a5801868c0940bc406 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260812 19:26:51.815348 22998 tablet_service.cc:1467] Processing CreateTablet for tablet 954401c5c5994738a6b10c07868f0dd4 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260812 19:26:51.815347 23133 tablet_service.cc:1467] Processing CreateTablet for tablet 65e13bc2fc304b11b8a9ebc589db2e96 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260812 19:26:51.816530 23131 tablet_service.cc:1467] Processing CreateTablet for tablet 954401c5c5994738a6b10c07868f0dd4 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260812 19:26:51.817440 22993 tablet_service.cc:1467] Processing CreateTablet for tablet 419c163281434479a70870e9b1a61faa (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260812 19:26:51.817708 23129 tablet_service.cc:1467] Processing CreateTablet for tablet 419c163281434479a70870e9b1a61faa (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260812 19:26:51.848029 22998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 954401c5c5994738a6b10c07868f0dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.818470 23138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 831b499ce47b4c518e0fc5e9c5a7c77f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.819478 22991 tablet_service.cc:1467] Processing CreateTablet for tablet 20d9fce7ef4748cfbcce47addf7c709c (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260812 19:26:51.820755 23127 tablet_service.cc:1467] Processing CreateTablet for tablet 20d9fce7ef4748cfbcce47addf7c709c (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260812 19:26:51.854111 23127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20d9fce7ef4748cfbcce47addf7c709c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.821478 22988 tablet_service.cc:1467] Processing CreateTablet for tablet e7342bbe3c864a43a9d7cdf0fa091324 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260812 19:26:51.822570 23126 tablet_service.cc:1467] Processing CreateTablet for tablet e7342bbe3c864a43a9d7cdf0fa091324 (DEFAULT_TABLE table=test-workload [id=43bbef594558485992a517b9aec6ecc4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260812 19:26:51.857954 23126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7342bbe3c864a43a9d7cdf0fa091324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.859443 23129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 419c163281434479a70870e9b1a61faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.861073 23131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 954401c5c5994738a6b10c07868f0dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.862618 23134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 411ac8056d5645a5801868c0940bc406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.864143 23133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65e13bc2fc304b11b8a9ebc589db2e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.881369 23231 tablet_bootstrap.cc:492] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:51.882016 23231 ts_tablet_manager.cc:1397] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.086s	user 0.017s	sys 0.031s
I20260812 19:26:51.885167 23231 raft_consensus.cc:348] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:51.885943 23231 raft_consensus.cc:374] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:51.886241 23231 raft_consensus.cc:729] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:51.887147 23231 consensus_queue.cc:260] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:51.917987 22929 heartbeater.cc:503] Master 127.3.253.62:46515 was elected leader, sending a full tablet report...
I20260812 19:26:51.918457 23231 ts_tablet_manager.cc:1428] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.029s
I20260812 19:26:51.919700 23231 tablet_bootstrap.cc:492] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:51.926584 23231 tablet_bootstrap.cc:654] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:51.936110 22993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 419c163281434479a70870e9b1a61faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.970468 23236 tablet_bootstrap.cc:654] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:51.973384 22991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20d9fce7ef4748cfbcce47addf7c709c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:52.003108 22988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7342bbe3c864a43a9d7cdf0fa091324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:52.004539 23234 tablet_bootstrap.cc:492] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:52.029508 23231 tablet_bootstrap.cc:492] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:52.030082 23231 ts_tablet_manager.cc:1397] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.111s	user 0.033s	sys 0.046s
I20260812 19:26:52.030499 23236 tablet_bootstrap.cc:492] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:52.031148 23236 ts_tablet_manager.cc:1397] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.201s	user 0.018s	sys 0.013s
I20260812 19:26:52.033303 23231 raft_consensus.cc:348] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.034142 23231 raft_consensus.cc:374] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.034565 23231 raft_consensus.cc:729] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.034039 23236 raft_consensus.cc:348] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.035027 23236 raft_consensus.cc:374] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.035331 23236 raft_consensus.cc:729] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.036158 23236 consensus_queue.cc:260] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.035348 23231 consensus_queue.cc:260] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.041890 23234 tablet_bootstrap.cc:654] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.043426 23231 ts_tablet_manager.cc:1428] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260812 19:26:52.044878 23231 tablet_bootstrap.cc:492] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:52.046543 23236 ts_tablet_manager.cc:1428] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.008s
I20260812 19:26:52.046820 23202 heartbeater.cc:503] Master 127.3.253.62:46515 was elected leader, sending a full tablet report...
I20260812 19:26:52.047649 23236 tablet_bootstrap.cc:492] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
I20260812 19:26:52.051561 23231 tablet_bootstrap.cc:654] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.054387 23236 tablet_bootstrap.cc:654] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.063889 23231 tablet_bootstrap.cc:492] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:52.064479 23231 ts_tablet_manager.cc:1397] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260812 19:26:52.065346 23236 tablet_bootstrap.cc:492] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:52.065896 23236 ts_tablet_manager.cc:1397] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260812 19:26:52.067449 23231 raft_consensus.cc:348] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.068379 23231 raft_consensus.cc:374] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.068679 23231 raft_consensus.cc:729] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.068727 23236 raft_consensus.cc:348] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.069809 23236 raft_consensus.cc:374] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.070106 23236 raft_consensus.cc:729] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.069651 23231 consensus_queue.cc:260] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.070955 23236 consensus_queue.cc:260] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.072155 23231 ts_tablet_manager.cc:1428] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.008s
I20260812 19:26:52.073350 23231 tablet_bootstrap.cc:492] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:52.073520 23236 ts_tablet_manager.cc:1428] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260812 19:26:52.074489 23236 tablet_bootstrap.cc:492] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
I20260812 19:26:52.079879 23231 tablet_bootstrap.cc:654] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.083223 23236 tablet_bootstrap.cc:654] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.088343 23234 tablet_bootstrap.cc:492] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:52.088582 23231 tablet_bootstrap.cc:492] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:52.088845 23234 ts_tablet_manager.cc:1397] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.035s
I20260812 19:26:52.089190 23231 ts_tablet_manager.cc:1397] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.005s
I20260812 19:26:52.092063 23234 raft_consensus.cc:348] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.092923 23234 raft_consensus.cc:374] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.093216 23234 raft_consensus.cc:729] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.093971 23234 consensus_queue.cc:260] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.094220 23231 raft_consensus.cc:348] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.095208 23231 raft_consensus.cc:374] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.095547 23231 raft_consensus.cc:729] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.096385 23231 consensus_queue.cc:260] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.099267 23231 ts_tablet_manager.cc:1428] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260812 19:26:52.101215 23231 tablet_bootstrap.cc:492] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:52.107712 23231 tablet_bootstrap.cc:654] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.108284 23236 tablet_bootstrap.cc:492] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:52.108893 23236 ts_tablet_manager.cc:1397] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.011s
W20260812 19:26:52.109695 23203 tablet.cc:2369] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:26:52.112545 23236 raft_consensus.cc:348] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.113550 23236 raft_consensus.cc:374] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.113930 23236 raft_consensus.cc:729] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.115157 23236 consensus_queue.cc:260] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.117816 23069 heartbeater.cc:503] Master 127.3.253.62:46515 was elected leader, sending a full tablet report...
I20260812 19:26:52.118192 23236 ts_tablet_manager.cc:1428] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.007s
I20260812 19:26:52.118844 23234 ts_tablet_manager.cc:1428] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.030s	user 0.023s	sys 0.003s
I20260812 19:26:52.119262 23236 tablet_bootstrap.cc:492] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
I20260812 19:26:52.119894 23234 tablet_bootstrap.cc:492] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:52.127624 23234 tablet_bootstrap.cc:654] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.127630 23236 tablet_bootstrap.cc:654] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.133554 23231 tablet_bootstrap.cc:492] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:52.134285 23231 ts_tablet_manager.cc:1397] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.011s
I20260812 19:26:52.137609 23231 raft_consensus.cc:348] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.138298 23236 tablet_bootstrap.cc:492] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:52.138401 23231 raft_consensus.cc:374] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.138873 23231 raft_consensus.cc:729] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.138993 23236 ts_tablet_manager.cc:1397] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260812 19:26:52.139964 23231 consensus_queue.cc:260] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.141358 23238 raft_consensus.cc:482] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.141808 23238 raft_consensus.cc:504] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.142282 23236 raft_consensus.cc:348] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.143095 23236 raft_consensus.cc:374] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.143380 23236 raft_consensus.cc:729] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.144641 23238 leader_election.cc:288] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.144714 23259 raft_consensus.cc:482] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.145758 23259 raft_consensus.cc:504] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.152352 23231 ts_tablet_manager.cc:1428] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.006s
I20260812 19:26:52.156028 23234 tablet_bootstrap.cc:492] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:52.156744 23234 ts_tablet_manager.cc:1397] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.011s
I20260812 19:26:52.163998 23234 raft_consensus.cc:348] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.165045 23234 raft_consensus.cc:374] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.165400 23234 raft_consensus.cc:729] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.158677 23236 consensus_queue.cc:260] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.166850 23259 leader_election.cc:288] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.169746 23236 ts_tablet_manager.cc:1428] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260812 19:26:52.173167 23231 tablet_bootstrap.cc:492] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:52.176151 23236 tablet_bootstrap.cc:492] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
W20260812 19:26:52.181546 22789 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:26:52.166309 23234 consensus_queue.cc:260] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.188185 23231 tablet_bootstrap.cc:654] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.189211 23234 ts_tablet_manager.cc:1428] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260812 19:26:52.190363 23234 tablet_bootstrap.cc:492] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:52.197775 23236 tablet_bootstrap.cc:654] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.199131 23238 raft_consensus.cc:482] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.199770 23238 raft_consensus.cc:504] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.201984 23238 leader_election.cc:288] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.204530 23234 tablet_bootstrap.cc:654] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.211220 23236 tablet_bootstrap.cc:492] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:52.212620 23236 ts_tablet_manager.cc:1397] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.000s
I20260812 19:26:52.216380 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7342bbe3c864a43a9d7cdf0fa091324" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:52.216876 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "419c163281434479a70870e9b1a61faa" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:52.217275 23162 raft_consensus.cc:2454] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 0.
I20260812 19:26:52.217686 23159 raft_consensus.cc:2454] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 0.
I20260812 19:26:52.217133 23236 raft_consensus.cc:348] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.218751 23236 raft_consensus.cc:374] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.219172 23236 raft_consensus.cc:729] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.219964 23027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7342bbe3c864a43a9d7cdf0fa091324" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
I20260812 19:26:52.220358 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "419c163281434479a70870e9b1a61faa" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
I20260812 19:26:52.220296 23236 consensus_queue.cc:260] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
W20260812 19:26:52.221961 22824 leader_election.cc:341] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.222409 22822 leader_election.cc:302] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
W20260812 19:26:52.223104 22824 leader_election.cc:341] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.223433 23238 raft_consensus.cc:2781] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:52.223835 23238 raft_consensus.cc:482] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:52.224210 23238 raft_consensus.cc:3037] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.225116 23236 ts_tablet_manager.cc:1428] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260812 19:26:52.230139 22822 leader_election.cc:302] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:52.226584 23236 tablet_bootstrap.cc:492] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
I20260812 19:26:52.236193 23234 tablet_bootstrap.cc:492] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:52.236790 23234 ts_tablet_manager.cc:1397] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.047s	user 0.025s	sys 0.012s
I20260812 19:26:52.237617 23231 tablet_bootstrap.cc:492] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:52.238195 23231 ts_tablet_manager.cc:1397] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.014s
I20260812 19:26:52.240092 23234 raft_consensus.cc:348] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.241001 23234 raft_consensus.cc:374] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.241289 23234 raft_consensus.cc:729] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.242779 23238 raft_consensus.cc:504] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.245045 23238 leader_election.cc:288] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Requested vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.245587 23238 raft_consensus.cc:2781] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:52.247225 23236 tablet_bootstrap.cc:654] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.248358 23234 consensus_queue.cc:260] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.247776 22885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ce053aa9074a4db2d554efe9d02f64" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:52.251776 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "419c163281434479a70870e9b1a61faa" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:52.252453 23162 raft_consensus.cc:3037] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:52.253355 22962 leader_election.cc:341] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.253449 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "419c163281434479a70870e9b1a61faa" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:52.255880 23231 raft_consensus.cc:348] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.256492 23231 raft_consensus.cc:374] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.256750 23231 raft_consensus.cc:729] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.257422 23231 consensus_queue.cc:260] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.259631 23231 ts_tablet_manager.cc:1428] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260812 19:26:52.247728 23238 raft_consensus.cc:482] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:52.261503 23238 raft_consensus.cc:3037] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.261740 23026 raft_consensus.cc:3037] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.261739 23231 tablet_bootstrap.cc:492] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:52.273530 23236 tablet_bootstrap.cc:492] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:52.267411 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ce053aa9074a4db2d554efe9d02f64" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:52.274120 23162 raft_consensus.cc:2454] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 1.
I20260812 19:26:52.274622 23236 ts_tablet_manager.cc:1397] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.008s
I20260812 19:26:52.273603 23238 raft_consensus.cc:504] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
W20260812 19:26:52.275929 22961 leader_election.cc:341] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.277082 22961 leader_election.cc:302] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f; no voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691
I20260812 19:26:52.277896 23259 raft_consensus.cc:2726] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:52.277622 23236 raft_consensus.cc:348] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.278457 23236 raft_consensus.cc:374] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.278792 23236 raft_consensus.cc:729] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.278950 23238 leader_election.cc:288] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Requested vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.279682 23027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7342bbe3c864a43a9d7cdf0fa091324" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:52.280102 23231 tablet_bootstrap.cc:654] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.279654 23236 consensus_queue.cc:260] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
W20260812 19:26:52.281061 22824 leader_election.cc:341] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.271065 23026 raft_consensus.cc:2454] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 1.
I20260812 19:26:52.282579 23236 ts_tablet_manager.cc:1428] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260812 19:26:52.283885 23236 tablet_bootstrap.cc:492] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
I20260812 19:26:52.264387 23234 ts_tablet_manager.cc:1428] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260812 19:26:52.275326 22822 leader_election.cc:302] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:52.286902 23234 tablet_bootstrap.cc:492] T 411ac8056d5645a5801868c0940bc406 P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:52.292587 23236 tablet_bootstrap.cc:654] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.298313 23234 tablet_bootstrap.cc:654] T 411ac8056d5645a5801868c0940bc406 P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.302181 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7342bbe3c864a43a9d7cdf0fa091324" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:52.302889 23162 raft_consensus.cc:3037] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.309105 23238 raft_consensus.cc:2781] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:52.310684 23238 raft_consensus.cc:686] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Becoming Leader. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:52.311746 23238 consensus_queue.cc:237] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.312188 23273 raft_consensus.cc:482] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.313069 23234 tablet_bootstrap.cc:492] T 411ac8056d5645a5801868c0940bc406 P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:52.312950 23273 raft_consensus.cc:504] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.313817 23234 ts_tablet_manager.cc:1397] T 411ac8056d5645a5801868c0940bc406 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.001s
I20260812 19:26:52.315421 23162 raft_consensus.cc:2454] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 1.
I20260812 19:26:52.316860 22822 leader_election.cc:302] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:52.317147 23273 leader_election.cc:288] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.317968 23273 raft_consensus.cc:2781] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:52.318410 23273 raft_consensus.cc:686] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Becoming Leader. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:52.318542 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954401c5c5994738a6b10c07868f0dd4" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
W20260812 19:26:52.320194 22824 leader_election.cc:341] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.320611 23231 tablet_bootstrap.cc:492] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:52.319432 23273 consensus_queue.cc:237] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.321225 23231 ts_tablet_manager.cc:1397] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.060s	user 0.020s	sys 0.023s
I20260812 19:26:52.324296 23231 raft_consensus.cc:348] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.325079 23231 raft_consensus.cc:374] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.325359 23231 raft_consensus.cc:729] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.326342 23236 tablet_bootstrap.cc:492] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:52.326010 23231 consensus_queue.cc:260] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.326874 22705 catalog_manager.cc:5495] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 271fa24c603a441fa865c54511adbdc3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "271fa24c603a441fa865c54511adbdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:52.327713 23234 raft_consensus.cc:348] T 411ac8056d5645a5801868c0940bc406 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.328503 23234 raft_consensus.cc:374] T 411ac8056d5645a5801868c0940bc406 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.328526 23231 ts_tablet_manager.cc:1428] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260812 19:26:52.330996 23234 raft_consensus.cc:729] T 411ac8056d5645a5801868c0940bc406 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.326910 23236 ts_tablet_manager.cc:1397] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.016s
I20260812 19:26:52.332202 23231 tablet_bootstrap.cc:492] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:52.334380 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954401c5c5994738a6b10c07868f0dd4" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:52.335119 23162 raft_consensus.cc:2454] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 0.
I20260812 19:26:52.334944 23236 raft_consensus.cc:348] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.335764 23236 raft_consensus.cc:374] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.336084 23236 raft_consensus.cc:729] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.336442 22822 leader_election.cc:302] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:52.336825 23236 consensus_queue.cc:260] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.337530 23234 consensus_queue.cc:260] T 411ac8056d5645a5801868c0940bc406 P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.339118 23238 raft_consensus.cc:482] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.339658 23282 raft_consensus.cc:2781] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:52.339632 23238 raft_consensus.cc:504] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.340152 23282 raft_consensus.cc:482] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:52.340984 23231 tablet_bootstrap.cc:654] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.341902 23238 leader_election.cc:288] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.343102 23236 ts_tablet_manager.cc:1428] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260812 19:26:52.343757 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8316bd251de448b78b562f94941532c9" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
I20260812 19:26:52.345150 23236 tablet_bootstrap.cc:492] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
W20260812 19:26:52.345528 22824 leader_election.cc:341] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.349139 23273 raft_consensus.cc:482] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.349676 23273 raft_consensus.cc:504] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.350677 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8316bd251de448b78b562f94941532c9" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:52.351477 23162 raft_consensus.cc:2454] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 0.
I20260812 19:26:52.352631 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e13bc2fc304b11b8a9ebc589db2e96" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
W20260812 19:26:52.354390 22824 leader_election.cc:341] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.354722 23231 tablet_bootstrap.cc:492] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:52.355413 23231 ts_tablet_manager.cc:1397] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
I20260812 19:26:52.355590 23236 tablet_bootstrap.cc:654] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.357354 22822 leader_election.cc:302] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:52.358201 23238 raft_consensus.cc:2781] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:52.358583 23238 raft_consensus.cc:482] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:52.358985 23238 raft_consensus.cc:3037] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.358769 23231 raft_consensus.cc:348] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.359745 23231 raft_consensus.cc:374] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.360083 23231 raft_consensus.cc:729] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.360790 23234 ts_tablet_manager.cc:1428] T 411ac8056d5645a5801868c0940bc406 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.002s
I20260812 19:26:52.362267 23234 tablet_bootstrap.cc:492] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:52.360803 23231 consensus_queue.cc:260] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.340556 23282 raft_consensus.cc:3037] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.366858 23238 raft_consensus.cc:504] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.367347 23273 leader_election.cc:288] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.368512 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e13bc2fc304b11b8a9ebc589db2e96" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:52.369393 23162 raft_consensus.cc:2454] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 0.
I20260812 19:26:52.370491 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8316bd251de448b78b562f94941532c9" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:52.370515 22822 leader_election.cc:302] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:52.372011 23293 raft_consensus.cc:2781] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260812 19:26:52.372112 22824 leader_election.cc:341] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.372426 23293 raft_consensus.cc:482] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:52.372779 23293 raft_consensus.cc:3037] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.373282 23238 leader_election.cc:288] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Requested vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.374397 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8316bd251de448b78b562f94941532c9" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:52.375070 23162 raft_consensus.cc:3037] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.380424 23231 ts_tablet_manager.cc:1428] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260812 19:26:52.381873 23231 tablet_bootstrap.cc:492] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:52.383090 23162 raft_consensus.cc:2454] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 1.
I20260812 19:26:52.383960 23293 raft_consensus.cc:504] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.384516 22822 leader_election.cc:302] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:52.384450 23282 raft_consensus.cc:504] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.386116 23238 raft_consensus.cc:2781] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:52.386621 23238 raft_consensus.cc:686] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Becoming Leader. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:52.387550 23238 consensus_queue.cc:237] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.388195 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e13bc2fc304b11b8a9ebc589db2e96" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:52.388252 23027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954401c5c5994738a6b10c07868f0dd4" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
W20260812 19:26:52.390261 22824 leader_election.cc:341] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.390470 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954401c5c5994738a6b10c07868f0dd4" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
W20260812 19:26:52.391031 22824 leader_election.cc:341] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.391176 23159 raft_consensus.cc:3037] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.392899 23231 tablet_bootstrap.cc:654] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.393086 23293 leader_election.cc:288] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Requested vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.395294 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e13bc2fc304b11b8a9ebc589db2e96" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:52.396076 23157 raft_consensus.cc:3037] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.397989 23236 tablet_bootstrap.cc:492] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:52.398586 23236 ts_tablet_manager.cc:1397] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.013s
I20260812 19:26:52.401608 23236 raft_consensus.cc:348] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.402318 23236 raft_consensus.cc:374] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.402701 23282 leader_election.cc:288] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Requested vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.402595 23236 raft_consensus.cc:729] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.404016 23236 consensus_queue.cc:260] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.406466 23236 ts_tablet_manager.cc:1428] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260812 19:26:52.407536 23236 tablet_bootstrap.cc:492] T 411ac8056d5645a5801868c0940bc406 P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
I20260812 19:26:52.408730 23234 tablet_bootstrap.cc:654] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.413275 23236 tablet_bootstrap.cc:654] T 411ac8056d5645a5801868c0940bc406 P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.417435 23246 raft_consensus.cc:482] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.418018 23246 raft_consensus.cc:504] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.420863 23259 raft_consensus.cc:482] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.421432 23259 raft_consensus.cc:504] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.423002 23246 leader_election.cc:288] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:52.423506 23259 leader_election.cc:288] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.425208 22885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "831b499ce47b4c518e0fc5e9c5a7c77f" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:52.425912 22885 raft_consensus.cc:2454] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 0.
I20260812 19:26:52.426177 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "831b499ce47b4c518e0fc5e9c5a7c77f" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:52.426873 23162 raft_consensus.cc:2454] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 0.
I20260812 19:26:52.428161 22961 leader_election.cc:302] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:52.428999 23259 raft_consensus.cc:2781] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:52.423360 23159 raft_consensus.cc:2454] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 1.
I20260812 19:26:52.430028 23259 raft_consensus.cc:482] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:52.423552 23157 raft_consensus.cc:2454] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 1.
I20260812 19:26:52.430932 22703 catalog_manager.cc:5495] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 271fa24c603a441fa865c54511adbdc3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "271fa24c603a441fa865c54511adbdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:52.430706 23259 raft_consensus.cc:3037] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.431603 22822 leader_election.cc:302] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:52.434283 22822 leader_election.cc:302] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:52.433537 22703 catalog_manager.cc:5495] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 271fa24c603a441fa865c54511adbdc3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "271fa24c603a441fa865c54511adbdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:52.435480 23282 raft_consensus.cc:2781] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:52.435963 23282 raft_consensus.cc:686] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Becoming Leader. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:52.436098 23273 raft_consensus.cc:2781] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:52.436620 23273 raft_consensus.cc:686] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Becoming Leader. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:52.436890 23282 consensus_queue.cc:237] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.437460 23273 consensus_queue.cc:237] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.440394 23234 tablet_bootstrap.cc:492] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:52.441042 23234 ts_tablet_manager.cc:1397] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.003s
I20260812 19:26:52.445353 23231 tablet_bootstrap.cc:492] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:52.446012 23231 ts_tablet_manager.cc:1397] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.000s
I20260812 19:26:52.449559 23231 raft_consensus.cc:348] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.452198 23259 raft_consensus.cc:504] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.456334 22885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "831b499ce47b4c518e0fc5e9c5a7c77f" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:52.457187 22885 raft_consensus.cc:3037] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.468737 23234 raft_consensus.cc:348] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.469769 23234 raft_consensus.cc:374] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.470026 23259 leader_election.cc:288] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.470268 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "831b499ce47b4c518e0fc5e9c5a7c77f" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:52.470996 23157 raft_consensus.cc:3037] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.450498 23231 raft_consensus.cc:374] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.471520 23231 raft_consensus.cc:729] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.472608 22885 raft_consensus.cc:2454] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 1.
I20260812 19:26:52.473968 22962 leader_election.cc:302] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f; no voters: 
I20260812 19:26:52.474967 23259 raft_consensus.cc:2781] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:52.476365 23236 tablet_bootstrap.cc:492] T 411ac8056d5645a5801868c0940bc406 P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:52.476903 23236 ts_tablet_manager.cc:1397] T 411ac8056d5645a5801868c0940bc406 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.007s
I20260812 19:26:52.470105 23234 raft_consensus.cc:729] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.478204 23231 consensus_queue.cc:260] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.480417 23231 ts_tablet_manager.cc:1428] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260812 19:26:52.481000 23157 raft_consensus.cc:2454] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 1.
I20260812 19:26:52.481396 23234 consensus_queue.cc:260] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.485407 23236 raft_consensus.cc:348] T 411ac8056d5645a5801868c0940bc406 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.486168 23236 raft_consensus.cc:374] T 411ac8056d5645a5801868c0940bc406 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.486454 23236 raft_consensus.cc:729] T 411ac8056d5645a5801868c0940bc406 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.487278 23236 consensus_queue.cc:260] T 411ac8056d5645a5801868c0940bc406 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.491526 23236 ts_tablet_manager.cc:1428] T 411ac8056d5645a5801868c0940bc406 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260812 19:26:52.492173 23259 raft_consensus.cc:686] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Becoming Leader. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:26:52.493196 23259 consensus_queue.cc:237] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.494414 23234 ts_tablet_manager.cc:1428] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.001s
I20260812 19:26:52.497735 23234 tablet_bootstrap.cc:492] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:52.501259 22703 catalog_manager.cc:5495] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 271fa24c603a441fa865c54511adbdc3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "271fa24c603a441fa865c54511adbdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:52.503594 22703 catalog_manager.cc:5495] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 271fa24c603a441fa865c54511adbdc3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "271fa24c603a441fa865c54511adbdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:52.511957 23027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ce053aa9074a4db2d554efe9d02f64" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
I20260812 19:26:52.512955 23027 raft_consensus.cc:2454] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 0.
I20260812 19:26:52.514696 23093 leader_election.cc:302] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:52.515719 23246 raft_consensus.cc:2781] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:52.516115 23246 raft_consensus.cc:482] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:52.516453 23246 raft_consensus.cc:3037] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.518394 22885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ce053aa9074a4db2d554efe9d02f64" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:52.517823 22705 catalog_manager.cc:5495] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f reported cstate change: term changed from 0 to 1, leader changed from <none> to 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2). New cstate: current_term: 1 leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:52.519105 22885 raft_consensus.cc:2454] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 0.
I20260812 19:26:52.525161 23234 tablet_bootstrap.cc:654] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.529712 23273 raft_consensus.cc:482] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.530031 23246 raft_consensus.cc:504] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.530294 23273 raft_consensus.cc:504] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.532274 23246 leader_election.cc:288] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:52.532513 23273 leader_election.cc:288] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.534148 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "411ac8056d5645a5801868c0940bc406" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:52.534152 23027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "411ac8056d5645a5801868c0940bc406" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
I20260812 19:26:52.535099 23027 raft_consensus.cc:2454] T 411ac8056d5645a5801868c0940bc406 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 0.
I20260812 19:26:52.536314 22824 leader_election.cc:302] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f; no voters: 
I20260812 19:26:52.536799 23027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ce053aa9074a4db2d554efe9d02f64" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:52.537142 23273 raft_consensus.cc:2781] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:52.537596 23273 raft_consensus.cc:482] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:52.537444 22885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ce053aa9074a4db2d554efe9d02f64" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:52.537957 23273 raft_consensus.cc:3037] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.538110 22885 raft_consensus.cc:3037] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.535090 23157 raft_consensus.cc:2454] T 411ac8056d5645a5801868c0940bc406 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 0.
I20260812 19:26:52.537456 23027 raft_consensus.cc:3037] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.546089 23273 raft_consensus.cc:504] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.549844 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "411ac8056d5645a5801868c0940bc406" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:52.550058 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "411ac8056d5645a5801868c0940bc406" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:52.550550 23026 raft_consensus.cc:3037] T 411ac8056d5645a5801868c0940bc406 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.550812 23157 raft_consensus.cc:3037] T 411ac8056d5645a5801868c0940bc406 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.551424 23234 tablet_bootstrap.cc:492] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:52.552033 23234 ts_tablet_manager.cc:1397] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.055s	user 0.026s	sys 0.005s
I20260812 19:26:52.553751 22885 raft_consensus.cc:2454] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 1.
I20260812 19:26:52.555295 23093 leader_election.cc:302] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:52.555298 23234 raft_consensus.cc:348] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.556437 23234 raft_consensus.cc:374] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.556493 23246 raft_consensus.cc:2781] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:52.556802 23234 raft_consensus.cc:729] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.557755 23234 consensus_queue.cc:260] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.558638 23273 leader_election.cc:288] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Requested vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.559543 23026 raft_consensus.cc:2454] T 411ac8056d5645a5801868c0940bc406 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 1.
I20260812 19:26:52.561728 22824 leader_election.cc:302] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f; no voters: 
I20260812 19:26:52.561772 23157 raft_consensus.cc:2454] T 411ac8056d5645a5801868c0940bc406 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 1.
I20260812 19:26:52.562750 23273 raft_consensus.cc:2781] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:52.563274 23273 raft_consensus.cc:686] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Becoming Leader. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:52.564189 23273 consensus_queue.cc:237] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.567143 23027 raft_consensus.cc:2454] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 1.
I20260812 19:26:52.568428 23234 ts_tablet_manager.cc:1428] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260812 19:26:52.570230 23234 tablet_bootstrap.cc:492] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:52.572865 23246 raft_consensus.cc:686] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Becoming Leader. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:26:52.573931 23246 consensus_queue.cc:237] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.577360 23234 tablet_bootstrap.cc:654] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.577199 22701 catalog_manager.cc:5495] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 271fa24c603a441fa865c54511adbdc3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "271fa24c603a441fa865c54511adbdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:52.584622 23234 tablet_bootstrap.cc:492] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:52.584411 22705 catalog_manager.cc:5495] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:52.585224 23234 ts_tablet_manager.cc:1397] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260812 19:26:52.588336 23234 raft_consensus.cc:348] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.589097 23234 raft_consensus.cc:374] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.589385 23234 raft_consensus.cc:729] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.590118 23234 consensus_queue.cc:260] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.592581 23234 ts_tablet_manager.cc:1428] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260812 19:26:52.593771 23234 tablet_bootstrap.cc:492] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:52.599160 23234 tablet_bootstrap.cc:654] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.604214 23234 tablet_bootstrap.cc:492] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:52.604714 23234 ts_tablet_manager.cc:1397] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.004s
I20260812 19:26:52.606976 23234 raft_consensus.cc:348] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.607553 23234 raft_consensus.cc:374] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.607765 23234 raft_consensus.cc:729] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.608377 23234 consensus_queue.cc:260] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.609839 23234 ts_tablet_manager.cc:1428] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260812 19:26:52.610632 23234 tablet_bootstrap.cc:492] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:52.615757 23234 tablet_bootstrap.cc:654] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.620647 23234 tablet_bootstrap.cc:492] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:52.621131 23234 ts_tablet_manager.cc:1397] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.011s	user 0.003s	sys 0.004s
I20260812 19:26:52.623486 23234 raft_consensus.cc:348] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.624032 23234 raft_consensus.cc:374] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.624207 23234 raft_consensus.cc:729] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.624639 23234 consensus_queue.cc:260] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.626546 23234 ts_tablet_manager.cc:1428] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 19:26:52.633448 23273 raft_consensus.cc:482] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.634024 23273 raft_consensus.cc:504] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.635902 23273 leader_election.cc:288] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.636612 23027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20d9fce7ef4748cfbcce47addf7c709c" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
I20260812 19:26:52.636896 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20d9fce7ef4748cfbcce47addf7c709c" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:52.637362 23027 raft_consensus.cc:2454] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 0.
I20260812 19:26:52.637624 23157 raft_consensus.cc:2454] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 0.
I20260812 19:26:52.638505 22824 leader_election.cc:302] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f; no voters: 
I20260812 19:26:52.639328 23273 raft_consensus.cc:2781] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:52.639701 23273 raft_consensus.cc:482] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:52.640090 23273 raft_consensus.cc:3037] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.645635 23273 raft_consensus.cc:504] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.647274 23273 leader_election.cc:288] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Requested vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.648264 23027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20d9fce7ef4748cfbcce47addf7c709c" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:52.648283 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20d9fce7ef4748cfbcce47addf7c709c" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:52.648891 23027 raft_consensus.cc:3037] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.649044 23157 raft_consensus.cc:3037] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.655088 23157 raft_consensus.cc:2454] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 1.
I20260812 19:26:52.655190 23027 raft_consensus.cc:2454] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 1.
I20260812 19:26:52.657231 22822 leader_election.cc:302] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:52.658469 23273 raft_consensus.cc:2781] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:52.659056 23273 raft_consensus.cc:686] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Becoming Leader. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:52.660030 23273 consensus_queue.cc:237] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.670135 22705 catalog_manager.cc:5495] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 271fa24c603a441fa865c54511adbdc3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "271fa24c603a441fa865c54511adbdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:52.722791 23157 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "99ce053aa9074a4db2d554efe9d02f64"
dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
mode: GRACEFUL
new_leader_uuid: "271fa24c603a441fa865c54511adbdc3"
 from {username='slave'} at 127.0.0.1:50540
I20260812 19:26:52.723414 23157 raft_consensus.cc:595] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Received request to transfer leadership to TS 271fa24c603a441fa865c54511adbdc3
I20260812 19:26:52.740051 23027 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "831b499ce47b4c518e0fc5e9c5a7c77f"
dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
mode: GRACEFUL
new_leader_uuid: "271fa24c603a441fa865c54511adbdc3"
 from {username='slave'} at 127.0.0.1:40000
I20260812 19:26:52.740679 23027 raft_consensus.cc:595] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Received request to transfer leadership to TS 271fa24c603a441fa865c54511adbdc3
I20260812 19:26:52.761930 22885 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "65e13bc2fc304b11b8a9ebc589db2e96"
dest_uuid: "271fa24c603a441fa865c54511adbdc3"
mode: GRACEFUL
new_leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
 from {username='slave'} at 127.0.0.1:39322
I20260812 19:26:52.762483 22885 raft_consensus.cc:595] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Received request to transfer leadership to TS 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:52.767710 22885 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "954401c5c5994738a6b10c07868f0dd4"
dest_uuid: "271fa24c603a441fa865c54511adbdc3"
mode: GRACEFUL
new_leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
 from {username='slave'} at 127.0.0.1:39322
I20260812 19:26:52.768266 22885 raft_consensus.cc:595] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Received request to transfer leadership to TS 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:52.773393 22885 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "419c163281434479a70870e9b1a61faa"
dest_uuid: "271fa24c603a441fa865c54511adbdc3"
mode: GRACEFUL
new_leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
 from {username='slave'} at 127.0.0.1:39322
I20260812 19:26:52.773881 22885 raft_consensus.cc:595] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Received request to transfer leadership to TS 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:52.778702 22885 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "20d9fce7ef4748cfbcce47addf7c709c"
dest_uuid: "271fa24c603a441fa865c54511adbdc3"
mode: GRACEFUL
new_leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
 from {username='slave'} at 127.0.0.1:39322
I20260812 19:26:52.779181 22885 raft_consensus.cc:595] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Received request to transfer leadership to TS 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:52.784068 22885 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e7342bbe3c864a43a9d7cdf0fa091324"
dest_uuid: "271fa24c603a441fa865c54511adbdc3"
mode: GRACEFUL
new_leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
 from {username='slave'} at 127.0.0.1:39322
I20260812 19:26:52.784565 22885 raft_consensus.cc:595] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Received request to transfer leadership to TS d5456a1fcbb14d85bfdfd59aa4f48691
I20260812 19:26:52.800295 23306 raft_consensus.cc:482] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.800923 23306 raft_consensus.cc:504] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.802764 23306 leader_election.cc:288] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.803710 22885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e13bc2fc304b11b8a9ebc589db2e96" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:52.803898 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e13bc2fc304b11b8a9ebc589db2e96" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:52.804658 23157 raft_consensus.cc:2379] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71c459a9ab8f405283add8f5c2e1f17f in current term 1: Already voted for candidate 271fa24c603a441fa865c54511adbdc3 in this term.
I20260812 19:26:52.805595 22961 leader_election.cc:302] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f; no voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691
I20260812 19:26:52.806291 23306 raft_consensus.cc:3037] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.811887 23306 raft_consensus.cc:2726] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:52.817068 23306 raft_consensus.cc:482] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.817456 23306 raft_consensus.cc:504] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.819094 23306 leader_election.cc:288] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.820214 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8316bd251de448b78b562f94941532c9" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:52.820107 22885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8316bd251de448b78b562f94941532c9" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:52.821373 23157 raft_consensus.cc:2379] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71c459a9ab8f405283add8f5c2e1f17f in current term 1: Already voted for candidate 271fa24c603a441fa865c54511adbdc3 in this term.
I20260812 19:26:52.822525 22961 leader_election.cc:302] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f; no voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691
I20260812 19:26:52.823289 23306 raft_consensus.cc:3037] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.826440 23273 consensus_queue.cc:1035] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:52.829803 23306 raft_consensus.cc:2726] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:52.841466 23273 consensus_queue.cc:1035] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:52.842278 23027 raft_consensus.cc:3037] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.854471 23273 consensus_queue.cc:1035] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:52.854902 23238 consensus_queue.cc:1035] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:52.865002 23306 raft_consensus.cc:482] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.865549 23306 raft_consensus.cc:504] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.868289 22885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954401c5c5994738a6b10c07868f0dd4" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:52.873176 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954401c5c5994738a6b10c07868f0dd4" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:52.874070 23162 raft_consensus.cc:2379] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71c459a9ab8f405283add8f5c2e1f17f in current term 1: Already voted for candidate 271fa24c603a441fa865c54511adbdc3 in this term.
I20260812 19:26:52.875324 23282 consensus_queue.cc:1035] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:52.878276 22961 leader_election.cc:302] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f; no voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691
I20260812 19:26:52.879302 23305 raft_consensus.cc:3037] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.867537 23306 leader_election.cc:288] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.888248 23305 raft_consensus.cc:2726] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:52.890985 23282 consensus_queue.cc:1035] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:52.895112 23238 raft_consensus.cc:979] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3: : Instructing follower d5456a1fcbb14d85bfdfd59aa4f48691 to start an election
I20260812 19:26:52.895633 23238 raft_consensus.cc:1067] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Signalling peer d5456a1fcbb14d85bfdfd59aa4f48691 to start an election
I20260812 19:26:52.898070 23162 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e7342bbe3c864a43a9d7cdf0fa091324"
dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
 from {username='slave'} at 127.0.0.1:50536
I20260812 19:26:52.900233 23162 raft_consensus.cc:482] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:52.900507 23238 raft_consensus.cc:979] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3: : Instructing follower 71c459a9ab8f405283add8f5c2e1f17f to start an election
I20260812 19:26:52.900681 23162 raft_consensus.cc:3037] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:52.901069 23282 raft_consensus.cc:1067] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Signalling peer 71c459a9ab8f405283add8f5c2e1f17f to start an election
I20260812 19:26:52.901579 23305 consensus_queue.cc:1035] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:52.902788 23027 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "419c163281434479a70870e9b1a61faa"
dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
 from {username='slave'} at 127.0.0.1:39974
I20260812 19:26:52.903406 23027 raft_consensus.cc:482] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:52.903761 23027 raft_consensus.cc:3037] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:52.908749 23162 raft_consensus.cc:504] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.912065 23162 leader_election.cc:288] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 2 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:52.914078 22885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7342bbe3c864a43a9d7cdf0fa091324" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:52.914953 22885 raft_consensus.cc:3032] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:52.915297 22885 raft_consensus.cc:729] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:52.915577 23027 raft_consensus.cc:504] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.916181 22885 consensus_queue.cc:260] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.916944 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7342bbe3c864a43a9d7cdf0fa091324" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:52.917611 23026 raft_consensus.cc:3037] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:52.917713 22885 raft_consensus.cc:3037] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:52.920996 23027 leader_election.cc:288] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 2 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.921934 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "419c163281434479a70870e9b1a61faa" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:52.922605 22882 raft_consensus.cc:3032] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:52.922945 22882 raft_consensus.cc:729] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:52.924083 22885 raft_consensus.cc:2454] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 2.
I20260812 19:26:52.923710 22882 consensus_queue.cc:260] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.925133 23026 raft_consensus.cc:2454] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 2.
I20260812 19:26:52.925333 23093 leader_election.cc:302] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:52.926888 23246 raft_consensus.cc:2781] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:52.927363 23246 raft_consensus.cc:686] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 LEADER]: Becoming Leader. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:26:52.928213 23246 consensus_queue.cc:237] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.936182 23238 consensus_queue.cc:1035] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:52.925303 22882 raft_consensus.cc:3037] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:52.938534 23305 consensus_queue.cc:1035] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:52.945183 22703 catalog_manager.cc:5495] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 reported cstate change: term changed from 1 to 2, leader changed from 271fa24c603a441fa865c54511adbdc3 (127.3.253.1) to d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:52.945888 23282 consensus_queue.cc:1035] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:52.951427 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "419c163281434479a70870e9b1a61faa" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:52.952157 23157 raft_consensus.cc:3037] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:52.955982 22882 raft_consensus.cc:2454] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 2.
I20260812 19:26:52.957353 22962 leader_election.cc:302] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f; no voters: 
I20260812 19:26:52.958927 23305 raft_consensus.cc:2781] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:52.959409 23305 raft_consensus.cc:686] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Becoming Leader. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:26:52.960228 23305 consensus_queue.cc:237] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.967446 23157 raft_consensus.cc:2454] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 2.
I20260812 19:26:52.968319 23282 consensus_queue.cc:1035] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:52.976827 22703 catalog_manager.cc:5495] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f reported cstate change: term changed from 1 to 2, leader changed from 271fa24c603a441fa865c54511adbdc3 (127.3.253.1) to 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2). New cstate: current_term: 2 leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:52.979180 23306 raft_consensus.cc:979] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f: : Instructing follower 271fa24c603a441fa865c54511adbdc3 to start an election
I20260812 19:26:52.979746 23259 raft_consensus.cc:1067] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Signalling peer 271fa24c603a441fa865c54511adbdc3 to start an election
I20260812 19:26:52.981597 22880 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "831b499ce47b4c518e0fc5e9c5a7c77f"
dest_uuid: "271fa24c603a441fa865c54511adbdc3"
 from {username='slave'} at 127.0.0.1:39296
I20260812 19:26:52.982375 22880 raft_consensus.cc:482] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:52.982888 22880 raft_consensus.cc:3037] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:52.990839 22880 raft_consensus.cc:504] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:52.992884 22880 leader_election.cc:288] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 2 election: Requested vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:52.994619 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "831b499ce47b4c518e0fc5e9c5a7c77f" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:52.995391 23157 raft_consensus.cc:3037] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:52.997133 23027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "831b499ce47b4c518e0fc5e9c5a7c77f" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:52.997815 23027 raft_consensus.cc:3032] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:52.998124 23027 raft_consensus.cc:729] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:26:52.998631 23238 consensus_queue.cc:1035] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:52.998948 23027 consensus_queue.cc:260] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:53.000149 23027 raft_consensus.cc:3037] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:53.007787 23157 raft_consensus.cc:2454] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 2.
I20260812 19:26:53.009312 22822 leader_election.cc:302] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:53.010417 23282 consensus_queue.cc:1035] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:53.010439 23238 raft_consensus.cc:2781] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:53.011745 23238 raft_consensus.cc:686] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Becoming Leader. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:53.014408 23282 consensus_queue.cc:1035] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:53.013083 23238 consensus_queue.cc:237] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:53.025374 23027 raft_consensus.cc:2454] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 2.
I20260812 19:26:53.030486 23273 raft_consensus.cc:979] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3: : Instructing follower 71c459a9ab8f405283add8f5c2e1f17f to start an election
I20260812 19:26:53.031109 23273 raft_consensus.cc:1067] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Signalling peer 71c459a9ab8f405283add8f5c2e1f17f to start an election
I20260812 19:26:53.037081 22701 catalog_manager.cc:5495] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 reported cstate change: term changed from 1 to 2, leader changed from 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2) to 271fa24c603a441fa865c54511adbdc3 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "271fa24c603a441fa865c54511adbdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:53.042016 23022 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "65e13bc2fc304b11b8a9ebc589db2e96"
dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
 from {username='slave'} at 127.0.0.1:39974
I20260812 19:26:53.042752 23022 raft_consensus.cc:482] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:53.043159 23022 raft_consensus.cc:3037] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:53.047268 23282 raft_consensus.cc:979] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3: : Instructing follower 71c459a9ab8f405283add8f5c2e1f17f to start an election
I20260812 19:26:53.048528 23293 raft_consensus.cc:1067] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Signalling peer 71c459a9ab8f405283add8f5c2e1f17f to start an election
I20260812 19:26:53.050745 23026 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "954401c5c5994738a6b10c07868f0dd4"
dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
 from {username='slave'} at 127.0.0.1:39974
I20260812 19:26:53.051311 23026 raft_consensus.cc:482] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:53.051632 23026 raft_consensus.cc:3037] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:53.058708 23026 raft_consensus.cc:504] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:53.060002 23022 raft_consensus.cc:504] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:53.062471 22880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954401c5c5994738a6b10c07868f0dd4" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:53.063222 22880 raft_consensus.cc:3032] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:53.063503 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e13bc2fc304b11b8a9ebc589db2e96" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:53.063573 22880 raft_consensus.cc:729] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:53.063935 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e13bc2fc304b11b8a9ebc589db2e96" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:53.064180 23162 raft_consensus.cc:3037] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:53.064585 22882 raft_consensus.cc:3032] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:53.064622 22880 consensus_queue.cc:260] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:53.065012 22882 raft_consensus.cc:729] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:53.065620 22880 raft_consensus.cc:3037] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:53.065812 22882 consensus_queue.cc:260] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:53.067024 22882 raft_consensus.cc:3037] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:53.068437 23026 leader_election.cc:288] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 2 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:53.069954 23022 leader_election.cc:288] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 2 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:53.070452 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954401c5c5994738a6b10c07868f0dd4" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:53.071110 23157 raft_consensus.cc:3037] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:53.073146 22880 raft_consensus.cc:2454] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 2.
I20260812 19:26:53.074373 22962 leader_election.cc:302] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f; no voters: 
I20260812 19:26:53.074513 22882 raft_consensus.cc:2454] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 2.
I20260812 19:26:53.075083 23162 raft_consensus.cc:2454] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 2.
I20260812 19:26:53.075378 23305 raft_consensus.cc:2781] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:53.075795 22962 leader_election.cc:302] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f; no voters: 
I20260812 19:26:53.075958 23305 raft_consensus.cc:686] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Becoming Leader. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:26:53.076756 23259 raft_consensus.cc:2781] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:53.077276 23259 raft_consensus.cc:686] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Becoming Leader. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:26:53.076905 23305 consensus_queue.cc:237] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:53.078168 23259 consensus_queue.cc:237] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:53.079687 23157 raft_consensus.cc:2454] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 2.
I20260812 19:26:53.083657 23246 consensus_queue.cc:1035] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:53.085932 22703 catalog_manager.cc:5495] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f reported cstate change: term changed from 1 to 2, leader changed from 271fa24c603a441fa865c54511adbdc3 (127.3.253.1) to 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2). New cstate: current_term: 2 leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:53.094728 23363 consensus_queue.cc:1035] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:53.105145 23246 raft_consensus.cc:979] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691: : Instructing follower 271fa24c603a441fa865c54511adbdc3 to start an election
I20260812 19:26:53.105785 23311 raft_consensus.cc:1067] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Signalling peer 271fa24c603a441fa865c54511adbdc3 to start an election
I20260812 19:26:53.105234 22703 catalog_manager.cc:5495] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f reported cstate change: term changed from 1 to 2, leader changed from 271fa24c603a441fa865c54511adbdc3 (127.3.253.1) to 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2). New cstate: current_term: 2 leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:53.106881 23282 consensus_queue.cc:1035] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:53.107403 22882 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "99ce053aa9074a4db2d554efe9d02f64"
dest_uuid: "271fa24c603a441fa865c54511adbdc3"
 from {username='slave'} at 127.0.0.1:39306
I20260812 19:26:53.108080 22882 raft_consensus.cc:482] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:53.108435 22882 raft_consensus.cc:3037] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:53.118888 23282 consensus_queue.cc:1035] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:53.127192 23282 raft_consensus.cc:979] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3: : Instructing follower 71c459a9ab8f405283add8f5c2e1f17f to start an election
I20260812 19:26:53.127703 23238 raft_consensus.cc:1067] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Signalling peer 71c459a9ab8f405283add8f5c2e1f17f to start an election
I20260812 19:26:53.129467 23022 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "20d9fce7ef4748cfbcce47addf7c709c"
dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
 from {username='slave'} at 127.0.0.1:39974
I20260812 19:26:53.130168 23022 raft_consensus.cc:482] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:53.130776 23022 raft_consensus.cc:3037] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:53.131476 22882 raft_consensus.cc:504] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:53.133733 22882 leader_election.cc:288] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 2 election: Requested vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:53.134887 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ce053aa9074a4db2d554efe9d02f64" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:53.135056 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ce053aa9074a4db2d554efe9d02f64" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:53.135605 23026 raft_consensus.cc:3037] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:53.135758 23157 raft_consensus.cc:3032] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:53.136185 23157 raft_consensus.cc:729] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:26:53.136960 23157 consensus_queue.cc:260] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:53.138336 23157 raft_consensus.cc:3037] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:53.140311 23022 raft_consensus.cc:504] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:53.142550 23022 leader_election.cc:288] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 2 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:53.143337 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20d9fce7ef4748cfbcce47addf7c709c" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:53.144014 22882 raft_consensus.cc:3032] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:53.144340 22882 raft_consensus.cc:729] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:53.145087 23026 raft_consensus.cc:2454] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 2.
I20260812 19:26:53.145458 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20d9fce7ef4748cfbcce47addf7c709c" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:53.146099 23162 raft_consensus.cc:3037] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:53.146188 22824 leader_election.cc:302] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f; no voters: 
I20260812 19:26:53.146633 23157 raft_consensus.cc:2454] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 2.
I20260812 19:26:53.147259 23238 raft_consensus.cc:2781] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:53.147770 23238 raft_consensus.cc:686] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Becoming Leader. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:53.148519 23238 consensus_queue.cc:237] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:53.145104 22882 consensus_queue.cc:260] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:53.152405 22882 raft_consensus.cc:3037] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:53.152882 23162 raft_consensus.cc:2454] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 2.
I20260812 19:26:53.153832 22961 leader_election.cc:302] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:53.154625 23259 raft_consensus.cc:2781] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:53.155143 23259 raft_consensus.cc:686] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Becoming Leader. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:26:53.155879 23259 consensus_queue.cc:237] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:53.158303 22882 raft_consensus.cc:2454] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 2.
I20260812 19:26:53.162748 22705 catalog_manager.cc:5495] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f reported cstate change: term changed from 1 to 2, leader changed from 271fa24c603a441fa865c54511adbdc3 (127.3.253.1) to 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2). New cstate: current_term: 2 leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:53.163719 22701 catalog_manager.cc:5495] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 reported cstate change: term changed from 1 to 2, leader changed from d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3) to 271fa24c603a441fa865c54511adbdc3 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "271fa24c603a441fa865c54511adbdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:53.362970 22882 raft_consensus.cc:1261] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Refusing update from remote peer 71c459a9ab8f405283add8f5c2e1f17f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:53.364310 23259 consensus_queue.cc:1035] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:53.371968 23162 raft_consensus.cc:1261] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Refusing update from remote peer 71c459a9ab8f405283add8f5c2e1f17f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:53.373531 23306 consensus_queue.cc:1035] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:53.482371 23026 raft_consensus.cc:1261] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Refusing update from remote peer d5456a1fcbb14d85bfdfd59aa4f48691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:53.483660 23311 consensus_queue.cc:1035] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:53.491230 22882 raft_consensus.cc:1261] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Refusing update from remote peer d5456a1fcbb14d85bfdfd59aa4f48691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:53.492925 23363 consensus_queue.cc:1035] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:53.516768 23026 raft_consensus.cc:1261] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Refusing update from remote peer 271fa24c603a441fa865c54511adbdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:53.518232 23238 consensus_queue.cc:1035] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:53.526587 23162 raft_consensus.cc:1261] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Refusing update from remote peer 271fa24c603a441fa865c54511adbdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:53.528110 23238 consensus_queue.cc:1035] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:53.551172 22882 raft_consensus.cc:1261] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Refusing update from remote peer 71c459a9ab8f405283add8f5c2e1f17f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:53.552389 23306 consensus_queue.cc:1035] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:53.560065 22880 raft_consensus.cc:1261] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Refusing update from remote peer 71c459a9ab8f405283add8f5c2e1f17f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:53.561477 23162 raft_consensus.cc:1261] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Refusing update from remote peer 71c459a9ab8f405283add8f5c2e1f17f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:53.561542 23157 raft_consensus.cc:1261] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Refusing update from remote peer 271fa24c603a441fa865c54511adbdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:53.562397 23305 consensus_queue.cc:1035] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:53.565066 23238 consensus_queue.cc:1035] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:53.566938 23305 consensus_queue.cc:1035] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:53.576059 23026 raft_consensus.cc:1261] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Refusing update from remote peer 271fa24c603a441fa865c54511adbdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:53.578007 23293 consensus_queue.cc:1035] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:53.580293 23157 raft_consensus.cc:1261] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Refusing update from remote peer 71c459a9ab8f405283add8f5c2e1f17f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:53.591955 23306 consensus_queue.cc:1035] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:53.603615 23162 raft_consensus.cc:1261] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Refusing update from remote peer 71c459a9ab8f405283add8f5c2e1f17f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:53.605357 23306 consensus_queue.cc:1035] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:53.612874 22880 raft_consensus.cc:1261] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Refusing update from remote peer 71c459a9ab8f405283add8f5c2e1f17f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:53.614200 23305 consensus_queue.cc:1035] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:55.786000  4084 test_util.cc:268] Using random seed: -1845429268
I20260812 19:26:55.814793 22705 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40474:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 19:26:55.816972 22705 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:55.872515 22858 tablet_service.cc:1467] Processing CreateTablet for tablet 3dd7b91470ea43ed98f7ca2f6975b0a2 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260812 19:26:55.873267 22991 tablet_service.cc:1467] Processing CreateTablet for tablet 3dd7b91470ea43ed98f7ca2f6975b0a2 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260812 19:26:55.873924 22858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dd7b91470ea43ed98f7ca2f6975b0a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.873776 23134 tablet_service.cc:1467] Processing CreateTablet for tablet 3dd7b91470ea43ed98f7ca2f6975b0a2 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260812 19:26:55.874708 22991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dd7b91470ea43ed98f7ca2f6975b0a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.875147 23134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dd7b91470ea43ed98f7ca2f6975b0a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.885041 22864 tablet_service.cc:1467] Processing CreateTablet for tablet 99c1c937c48341fda945b5dc79d12d3a (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260812 19:26:55.886446 22864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99c1c937c48341fda945b5dc79d12d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.886353 23127 tablet_service.cc:1467] Processing CreateTablet for tablet 99c1c937c48341fda945b5dc79d12d3a (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260812 19:26:55.887844 23127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99c1c937c48341fda945b5dc79d12d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.890107 22999 tablet_service.cc:1467] Processing CreateTablet for tablet 99c1c937c48341fda945b5dc79d12d3a (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260812 19:26:55.890477 23138 tablet_service.cc:1467] Processing CreateTablet for tablet 3babac97ab8b4ff0a8c22d7011775e86 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260812 19:26:55.891788 23138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3babac97ab8b4ff0a8c22d7011775e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.892153 23141 tablet_service.cc:1467] Processing CreateTablet for tablet 5b9d00b660274a0eb9e6ed18ef5718ed (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260812 19:26:55.893460 23141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b9d00b660274a0eb9e6ed18ef5718ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.895632 22988 tablet_service.cc:1467] Processing CreateTablet for tablet 3babac97ab8b4ff0a8c22d7011775e86 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260812 19:26:55.898152 22852 tablet_service.cc:1467] Processing CreateTablet for tablet 3babac97ab8b4ff0a8c22d7011775e86 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260812 19:26:55.899497 22852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3babac97ab8b4ff0a8c22d7011775e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.899750 22863 tablet_service.cc:1467] Processing CreateTablet for tablet 5b9d00b660274a0eb9e6ed18ef5718ed (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260812 19:26:55.900982 22863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b9d00b660274a0eb9e6ed18ef5718ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.903848 22998 tablet_service.cc:1467] Processing CreateTablet for tablet 5b9d00b660274a0eb9e6ed18ef5718ed (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260812 19:26:55.905844 22859 tablet_service.cc:1467] Processing CreateTablet for tablet 024f88b62c6a4987ac7154abbb3cf1f9 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260812 19:26:55.907143 22859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 024f88b62c6a4987ac7154abbb3cf1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.911417 23003 tablet_service.cc:1467] Processing CreateTablet for tablet 024f88b62c6a4987ac7154abbb3cf1f9 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260812 19:26:55.913336 23131 tablet_service.cc:1467] Processing CreateTablet for tablet 024f88b62c6a4987ac7154abbb3cf1f9 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260812 19:26:55.914747 23131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 024f88b62c6a4987ac7154abbb3cf1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.914500 22851 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6752ffef7c45b69844f73592ca7e54 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260812 19:26:55.915866 22851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6752ffef7c45b69844f73592ca7e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.919104 23126 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6752ffef7c45b69844f73592ca7e54 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260812 19:26:55.919615 23001 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6752ffef7c45b69844f73592ca7e54 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260812 19:26:55.920562 23126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6752ffef7c45b69844f73592ca7e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.920662 22856 tablet_service.cc:1467] Processing CreateTablet for tablet c971d430cc364661b176d7acc3050088 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260812 19:26:55.921999 22856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c971d430cc364661b176d7acc3050088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.928670 22993 tablet_service.cc:1467] Processing CreateTablet for tablet c971d430cc364661b176d7acc3050088 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260812 19:26:55.935089 23129 tablet_service.cc:1467] Processing CreateTablet for tablet c971d430cc364661b176d7acc3050088 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260812 19:26:55.937177 23129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c971d430cc364661b176d7acc3050088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.941022 23001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6752ffef7c45b69844f73592ca7e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.945150 22993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c971d430cc364661b176d7acc3050088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.948190 23006 tablet_service.cc:1467] Processing CreateTablet for tablet be1fce37be484514832213da63481039 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260812 19:26:55.949193 23003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 024f88b62c6a4987ac7154abbb3cf1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.951197 23005 tablet_service.cc:1467] Processing CreateTablet for tablet dfd67cc699b540a4acee00b54efc781a (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260812 19:26:55.951619 22854 tablet_service.cc:1467] Processing CreateTablet for tablet be1fce37be484514832213da63481039 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260812 19:26:55.952509 23005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfd67cc699b540a4acee00b54efc781a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.952958 22854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be1fce37be484514832213da63481039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.954684 22857 tablet_service.cc:1467] Processing CreateTablet for tablet dfd67cc699b540a4acee00b54efc781a (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260812 19:26:55.955061 23006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be1fce37be484514832213da63481039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.955922 22857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfd67cc699b540a4acee00b54efc781a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.957468 23133 tablet_service.cc:1467] Processing CreateTablet for tablet be1fce37be484514832213da63481039 (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260812 19:26:55.958729 23133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be1fce37be484514832213da63481039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.959591 23135 tablet_service.cc:1467] Processing CreateTablet for tablet dfd67cc699b540a4acee00b54efc781a (DEFAULT_TABLE table=soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260812 19:26:55.960800 23135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfd67cc699b540a4acee00b54efc781a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.963171 22998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b9d00b660274a0eb9e6ed18ef5718ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.966434 22999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99c1c937c48341fda945b5dc79d12d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:55.975003 22988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3babac97ab8b4ff0a8c22d7011775e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.017709 23400 tablet_bootstrap.cc:492] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:56.024772 23399 tablet_bootstrap.cc:492] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
I20260812 19:26:56.069394 23399 tablet_bootstrap.cc:654] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.069511 23403 tablet_bootstrap.cc:492] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:56.074928 23400 tablet_bootstrap.cc:654] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.079166 23399 tablet_bootstrap.cc:492] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:56.079381 23403 tablet_bootstrap.cc:654] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.079772 23399 ts_tablet_manager.cc:1397] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.055s	user 0.006s	sys 0.009s
I20260812 19:26:56.083150 23400 tablet_bootstrap.cc:492] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:56.083227 23399 raft_consensus.cc:348] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.083951 23400 ts_tablet_manager.cc:1397] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.006s
I20260812 19:26:56.084230 23399 raft_consensus.cc:374] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.084543 23399 raft_consensus.cc:729] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.085426 23399 consensus_queue.cc:260] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.087076 23400 raft_consensus.cc:348] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.087894 23400 raft_consensus.cc:374] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.088269 23399 ts_tablet_manager.cc:1428] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260812 19:26:56.088168 23400 raft_consensus.cc:729] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.089493 23399 tablet_bootstrap.cc:492] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
I20260812 19:26:56.089118 23400 consensus_queue.cc:260] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.091599 23400 ts_tablet_manager.cc:1428] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260812 19:26:56.093235 23400 tablet_bootstrap.cc:492] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:56.095835 23399 tablet_bootstrap.cc:654] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.100306 23400 tablet_bootstrap.cc:654] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.108736 23399 tablet_bootstrap.cc:492] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:56.109508 23399 ts_tablet_manager.cc:1397] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260812 19:26:56.110826 23374 raft_consensus.cc:482] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.111526 23374 raft_consensus.cc:504] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.112804 23403 tablet_bootstrap.cc:492] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:56.113334 23403 ts_tablet_manager.cc:1397] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.007s
I20260812 19:26:56.114377 23374 leader_election.cc:288] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:56.116196 22880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd7b91470ea43ed98f7ca2f6975b0a2" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:56.116411 23403 raft_consensus.cc:348] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.116953 22880 raft_consensus.cc:2454] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 0.
I20260812 19:26:56.117156 23403 raft_consensus.cc:374] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.117462 23403 raft_consensus.cc:729] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.118144 23403 consensus_queue.cc:260] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.118896 23093 leader_election.cc:302] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:56.120536 23403 ts_tablet_manager.cc:1428] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260812 19:26:56.121399 23022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd7b91470ea43ed98f7ca2f6975b0a2" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
I20260812 19:26:56.122049 23022 raft_consensus.cc:2454] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 0.
I20260812 19:26:56.121852 23399 raft_consensus.cc:348] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.122983 23399 raft_consensus.cc:374] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.123371 23399 raft_consensus.cc:729] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.123821 23403 tablet_bootstrap.cc:492] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:56.125216 23374 raft_consensus.cc:2781] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:56.126178 23374 raft_consensus.cc:482] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:56.126531 23374 raft_consensus.cc:3037] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.128242 23400 tablet_bootstrap.cc:492] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:56.128808 23400 ts_tablet_manager.cc:1397] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.015s
I20260812 19:26:56.132191 23400 raft_consensus.cc:348] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.133009 23400 raft_consensus.cc:374] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.133308 23400 raft_consensus.cc:729] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.134002 23400 consensus_queue.cc:260] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.134764 23374 raft_consensus.cc:504] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.150478 22880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd7b91470ea43ed98f7ca2f6975b0a2" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:56.151214 22880 raft_consensus.cc:3037] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.147711 23400 ts_tablet_manager.cc:1428] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260812 19:26:56.139140 23399 consensus_queue.cc:260] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.160212 23400 tablet_bootstrap.cc:492] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:56.167068 23374 leader_election.cc:288] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:56.175611 22880 raft_consensus.cc:2454] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 1.
I20260812 19:26:56.177798 23093 leader_election.cc:302] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:56.179579 23022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd7b91470ea43ed98f7ca2f6975b0a2" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:56.180397 23022 raft_consensus.cc:3037] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.180545 23374 raft_consensus.cc:2781] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:56.181094 23374 raft_consensus.cc:686] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Becoming Leader. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:26:56.181181 23400 tablet_bootstrap.cc:654] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.183542 23403 tablet_bootstrap.cc:654] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.182072 23374 consensus_queue.cc:237] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.191339 23022 raft_consensus.cc:2454] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 1.
I20260812 19:26:56.203073 23399 ts_tablet_manager.cc:1428] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.093s	user 0.011s	sys 0.009s
I20260812 19:26:56.203327 23403 tablet_bootstrap.cc:492] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:56.205087 23399 tablet_bootstrap.cc:492] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
I20260812 19:26:56.211442 23403 ts_tablet_manager.cc:1397] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.010s
I20260812 19:26:56.206097 23400 tablet_bootstrap.cc:492] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:56.212217 23400 ts_tablet_manager.cc:1397] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.014s
I20260812 19:26:56.211133 22701 catalog_manager.cc:5495] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:56.214728 23403 raft_consensus.cc:348] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.215565 23403 raft_consensus.cc:374] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.216094 23403 raft_consensus.cc:729] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.215452 23400 raft_consensus.cc:348] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.216640 23400 raft_consensus.cc:374] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.218962 23399 tablet_bootstrap.cc:654] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:56.219338 22789 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:26:56.216988 23403 consensus_queue.cc:260] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.217002 23400 raft_consensus.cc:729] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.226686 23403 ts_tablet_manager.cc:1428] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.004s
I20260812 19:26:56.227741 23403 tablet_bootstrap.cc:492] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:56.228121 23400 consensus_queue.cc:260] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.231009 23400 ts_tablet_manager.cc:1428] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260812 19:26:56.232213 23400 tablet_bootstrap.cc:492] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:56.234684 23403 tablet_bootstrap.cc:654] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.239024 23400 tablet_bootstrap.cc:654] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.244522 23413 raft_consensus.cc:482] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.245190 23413 raft_consensus.cc:504] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.249351 23413 leader_election.cc:288] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:56.249446 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfd67cc699b540a4acee00b54efc781a" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:56.250020 22880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfd67cc699b540a4acee00b54efc781a" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
W20260812 19:26:56.251210 22961 leader_election.cc:341] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:56.251747 22962 leader_election.cc:341] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.251875 23399 tablet_bootstrap.cc:492] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:56.252236 22962 leader_election.cc:302] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f; no voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691
I20260812 19:26:56.252492 23399 ts_tablet_manager.cc:1397] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.048s	user 0.005s	sys 0.024s
I20260812 19:26:56.253482 23413 raft_consensus.cc:2726] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:56.254392 23403 tablet_bootstrap.cc:492] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:56.255012 23403 ts_tablet_manager.cc:1397] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.006s
I20260812 19:26:56.255941 23399 raft_consensus.cc:348] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.256778 23399 raft_consensus.cc:374] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.257066 23399 raft_consensus.cc:729] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.257550 23400 tablet_bootstrap.cc:492] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:56.257714 23403 raft_consensus.cc:348] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.258423 23403 raft_consensus.cc:374] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.257916 23399 consensus_queue.cc:260] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.258469 23400 ts_tablet_manager.cc:1397] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.009s
I20260812 19:26:56.258710 23403 raft_consensus.cc:729] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.259009 23374 raft_consensus.cc:482] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.259562 23403 consensus_queue.cc:260] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.259501 23374 raft_consensus.cc:504] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.261572 23403 ts_tablet_manager.cc:1428] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260812 19:26:56.262869 23403 tablet_bootstrap.cc:492] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:56.263629 23399 ts_tablet_manager.cc:1428] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260812 19:26:56.264624 23399 tablet_bootstrap.cc:492] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
I20260812 19:26:56.267675 22880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3babac97ab8b4ff0a8c22d7011775e86" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:56.268007 23374 leader_election.cc:288] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:56.269577 23403 tablet_bootstrap.cc:654] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.270831 23399 tablet_bootstrap.cc:654] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.271636 23400 raft_consensus.cc:348] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.272480 23400 raft_consensus.cc:374] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.272769 23400 raft_consensus.cc:729] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.273586 23400 consensus_queue.cc:260] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
W20260812 19:26:56.270367 23093 leader_election.cc:341] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.282227 23403 tablet_bootstrap.cc:492] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:56.269524 23022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3babac97ab8b4ff0a8c22d7011775e86" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
I20260812 19:26:56.282945 23403 ts_tablet_manager.cc:1397] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260812 19:26:56.284608 23399 tablet_bootstrap.cc:492] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:56.285136 23399 ts_tablet_manager.cc:1397] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.012s
I20260812 19:26:56.286248 23403 raft_consensus.cc:348] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.287323 23403 raft_consensus.cc:374] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.287735 23403 raft_consensus.cc:729] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.288036 23399 raft_consensus.cc:348] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.288808 23399 raft_consensus.cc:374] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.289291 23399 raft_consensus.cc:729] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.288707 23403 consensus_queue.cc:260] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.289986 23399 consensus_queue.cc:260] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.291713 23403 ts_tablet_manager.cc:1428] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260812 19:26:56.292696 23399 ts_tablet_manager.cc:1428] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260812 19:26:56.292766 23400 ts_tablet_manager.cc:1428] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260812 19:26:56.293954 23399 tablet_bootstrap.cc:492] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
I20260812 19:26:56.294216 23400 tablet_bootstrap.cc:492] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:56.292771 23403 tablet_bootstrap.cc:492] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:56.300614 23400 tablet_bootstrap.cc:654] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.305569 23403 tablet_bootstrap.cc:654] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:56.292714 23093 leader_election.cc:341] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.307685 23093 leader_election.cc:302] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:56.309052 23399 tablet_bootstrap.cc:654] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.309823 23420 raft_consensus.cc:2726] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:56.310863 23400 tablet_bootstrap.cc:492] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:56.311424 23400 ts_tablet_manager.cc:1397] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.002s
I20260812 19:26:56.314421 23400 raft_consensus.cc:348] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.315191 23400 raft_consensus.cc:374] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.315500 23400 raft_consensus.cc:729] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.316009 23414 raft_consensus.cc:482] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.316213 23400 consensus_queue.cc:260] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.316689 23414 raft_consensus.cc:504] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.318970 23400 ts_tablet_manager.cc:1428] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260812 19:26:56.319279 23414 leader_election.cc:288] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:56.320406 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6752ffef7c45b69844f73592ca7e54" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:56.321035 23022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6752ffef7c45b69844f73592ca7e54" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
W20260812 19:26:56.322001 22822 leader_election.cc:341] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.322398 23403 tablet_bootstrap.cc:492] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
W20260812 19:26:56.322506 22824 leader_election.cc:341] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.323124 23403 ts_tablet_manager.cc:1397] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.031s	user 0.004s	sys 0.014s
I20260812 19:26:56.323417 23400 tablet_bootstrap.cc:492] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:56.323119 22824 leader_election.cc:302] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3; no voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691
I20260812 19:26:56.324651 23414 raft_consensus.cc:2726] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:56.327473 23399 tablet_bootstrap.cc:492] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:56.327106 23403 raft_consensus.cc:348] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.327929 23403 raft_consensus.cc:374] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.328068 23399 ts_tablet_manager.cc:1397] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.005s
I20260812 19:26:56.328262 23403 raft_consensus.cc:729] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.329114 23403 consensus_queue.cc:260] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.330500 23420 raft_consensus.cc:482] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.330786 23400 tablet_bootstrap.cc:654] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.331063 23420 raft_consensus.cc:504] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.331331 23399 raft_consensus.cc:348] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.332132 23399 raft_consensus.cc:374] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.332408 23399 raft_consensus.cc:729] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.333441 23420 leader_election.cc:288] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:56.333159 23399 consensus_queue.cc:260] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.335090 23022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b9d00b660274a0eb9e6ed18ef5718ed" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
I20260812 19:26:56.335534 23403 ts_tablet_manager.cc:1428] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260812 19:26:56.335505 23399 ts_tablet_manager.cc:1428] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260812 19:26:56.336828 23403 tablet_bootstrap.cc:492] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:56.336834 23399 tablet_bootstrap.cc:492] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
W20260812 19:26:56.337340 23093 leader_election.cc:341] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.339593 22880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b9d00b660274a0eb9e6ed18ef5718ed" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:56.340296 22880 raft_consensus.cc:2454] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 0.
I20260812 19:26:56.341533 23093 leader_election.cc:302] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:56.343863 23399 tablet_bootstrap.cc:654] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.343868 23403 tablet_bootstrap.cc:654] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.348042 23420 raft_consensus.cc:2781] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:56.348605 23420 raft_consensus.cc:482] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:56.349036 23420 raft_consensus.cc:3037] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.358424 23399 tablet_bootstrap.cc:492] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:56.358332 23403 tablet_bootstrap.cc:492] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:56.359155 23399 ts_tablet_manager.cc:1397] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.012s
I20260812 19:26:56.362255 23399 raft_consensus.cc:348] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.363075 23399 raft_consensus.cc:374] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.359165 23403 ts_tablet_manager.cc:1397] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260812 19:26:56.363443 23399 raft_consensus.cc:729] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.364279 23399 consensus_queue.cc:260] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.366076 23403 raft_consensus.cc:348] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.366707 23399 ts_tablet_manager.cc:1428] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260812 19:26:56.366946 23403 raft_consensus.cc:374] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.367295 23403 raft_consensus.cc:729] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.368446 23399 tablet_bootstrap.cc:492] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
I20260812 19:26:56.368067 23403 consensus_queue.cc:260] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.372670 23403 ts_tablet_manager.cc:1428] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260812 19:26:56.373745 23403 tablet_bootstrap.cc:492] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:56.375926 23399 tablet_bootstrap.cc:654] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.382354 23403 tablet_bootstrap.cc:654] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.389262 23399 tablet_bootstrap.cc:492] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:56.390133 23399 ts_tablet_manager.cc:1397] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260812 19:26:56.394243 23399 raft_consensus.cc:348] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.395442 23399 raft_consensus.cc:374] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.395896 23399 raft_consensus.cc:729] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.396926 23399 consensus_queue.cc:260] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.400460 23399 ts_tablet_manager.cc:1428] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260812 19:26:56.401047 23403 tablet_bootstrap.cc:492] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:56.400820 23420 raft_consensus.cc:504] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.401722 23399 tablet_bootstrap.cc:492] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
I20260812 19:26:56.401767 23403 ts_tablet_manager.cc:1397] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.013s
I20260812 19:26:56.405112 23403 raft_consensus.cc:348] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.405989 23403 raft_consensus.cc:374] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.406330 23403 raft_consensus.cc:729] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.407161 23403 consensus_queue.cc:260] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.408903 23399 tablet_bootstrap.cc:654] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.410115 23403 ts_tablet_manager.cc:1428] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260812 19:26:56.411301 23403 tablet_bootstrap.cc:492] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:56.420985 23403 tablet_bootstrap.cc:654] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.428773 23399 tablet_bootstrap.cc:492] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:56.429382 23399 ts_tablet_manager.cc:1397] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.009s
I20260812 19:26:56.432107 23403 tablet_bootstrap.cc:492] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:56.432124 23399 raft_consensus.cc:348] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.432893 23403 ts_tablet_manager.cc:1397] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.002s
I20260812 19:26:56.433076 23399 raft_consensus.cc:374] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.433472 23399 raft_consensus.cc:729] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.434198 23399 consensus_queue.cc:260] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.435738 23399 ts_tablet_manager.cc:1428] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260812 19:26:56.436146 23403 raft_consensus.cc:348] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.436672 23399 tablet_bootstrap.cc:492] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691: Bootstrap starting.
I20260812 19:26:56.436980 23403 raft_consensus.cc:374] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.437310 23403 raft_consensus.cc:729] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.438014 23403 consensus_queue.cc:260] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.440434 23403 ts_tablet_manager.cc:1428] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260812 19:26:56.441387 23403 tablet_bootstrap.cc:492] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f: Bootstrap starting.
I20260812 19:26:56.442785 23399 tablet_bootstrap.cc:654] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.444315 23420 leader_election.cc:288] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:56.445842 22880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b9d00b660274a0eb9e6ed18ef5718ed" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:56.446503 22880 raft_consensus.cc:3037] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.447242 23403 tablet_bootstrap.cc:654] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.450058 23022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b9d00b660274a0eb9e6ed18ef5718ed" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
W20260812 19:26:56.451615 23093 leader_election.cc:341] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.459288 23399 tablet_bootstrap.cc:492] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691: No bootstrap required, opened a new log
I20260812 19:26:56.460019 23399 ts_tablet_manager.cc:1397] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.008s
I20260812 19:26:56.461939 23413 raft_consensus.cc:482] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.462495 23413 raft_consensus.cc:504] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.463596 23399 raft_consensus.cc:348] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.464560 23399 raft_consensus.cc:374] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.464597 23413 leader_election.cc:288] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:56.465003 23399 raft_consensus.cc:729] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.466503 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be1fce37be484514832213da63481039" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:56.467250 23157 raft_consensus.cc:2454] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 0.
I20260812 19:26:56.467191 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be1fce37be484514832213da63481039" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:56.468539 22882 raft_consensus.cc:2454] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 0.
I20260812 19:26:56.468851 22961 leader_election.cc:302] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:56.470913 23413 raft_consensus.cc:2781] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:56.471472 23413 raft_consensus.cc:482] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:56.471901 23413 raft_consensus.cc:3037] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.472374 22880 raft_consensus.cc:2454] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 1.
I20260812 19:26:56.473523 23093 leader_election.cc:302] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:56.474237 23420 raft_consensus.cc:2781] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:56.475020 23420 raft_consensus.cc:686] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Becoming Leader. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:26:56.475818 23420 consensus_queue.cc:237] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.480788 23374 raft_consensus.cc:482] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.481328 23374 raft_consensus.cc:504] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.483064 23374 leader_election.cc:288] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:56.482560 23413 raft_consensus.cc:504] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.483779 23400 tablet_bootstrap.cc:492] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:56.484336 23400 ts_tablet_manager.cc:1397] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.161s	user 0.046s	sys 0.060s
I20260812 19:26:56.484730 23022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c971d430cc364661b176d7acc3050088" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
I20260812 19:26:56.485212 23413 leader_election.cc:288] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:56.485473 23022 raft_consensus.cc:2454] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 0.
I20260812 19:26:56.486337 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be1fce37be484514832213da63481039" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:56.487021 23157 raft_consensus.cc:3037] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.470856 23399 consensus_queue.cc:260] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.488196 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be1fce37be484514832213da63481039" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:56.488533 23403 tablet_bootstrap.cc:492] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f: No bootstrap required, opened a new log
I20260812 19:26:56.488858 22882 raft_consensus.cc:3037] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.489100 23399 ts_tablet_manager.cc:1428] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260812 19:26:56.489132 23403 ts_tablet_manager.cc:1397] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.020s
I20260812 19:26:56.491202 23093 leader_election.cc:302] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:56.493360 23420 raft_consensus.cc:2781] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:56.493709 23420 raft_consensus.cc:482] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:56.494046 23420 raft_consensus.cc:3037] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.498886 22705 catalog_manager.cc:5495] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:56.500589 22882 raft_consensus.cc:2454] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 1.
I20260812 19:26:56.501138 23374 raft_consensus.cc:482] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.501668 23374 raft_consensus.cc:504] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.501749 22962 leader_election.cc:302] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f; no voters: 
I20260812 19:26:56.502596 23413 raft_consensus.cc:2781] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:56.502923 22880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c971d430cc364661b176d7acc3050088" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:56.504436 23413 raft_consensus.cc:686] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Becoming Leader. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:26:56.505321 23413 consensus_queue.cc:237] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
W20260812 19:26:56.505950 23093 leader_election.cc:341] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.506532 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6752ffef7c45b69844f73592ca7e54" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:56.503659 23374 leader_election.cc:288] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:56.507514 23022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6752ffef7c45b69844f73592ca7e54" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
I20260812 19:26:56.508455 23022 raft_consensus.cc:2454] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 0.
I20260812 19:26:56.508559 23157 raft_consensus.cc:2454] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 1.
I20260812 19:26:56.509969 22882 raft_consensus.cc:2454] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 0.
I20260812 19:26:56.510434 23093 leader_election.cc:302] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:56.511320 23374 raft_consensus.cc:2781] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:56.513423 23403 raft_consensus.cc:348] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.514151 23403 raft_consensus.cc:374] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.514406 23403 raft_consensus.cc:729] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.515098 23403 consensus_queue.cc:260] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.516064 23400 raft_consensus.cc:348] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.516827 23400 raft_consensus.cc:374] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.517093 23400 raft_consensus.cc:729] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.517124 23403 ts_tablet_manager.cc:1428] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.003s
I20260812 19:26:56.511782 23374 raft_consensus.cc:482] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:56.518051 23374 raft_consensus.cc:3037] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.522950 23420 raft_consensus.cc:504] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.523000 23400 consensus_queue.cc:260] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.524375 23374 raft_consensus.cc:504] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.525235 23420 leader_election.cc:288] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:56.526515 23022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c971d430cc364661b176d7acc3050088" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:56.527081 23022 raft_consensus.cc:3037] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.527274 23400 ts_tablet_manager.cc:1428] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.002s
I20260812 19:26:56.528306 23400 tablet_bootstrap.cc:492] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:56.530877 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c971d430cc364661b176d7acc3050088" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3"
W20260812 19:26:56.532424 23093 leader_election.cc:341] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.533344 23374 leader_election.cc:288] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:56.534523 23400 tablet_bootstrap.cc:654] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.534855 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6752ffef7c45b69844f73592ca7e54" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:56.535569 23026 raft_consensus.cc:3037] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.535666 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6752ffef7c45b69844f73592ca7e54" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:56.537346 22882 raft_consensus.cc:3037] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.536761 22705 catalog_manager.cc:5495] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f reported cstate change: term changed from 0 to 1, leader changed from <none> to 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2). New cstate: current_term: 1 leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:56.536763 23022 raft_consensus.cc:2454] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 1.
I20260812 19:26:56.545408 23413 raft_consensus.cc:482] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.545962 23413 raft_consensus.cc:504] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.547151 23400 tablet_bootstrap.cc:492] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:56.546247 23093 leader_election.cc:302] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 271fa24c603a441fa865c54511adbdc3
I20260812 19:26:56.547792 23400 ts_tablet_manager.cc:1397] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260812 19:26:56.545081 22882 raft_consensus.cc:2454] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 1.
I20260812 19:26:56.548988 22880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3babac97ab8b4ff0a8c22d7011775e86" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:56.550374 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3babac97ab8b4ff0a8c22d7011775e86" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:56.548998 23413 leader_election.cc:288] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:56.551118 23157 raft_consensus.cc:2454] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 0.
I20260812 19:26:56.550989 23400 raft_consensus.cc:348] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.552155 23400 raft_consensus.cc:374] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.552527 23400 raft_consensus.cc:729] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.552814 22961 leader_election.cc:302] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:56.553819 23026 raft_consensus.cc:2454] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 1.
I20260812 19:26:56.553424 23400 consensus_queue.cc:260] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
W20260812 19:26:56.553989 22962 leader_election.cc:341] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.554903 23374 raft_consensus.cc:2781] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:56.555400 23413 raft_consensus.cc:2781] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:56.556162 23093 leader_election.cc:302] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:56.555485 23374 raft_consensus.cc:686] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Becoming Leader. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:26:56.557149 23400 ts_tablet_manager.cc:1428] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260812 19:26:56.557372 23374 consensus_queue.cc:237] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.558246 23400 tablet_bootstrap.cc:492] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:56.559154 23420 raft_consensus.cc:2781] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:56.559700 23420 raft_consensus.cc:686] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Becoming Leader. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:26:56.560504 23420 consensus_queue.cc:237] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.556522 23413 raft_consensus.cc:482] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:56.564898 23413 raft_consensus.cc:3037] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.565503 23400 tablet_bootstrap.cc:654] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.576041 23413 raft_consensus.cc:504] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.577929 23420 raft_consensus.cc:482] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.580128 22880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3babac97ab8b4ff0a8c22d7011775e86" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3"
W20260812 19:26:56.582535 22962 leader_election.cc:341] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.584368 23259 raft_consensus.cc:482] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.584260 23420 raft_consensus.cc:504] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.585036 23259 raft_consensus.cc:504] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.586385 22705 catalog_manager.cc:5495] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:56.587244 23259 leader_election.cc:288] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:56.588793 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c1c937c48341fda945b5dc79d12d3a" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:56.589294 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c1c937c48341fda945b5dc79d12d3a" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:56.589515 22882 raft_consensus.cc:2454] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 0.
I20260812 19:26:56.589426 22880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "024f88b62c6a4987ac7154abbb3cf1f9" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:56.589964 23157 raft_consensus.cc:2454] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 0.
I20260812 19:26:56.590955 22962 leader_election.cc:302] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f; no voters: 
I20260812 19:26:56.592020 23259 raft_consensus.cc:2781] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:56.592365 23259 raft_consensus.cc:482] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:56.590664 22880 raft_consensus.cc:2454] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 0.
I20260812 19:26:56.592705 23259 raft_consensus.cc:3037] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.593922 23093 leader_election.cc:302] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:56.595335 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3babac97ab8b4ff0a8c22d7011775e86" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:56.596160 23157 raft_consensus.cc:3037] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.601617 23420 leader_election.cc:288] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:56.602718 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "024f88b62c6a4987ac7154abbb3cf1f9" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
I20260812 19:26:56.603435 23026 raft_consensus.cc:2454] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 0.
I20260812 19:26:56.602746 23413 leader_election.cc:288] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:56.602427 23420 raft_consensus.cc:2781] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:56.604993 23420 raft_consensus.cc:482] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:56.605444 23420 raft_consensus.cc:3037] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.607972 23259 raft_consensus.cc:504] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.609759 23259 leader_election.cc:288] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:56.611104 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c1c937c48341fda945b5dc79d12d3a" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:56.611797 23162 raft_consensus.cc:3037] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.612684 22705 catalog_manager.cc:5495] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:56.613668 23400 tablet_bootstrap.cc:492] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:56.614399 23400 ts_tablet_manager.cc:1397] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.031s
I20260812 19:26:56.616842 23157 raft_consensus.cc:2454] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 1.
I20260812 19:26:56.617244 23400 raft_consensus.cc:348] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.617934 23400 raft_consensus.cc:374] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.618216 23400 raft_consensus.cc:729] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.618031 22961 leader_election.cc:302] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 271fa24c603a441fa865c54511adbdc3
I20260812 19:26:56.618934 23400 consensus_queue.cc:260] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.620429 23259 raft_consensus.cc:2781] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:56.621125 23400 ts_tablet_manager.cc:1428] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260812 19:26:56.621830 23259 raft_consensus.cc:686] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Becoming Leader. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:26:56.623378 23400 tablet_bootstrap.cc:492] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3: Bootstrap starting.
I20260812 19:26:56.623292 23259 consensus_queue.cc:237] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.610576 22880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c1c937c48341fda945b5dc79d12d3a" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:56.626012 22880 raft_consensus.cc:3037] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.633050 23420 raft_consensus.cc:504] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.635186 23420 leader_election.cc:288] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:56.636349 23400 tablet_bootstrap.cc:654] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.636361 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "024f88b62c6a4987ac7154abbb3cf1f9" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:56.637437 22882 raft_consensus.cc:3037] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.642071 22880 raft_consensus.cc:2454] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 1.
I20260812 19:26:56.642735 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "024f88b62c6a4987ac7154abbb3cf1f9" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:56.644287 23026 raft_consensus.cc:3037] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.646026 23400 tablet_bootstrap.cc:492] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3: No bootstrap required, opened a new log
I20260812 19:26:56.646121 22882 raft_consensus.cc:2454] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 1.
I20260812 19:26:56.646569 23400 ts_tablet_manager.cc:1397] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260812 19:26:56.643541 23162 raft_consensus.cc:2454] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 1.
I20260812 19:26:56.647289 23093 leader_election.cc:302] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:56.648144 23420 raft_consensus.cc:2781] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:56.647954 22961 leader_election.cc:302] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:56.648600 23420 raft_consensus.cc:686] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Becoming Leader. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:26:56.649111 23413 raft_consensus.cc:2781] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:56.649441 23420 consensus_queue.cc:237] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.650213 23413 raft_consensus.cc:686] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Becoming Leader. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:26:56.651244 23413 consensus_queue.cc:237] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.652757 23400 raft_consensus.cc:348] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.653949 23400 raft_consensus.cc:374] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.654511 23400 raft_consensus.cc:729] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.655514 23400 consensus_queue.cc:260] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.658190 23026 raft_consensus.cc:2454] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 1.
I20260812 19:26:56.661880 23400 ts_tablet_manager.cc:1428] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260812 19:26:56.673717 22703 catalog_manager.cc:5495] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f reported cstate change: term changed from 0 to 1, leader changed from <none> to 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2). New cstate: current_term: 1 leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:56.683396 22705 catalog_manager.cc:5495] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:56.688825 22703 catalog_manager.cc:5495] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f reported cstate change: term changed from 0 to 1, leader changed from <none> to 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2). New cstate: current_term: 1 leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:56.702056 23420 consensus_queue.cc:1035] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:56.713542 23419 consensus_queue.cc:1035] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:56.781646 23414 raft_consensus.cc:482] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.782258 23414 raft_consensus.cc:504] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.783902 23414 leader_election.cc:288] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:56.784888 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c971d430cc364661b176d7acc3050088" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
I20260812 19:26:56.784999 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c971d430cc364661b176d7acc3050088" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:56.785974 23026 raft_consensus.cc:2379] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 271fa24c603a441fa865c54511adbdc3 in current term 1: Already voted for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in this term.
I20260812 19:26:56.786962 22824 leader_election.cc:302] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3; no voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691
I20260812 19:26:56.787766 23414 raft_consensus.cc:3037] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.793814 23414 raft_consensus.cc:2726] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:56.816370 23420 raft_consensus.cc:482] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.817121 23420 raft_consensus.cc:504] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.819741 23420 leader_election.cc:288] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:56.820572 22880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfd67cc699b540a4acee00b54efc781a" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:56.820890 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfd67cc699b540a4acee00b54efc781a" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
I20260812 19:26:56.821360 22880 raft_consensus.cc:2454] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 0.
I20260812 19:26:56.821753 23026 raft_consensus.cc:2454] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 0.
I20260812 19:26:56.822427 23093 leader_election.cc:302] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:56.823432 23420 raft_consensus.cc:2781] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:56.823912 23420 raft_consensus.cc:482] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:56.824304 23420 raft_consensus.cc:3037] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.831112 23420 raft_consensus.cc:504] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.833088 23420 leader_election.cc:288] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:26:56.833928 22880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfd67cc699b540a4acee00b54efc781a" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:56.834195 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfd67cc699b540a4acee00b54efc781a" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:56.834728 22880 raft_consensus.cc:3037] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.834888 23026 raft_consensus.cc:3037] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.842495 22880 raft_consensus.cc:2454] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 1.
I20260812 19:26:56.842495 23026 raft_consensus.cc:2454] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 1.
I20260812 19:26:56.843909 23093 leader_election.cc:302] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:56.844640 23420 raft_consensus.cc:2781] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:56.845176 23420 raft_consensus.cc:686] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Becoming Leader. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:26:56.846057 23420 consensus_queue.cc:237] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.854743 23259 raft_consensus.cc:482] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.855368 23259 raft_consensus.cc:504] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.855268 22705 catalog_manager.cc:5495] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:56.857888 23259 leader_election.cc:288] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:56.859086 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b9d00b660274a0eb9e6ed18ef5718ed" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:56.859166 22880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b9d00b660274a0eb9e6ed18ef5718ed" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "271fa24c603a441fa865c54511adbdc3" is_pre_election: true
I20260812 19:26:56.860184 22880 raft_consensus.cc:2379] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71c459a9ab8f405283add8f5c2e1f17f in current term 1: Already voted for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in this term.
I20260812 19:26:56.861117 22962 leader_election.cc:302] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f; no voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691
I20260812 19:26:56.861794 23259 raft_consensus.cc:3037] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.868588 23259 raft_consensus.cc:2726] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:56.876797 23420 consensus_queue.cc:1035] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:56.886828 23420 consensus_queue.cc:1035] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:56.898379 23414 raft_consensus.cc:482] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.898967 23414 raft_consensus.cc:504] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:56.900895 23414 leader_election.cc:288] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:56.901496 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3babac97ab8b4ff0a8c22d7011775e86" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f" is_pre_election: true
I20260812 19:26:56.902427 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3babac97ab8b4ff0a8c22d7011775e86" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" is_pre_election: true
I20260812 19:26:56.903329 23162 raft_consensus.cc:2379] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 271fa24c603a441fa865c54511adbdc3 in current term 1: Already voted for candidate 71c459a9ab8f405283add8f5c2e1f17f in this term.
I20260812 19:26:56.904239 22822 leader_election.cc:302] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3; no voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691
I20260812 19:26:56.904909 23414 raft_consensus.cc:3037] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.910130 23414 raft_consensus.cc:2726] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:56.946125 23374 consensus_queue.cc:1035] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:56.957469 23419 consensus_queue.cc:1035] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:56.967222 23420 consensus_queue.cc:1035] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:56.984768 23259 consensus_queue.cc:1035] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:56.985853 23420 consensus_queue.cc:1035] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:57.002525 23162 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3dd7b91470ea43ed98f7ca2f6975b0a2"
dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
mode: GRACEFUL
new_leader_uuid: "271fa24c603a441fa865c54511adbdc3"
 from {username='slave'} at 127.0.0.1:50540
I20260812 19:26:57.003487 23162 raft_consensus.cc:595] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Received request to transfer leadership to TS 271fa24c603a441fa865c54511adbdc3
I20260812 19:26:57.014210 23022 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "99c1c937c48341fda945b5dc79d12d3a"
dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
mode: GRACEFUL
new_leader_uuid: "271fa24c603a441fa865c54511adbdc3"
 from {username='slave'} at 127.0.0.1:40000
I20260812 19:26:57.014922 23022 raft_consensus.cc:595] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Received request to transfer leadership to TS 271fa24c603a441fa865c54511adbdc3
I20260812 19:26:57.021301 23020 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3babac97ab8b4ff0a8c22d7011775e86"
dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
mode: GRACEFUL
new_leader_uuid: "271fa24c603a441fa865c54511adbdc3"
 from {username='slave'} at 127.0.0.1:40000
I20260812 19:26:57.021960 23020 raft_consensus.cc:595] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Received request to transfer leadership to TS 271fa24c603a441fa865c54511adbdc3
I20260812 19:26:57.024277 23413 consensus_queue.cc:1035] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:57.029971 23157 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5b9d00b660274a0eb9e6ed18ef5718ed"
dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
mode: GRACEFUL
new_leader_uuid: "271fa24c603a441fa865c54511adbdc3"
 from {username='slave'} at 127.0.0.1:50540
I20260812 19:26:57.030838 23157 raft_consensus.cc:595] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Received request to transfer leadership to TS 271fa24c603a441fa865c54511adbdc3
I20260812 19:26:57.037034 23419 consensus_queue.cc:1035] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:57.037477 23157 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "024f88b62c6a4987ac7154abbb3cf1f9"
dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
mode: GRACEFUL
new_leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
 from {username='slave'} at 127.0.0.1:50540
I20260812 19:26:57.038264 23157 raft_consensus.cc:595] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Received request to transfer leadership to TS 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:57.044765 23157 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6a6752ffef7c45b69844f73592ca7e54"
dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
mode: GRACEFUL
new_leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
 from {username='slave'} at 127.0.0.1:50540
I20260812 19:26:57.045513 23157 raft_consensus.cc:595] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Received request to transfer leadership to TS 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:57.052104 23419 consensus_queue.cc:1035] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:57.052909 23157 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c971d430cc364661b176d7acc3050088"
dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
mode: GRACEFUL
new_leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
 from {username='slave'} at 127.0.0.1:50540
I20260812 19:26:57.053673 23157 raft_consensus.cc:595] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Received request to transfer leadership to TS 71c459a9ab8f405283add8f5c2e1f17f
I20260812 19:26:57.060799 23420 raft_consensus.cc:979] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691: : Instructing follower 71c459a9ab8f405283add8f5c2e1f17f to start an election
I20260812 19:26:57.061338 23419 raft_consensus.cc:1067] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Signalling peer 71c459a9ab8f405283add8f5c2e1f17f to start an election
I20260812 19:26:57.062989 23413 consensus_queue.cc:1035] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:57.074728 23026 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "024f88b62c6a4987ac7154abbb3cf1f9"
dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
 from {username='slave'} at 127.0.0.1:39986
I20260812 19:26:57.075518 23026 raft_consensus.cc:482] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:57.076004 23026 raft_consensus.cc:3037] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.086184 23026 raft_consensus.cc:504] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.089195 22885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "024f88b62c6a4987ac7154abbb3cf1f9" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:57.089974 23413 raft_consensus.cc:979] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f: : Instructing follower 271fa24c603a441fa865c54511adbdc3 to start an election
I20260812 19:26:57.089838 22885 raft_consensus.cc:3037] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.089709 23026 leader_election.cc:288] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 2 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:57.090299 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "024f88b62c6a4987ac7154abbb3cf1f9" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:57.091059 23157 raft_consensus.cc:3032] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:57.091144 23413 raft_consensus.cc:1067] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Signalling peer 271fa24c603a441fa865c54511adbdc3 to start an election
I20260812 19:26:57.091430 23157 raft_consensus.cc:729] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:26:57.092363 23157 consensus_queue.cc:260] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.093509 23157 raft_consensus.cc:3037] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.094110 23259 consensus_queue.cc:1035] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:57.101984 23157 raft_consensus.cc:2454] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 2.
I20260812 19:26:57.104063 22961 leader_election.cc:302] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:57.104914 22882 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3babac97ab8b4ff0a8c22d7011775e86"
dest_uuid: "271fa24c603a441fa865c54511adbdc3"
 from {username='slave'} at 127.0.0.1:39296
I20260812 19:26:57.105185 23413 raft_consensus.cc:2781] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:57.105551 22882 raft_consensus.cc:482] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:57.105778 23413 raft_consensus.cc:686] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Becoming Leader. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:26:57.105993 22882 raft_consensus.cc:3037] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.106783 23413 consensus_queue.cc:237] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.104199 22885 raft_consensus.cc:2454] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 2.
I20260812 19:26:57.113176 22882 raft_consensus.cc:504] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.115970 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3babac97ab8b4ff0a8c22d7011775e86" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:57.116458 22882 leader_election.cc:288] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 2 election: Requested vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:57.117359 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3babac97ab8b4ff0a8c22d7011775e86" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:57.116638 23026 raft_consensus.cc:3032] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:57.117940 23157 raft_consensus.cc:3037] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.118040 23026 raft_consensus.cc:729] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:26:57.118937 23026 consensus_queue.cc:260] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.120101 23026 raft_consensus.cc:3037] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.124838 23157 raft_consensus.cc:2454] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 2.
I20260812 19:26:57.122538 22701 catalog_manager.cc:5495] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f reported cstate change: term changed from 1 to 2, leader changed from d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3) to 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2). New cstate: current_term: 2 leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:57.125967 22822 leader_election.cc:302] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:26:57.126744 23511 raft_consensus.cc:2781] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:57.127197 23511 raft_consensus.cc:686] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Becoming Leader. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:57.127882 23511 consensus_queue.cc:237] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.132514 23026 raft_consensus.cc:2454] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 2.
I20260812 19:26:57.137277 22711 catalog_manager.cc:5495] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 reported cstate change: term changed from 1 to 2, leader changed from 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2) to 271fa24c603a441fa865c54511adbdc3 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "271fa24c603a441fa865c54511adbdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:57.198697 23413 consensus_queue.cc:1035] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:57.206357 23413 raft_consensus.cc:979] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f: : Instructing follower 271fa24c603a441fa865c54511adbdc3 to start an election
I20260812 19:26:57.206898 23413 raft_consensus.cc:1067] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Signalling peer 271fa24c603a441fa865c54511adbdc3 to start an election
I20260812 19:26:57.209517 22885 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "99c1c937c48341fda945b5dc79d12d3a"
dest_uuid: "271fa24c603a441fa865c54511adbdc3"
 from {username='slave'} at 127.0.0.1:39296
I20260812 19:26:57.211051 22885 raft_consensus.cc:482] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:57.212168 23374 raft_consensus.cc:979] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691: : Instructing follower 271fa24c603a441fa865c54511adbdc3 to start an election
I20260812 19:26:57.211493 22885 raft_consensus.cc:3037] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.212677 23374 raft_consensus.cc:1067] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Signalling peer 271fa24c603a441fa865c54511adbdc3 to start an election
I20260812 19:26:57.213028 23259 consensus_queue.cc:1035] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:57.214561 22882 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3dd7b91470ea43ed98f7ca2f6975b0a2"
dest_uuid: "271fa24c603a441fa865c54511adbdc3"
 from {username='slave'} at 127.0.0.1:39306
I20260812 19:26:57.215247 22882 raft_consensus.cc:482] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:57.216909 22882 raft_consensus.cc:3037] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.220263 22885 raft_consensus.cc:504] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.224566 22882 raft_consensus.cc:504] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.227869 22885 leader_election.cc:288] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 2 election: Requested vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:57.228482 23020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c1c937c48341fda945b5dc79d12d3a" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:57.229382 23020 raft_consensus.cc:3032] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:57.229697 23020 raft_consensus.cc:729] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:26:57.230479 23020 consensus_queue.cc:260] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.231204 23026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd7b91470ea43ed98f7ca2f6975b0a2" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:57.231858 23026 raft_consensus.cc:3037] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.231873 23020 raft_consensus.cc:3037] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.238930 23374 consensus_queue.cc:1035] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:57.239298 23026 raft_consensus.cc:2454] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 2.
I20260812 19:26:57.240588 22824 leader_election.cc:302] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f; no voters: 
I20260812 19:26:57.241526 23511 raft_consensus.cc:2781] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:57.241935 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c1c937c48341fda945b5dc79d12d3a" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:57.241981 23511 raft_consensus.cc:686] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Becoming Leader. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:57.242398 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd7b91470ea43ed98f7ca2f6975b0a2" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:57.243151 23157 raft_consensus.cc:3032] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:57.243487 23157 raft_consensus.cc:729] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:26:57.243345 23511 consensus_queue.cc:237] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.242555 23162 raft_consensus.cc:3037] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.244434 23157 consensus_queue.cc:260] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.245576 23157 raft_consensus.cc:3037] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.249311 22882 leader_election.cc:288] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 2 election: Requested vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:57.252555 23020 raft_consensus.cc:2454] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 2.
I20260812 19:26:57.256415 23157 raft_consensus.cc:2454] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 2.
I20260812 19:26:57.259653 22824 leader_election.cc:302] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f; no voters: 
I20260812 19:26:57.263154 23511 raft_consensus.cc:2781] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:57.262730 22701 catalog_manager.cc:5495] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 reported cstate change: term changed from 1 to 2, leader changed from d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3) to 271fa24c603a441fa865c54511adbdc3 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "271fa24c603a441fa865c54511adbdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:57.263689 23511 raft_consensus.cc:686] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Becoming Leader. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:57.264559 23511 consensus_queue.cc:237] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.265518 23420 consensus_queue.cc:1035] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:57.266641 23162 raft_consensus.cc:2454] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 2.
I20260812 19:26:57.283054 22703 catalog_manager.cc:5495] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 reported cstate change: term changed from 1 to 2, leader changed from 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2) to 271fa24c603a441fa865c54511adbdc3 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "271fa24c603a441fa865c54511adbdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:57.405480 23420 raft_consensus.cc:979] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691: : Instructing follower 271fa24c603a441fa865c54511adbdc3 to start an election
I20260812 19:26:57.405998 23374 raft_consensus.cc:1067] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Signalling peer 271fa24c603a441fa865c54511adbdc3 to start an election
I20260812 19:26:57.407490 22885 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5b9d00b660274a0eb9e6ed18ef5718ed"
dest_uuid: "271fa24c603a441fa865c54511adbdc3"
 from {username='slave'} at 127.0.0.1:39306
I20260812 19:26:57.408083 22885 raft_consensus.cc:482] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:57.408455 22885 raft_consensus.cc:3037] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.414111 22885 raft_consensus.cc:504] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.415803 22885 leader_election.cc:288] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 2 election: Requested vote from peers 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:57.416857 23020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b9d00b660274a0eb9e6ed18ef5718ed" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:26:57.416901 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b9d00b660274a0eb9e6ed18ef5718ed" candidate_uuid: "271fa24c603a441fa865c54511adbdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:57.417546 23020 raft_consensus.cc:3037] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.417610 23162 raft_consensus.cc:3032] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:57.418009 23162 raft_consensus.cc:729] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:26:57.418696 23162 consensus_queue.cc:260] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.419665 23162 raft_consensus.cc:3037] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.423733 23020 raft_consensus.cc:2454] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 2.
I20260812 19:26:57.425151 22824 leader_election.cc:302] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f; no voters: 
I20260812 19:26:57.425935 23511 raft_consensus.cc:2781] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:57.426062 23162 raft_consensus.cc:2454] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 271fa24c603a441fa865c54511adbdc3 in term 2.
I20260812 19:26:57.426580 23511 raft_consensus.cc:686] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Becoming Leader. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:26:57.427958 23511 consensus_queue.cc:237] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.434770 22703 catalog_manager.cc:5495] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 reported cstate change: term changed from 1 to 2, leader changed from d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3) to 271fa24c603a441fa865c54511adbdc3 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "271fa24c603a441fa865c54511adbdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:57.448846 23419 raft_consensus.cc:979] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691: : Instructing follower 71c459a9ab8f405283add8f5c2e1f17f to start an election
I20260812 19:26:57.449363 23374 raft_consensus.cc:1067] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Signalling peer 71c459a9ab8f405283add8f5c2e1f17f to start an election
I20260812 19:26:57.451090 23020 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6a6752ffef7c45b69844f73592ca7e54"
dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
 from {username='slave'} at 127.0.0.1:39986
I20260812 19:26:57.451589 23020 raft_consensus.cc:482] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:57.451905 23020 raft_consensus.cc:3037] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.457559 23020 raft_consensus.cc:504] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.459163 23020 leader_election.cc:288] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 2 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:57.460004 22885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6752ffef7c45b69844f73592ca7e54" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:57.460215 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6752ffef7c45b69844f73592ca7e54" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:57.460697 22885 raft_consensus.cc:3037] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.460790 23162 raft_consensus.cc:3032] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:57.461170 23162 raft_consensus.cc:729] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:26:57.461819 23162 consensus_queue.cc:260] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.462764 23162 raft_consensus.cc:3037] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.466169 22885 raft_consensus.cc:2454] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 2.
I20260812 19:26:57.467368 22962 leader_election.cc:302] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f; no voters: 
I20260812 19:26:57.467850 23162 raft_consensus.cc:2454] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 2.
I20260812 19:26:57.468145 23259 raft_consensus.cc:2781] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:57.468693 23259 raft_consensus.cc:686] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Becoming Leader. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:26:57.469489 23259 consensus_queue.cc:237] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.475919 22703 catalog_manager.cc:5495] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f reported cstate change: term changed from 1 to 2, leader changed from d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3) to 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2). New cstate: current_term: 2 leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:57.520596 23162 raft_consensus.cc:1261] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Refusing update from remote peer 71c459a9ab8f405283add8f5c2e1f17f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:57.521662 23413 consensus_queue.cc:1035] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:57.529748 22885 raft_consensus.cc:1261] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Refusing update from remote peer 71c459a9ab8f405283add8f5c2e1f17f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:57.531358 23259 consensus_queue.cc:1035] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:57.564098 23419 raft_consensus.cc:979] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691: : Instructing follower 71c459a9ab8f405283add8f5c2e1f17f to start an election
I20260812 19:26:57.564669 23374 raft_consensus.cc:1067] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Signalling peer 71c459a9ab8f405283add8f5c2e1f17f to start an election
I20260812 19:26:57.566094 23020 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c971d430cc364661b176d7acc3050088"
dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
 from {username='slave'} at 127.0.0.1:39986
I20260812 19:26:57.566835 23020 raft_consensus.cc:482] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:26:57.567256 23020 raft_consensus.cc:3037] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.574074 23020 raft_consensus.cc:504] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.576045 23020 leader_election.cc:288] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 2 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3:38205)
I20260812 19:26:57.576889 22885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c971d430cc364661b176d7acc3050088" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:26:57.577095 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c971d430cc364661b176d7acc3050088" candidate_uuid: "71c459a9ab8f405283add8f5c2e1f17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
I20260812 19:26:57.577620 22885 raft_consensus.cc:3037] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.577656 23162 raft_consensus.cc:3032] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:26:57.578192 23162 raft_consensus.cc:729] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:26:57.579025 23162 consensus_queue.cc:260] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.580317 23162 raft_consensus.cc:3037] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:26:57.585026 22885 raft_consensus.cc:2454] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 2.
I20260812 19:26:57.586150 22962 leader_election.cc:302] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, 71c459a9ab8f405283add8f5c2e1f17f; no voters: 
I20260812 19:26:57.586948 23259 raft_consensus.cc:2781] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:26:57.587407 23259 raft_consensus.cc:686] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Becoming Leader. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:26:57.588198 23259 consensus_queue.cc:237] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:26:57.590737 23162 raft_consensus.cc:2454] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c459a9ab8f405283add8f5c2e1f17f in term 2.
I20260812 19:26:57.595734 22711 catalog_manager.cc:5495] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f reported cstate change: term changed from 1 to 2, leader changed from d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3) to 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2). New cstate: current_term: 2 leader_uuid: "71c459a9ab8f405283add8f5c2e1f17f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:57.643865 23162 raft_consensus.cc:1261] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Refusing update from remote peer 271fa24c603a441fa865c54511adbdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:57.645043 23511 consensus_queue.cc:1035] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:57.653152 23020 raft_consensus.cc:1261] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Refusing update from remote peer 271fa24c603a441fa865c54511adbdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:57.654992 23522 consensus_queue.cc:1035] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:26:57.704538 23162 raft_consensus.cc:1261] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Refusing update from remote peer 271fa24c603a441fa865c54511adbdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:57.705869 23522 consensus_queue.cc:1035] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:57.714078 23020 raft_consensus.cc:1261] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Refusing update from remote peer 271fa24c603a441fa865c54511adbdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:57.715653 23511 consensus_queue.cc:1035] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:57.818409 23020 raft_consensus.cc:1261] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Refusing update from remote peer 271fa24c603a441fa865c54511adbdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:57.819942 23511 consensus_queue.cc:1035] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:57.828676 23162 raft_consensus.cc:1261] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Refusing update from remote peer 271fa24c603a441fa865c54511adbdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:57.830951 23522 consensus_queue.cc:1035] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:26:57.838915 23157 raft_consensus.cc:1261] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Refusing update from remote peer 271fa24c603a441fa865c54511adbdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:57.840842 23522 consensus_queue.cc:1035] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:57.850839 22885 raft_consensus.cc:1261] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Refusing update from remote peer 71c459a9ab8f405283add8f5c2e1f17f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:57.852483 23259 consensus_queue.cc:1035] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:57.854983 23020 raft_consensus.cc:1261] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Refusing update from remote peer 271fa24c603a441fa865c54511adbdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:57.856736 23522 consensus_queue.cc:1035] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:57.866053 23162 raft_consensus.cc:1261] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Refusing update from remote peer 71c459a9ab8f405283add8f5c2e1f17f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:57.867503 23472 consensus_queue.cc:1035] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:58.148994 23162 raft_consensus.cc:1261] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Refusing update from remote peer 71c459a9ab8f405283add8f5c2e1f17f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:58.150274 23259 consensus_queue.cc:1035] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:26:58.161262 22885 raft_consensus.cc:1261] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Refusing update from remote peer 71c459a9ab8f405283add8f5c2e1f17f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:26:58.165479 23259 consensus_queue.cc:1035] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:00.074360 22711 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40474:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260812 19:27:00.108922 22711 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40474:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260812 19:27:00.148756  4084 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260812 19:27:00.453402 23610 tablet.cc:1722] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.461217 23611 tablet.cc:1722] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260812 19:27:00.530802 23600 log.cc:924] Time spent T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260812 19:27:00.566303 23599 log.cc:924] Time spent T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.003s
I20260812 19:27:00.523350 23621 tablet.cc:1722] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260812 19:27:00.585599 23203 tablet_mm_ops.cc:140] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:3dd7b91470ea43ed98f7ca2f6975b0a2)
I20260812 19:27:00.594707 23635 tablet.cc:1722] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.594983 23620 tablet.cc:1722] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.599612 22876 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3dd7b91470ea43ed98f7ca2f6975b0a2"
dest_uuid: "271fa24c603a441fa865c54511adbdc3"
mode: GRACEFUL
new_leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
 from {username='slave'} at 127.0.0.1:60970
I20260812 19:27:00.600903 22876 raft_consensus.cc:595] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Received request to transfer leadership to TS d5456a1fcbb14d85bfdfd59aa4f48691
W20260812 19:27:00.591820 23203 tablet_mm_ops.cc:305] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:3dd7b91470ea43ed98f7ca2f6975b0a2)
I20260812 19:27:00.613951 23637 tablet.cc:1722] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260812 19:27:00.611389 23203 tablet_mm_ops.cc:221] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:3dd7b91470ea43ed98f7ca2f6975b0a2)
I20260812 19:27:00.598172 23636 tablet.cc:1722] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.673240 23639 tablet.cc:1722] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.677356 23649 tablet.cc:1722] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.683694 23641 tablet.cc:1722] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.685117 23648 tablet.cc:1722] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.706502 23610 tablet.cc:1722] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.725176 23611 tablet.cc:1722] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.727826 23637 tablet.cc:1722] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.732681 23640 tablet.cc:1722] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.736773 23621 tablet.cc:1722] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.722254 23620 tablet.cc:1722] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.762596 23639 tablet.cc:1722] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.764132 23635 tablet.cc:1722] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.772308 23027 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c971d430cc364661b176d7acc3050088"
dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
mode: GRACEFUL
new_leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
 from {username='slave'} at 127.0.0.1:41288
I20260812 19:27:00.774431 23027 raft_consensus.cc:595] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Received request to transfer leadership to TS d5456a1fcbb14d85bfdfd59aa4f48691
I20260812 19:27:00.776352  4084 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260812 19:27:00.777074  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:00.779668 23636 tablet.cc:1722] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.780226 23621 tablet.cc:1722] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.783666 23648 tablet.cc:1722] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.786904 23639 tablet.cc:1722] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.800709 23637 tablet.cc:1722] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.807264 23027 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "20d9fce7ef4748cfbcce47addf7c709c"
dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
mode: GRACEFUL
new_leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
 from {username='slave'} at 127.0.0.1:41288
I20260812 19:27:00.808131 23027 raft_consensus.cc:595] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Received request to transfer leadership to TS d5456a1fcbb14d85bfdfd59aa4f48691
I20260812 19:27:00.806782 23639 tablet.cc:1722] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.817458 23621 tablet.cc:1722] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.818434 23641 tablet.cc:1722] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:00.819196 22882 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "831b499ce47b4c518e0fc5e9c5a7c77f"
dest_uuid: "271fa24c603a441fa865c54511adbdc3"
mode: GRACEFUL
new_leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
 from {username='slave'} at 127.0.0.1:60970
I20260812 19:27:00.827152 22882 raft_consensus.cc:595] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Received request to transfer leadership to TS d5456a1fcbb14d85bfdfd59aa4f48691
I20260812 19:27:00.832470  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260812 19:27:00.833153  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:00.861759 22711 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1: soft_deleted_table [id=8e77db6ccd904623bfa079c589369b5b] alter complete (version 1)
I20260812 19:27:00.900139 23598 raft_consensus.cc:979] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3: : Instructing follower d5456a1fcbb14d85bfdfd59aa4f48691 to start an election
I20260812 19:27:00.900880 23646 raft_consensus.cc:1067] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Signalling peer d5456a1fcbb14d85bfdfd59aa4f48691 to start an election
I20260812 19:27:00.902716 23145 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "831b499ce47b4c518e0fc5e9c5a7c77f"
dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
 from {username='slave'} at 127.0.0.1:50536
I20260812 19:27:00.903333 23145 raft_consensus.cc:482] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:00.903620 23145 raft_consensus.cc:3037] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:00.909497 23145 raft_consensus.cc:504] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:27:00.911190 23145 leader_election.cc:288] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 3 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:27:00.912180 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "831b499ce47b4c518e0fc5e9c5a7c77f" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:27:00.912588 23027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "831b499ce47b4c518e0fc5e9c5a7c77f" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:27:00.912946 22882 raft_consensus.cc:3032] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:27:00.913290 23027 raft_consensus.cc:3037] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:00.913316 22882 raft_consensus.cc:729] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:27:00.914342 22882 consensus_queue.cc:260] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:27:00.915665 22882 raft_consensus.cc:3037] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:00.921543 22882 raft_consensus.cc:2454] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 3.
I20260812 19:27:00.921674 23027 raft_consensus.cc:2454] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 3.
I20260812 19:27:00.922943 23093 leader_election.cc:302] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:27:00.923892 23595 raft_consensus.cc:2781] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:27:00.924423 23595 raft_consensus.cc:686] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 LEADER]: Becoming Leader. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:27:00.925251 23595 consensus_queue.cc:237] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:27:00.934684 22711 catalog_manager.cc:5495] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 reported cstate change: term changed from 2 to 3, leader changed from 271fa24c603a441fa865c54511adbdc3 (127.3.253.1) to d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3). New cstate: current_term: 3 leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:00.937862 23531 raft_consensus.cc:979] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f: : Instructing follower d5456a1fcbb14d85bfdfd59aa4f48691 to start an election
I20260812 19:27:00.938573 23582 raft_consensus.cc:1067] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Signalling peer d5456a1fcbb14d85bfdfd59aa4f48691 to start an election
I20260812 19:27:00.940299 23145 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "20d9fce7ef4748cfbcce47addf7c709c"
dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
 from {username='slave'} at 127.0.0.1:50538
I20260812 19:27:00.940909 23145 raft_consensus.cc:482] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:00.941277 23145 raft_consensus.cc:3037] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:00.948580 23145 raft_consensus.cc:504] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:27:00.950274 23145 leader_election.cc:288] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 3 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:27:00.951073 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20d9fce7ef4748cfbcce47addf7c709c" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:27:00.951362 23027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20d9fce7ef4748cfbcce47addf7c709c" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:27:00.951795 22882 raft_consensus.cc:3037] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:00.952025 23027 raft_consensus.cc:3032] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:27:00.952375 23027 raft_consensus.cc:729] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:27:00.953156 23027 consensus_queue.cc:260] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:27:00.954452 23027 raft_consensus.cc:3037] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:00.957648 22882 raft_consensus.cc:2454] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 3.
I20260812 19:27:00.958912 23093 leader_election.cc:302] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:27:00.959652 23595 raft_consensus.cc:2781] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:27:00.959993 23027 raft_consensus.cc:2454] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 3.
I20260812 19:27:00.960090 23595 raft_consensus.cc:686] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 LEADER]: Becoming Leader. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:27:00.961246 23595 consensus_queue.cc:237] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:27:00.970595 22711 catalog_manager.cc:5495] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 reported cstate change: term changed from 2 to 3, leader changed from 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2) to d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3). New cstate: current_term: 3 leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:00.998034 23598 raft_consensus.cc:979] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3: : Instructing follower d5456a1fcbb14d85bfdfd59aa4f48691 to start an election
I20260812 19:27:00.998679 23646 raft_consensus.cc:1067] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Signalling peer d5456a1fcbb14d85bfdfd59aa4f48691 to start an election
I20260812 19:27:01.000598 23152 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3dd7b91470ea43ed98f7ca2f6975b0a2"
dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
 from {username='slave'} at 127.0.0.1:50536
I20260812 19:27:01.001106 23152 raft_consensus.cc:482] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:01.001402 23152 raft_consensus.cc:3037] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:01.007599 23152 raft_consensus.cc:504] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:27:01.009305 23152 leader_election.cc:288] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 3 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:27:01.010226 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd7b91470ea43ed98f7ca2f6975b0a2" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:27:01.010558 23027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd7b91470ea43ed98f7ca2f6975b0a2" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:27:01.010917 22882 raft_consensus.cc:3032] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:27:01.011251 23027 raft_consensus.cc:3037] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:01.011358 22882 raft_consensus.cc:729] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 271fa24c603a441fa865c54511adbdc3, State: Running, Role: LEADER
I20260812 19:27:01.013484 22882 consensus_queue.cc:260] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:27:01.014752 22882 raft_consensus.cc:3037] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:01.017618 23027 raft_consensus.cc:2454] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 3.
I20260812 19:27:01.018857 23093 leader_election.cc:302] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71c459a9ab8f405283add8f5c2e1f17f, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:27:01.020135 23595 raft_consensus.cc:2781] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:27:01.020651 23595 raft_consensus.cc:686] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 LEADER]: Becoming Leader. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:27:01.020704 22882 raft_consensus.cc:2454] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 3.
I20260812 19:27:01.022044 23595 consensus_queue.cc:237] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:27:01.030900 22711 catalog_manager.cc:5495] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 reported cstate change: term changed from 2 to 3, leader changed from 271fa24c603a441fa865c54511adbdc3 (127.3.253.1) to d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3). New cstate: current_term: 3 leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:01.092213 23531 raft_consensus.cc:979] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f: : Instructing follower d5456a1fcbb14d85bfdfd59aa4f48691 to start an election
I20260812 19:27:01.092808 23582 raft_consensus.cc:1067] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Signalling peer d5456a1fcbb14d85bfdfd59aa4f48691 to start an election
I20260812 19:27:01.094378 23152 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c971d430cc364661b176d7acc3050088"
dest_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691"
 from {username='slave'} at 127.0.0.1:50538
I20260812 19:27:01.094973 23152 raft_consensus.cc:482] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:01.095336 23152 raft_consensus.cc:3037] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:01.101429 23152 raft_consensus.cc:504] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:27:01.103161 23152 leader_election.cc:288] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 3 election: Requested vote from peers 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945), 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857)
I20260812 19:27:01.104342 23027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c971d430cc364661b176d7acc3050088" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "71c459a9ab8f405283add8f5c2e1f17f"
I20260812 19:27:01.104511 22878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c971d430cc364661b176d7acc3050088" candidate_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "271fa24c603a441fa865c54511adbdc3"
I20260812 19:27:01.105116 23027 raft_consensus.cc:3032] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:27:01.105295 22878 raft_consensus.cc:3037] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:01.105490 23027 raft_consensus.cc:729] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71c459a9ab8f405283add8f5c2e1f17f, State: Running, Role: LEADER
I20260812 19:27:01.106513 23027 consensus_queue.cc:260] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:27:01.107905 23027 raft_consensus.cc:3037] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:01.111944 22878 raft_consensus.cc:2454] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 3.
I20260812 19:27:01.113116 23093 leader_election.cc:302] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271fa24c603a441fa865c54511adbdc3, d5456a1fcbb14d85bfdfd59aa4f48691; no voters: 
I20260812 19:27:01.113898 23595 raft_consensus.cc:2781] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:27:01.113768 23027 raft_consensus.cc:2454] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5456a1fcbb14d85bfdfd59aa4f48691 in term 3.
I20260812 19:27:01.114518 23595 raft_consensus.cc:686] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 LEADER]: Becoming Leader. State: Replica: d5456a1fcbb14d85bfdfd59aa4f48691, State: Running, Role: LEADER
I20260812 19:27:01.115398 23595 consensus_queue.cc:237] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } }
I20260812 19:27:01.122153 22711 catalog_manager.cc:5495] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 reported cstate change: term changed from 2 to 3, leader changed from 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2) to d5456a1fcbb14d85bfdfd59aa4f48691 (127.3.253.3). New cstate: current_term: 3 leader_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5456a1fcbb14d85bfdfd59aa4f48691" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38205 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:01.412516 23027 raft_consensus.cc:1261] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Refusing update from remote peer d5456a1fcbb14d85bfdfd59aa4f48691: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:27:01.413982 23595 consensus_queue.cc:1035] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:27:01.427420 22878 raft_consensus.cc:1261] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Refusing update from remote peer d5456a1fcbb14d85bfdfd59aa4f48691: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:27:01.428977 23595 consensus_queue.cc:1035] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:27:01.432495 22882 raft_consensus.cc:1261] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Refusing update from remote peer d5456a1fcbb14d85bfdfd59aa4f48691: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260812 19:27:01.434360 23667 consensus_queue.cc:1035] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:27:01.453554 23027 raft_consensus.cc:1261] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Refusing update from remote peer d5456a1fcbb14d85bfdfd59aa4f48691: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260812 19:27:01.456162 23595 consensus_queue.cc:1035] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:27:01.510224 22878 raft_consensus.cc:1261] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Refusing update from remote peer d5456a1fcbb14d85bfdfd59aa4f48691: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:27:01.511777 23595 consensus_queue.cc:1035] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:27:01.523367 23027 raft_consensus.cc:1261] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Refusing update from remote peer d5456a1fcbb14d85bfdfd59aa4f48691: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:27:01.526393 23595 consensus_queue.cc:1035] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:27:01.527055 23027 raft_consensus.cc:1261] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Refusing update from remote peer d5456a1fcbb14d85bfdfd59aa4f48691: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260812 19:27:01.529909 23670 consensus_queue.cc:1035] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c459a9ab8f405283add8f5c2e1f17f" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 19:27:01.546463 22878 raft_consensus.cc:1261] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Refusing update from remote peer d5456a1fcbb14d85bfdfd59aa4f48691: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260812 19:27:01.548416 23667 consensus_queue.cc:1035] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "271fa24c603a441fa865c54511adbdc3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260812 19:27:01.834144  4084 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260812 19:27:01.839967  4084 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260812 19:27:01.840461  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:01.845719  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:01.846051  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:02.847029  4084 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260812 19:27:02.852032  4084 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260812 19:27:02.852545  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:02.857532  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:02.857899  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:03.858908  4084 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260812 19:27:03.864224  4084 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260812 19:27:03.864689  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:03.869513  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:03.869864  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:04.870867  4084 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260812 19:27:04.875988  4084 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260812 19:27:04.876485  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:04.881296  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:04.881690  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:05.882577  4084 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260812 19:27:05.887885  4084 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260812 19:27:05.888453  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:05.893848  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:05.894294  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:06.895351  4084 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260812 19:27:06.901362  4084 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260812 19:27:06.901785  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:06.906230  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:06.906561  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:07.907516  4084 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260812 19:27:07.912809  4084 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260812 19:27:07.913216  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:07.917730  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:07.918071  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:08.919010  4084 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260812 19:27:08.924474  4084 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260812 19:27:08.925050  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:08.929934  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:08.930335  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:09.931547  4084 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260812 19:27:09.937855  4084 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260812 19:27:09.938385  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:09.943470  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:09.943974  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:11.007987  4084 tablet_server.cc:178] TabletServer@127.3.253.1:0 shutting down...
W20260812 19:27:11.033105 22962 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 141 similar messages]
W20260812 19:27:11.043486 22962 consensus_peers.cc:487] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f -> Peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Couldn't send request to peer 271fa24c603a441fa865c54511adbdc3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:11.044451 22962 consensus_peers.cc:487] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f -> Peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Couldn't send request to peer 271fa24c603a441fa865c54511adbdc3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:11.066069 22962 consensus_peers.cc:487] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f -> Peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Couldn't send request to peer 271fa24c603a441fa865c54511adbdc3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:11.070547  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:27:11.071576  4084 tablet_replica.cc:330] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.072686  4084 raft_consensus.cc:2229] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.073513  4084 raft_consensus.cc:2258] T c971d430cc364661b176d7acc3050088 P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.076435  4084 tablet_replica.cc:330] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.077123  4084 raft_consensus.cc:2229] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.077762  4084 raft_consensus.cc:2258] T 024f88b62c6a4987ac7154abbb3cf1f9 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.080632  4084 tablet_replica.cc:330] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.081350  4084 raft_consensus.cc:2229] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.082435  4084 raft_consensus.cc:2258] T 99c1c937c48341fda945b5dc79d12d3a P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.085127  4084 tablet_replica.cc:330] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.085762  4084 raft_consensus.cc:2229] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.086405  4084 raft_consensus.cc:2258] T dfd67cc699b540a4acee00b54efc781a P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.089084  4084 tablet_replica.cc:330] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.089829  4084 raft_consensus.cc:2229] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.090365  4084 raft_consensus.cc:2258] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.093262  4084 tablet_replica.cc:330] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.093860  4084 raft_consensus.cc:2229] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.095304  4084 raft_consensus.cc:2258] T 411ac8056d5645a5801868c0940bc406 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.098767  4084 tablet_replica.cc:330] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.099404  4084 raft_consensus.cc:2229] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.099995  4084 raft_consensus.cc:2258] T be1fce37be484514832213da63481039 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.102694  4084 tablet_replica.cc:330] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.103312  4084 raft_consensus.cc:2229] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.103904  4084 raft_consensus.cc:2258] T 20d9fce7ef4748cfbcce47addf7c709c P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.106554  4084 tablet_replica.cc:330] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.107235  4084 raft_consensus.cc:2229] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.108237  4084 raft_consensus.cc:2258] T 3babac97ab8b4ff0a8c22d7011775e86 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.110970  4084 tablet_replica.cc:330] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.111629  4084 raft_consensus.cc:2229] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.112141  4084 raft_consensus.cc:2258] T 831b499ce47b4c518e0fc5e9c5a7c77f P 271fa24c603a441fa865c54511adbdc3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.114707  4084 tablet_replica.cc:330] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.115352  4084 raft_consensus.cc:2229] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.116364  4084 raft_consensus.cc:2258] T 99ce053aa9074a4db2d554efe9d02f64 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.119087  4084 tablet_replica.cc:330] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.119704  4084 raft_consensus.cc:2229] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.120313  4084 raft_consensus.cc:2258] T 6a6752ffef7c45b69844f73592ca7e54 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.122809  4084 tablet_replica.cc:330] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.123397  4084 raft_consensus.cc:2229] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.123867  4084 raft_consensus.cc:2258] T e7342bbe3c864a43a9d7cdf0fa091324 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.126273  4084 tablet_replica.cc:330] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.126811  4084 raft_consensus.cc:2229] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.127799  4084 raft_consensus.cc:2258] T 8316bd251de448b78b562f94941532c9 P 271fa24c603a441fa865c54511adbdc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.130468  4084 tablet_replica.cc:330] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.131090  4084 raft_consensus.cc:2229] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.131608  4084 raft_consensus.cc:2258] T 419c163281434479a70870e9b1a61faa P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.134281  4084 tablet_replica.cc:330] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.134931  4084 raft_consensus.cc:2229] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.135504  4084 raft_consensus.cc:2258] T 954401c5c5994738a6b10c07868f0dd4 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.138247  4084 tablet_replica.cc:330] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.138924  4084 raft_consensus.cc:2229] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.140352  4084 raft_consensus.cc:2258] T 5b9d00b660274a0eb9e6ed18ef5718ed P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.144269  4084 tablet_replica.cc:330] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3: stopping tablet replica
I20260812 19:27:11.144829  4084 raft_consensus.cc:2229] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260812 19:27:11.145385 23093 consensus_peers.cc:487] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 -> Peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Couldn't send request to peer 271fa24c603a441fa865c54511adbdc3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:11.145488  4084 raft_consensus.cc:2258] T 65e13bc2fc304b11b8a9ebc589db2e96 P 271fa24c603a441fa865c54511adbdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.198442  4084 tablet_server.cc:194] TabletServer@127.3.253.1:0 shutdown complete.
W20260812 19:27:11.206856 23093 consensus_peers.cc:487] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 -> Peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Couldn't send request to peer 271fa24c603a441fa865c54511adbdc3. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:44945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:11.245811  4084 tablet_server.cc:178] TabletServer@127.3.253.2:0 shutting down...
W20260812 19:27:11.260036 22962 consensus_peers.cc:487] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f -> Peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Couldn't send request to peer 271fa24c603a441fa865c54511adbdc3. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:44945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:11.274605 23093 consensus_peers.cc:487] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 -> Peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Couldn't send request to peer 71c459a9ab8f405283add8f5c2e1f17f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:11.280351 22962 consensus_peers.cc:487] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f -> Peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Couldn't send request to peer 271fa24c603a441fa865c54511adbdc3. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:44945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:11.292091  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:27:11.292999  4084 tablet_replica.cc:330] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.293974  4084 raft_consensus.cc:2229] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.294592  4084 raft_consensus.cc:2258] T 5b9d00b660274a0eb9e6ed18ef5718ed P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.297176  4084 tablet_replica.cc:330] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.297792  4084 raft_consensus.cc:2229] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.298378  4084 raft_consensus.cc:2258] T 99c1c937c48341fda945b5dc79d12d3a P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.300992  4084 tablet_replica.cc:330] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.301636  4084 raft_consensus.cc:2229] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.302649  4084 raft_consensus.cc:2258] T 024f88b62c6a4987ac7154abbb3cf1f9 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.305179  4084 tablet_replica.cc:330] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.305873  4084 raft_consensus.cc:2229] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.306389  4084 raft_consensus.cc:2258] T c971d430cc364661b176d7acc3050088 P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.308722  4084 tablet_replica.cc:330] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.309368  4084 raft_consensus.cc:2229] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.309973  4084 raft_consensus.cc:2258] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.312288  4084 tablet_replica.cc:330] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.312888  4084 raft_consensus.cc:2229] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.313438  4084 raft_consensus.cc:2258] T dfd67cc699b540a4acee00b54efc781a P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.315759  4084 tablet_replica.cc:330] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.316361  4084 raft_consensus.cc:2229] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.317386  4084 raft_consensus.cc:2258] T be1fce37be484514832213da63481039 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.319832  4084 tablet_replica.cc:330] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.320457  4084 raft_consensus.cc:2229] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.320984  4084 raft_consensus.cc:2258] T 20d9fce7ef4748cfbcce47addf7c709c P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.323396  4084 tablet_replica.cc:330] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.324002  4084 raft_consensus.cc:2229] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.325006  4084 raft_consensus.cc:2258] T 65e13bc2fc304b11b8a9ebc589db2e96 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.327903  4084 tablet_replica.cc:330] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.328514  4084 raft_consensus.cc:2229] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.329519  4084 raft_consensus.cc:2258] T 954401c5c5994738a6b10c07868f0dd4 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.332132  4084 tablet_replica.cc:330] T 411ac8056d5645a5801868c0940bc406 P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.332906  4084 raft_consensus.cc:2229] T 411ac8056d5645a5801868c0940bc406 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.333410  4084 raft_consensus.cc:2258] T 411ac8056d5645a5801868c0940bc406 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.335809  4084 tablet_replica.cc:330] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.336375  4084 raft_consensus.cc:2229] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.336889  4084 raft_consensus.cc:2258] T 8316bd251de448b78b562f94941532c9 P 71c459a9ab8f405283add8f5c2e1f17f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.339218  4084 tablet_replica.cc:330] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.339762  4084 raft_consensus.cc:2229] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.340740  4084 raft_consensus.cc:2258] T 419c163281434479a70870e9b1a61faa P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.342968  4084 tablet_replica.cc:330] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.343538  4084 raft_consensus.cc:2229] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.344126  4084 raft_consensus.cc:2258] T 3babac97ab8b4ff0a8c22d7011775e86 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.346537  4084 tablet_replica.cc:330] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.347204  4084 raft_consensus.cc:2229] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.347885  4084 raft_consensus.cc:2258] T 831b499ce47b4c518e0fc5e9c5a7c77f P 71c459a9ab8f405283add8f5c2e1f17f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260812 19:27:11.350787 23093 consensus_peers.cc:487] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 -> Peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Couldn't send request to peer 271fa24c603a441fa865c54511adbdc3. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:44945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:11.351140  4084 tablet_replica.cc:330] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.351883  4084 raft_consensus.cc:2229] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.352849  4084 raft_consensus.cc:2258] T 6a6752ffef7c45b69844f73592ca7e54 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.355422  4084 tablet_replica.cc:330] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.355945  4084 raft_consensus.cc:2229] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.356451  4084 raft_consensus.cc:2258] T e7342bbe3c864a43a9d7cdf0fa091324 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.358773  4084 tablet_replica.cc:330] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f: stopping tablet replica
I20260812 19:27:11.359287  4084 raft_consensus.cc:2229] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.359791  4084 raft_consensus.cc:2258] T 99ce053aa9074a4db2d554efe9d02f64 P 71c459a9ab8f405283add8f5c2e1f17f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.397208  4084 tablet_server.cc:194] TabletServer@127.3.253.2:0 shutdown complete.
W20260812 19:27:11.413703 23093 consensus_peers.cc:487] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 -> Peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Couldn't send request to peer 271fa24c603a441fa865c54511adbdc3. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:44945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:11.436326 23093 consensus_peers.cc:487] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 -> Peer 271fa24c603a441fa865c54511adbdc3 (127.3.253.1:44945): Couldn't send request to peer 271fa24c603a441fa865c54511adbdc3. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:44945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:11.443140  4084 tablet_server.cc:178] TabletServer@127.3.253.3:0 shutting down...
W20260812 19:27:11.459263 23093 consensus_peers.cc:487] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 -> Peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Couldn't send request to peer 71c459a9ab8f405283add8f5c2e1f17f. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:33857: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:11.482199 23093 consensus_peers.cc:487] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 -> Peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Couldn't send request to peer 71c459a9ab8f405283add8f5c2e1f17f. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:33857: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:11.483670  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:27:11.484642  4084 tablet_replica.cc:330] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.485561  4084 raft_consensus.cc:2229] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.486263  4084 raft_consensus.cc:2258] T 024f88b62c6a4987ac7154abbb3cf1f9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.489187  4084 tablet_replica.cc:330] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.490106  4084 raft_consensus.cc:2229] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.490958  4084 raft_consensus.cc:2258] T 99c1c937c48341fda945b5dc79d12d3a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260812 19:27:11.492991 23093 consensus_peers.cc:487] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 -> Peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Couldn't send request to peer 71c459a9ab8f405283add8f5c2e1f17f. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:33857: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:11.493894  4084 tablet_replica.cc:330] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.494576  4084 raft_consensus.cc:2229] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.495586  4084 raft_consensus.cc:2258] T c971d430cc364661b176d7acc3050088 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.498459  4084 tablet_replica.cc:330] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.499249  4084 raft_consensus.cc:2229] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.500385  4084 raft_consensus.cc:2258] T dfd67cc699b540a4acee00b54efc781a P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:27:11.500873 23093 consensus_peers.cc:487] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 -> Peer 71c459a9ab8f405283add8f5c2e1f17f (127.3.253.2:33857): Couldn't send request to peer 71c459a9ab8f405283add8f5c2e1f17f. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:33857: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:11.502889  4084 tablet_replica.cc:330] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.503636  4084 raft_consensus.cc:2229] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.504534  4084 raft_consensus.cc:2258] T 3dd7b91470ea43ed98f7ca2f6975b0a2 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.506970  4084 tablet_replica.cc:330] T 411ac8056d5645a5801868c0940bc406 P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.507529  4084 raft_consensus.cc:2229] T 411ac8056d5645a5801868c0940bc406 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.507998  4084 raft_consensus.cc:2258] T 411ac8056d5645a5801868c0940bc406 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.510167  4084 tablet_replica.cc:330] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.510772  4084 raft_consensus.cc:2229] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.511253  4084 raft_consensus.cc:2258] T be1fce37be484514832213da63481039 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.513447  4084 tablet_replica.cc:330] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.514026  4084 raft_consensus.cc:2229] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.515015  4084 raft_consensus.cc:2258] T 20d9fce7ef4748cfbcce47addf7c709c P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.517292  4084 tablet_replica.cc:330] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.517884  4084 raft_consensus.cc:2229] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.518384  4084 raft_consensus.cc:2258] T 3babac97ab8b4ff0a8c22d7011775e86 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.520817  4084 tablet_replica.cc:330] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.521390  4084 raft_consensus.cc:2229] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.522332  4084 raft_consensus.cc:2258] T 831b499ce47b4c518e0fc5e9c5a7c77f P d5456a1fcbb14d85bfdfd59aa4f48691 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.524415  4084 tablet_replica.cc:330] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.525043  4084 raft_consensus.cc:2229] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.525522  4084 raft_consensus.cc:2258] T 954401c5c5994738a6b10c07868f0dd4 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.527773  4084 tablet_replica.cc:330] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.528307  4084 raft_consensus.cc:2229] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.528798  4084 raft_consensus.cc:2258] T 99ce053aa9074a4db2d554efe9d02f64 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.530951  4084 tablet_replica.cc:330] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.531576  4084 raft_consensus.cc:2229] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.532193  4084 raft_consensus.cc:2258] T 6a6752ffef7c45b69844f73592ca7e54 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.534631  4084 tablet_replica.cc:330] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.535215  4084 raft_consensus.cc:2229] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.536088  4084 raft_consensus.cc:2258] T e7342bbe3c864a43a9d7cdf0fa091324 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.538161  4084 tablet_replica.cc:330] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.538763  4084 raft_consensus.cc:2229] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.539290  4084 raft_consensus.cc:2258] T 5b9d00b660274a0eb9e6ed18ef5718ed P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.541497  4084 tablet_replica.cc:330] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.542011  4084 raft_consensus.cc:2229] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.542480  4084 raft_consensus.cc:2258] T 65e13bc2fc304b11b8a9ebc589db2e96 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.544612  4084 tablet_replica.cc:330] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.545123  4084 raft_consensus.cc:2229] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.545616  4084 raft_consensus.cc:2258] T 419c163281434479a70870e9b1a61faa P d5456a1fcbb14d85bfdfd59aa4f48691 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.547626  4084 tablet_replica.cc:330] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691: stopping tablet replica
I20260812 19:27:11.548125  4084 raft_consensus.cc:2229] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:11.548578  4084 raft_consensus.cc:2258] T 8316bd251de448b78b562f94941532c9 P d5456a1fcbb14d85bfdfd59aa4f48691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.592823  4084 tablet_server.cc:194] TabletServer@127.3.253.3:0 shutdown complete.
I20260812 19:27:11.632395  4084 master.cc:537] Master@127.3.253.62:46515 shutting down...
I20260812 19:27:11.662101  4084 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:11.662822  4084 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:11.663187  4084 tablet_replica.cc:330] T 00000000000000000000000000000000 P 459fc665cea447b3a941333f6ebcafa1: stopping tablet replica
I20260812 19:27:11.683977  4084 master.cc:552] Master@127.3.253.62:46515 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20721 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260812 19:27:11.742681  4084 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.253.62:35739
I20260812 19:27:11.743832  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:27:11.750463 23715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:27:11.750486 23717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:27:11.751343 23719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:27:11.752453  4084 server_base.cc:1034] running on GCE node
I20260812 19:27:11.753525  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:27:11.753706  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:27:11.753813  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562831753806 us; error 0 us; skew 500 ppm
I20260812 19:27:11.754252  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:27:11.756727  4084 webserver.cc:460] Webserver started at http://127.3.253.62:34273/ using document root <none> and password file <none>
I20260812 19:27:11.757150  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:27:11.757301  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:27:11.757541  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:27:11.759434  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/master-0-root/instance:
uuid: "979049e461e44afb925ffa7bd5f98b09"
format_stamp: "Formatted at 2026-08-12 19:27:11 on dist-test-slave-3kk6"
I20260812 19:27:11.764226  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 19:27:11.767596 23731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:27:11.768388  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 19:27:11.768678  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/master-0-root
uuid: "979049e461e44afb925ffa7bd5f98b09"
format_stamp: "Formatted at 2026-08-12 19:27:11 on dist-test-slave-3kk6"
I20260812 19:27:11.768952  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:27:11.780963  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:27:11.782284  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:27:11.823432  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.62:35739
I20260812 19:27:11.823555 23827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.62:35739 every 8 connection(s)
I20260812 19:27:11.827466 23828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:11.839865 23828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09: Bootstrap starting.
I20260812 19:27:11.844718 23828 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:11.849291 23828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09: No bootstrap required, opened a new log
I20260812 19:27:11.851553 23828 raft_consensus.cc:348] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979049e461e44afb925ffa7bd5f98b09" member_type: VOTER }
I20260812 19:27:11.852093 23828 raft_consensus.cc:374] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:11.852274 23828 raft_consensus.cc:729] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 979049e461e44afb925ffa7bd5f98b09, State: Initialized, Role: FOLLOWER
I20260812 19:27:11.852890 23828 consensus_queue.cc:260] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979049e461e44afb925ffa7bd5f98b09" member_type: VOTER }
I20260812 19:27:11.853320 23828 raft_consensus.cc:388] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 19:27:11.853507 23828 raft_consensus.cc:482] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 19:27:11.853726 23828 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.858692 23828 raft_consensus.cc:504] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979049e461e44afb925ffa7bd5f98b09" member_type: VOTER }
I20260812 19:27:11.859297 23828 leader_election.cc:302] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 979049e461e44afb925ffa7bd5f98b09; no voters: 
I20260812 19:27:11.860487 23828 leader_election.cc:288] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 19:27:11.860984 23834 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:11.862488 23834 raft_consensus.cc:686] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [term 1 LEADER]: Becoming Leader. State: Replica: 979049e461e44afb925ffa7bd5f98b09, State: Running, Role: LEADER
I20260812 19:27:11.863242 23834 consensus_queue.cc:237] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979049e461e44afb925ffa7bd5f98b09" member_type: VOTER }
I20260812 19:27:11.863873 23828 sys_catalog.cc:564] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 19:27:11.868171 23835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "979049e461e44afb925ffa7bd5f98b09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979049e461e44afb925ffa7bd5f98b09" member_type: VOTER } }
I20260812 19:27:11.868857 23835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [sys.catalog]: This master's current role is: LEADER
I20260812 19:27:11.869585 23838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 979049e461e44afb925ffa7bd5f98b09. Latest consensus state: current_term: 1 leader_uuid: "979049e461e44afb925ffa7bd5f98b09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979049e461e44afb925ffa7bd5f98b09" member_type: VOTER } }
I20260812 19:27:11.870239 23838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [sys.catalog]: This master's current role is: LEADER
I20260812 19:27:11.871987 23848 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 19:27:11.877290 23848 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 19:27:11.879197  4084 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 19:27:11.886953 23848 catalog_manager.cc:1347] Generated new cluster ID: ccdd6a481f7b4653a3ad64385dcbe38c
I20260812 19:27:11.887261 23848 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:27:11.901038 23848 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 19:27:11.902935 23848 catalog_manager.cc:1504] Loading token signing keys...
I20260812 19:27:11.913479 23848 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09: Generated new TSK 0
I20260812 19:27:11.914220 23848 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:27:11.946130  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:27:11.952539 23861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:27:11.953612 23863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:27:11.955236 23865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:27:11.956462  4084 server_base.cc:1034] running on GCE node
I20260812 19:27:11.957588  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:27:11.957841  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:27:11.958014  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562831957999 us; error 0 us; skew 500 ppm
I20260812 19:27:11.958544  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:27:11.961208  4084 webserver.cc:460] Webserver started at http://127.3.253.1:37855/ using document root <none> and password file <none>
I20260812 19:27:11.961686  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:27:11.961889  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:27:11.962149  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:27:11.963502  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/ts-0-root/instance:
uuid: "d5903dc2c6e247ac908381187487e4b3"
format_stamp: "Formatted at 2026-08-12 19:27:11 on dist-test-slave-3kk6"
I20260812 19:27:11.968516  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260812 19:27:11.972153 23871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:27:11.972995  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 19:27:11.973357  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/ts-0-root
uuid: "d5903dc2c6e247ac908381187487e4b3"
format_stamp: "Formatted at 2026-08-12 19:27:11 on dist-test-slave-3kk6"
I20260812 19:27:11.973680  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:27:11.997135  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:27:11.998430  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:27:11.999976  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:27:12.002323  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:27:12.002542  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:27:12.002831  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:27:12.003028  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:27:12.049599  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.1:35907
I20260812 19:27:12.049726 23983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.1:35907 every 8 connection(s)
I20260812 19:27:12.054767  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:27:12.063000 23989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:27:12.065029 23990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:27:12.068480 23992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:27:12.069607  4084 server_base.cc:1034] running on GCE node
I20260812 19:27:12.071241  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 19:27:12.071494  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:27:12.071712  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562832071694 us; error 0 us; skew 500 ppm
I20260812 19:27:12.072504  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:27:12.074361 23985 heartbeater.cc:347] Connected to a master server at 127.3.253.62:35739
I20260812 19:27:12.074885 23985 heartbeater.cc:464] Registering TS with master...
I20260812 19:27:12.075757  4084 webserver.cc:460] Webserver started at http://127.3.253.2:44747/ using document root <none> and password file <none>
I20260812 19:27:12.075938 23985 heartbeater.cc:511] Master 127.3.253.62:35739 requested a full tablet report, sending...
I20260812 19:27:12.076514  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:27:12.076792  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:27:12.077126  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:27:12.078436 23765 ts_manager.cc:194] Registered new tserver with Master: d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907)
I20260812 19:27:12.078891  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/ts-1-root/instance:
uuid: "a945c890138c411aa6413b46099be1d6"
format_stamp: "Formatted at 2026-08-12 19:27:12 on dist-test-slave-3kk6"
I20260812 19:27:12.081544 23765 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51484
I20260812 19:27:12.085526  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260812 19:27:12.089303 24000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:27:12.090118  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 19:27:12.090385  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/ts-1-root
uuid: "a945c890138c411aa6413b46099be1d6"
format_stamp: "Formatted at 2026-08-12 19:27:12 on dist-test-slave-3kk6"
I20260812 19:27:12.090624  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:27:12.109542  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:27:12.110936  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:27:12.112398  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:27:12.114782  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:27:12.114971  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:27:12.115250  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:27:12.115408  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:27:12.157867  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.2:37499
I20260812 19:27:12.158030 24097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.2:37499 every 8 connection(s)
I20260812 19:27:12.163152  4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:27:12.171734 24102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:27:12.172370 24105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:27:12.178071 24109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:27:12.178582  4084 server_base.cc:1034] running on GCE node
I20260812 19:27:12.179888  4084 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260812 19:27:12.180023 24098 heartbeater.cc:347] Connected to a master server at 127.3.253.62:35739
W20260812 19:27:12.180171  4084 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 19:27:12.180508  4084 hybrid_clock.cc:648] HybridClock initialized: now 1786562832180490 us; error 0 us; skew 500 ppm
I20260812 19:27:12.180557 24098 heartbeater.cc:464] Registering TS with master...
I20260812 19:27:12.181167  4084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:27:12.181473 24098 heartbeater.cc:511] Master 127.3.253.62:35739 requested a full tablet report, sending...
I20260812 19:27:12.183852 23765 ts_manager.cc:194] Registered new tserver with Master: a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:12.184113  4084 webserver.cc:460] Webserver started at http://127.3.253.3:44301/ using document root <none> and password file <none>
I20260812 19:27:12.184724  4084 fs_manager.cc:359] Metadata directory not provided
I20260812 19:27:12.184917  4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:27:12.185189  4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:27:12.185835 23765 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51500
I20260812 19:27:12.186533  4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/ts-2-root/instance:
uuid: "ffd3f94084504c5b94551fd257267978"
format_stamp: "Formatted at 2026-08-12 19:27:12 on dist-test-slave-3kk6"
I20260812 19:27:12.191612  4084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 19:27:12.195393 24116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:27:12.196291  4084 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260812 19:27:12.196609  4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/ts-2-root
uuid: "ffd3f94084504c5b94551fd257267978"
format_stamp: "Formatted at 2026-08-12 19:27:12 on dist-test-slave-3kk6"
I20260812 19:27:12.196895  4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNNCXIv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786562432658360-4084-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:27:12.211335  4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260812 19:27:12.212656  4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:27:12.214144  4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:27:12.216547  4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:27:12.216765  4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:27:12.217029  4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:27:12.217197  4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 19:27:12.260372  4084 rpc_server.cc:307] RPC server started. Bound to: 127.3.253.3:38531
I20260812 19:27:12.260494 24228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.253.3:38531 every 8 connection(s)
I20260812 19:27:12.277359 24229 heartbeater.cc:347] Connected to a master server at 127.3.253.62:35739
I20260812 19:27:12.277868 24229 heartbeater.cc:464] Registering TS with master...
I20260812 19:27:12.278525 24229 heartbeater.cc:511] Master 127.3.253.62:35739 requested a full tablet report, sending...
I20260812 19:27:12.280530 23765 ts_manager.cc:194] Registered new tserver with Master: ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:12.281395  4084 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017437274s
I20260812 19:27:12.282857 23765 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51504
I20260812 19:27:12.284063  4084 test_util.cc:268] Using random seed: -1828931191
I20260812 19:27:12.311172 23765 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51516:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 19:27:12.313951 23765 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:12.384181 24044 tablet_service.cc:1467] Processing CreateTablet for tablet 377918f8e49b483f9c2d59cf73ce820f (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260812 19:27:12.385773 24044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 377918f8e49b483f9c2d59cf73ce820f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.386050 24039 tablet_service.cc:1467] Processing CreateTablet for tablet b60c661c0d2d4a1db6e5256c7a60da76 (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260812 19:27:12.387480 24039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b60c661c0d2d4a1db6e5256c7a60da76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.391987 24037 tablet_service.cc:1467] Processing CreateTablet for tablet c2e53b579ac947bbb23b5dede3c9391f (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260812 19:27:12.393465 24037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2e53b579ac947bbb23b5dede3c9391f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.394826 24036 tablet_service.cc:1467] Processing CreateTablet for tablet 8c7d1173b851418584001c638601f887 (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260812 19:27:12.396270 24036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c7d1173b851418584001c638601f887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.384727 24043 tablet_service.cc:1467] Processing CreateTablet for tablet e87eb94d5c224f8d8e6aac06c3fceca3 (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260812 19:27:12.400141 24043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e87eb94d5c224f8d8e6aac06c3fceca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.410842 23920 tablet_service.cc:1467] Processing CreateTablet for tablet 377918f8e49b483f9c2d59cf73ce820f (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260812 19:27:12.411895 23917 tablet_service.cc:1467] Processing CreateTablet for tablet c2e53b579ac947bbb23b5dede3c9391f (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260812 19:27:12.412487 23920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 377918f8e49b483f9c2d59cf73ce820f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.413316 23917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2e53b579ac947bbb23b5dede3c9391f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.414757 23919 tablet_service.cc:1467] Processing CreateTablet for tablet e87eb94d5c224f8d8e6aac06c3fceca3 (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260812 19:27:12.416288 23919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e87eb94d5c224f8d8e6aac06c3fceca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.415908 23916 tablet_service.cc:1467] Processing CreateTablet for tablet 8c7d1173b851418584001c638601f887 (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260812 19:27:12.417368 23916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c7d1173b851418584001c638601f887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.419181 23918 tablet_service.cc:1467] Processing CreateTablet for tablet b60c661c0d2d4a1db6e5256c7a60da76 (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260812 19:27:12.419653 23913 tablet_service.cc:1467] Processing CreateTablet for tablet 733f257d57b3493c8d4c87e92944a7ab (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260812 19:27:12.420563 23918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b60c661c0d2d4a1db6e5256c7a60da76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.422991 23913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 733f257d57b3493c8d4c87e92944a7ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.423313 24035 tablet_service.cc:1467] Processing CreateTablet for tablet 733f257d57b3493c8d4c87e92944a7ab (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260812 19:27:12.424831 24035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 733f257d57b3493c8d4c87e92944a7ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.424512 24032 tablet_service.cc:1467] Processing CreateTablet for tablet 82e36e0cbbbe4f4bb70897d2660981c2 (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260812 19:27:12.425875 24032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82e36e0cbbbe4f4bb70897d2660981c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.423323 23911 tablet_service.cc:1467] Processing CreateTablet for tablet 82e36e0cbbbe4f4bb70897d2660981c2 (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260812 19:27:12.427906 24031 tablet_service.cc:1467] Processing CreateTablet for tablet 5842b318cf814fe59cb68d5a3fb2239e (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260812 19:27:12.429262 24031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5842b318cf814fe59cb68d5a3fb2239e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.435635 23911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82e36e0cbbbe4f4bb70897d2660981c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.436946 24030 tablet_service.cc:1467] Processing CreateTablet for tablet 4dc105f37baa4573b9c4d8bbbdf723c0 (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260812 19:27:12.438385 24030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dc105f37baa4573b9c4d8bbbdf723c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.440657 24167 tablet_service.cc:1467] Processing CreateTablet for tablet 377918f8e49b483f9c2d59cf73ce820f (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260812 19:27:12.442138 24167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 377918f8e49b483f9c2d59cf73ce820f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.443081 24157 tablet_service.cc:1467] Processing CreateTablet for tablet 8c7d1173b851418584001c638601f887 (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260812 19:27:12.443917 24164 tablet_service.cc:1467] Processing CreateTablet for tablet e87eb94d5c224f8d8e6aac06c3fceca3 (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260812 19:27:12.444607 24157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c7d1173b851418584001c638601f887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.445446 24164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e87eb94d5c224f8d8e6aac06c3fceca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.446899 24155 tablet_service.cc:1467] Processing CreateTablet for tablet 733f257d57b3493c8d4c87e92944a7ab (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260812 19:27:12.447834 24162 tablet_service.cc:1467] Processing CreateTablet for tablet b60c661c0d2d4a1db6e5256c7a60da76 (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260812 19:27:12.448333 24155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 733f257d57b3493c8d4c87e92944a7ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.449221 24162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b60c661c0d2d4a1db6e5256c7a60da76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.450554 24152 tablet_service.cc:1467] Processing CreateTablet for tablet 82e36e0cbbbe4f4bb70897d2660981c2 (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260812 19:27:12.451946 24159 tablet_service.cc:1467] Processing CreateTablet for tablet c2e53b579ac947bbb23b5dede3c9391f (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260812 19:27:12.452031 23908 tablet_service.cc:1467] Processing CreateTablet for tablet 5842b318cf814fe59cb68d5a3fb2239e (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260812 19:27:12.453558 23908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5842b318cf814fe59cb68d5a3fb2239e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.453745 24151 tablet_service.cc:1467] Processing CreateTablet for tablet 5842b318cf814fe59cb68d5a3fb2239e (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260812 19:27:12.452054 24152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82e36e0cbbbe4f4bb70897d2660981c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.455403 24151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5842b318cf814fe59cb68d5a3fb2239e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.456804 24159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2e53b579ac947bbb23b5dede3c9391f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.457461 23907 tablet_service.cc:1467] Processing CreateTablet for tablet 4dc105f37baa4573b9c4d8bbbdf723c0 (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260812 19:27:12.458917 23907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dc105f37baa4573b9c4d8bbbdf723c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.505376 24150 tablet_service.cc:1467] Processing CreateTablet for tablet 4dc105f37baa4573b9c4d8bbbdf723c0 (DEFAULT_TABLE table=test-workload [id=c3ca7cf4f43a46fb9a0f2862b653d1e7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260812 19:27:12.507194 24150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dc105f37baa4573b9c4d8bbbdf723c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.512421 24255 tablet_bootstrap.cc:492] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:12.541450 24256 tablet_bootstrap.cc:492] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:12.548785 24256 tablet_bootstrap.cc:654] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.551007 24255 tablet_bootstrap.cc:654] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.562453 24255 tablet_bootstrap.cc:492] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:12.563006 24255 ts_tablet_manager.cc:1397] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.009s
I20260812 19:27:12.566174 24255 raft_consensus.cc:348] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.566967 24255 raft_consensus.cc:374] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.567255 24255 raft_consensus.cc:729] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.568003 24255 consensus_queue.cc:260] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.570240 24098 heartbeater.cc:503] Master 127.3.253.62:35739 was elected leader, sending a full tablet report...
I20260812 19:27:12.570763 24255 ts_tablet_manager.cc:1428] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260812 19:27:12.572000 24255 tablet_bootstrap.cc:492] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:12.579787 24255 tablet_bootstrap.cc:654] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.588464 24257 tablet_bootstrap.cc:492] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:12.598868 24257 tablet_bootstrap.cc:654] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.610247 24256 tablet_bootstrap.cc:492] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:12.610247 24255 tablet_bootstrap.cc:492] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:12.610411 24257 tablet_bootstrap.cc:492] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:12.611014 24256 ts_tablet_manager.cc:1397] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.014s
I20260812 19:27:12.611054 24255 ts_tablet_manager.cc:1397] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.018s
I20260812 19:27:12.611178 24257 ts_tablet_manager.cc:1397] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260812 19:27:12.613822 24257 raft_consensus.cc:348] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.614408 24257 raft_consensus.cc:374] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.614826 24257 raft_consensus.cc:729] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.614472 24255 raft_consensus.cc:348] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.614842 24256 raft_consensus.cc:348] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.615571 24255 raft_consensus.cc:374] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.615813 24256 raft_consensus.cc:374] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.616011 24255 raft_consensus.cc:729] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.615638 24257 consensus_queue.cc:260] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.616349 24256 raft_consensus.cc:729] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.616891 24255 consensus_queue.cc:260] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.617234 24256 consensus_queue.cc:260] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.618844 24229 heartbeater.cc:503] Master 127.3.253.62:35739 was elected leader, sending a full tablet report...
I20260812 19:27:12.620107 24255 ts_tablet_manager.cc:1428] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260812 19:27:12.621150 24255 tablet_bootstrap.cc:492] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:12.627288 24256 ts_tablet_manager.cc:1428] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.004s
I20260812 19:27:12.627866 24255 tablet_bootstrap.cc:654] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.628275 23985 heartbeater.cc:503] Master 127.3.253.62:35739 was elected leader, sending a full tablet report...
I20260812 19:27:12.633091 24256 tablet_bootstrap.cc:492] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:12.638068 24255 tablet_bootstrap.cc:492] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:12.638801 24255 ts_tablet_manager.cc:1397] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260812 19:27:12.638993 24256 tablet_bootstrap.cc:654] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.642064 24255 raft_consensus.cc:348] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.642947 24255 raft_consensus.cc:374] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.643261 24255 raft_consensus.cc:729] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.644086 24255 consensus_queue.cc:260] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.645450 24257 ts_tablet_manager.cc:1428] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260812 19:27:12.646013 24256 tablet_bootstrap.cc:492] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:12.646404 24255 ts_tablet_manager.cc:1428] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260812 19:27:12.646675 24257 tablet_bootstrap.cc:492] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:12.646834 24256 ts_tablet_manager.cc:1397] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.003s
I20260812 19:27:12.647492 24255 tablet_bootstrap.cc:492] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:12.654294 24255 tablet_bootstrap.cc:654] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.655616 24256 raft_consensus.cc:348] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.656735 24256 raft_consensus.cc:374] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.657145 24256 raft_consensus.cc:729] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.659438 24257 tablet_bootstrap.cc:654] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.658269 24256 consensus_queue.cc:260] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.661623 24274 raft_consensus.cc:482] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:12.662250 24274 raft_consensus.cc:504] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.672338 24256 ts_tablet_manager.cc:1428] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.005s
I20260812 19:27:12.673098 24257 tablet_bootstrap.cc:492] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:12.673699 24274 leader_election.cc:288] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:12.674031 24256 tablet_bootstrap.cc:492] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:12.678743 24257 ts_tablet_manager.cc:1397] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.004s
I20260812 19:27:12.686374 24257 raft_consensus.cc:348] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.687489 24257 raft_consensus.cc:374] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.687853 24257 raft_consensus.cc:729] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.688802 24256 tablet_bootstrap.cc:654] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.694305 24257 consensus_queue.cc:260] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.701741 24256 tablet_bootstrap.cc:492] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:12.702533 24256 ts_tablet_manager.cc:1397] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.009s
I20260812 19:27:12.705768 24256 raft_consensus.cc:348] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.706835 24256 raft_consensus.cc:374] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.707244 24256 raft_consensus.cc:729] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.708448 24257 ts_tablet_manager.cc:1428] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260812 19:27:12.708302 24256 consensus_queue.cc:260] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.709702 24257 tablet_bootstrap.cc:492] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:12.711364 24256 ts_tablet_manager.cc:1428] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260812 19:27:12.713616 24256 tablet_bootstrap.cc:492] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:12.713667 24255 tablet_bootstrap.cc:492] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:12.714390 24255 ts_tablet_manager.cc:1397] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.067s	user 0.038s	sys 0.025s
I20260812 19:27:12.717397 24255 raft_consensus.cc:348] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.718179 24255 raft_consensus.cc:374] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.718467 24255 raft_consensus.cc:729] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.719205 24255 consensus_queue.cc:260] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.720643 24257 tablet_bootstrap.cc:654] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.721958 24282 raft_consensus.cc:482] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:12.722536 24282 raft_consensus.cc:504] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.724848 24282 leader_election.cc:288] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:12.721621 24255 ts_tablet_manager.cc:1428] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260812 19:27:12.726588 24255 tablet_bootstrap.cc:492] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:12.727838 24256 tablet_bootstrap.cc:654] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.733603 24255 tablet_bootstrap.cc:654] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.740799 24256 tablet_bootstrap.cc:492] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:12.740926 24257 tablet_bootstrap.cc:492] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:12.741578 24256 ts_tablet_manager.cc:1397] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.011s
I20260812 19:27:12.741796 24257 ts_tablet_manager.cc:1397] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.000s
I20260812 19:27:12.744976 24256 raft_consensus.cc:348] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.746055 24256 raft_consensus.cc:374] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.745636 24257 raft_consensus.cc:348] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.746485 24256 raft_consensus.cc:729] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.746778 24257 raft_consensus.cc:374] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.747287 24257 raft_consensus.cc:729] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.747434 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c7d1173b851418584001c638601f887" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:12.747895 24256 consensus_queue.cc:260] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.748478 24059 raft_consensus.cc:2454] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 0.
I20260812 19:27:12.748350 24257 consensus_queue.cc:260] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.749523 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5842b318cf814fe59cb68d5a3fb2239e" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:12.750352 24057 raft_consensus.cc:2454] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 0.
I20260812 19:27:12.750401 23874 leader_election.cc:302] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:12.751403 24282 raft_consensus.cc:2781] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:12.751605 23874 leader_election.cc:302] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:12.751852 24257 ts_tablet_manager.cc:1428] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260812 19:27:12.751806 24282 raft_consensus.cc:482] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:12.752540 24282 raft_consensus.cc:3037] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:12.754868 24274 raft_consensus.cc:2781] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:12.755323 24274 raft_consensus.cc:482] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:12.755697 24274 raft_consensus.cc:3037] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:12.763747 24257 tablet_bootstrap.cc:492] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:12.770925 24282 raft_consensus.cc:504] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.775100 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c7d1173b851418584001c638601f887" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:12.775951 24057 raft_consensus.cc:3037] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:12.798444 24282 leader_election.cc:288] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Requested vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:12.803077 24184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c7d1173b851418584001c638601f887" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:12.809084 24186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5842b318cf814fe59cb68d5a3fb2239e" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
W20260812 19:27:12.811278 23872 leader_election.cc:341] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.802944 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c7d1173b851418584001c638601f887" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:12.812947 24274 raft_consensus.cc:504] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
W20260812 19:27:12.814477 23872 leader_election.cc:341] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.816172 24274 leader_election.cc:288] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Requested vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:12.817225 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5842b318cf814fe59cb68d5a3fb2239e" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6"
W20260812 19:27:12.817788 23872 leader_election.cc:341] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.817977 24059 raft_consensus.cc:3037] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:12.820901 24255 tablet_bootstrap.cc:492] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:12.821157 24257 tablet_bootstrap.cc:654] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.821724 24255 ts_tablet_manager.cc:1397] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.095s	user 0.044s	sys 0.041s
I20260812 19:27:12.824661 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5842b318cf814fe59cb68d5a3fb2239e" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978"
W20260812 19:27:12.826035 23872 leader_election.cc:341] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.826145 24255 raft_consensus.cc:348] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.828996 24255 raft_consensus.cc:374] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.829232 24299 raft_consensus.cc:482] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:12.829321 24255 raft_consensus.cc:729] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.830549 24255 consensus_queue.cc:260] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.832284 24256 ts_tablet_manager.cc:1428] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.090s	user 0.023s	sys 0.045s
I20260812 19:27:12.829840 24299 raft_consensus.cc:504] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.833549 24256 tablet_bootstrap.cc:492] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:12.834705 24299 leader_election.cc:288] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:12.836334 24056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377918f8e49b483f9c2d59cf73ce820f" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:12.837647 24056 raft_consensus.cc:2454] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 0.
I20260812 19:27:12.838949 24059 raft_consensus.cc:2454] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 1.
I20260812 19:27:12.839092 23874 leader_election.cc:302] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:12.840333 24299 raft_consensus.cc:2781] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:12.840718 24299 raft_consensus.cc:482] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:12.841075 24299 raft_consensus.cc:3037] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:12.841413 24255 ts_tablet_manager.cc:1428] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260812 19:27:12.842131 24256 tablet_bootstrap.cc:654] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.843276 23874 leader_election.cc:302] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: ffd3f94084504c5b94551fd257267978
I20260812 19:27:12.855377 24255 tablet_bootstrap.cc:492] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:12.859997 24256 tablet_bootstrap.cc:492] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:12.860610 24256 ts_tablet_manager.cc:1397] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.007s
I20260812 19:27:12.862236 24274 raft_consensus.cc:2781] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:12.862682 24299 raft_consensus.cc:504] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.863574 24255 tablet_bootstrap.cc:654] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.863477 24256 raft_consensus.cc:348] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.864352 24256 raft_consensus.cc:374] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.864639 24256 raft_consensus.cc:729] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.864804 24299 leader_election.cc:288] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Requested vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:12.865355 24256 consensus_queue.cc:260] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.868046 24256 ts_tablet_manager.cc:1428] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260812 19:27:12.868196 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377918f8e49b483f9c2d59cf73ce820f" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:12.869246 24256 tablet_bootstrap.cc:492] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:12.874369 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377918f8e49b483f9c2d59cf73ce820f" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:12.877041 24256 tablet_bootstrap.cc:654] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:12.877959 23849 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260812 19:27:12.877260 23872 leader_election.cc:341] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:12.880982 23872 leader_election.cc:341] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.825645 24057 raft_consensus.cc:2454] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 1.
I20260812 19:27:12.887223 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377918f8e49b483f9c2d59cf73ce820f" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:12.888181 24059 raft_consensus.cc:3037] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:12.888640 23874 leader_election.cc:302] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: ffd3f94084504c5b94551fd257267978
I20260812 19:27:12.890776 24282 raft_consensus.cc:2781] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:12.891590 24282 raft_consensus.cc:686] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Leader. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:12.896581 24274 raft_consensus.cc:686] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Leader. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:12.898212 24274 consensus_queue.cc:237] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.893829 24282 consensus_queue.cc:237] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.909312 24059 raft_consensus.cc:2454] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 1.
I20260812 19:27:12.911940 24257 tablet_bootstrap.cc:492] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:12.912782 24257 ts_tablet_manager.cc:1397] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.149s	user 0.014s	sys 0.001s
I20260812 19:27:12.915445 23874 leader_election.cc:302] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: ffd3f94084504c5b94551fd257267978
I20260812 19:27:12.917168 24299 raft_consensus.cc:482] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:12.917448 24303 raft_consensus.cc:2781] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:12.917797 24299 raft_consensus.cc:504] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.927678 24271 raft_consensus.cc:482] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:12.922370 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e87eb94d5c224f8d8e6aac06c3fceca3" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:12.920832 24299 leader_election.cc:288] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:12.928582 24271 raft_consensus.cc:504] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.923521 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e87eb94d5c224f8d8e6aac06c3fceca3" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
W20260812 19:27:12.930490 23874 leader_election.cc:341] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.930852 24189 raft_consensus.cc:2454] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 0.
I20260812 19:27:12.927282 24311 raft_consensus.cc:482] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:12.933269 24311 raft_consensus.cc:504] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.936309 23872 leader_election.cc:302] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5903dc2c6e247ac908381187487e4b3, ffd3f94084504c5b94551fd257267978; no voters: a945c890138c411aa6413b46099be1d6
I20260812 19:27:12.937179 24299 raft_consensus.cc:2781] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:12.937057 24186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733f257d57b3493c8d4c87e92944a7ab" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:12.937702 24299 raft_consensus.cc:482] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:12.939111 24299 raft_consensus.cc:3037] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:12.932585 24303 raft_consensus.cc:686] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Leader. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:12.952860 24271 leader_election.cc:288] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
W20260812 19:27:12.952999 23872 leader_election.cc:341] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.941700 24311 leader_election.cc:288] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:12.972960 24257 raft_consensus.cc:348] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.974390 24257 raft_consensus.cc:374] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.977427 24257 raft_consensus.cc:729] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.961896 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733f257d57b3493c8d4c87e92944a7ab" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:12.979465 24303 consensus_queue.cc:237] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.981477 24255 tablet_bootstrap.cc:492] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:12.982092 24255 ts_tablet_manager.cc:1397] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.136s	user 0.048s	sys 0.070s
I20260812 19:27:12.984277 24257 consensus_queue.cc:260] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
W20260812 19:27:12.985002 23874 leader_election.cc:341] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.985536 23874 leader_election.cc:302] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5903dc2c6e247ac908381187487e4b3; no voters: a945c890138c411aa6413b46099be1d6, ffd3f94084504c5b94551fd257267978
I20260812 19:27:12.987020 24274 raft_consensus.cc:2726] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:12.987248 24255 raft_consensus.cc:348] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.988025 24255 raft_consensus.cc:374] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.988303 24255 raft_consensus.cc:729] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.989089 24255 consensus_queue.cc:260] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.991145 24256 tablet_bootstrap.cc:492] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:12.991632 24255 ts_tablet_manager.cc:1428] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260812 19:27:12.992439 24299 raft_consensus.cc:504] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.993048 24255 tablet_bootstrap.cc:492] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:12.991760 24256 ts_tablet_manager.cc:1397] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.123s	user 0.041s	sys 0.068s
I20260812 19:27:12.998292 24256 raft_consensus.cc:348] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:12.999182 24256 raft_consensus.cc:374] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.999462 24256 raft_consensus.cc:729] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.000478 24255 tablet_bootstrap.cc:654] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:13.000278 24256 consensus_queue.cc:260] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.004490 24271 raft_consensus.cc:482] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.005046 24271 raft_consensus.cc:504] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.007164 24271 leader_election.cc:288] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:13.003278 24256 ts_tablet_manager.cc:1428] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260812 19:27:13.010349 24256 tablet_bootstrap.cc:492] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:13.010478 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e87eb94d5c224f8d8e6aac06c3fceca3" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:13.011075 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82e36e0cbbbe4f4bb70897d2660981c2" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:13.012818 24262 raft_consensus.cc:482] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.014596 24262 raft_consensus.cc:504] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.009824 23760 catalog_manager.cc:5495] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5903dc2c6e247ac908381187487e4b3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "d5903dc2c6e247ac908381187487e4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:13.017489 24262 leader_election.cc:288] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:13.017225 23760 catalog_manager.cc:5495] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5903dc2c6e247ac908381187487e4b3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "d5903dc2c6e247ac908381187487e4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:13.014024 24057 raft_consensus.cc:2454] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 0.
W20260812 19:27:13.020113 24119 leader_election.cc:341] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:13.020324 24262 raft_consensus.cc:482] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.026034 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e87eb94d5c224f8d8e6aac06c3fceca3" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6"
W20260812 19:27:13.037328 23874 leader_election.cc:341] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:13.037732 24256 tablet_bootstrap.cc:654] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:13.026976 24262 raft_consensus.cc:504] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.040970 24262 leader_election.cc:288] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:13.042223 24119 leader_election.cc:302] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:13.047897 24271 raft_consensus.cc:2781] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:13.048310 24271 raft_consensus.cc:482] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:13.048657 24271 raft_consensus.cc:3037] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.046610 24299 leader_election.cc:288] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Requested vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:13.049126 24257 ts_tablet_manager.cc:1428] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.136s	user 0.006s	sys 0.005s
I20260812 19:27:13.051195 24255 tablet_bootstrap.cc:492] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:13.051774 24255 ts_tablet_manager.cc:1397] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.059s	user 0.024s	sys 0.022s
I20260812 19:27:13.052242 24257 tablet_bootstrap.cc:492] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:13.048629 24186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e87eb94d5c224f8d8e6aac06c3fceca3" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:13.053735 24186 raft_consensus.cc:3037] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.069499 24271 raft_consensus.cc:504] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.071723 24271 leader_election.cc:288] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:13.072302 24271 raft_consensus.cc:482] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.072736 24271 raft_consensus.cc:504] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.072990 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82e36e0cbbbe4f4bb70897d2660981c2" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:13.073657 24057 raft_consensus.cc:3037] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.078313 24271 leader_election.cc:288] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:13.079162 24256 tablet_bootstrap.cc:492] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:13.079720 24256 ts_tablet_manager.cc:1397] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.011s
I20260812 19:27:13.080443 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dc105f37baa4573b9c4d8bbbdf723c0" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:13.083455 24186 raft_consensus.cc:2454] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 1.
I20260812 19:27:13.083961 24057 raft_consensus.cc:2454] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 1.
I20260812 19:27:13.085299 23872 leader_election.cc:302] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d5903dc2c6e247ac908381187487e4b3, ffd3f94084504c5b94551fd257267978; no voters: a945c890138c411aa6413b46099be1d6
W20260812 19:27:13.085445 24119 leader_election.cc:341] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:13.086205 24299 raft_consensus.cc:2781] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:13.086333 24119 leader_election.cc:302] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:13.084256 24256 raft_consensus.cc:348] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.086907 24299 raft_consensus.cc:686] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Leader. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:13.087345 24256 raft_consensus.cc:374] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.087644 24323 raft_consensus.cc:2781] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:13.089049 24323 raft_consensus.cc:686] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 1 LEADER]: Becoming Leader. State: Replica: ffd3f94084504c5b94551fd257267978, State: Running, Role: LEADER
I20260812 19:27:13.088136 24299 consensus_queue.cc:237] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.089936 24323 consensus_queue.cc:237] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.087697 24256 raft_consensus.cc:729] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.086403 24255 raft_consensus.cc:348] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.097548 24255 raft_consensus.cc:374] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.097869 24255 raft_consensus.cc:729] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.099079 24255 consensus_queue.cc:260] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.094627 24256 consensus_queue.cc:260] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.104085 24256 ts_tablet_manager.cc:1428] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260812 19:27:13.104914 24255 ts_tablet_manager.cc:1428] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.001s
I20260812 19:27:13.110816 24257 tablet_bootstrap.cc:654] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:13.111776 23935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e87eb94d5c224f8d8e6aac06c3fceca3" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:13.112241 23933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82e36e0cbbbe4f4bb70897d2660981c2" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:13.113137 23933 raft_consensus.cc:2454] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 0.
I20260812 19:27:13.113740 24117 leader_election.cc:302] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffd3f94084504c5b94551fd257267978; no voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3
I20260812 19:27:13.115212 24255 tablet_bootstrap.cc:492] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:13.115319 23931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dc105f37baa4573b9c4d8bbbdf723c0" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:13.116031 24323 raft_consensus.cc:2726] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:13.114446 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82e36e0cbbbe4f4bb70897d2660981c2" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:13.118332 23932 raft_consensus.cc:3037] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.123435 24256 tablet_bootstrap.cc:492] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
W20260812 19:27:13.123499 24117 leader_election.cc:341] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:13.124217 24117 leader_election.cc:302] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffd3f94084504c5b94551fd257267978; no voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3
I20260812 19:27:13.125388 24323 raft_consensus.cc:2726] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:13.125154 23931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b60c661c0d2d4a1db6e5256c7a60da76" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
W20260812 19:27:13.126926 24001 leader_election.cc:341] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:13.127020 23933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2e53b579ac947bbb23b5dede3c9391f" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:13.127957 23933 raft_consensus.cc:2454] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 0.
I20260812 19:27:13.129127 24001 leader_election.cc:302] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:13.130064 24262 raft_consensus.cc:2781] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:13.130470 24262 raft_consensus.cc:482] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:13.130861 24262 raft_consensus.cc:3037] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.136584 23932 raft_consensus.cc:2454] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 1.
I20260812 19:27:13.139876 24262 raft_consensus.cc:504] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.148344 24186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b60c661c0d2d4a1db6e5256c7a60da76" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:13.148769 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2e53b579ac947bbb23b5dede3c9391f" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:13.150187 24262 leader_election.cc:288] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:13.144632 23763 catalog_manager.cc:5495] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffd3f94084504c5b94551fd257267978 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "ffd3f94084504c5b94551fd257267978" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: HEALTHY } } }
W20260812 19:27:13.150403 24001 leader_election.cc:341] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:13.151152 24001 leader_election.cc:302] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a945c890138c411aa6413b46099be1d6; no voters: d5903dc2c6e247ac908381187487e4b3, ffd3f94084504c5b94551fd257267978
I20260812 19:27:13.152951 24337 raft_consensus.cc:2726] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:13.154174 24001 leader_election.cc:341] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:13.130061 24256 tablet_bootstrap.cc:654] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:13.150260 24255 tablet_bootstrap.cc:654] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:13.153131 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2e53b579ac947bbb23b5dede3c9391f" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:13.157851 24257 tablet_bootstrap.cc:492] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:13.158198 23932 raft_consensus.cc:3037] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.158355 24257 ts_tablet_manager.cc:1397] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.107s	user 0.022s	sys 0.022s
I20260812 19:27:13.161960 24257 raft_consensus.cc:348] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.162863 24257 raft_consensus.cc:374] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.161870 23761 catalog_manager.cc:5495] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5903dc2c6e247ac908381187487e4b3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "d5903dc2c6e247ac908381187487e4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:13.163175 24257 raft_consensus.cc:729] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.164762 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2e53b579ac947bbb23b5dede3c9391f" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:13.164434 23761 catalog_manager.cc:5495] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5903dc2c6e247ac908381187487e4b3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "d5903dc2c6e247ac908381187487e4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
W20260812 19:27:13.166219 24001 leader_election.cc:341] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:13.164762 24257 consensus_queue.cc:260] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.169150 24256 tablet_bootstrap.cc:492] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:13.169744 24256 ts_tablet_manager.cc:1397] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.003s
I20260812 19:27:13.170552 24257 ts_tablet_manager.cc:1428] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260812 19:27:13.171736 24257 tablet_bootstrap.cc:492] T b60c661c0d2d4a1db6e5256c7a60da76 P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:13.172885 24256 raft_consensus.cc:348] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.176147 24256 raft_consensus.cc:374] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.176501 24256 raft_consensus.cc:729] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.178472 24257 tablet_bootstrap.cc:654] T b60c661c0d2d4a1db6e5256c7a60da76 P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:13.177255 23932 raft_consensus.cc:2454] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 1.
I20260812 19:27:13.179767 24001 leader_election.cc:302] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: ffd3f94084504c5b94551fd257267978
I20260812 19:27:13.181049 24262 raft_consensus.cc:2781] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:13.181700 24262 raft_consensus.cc:686] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Becoming Leader. State: Replica: a945c890138c411aa6413b46099be1d6, State: Running, Role: LEADER
I20260812 19:27:13.182826 24262 consensus_queue.cc:237] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.178227 24256 consensus_queue.cc:260] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.195680 24256 ts_tablet_manager.cc:1428] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.003s
I20260812 19:27:13.196079 23761 catalog_manager.cc:5495] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a945c890138c411aa6413b46099be1d6 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "a945c890138c411aa6413b46099be1d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:13.197079 24256 tablet_bootstrap.cc:492] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:13.205808 24256 tablet_bootstrap.cc:654] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:13.210727 24255 tablet_bootstrap.cc:492] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:13.211162 24257 tablet_bootstrap.cc:492] T b60c661c0d2d4a1db6e5256c7a60da76 P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:13.211351 24255 ts_tablet_manager.cc:1397] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.015s
I20260812 19:27:13.211766 24257 ts_tablet_manager.cc:1397] T b60c661c0d2d4a1db6e5256c7a60da76 P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.028s
I20260812 19:27:13.214460 24256 tablet_bootstrap.cc:492] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:13.214460 24255 raft_consensus.cc:348] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.215167 24256 ts_tablet_manager.cc:1397] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260812 19:27:13.214568 24257 raft_consensus.cc:348] T b60c661c0d2d4a1db6e5256c7a60da76 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.215353 24255 raft_consensus.cc:374] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.215616 24257 raft_consensus.cc:374] T b60c661c0d2d4a1db6e5256c7a60da76 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.215694 24255 raft_consensus.cc:729] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.215961 24257 raft_consensus.cc:729] T b60c661c0d2d4a1db6e5256c7a60da76 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.216732 24257 consensus_queue.cc:260] T b60c661c0d2d4a1db6e5256c7a60da76 P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.216631 24255 consensus_queue.cc:260] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.217808 24256 raft_consensus.cc:348] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.218500 24256 raft_consensus.cc:374] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.218763 24256 raft_consensus.cc:729] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.218994 24255 ts_tablet_manager.cc:1428] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260812 19:27:13.219081 24257 ts_tablet_manager.cc:1428] T b60c661c0d2d4a1db6e5256c7a60da76 P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260812 19:27:13.219388 24256 consensus_queue.cc:260] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.220045 24255 tablet_bootstrap.cc:492] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:13.220264 24257 tablet_bootstrap.cc:492] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:13.221489 24256 ts_tablet_manager.cc:1428] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260812 19:27:13.226099 24257 tablet_bootstrap.cc:654] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:13.233543 24255 tablet_bootstrap.cc:654] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:13.240883 24255 tablet_bootstrap.cc:492] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:13.241045 24257 tablet_bootstrap.cc:492] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:13.241284 24255 ts_tablet_manager.cc:1397] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.003s
I20260812 19:27:13.241596 24257 ts_tablet_manager.cc:1397] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260812 19:27:13.243459 24255 raft_consensus.cc:348] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.244036 24255 raft_consensus.cc:374] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.244407 24255 raft_consensus.cc:729] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.243930 24257 raft_consensus.cc:348] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.244812 24257 raft_consensus.cc:374] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.245054 24257 raft_consensus.cc:729] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.245069 24255 consensus_queue.cc:260] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.245833 24257 consensus_queue.cc:260] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.247324 24255 ts_tablet_manager.cc:1428] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260812 19:27:13.248238 24257 ts_tablet_manager.cc:1428] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260812 19:27:13.249254 24257 tablet_bootstrap.cc:492] T 733f257d57b3493c8d4c87e92944a7ab P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:13.255239 24257 tablet_bootstrap.cc:654] T 733f257d57b3493c8d4c87e92944a7ab P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:13.260412 24257 tablet_bootstrap.cc:492] T 733f257d57b3493c8d4c87e92944a7ab P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:13.260799 24257 ts_tablet_manager.cc:1397] T 733f257d57b3493c8d4c87e92944a7ab P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260812 19:27:13.262844 24257 raft_consensus.cc:348] T 733f257d57b3493c8d4c87e92944a7ab P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.263348 24257 raft_consensus.cc:374] T 733f257d57b3493c8d4c87e92944a7ab P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.263536 24257 raft_consensus.cc:729] T 733f257d57b3493c8d4c87e92944a7ab P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.264178 24257 consensus_queue.cc:260] T 733f257d57b3493c8d4c87e92944a7ab P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.265867 24257 ts_tablet_manager.cc:1428] T 733f257d57b3493c8d4c87e92944a7ab P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 19:27:13.266943 24257 tablet_bootstrap.cc:492] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:13.272018 24257 tablet_bootstrap.cc:654] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:13.276644 24257 tablet_bootstrap.cc:492] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:13.277079 24257 ts_tablet_manager.cc:1397] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.010s	user 0.007s	sys 0.001s
I20260812 19:27:13.279217 24257 raft_consensus.cc:348] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.279748 24257 raft_consensus.cc:374] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.279994 24257 raft_consensus.cc:729] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.280560 24257 consensus_queue.cc:260] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.282083 24257 ts_tablet_manager.cc:1428] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 19:27:13.283728 24323 raft_consensus.cc:482] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.284225 24323 raft_consensus.cc:504] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.286448 24323 leader_election.cc:288] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:13.287436 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c7d1173b851418584001c638601f887" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:13.287518 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c7d1173b851418584001c638601f887" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:13.288420 24057 raft_consensus.cc:2379] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ffd3f94084504c5b94551fd257267978 in current term 1: Already voted for candidate d5903dc2c6e247ac908381187487e4b3 in this term.
I20260812 19:27:13.289381 24119 leader_election.cc:302] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffd3f94084504c5b94551fd257267978; no voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3
I20260812 19:27:13.290076 24323 raft_consensus.cc:3037] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.297331 24323 raft_consensus.cc:2726] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:13.306346 24323 raft_consensus.cc:482] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.306869 24323 raft_consensus.cc:504] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.308575 24323 leader_election.cc:288] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:13.309490 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5842b318cf814fe59cb68d5a3fb2239e" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:13.309631 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5842b318cf814fe59cb68d5a3fb2239e" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:13.310447 24057 raft_consensus.cc:2379] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ffd3f94084504c5b94551fd257267978 in current term 1: Already voted for candidate d5903dc2c6e247ac908381187487e4b3 in this term.
I20260812 19:27:13.311342 24119 leader_election.cc:302] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffd3f94084504c5b94551fd257267978; no voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3
I20260812 19:27:13.312032 24323 raft_consensus.cc:3037] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.317166 24323 raft_consensus.cc:2726] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:13.319793 24262 raft_consensus.cc:482] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.320283 24262 raft_consensus.cc:504] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.321841 24262 leader_election.cc:288] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:13.323010 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e87eb94d5c224f8d8e6aac06c3fceca3" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:13.323194 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e87eb94d5c224f8d8e6aac06c3fceca3" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:13.324118 24189 raft_consensus.cc:2379] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a945c890138c411aa6413b46099be1d6 in current term 1: Already voted for candidate d5903dc2c6e247ac908381187487e4b3 in this term.
I20260812 19:27:13.325003 24001 leader_election.cc:302] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a945c890138c411aa6413b46099be1d6; no voters: d5903dc2c6e247ac908381187487e4b3, ffd3f94084504c5b94551fd257267978
I20260812 19:27:13.325650 24262 raft_consensus.cc:3037] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.331418 24262 raft_consensus.cc:2726] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:13.344697 24299 consensus_queue.cc:1035] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:13.359223 24303 consensus_queue.cc:1035] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:13.359624 24299 raft_consensus.cc:482] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.360409 24271 raft_consensus.cc:482] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.360888 24299 raft_consensus.cc:504] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.361060 24271 raft_consensus.cc:504] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.363240 24299 leader_election.cc:288] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:13.364599 24271 leader_election.cc:288] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907)
I20260812 19:27:13.365126 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377918f8e49b483f9c2d59cf73ce820f" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:13.367213 24056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dc105f37baa4573b9c4d8bbbdf723c0" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:13.368037 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377918f8e49b483f9c2d59cf73ce820f" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:13.368203 24056 raft_consensus.cc:2454] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 0.
I20260812 19:27:13.368896 24059 raft_consensus.cc:2379] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ffd3f94084504c5b94551fd257267978 in current term 1: Already voted for candidate d5903dc2c6e247ac908381187487e4b3 in this term.
I20260812 19:27:13.369771 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dc105f37baa4573b9c4d8bbbdf723c0" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:13.370208 24119 leader_election.cc:302] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffd3f94084504c5b94551fd257267978; no voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3
I20260812 19:27:13.370075 23874 leader_election.cc:302] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:13.370630 24189 raft_consensus.cc:2454] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 0.
I20260812 19:27:13.371608 24299 raft_consensus.cc:2781] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:13.371675 24262 raft_consensus.cc:482] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.372735 24271 raft_consensus.cc:3037] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.372217 24299 raft_consensus.cc:482] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:13.373006 24262 raft_consensus.cc:504] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.374096 24299 raft_consensus.cc:3037] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.376525 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733f257d57b3493c8d4c87e92944a7ab" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:13.377285 23932 raft_consensus.cc:2454] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 0.
I20260812 19:27:13.378683 24001 leader_election.cc:302] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:13.379644 24337 raft_consensus.cc:2781] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:13.380061 24337 raft_consensus.cc:482] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:13.380417 24337 raft_consensus.cc:3037] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.381757 24271 raft_consensus.cc:2726] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:13.385586 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733f257d57b3493c8d4c87e92944a7ab" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:13.386436 24189 raft_consensus.cc:2454] T 733f257d57b3493c8d4c87e92944a7ab P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 0.
I20260812 19:27:13.387953 24262 leader_election.cc:288] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:13.388499 24303 consensus_queue.cc:1035] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:13.389142 24337 raft_consensus.cc:504] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.389700 24299 raft_consensus.cc:504] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.392091 24299 leader_election.cc:288] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Requested vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:13.393158 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733f257d57b3493c8d4c87e92944a7ab" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:13.393930 23932 raft_consensus.cc:3037] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.393818 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dc105f37baa4573b9c4d8bbbdf723c0" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:13.394586 24059 raft_consensus.cc:3037] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.395841 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dc105f37baa4573b9c4d8bbbdf723c0" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:13.396452 24189 raft_consensus.cc:3037] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.400954 24271 raft_consensus.cc:482] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.401472 24271 raft_consensus.cc:504] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.402207 23932 raft_consensus.cc:2454] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 1.
I20260812 19:27:13.402825 24059 raft_consensus.cc:2454] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 1.
I20260812 19:27:13.403666 24271 leader_election.cc:288] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:13.403698 24001 leader_election.cc:302] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:13.404229 23874 leader_election.cc:302] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:13.405712 24303 raft_consensus.cc:2781] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:13.405755 24363 raft_consensus.cc:2781] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:13.406184 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2e53b579ac947bbb23b5dede3c9391f" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:13.406913 24303 raft_consensus.cc:686] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Leader. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:13.407431 23932 raft_consensus.cc:2379] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ffd3f94084504c5b94551fd257267978 in current term 1: Already voted for candidate a945c890138c411aa6413b46099be1d6 in this term.
I20260812 19:27:13.406513 24363 raft_consensus.cc:686] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Becoming Leader. State: Replica: a945c890138c411aa6413b46099be1d6, State: Running, Role: LEADER
I20260812 19:27:13.409759 24363 consensus_queue.cc:237] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.410547 24299 consensus_queue.cc:1035] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:13.411728 24184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733f257d57b3493c8d4c87e92944a7ab" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:13.412429 24184 raft_consensus.cc:3037] T 733f257d57b3493c8d4c87e92944a7ab P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.412384 24303 consensus_queue.cc:237] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.420938 24337 leader_election.cc:288] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:13.425261 24189 raft_consensus.cc:2454] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 1.
I20260812 19:27:13.425988 24274 consensus_queue.cc:1035] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:13.426440 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2e53b579ac947bbb23b5dede3c9391f" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:13.432860 24184 raft_consensus.cc:2454] T 733f257d57b3493c8d4c87e92944a7ab P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 1.
I20260812 19:27:13.433391 23763 catalog_manager.cc:5495] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a945c890138c411aa6413b46099be1d6 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "a945c890138c411aa6413b46099be1d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:13.434751 23760 catalog_manager.cc:5495] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5903dc2c6e247ac908381187487e4b3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "d5903dc2c6e247ac908381187487e4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:13.438122 24119 leader_election.cc:302] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffd3f94084504c5b94551fd257267978; no voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3
I20260812 19:27:13.439553 24271 raft_consensus.cc:3037] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.442595 24282 consensus_queue.cc:1035] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:13.448005 24271 raft_consensus.cc:2726] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:13.505112 24274 raft_consensus.cc:482] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.505666 24274 raft_consensus.cc:504] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.507519 24274 leader_election.cc:288] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:13.508071 24274 consensus_queue.cc:1035] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:13.508471 24056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b60c661c0d2d4a1db6e5256c7a60da76" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:13.508863 24184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b60c661c0d2d4a1db6e5256c7a60da76" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:13.509279 24056 raft_consensus.cc:2454] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 0.
I20260812 19:27:13.509632 24184 raft_consensus.cc:2454] T b60c661c0d2d4a1db6e5256c7a60da76 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 0.
I20260812 19:27:13.510731 23874 leader_election.cc:302] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:13.511631 24282 raft_consensus.cc:2781] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:13.512032 24282 raft_consensus.cc:482] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:13.512300 24282 raft_consensus.cc:3037] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.520130 24282 raft_consensus.cc:504] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.520505 24299 consensus_queue.cc:1035] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:13.522287 24282 leader_election.cc:288] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Requested vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:13.523370 24056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b60c661c0d2d4a1db6e5256c7a60da76" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:13.524044 24056 raft_consensus.cc:3037] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.526925 24183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b60c661c0d2d4a1db6e5256c7a60da76" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:13.527592 24183 raft_consensus.cc:3037] T b60c661c0d2d4a1db6e5256c7a60da76 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.531279 24271 consensus_queue.cc:1035] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:13.533085 24056 raft_consensus.cc:2454] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 1.
I20260812 19:27:13.534484 23874 leader_election.cc:302] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:13.535477 24274 raft_consensus.cc:2781] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:13.535955 24274 raft_consensus.cc:686] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Leader. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:13.536808 24183 raft_consensus.cc:2454] T b60c661c0d2d4a1db6e5256c7a60da76 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 1.
I20260812 19:27:13.536971 24274 consensus_queue.cc:237] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.548127 24386 consensus_queue.cc:1035] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:13.548842 23760 catalog_manager.cc:5495] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5903dc2c6e247ac908381187487e4b3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "d5903dc2c6e247ac908381187487e4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:13.600461 24363 consensus_queue.cc:1035] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:13.611339 24363 consensus_queue.cc:1035] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:13.793249 24262 consensus_queue.cc:1035] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:13.812332 24363 consensus_queue.cc:1035] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:13.815969 24057 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c2e53b579ac947bbb23b5dede3c9391f"
dest_uuid: "a945c890138c411aa6413b46099be1d6"
mode: GRACEFUL
new_leader_uuid: "d5903dc2c6e247ac908381187487e4b3"
 from {username='slave'} at 127.0.0.1:51534
I20260812 19:27:13.816659 24057 raft_consensus.cc:595] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Received request to transfer leadership to TS d5903dc2c6e247ac908381187487e4b3
I20260812 19:27:13.836115 23932 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8c7d1173b851418584001c638601f887"
dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
mode: GRACEFUL
new_leader_uuid: "a945c890138c411aa6413b46099be1d6"
 from {username='slave'} at 127.0.0.1:50784
I20260812 19:27:13.836723 23932 raft_consensus.cc:595] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Received request to transfer leadership to TS a945c890138c411aa6413b46099be1d6
I20260812 19:27:13.855377 24183 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "82e36e0cbbbe4f4bb70897d2660981c2"
dest_uuid: "ffd3f94084504c5b94551fd257267978"
mode: GRACEFUL
new_leader_uuid: "a945c890138c411aa6413b46099be1d6"
 from {username='slave'} at 127.0.0.1:55736
I20260812 19:27:13.855978 24183 raft_consensus.cc:595] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 1 LEADER]: Received request to transfer leadership to TS a945c890138c411aa6413b46099be1d6
I20260812 19:27:13.861230 23932 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5842b318cf814fe59cb68d5a3fb2239e"
dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
mode: GRACEFUL
new_leader_uuid: "a945c890138c411aa6413b46099be1d6"
 from {username='slave'} at 127.0.0.1:50784
I20260812 19:27:13.861805 23932 raft_consensus.cc:595] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Received request to transfer leadership to TS a945c890138c411aa6413b46099be1d6
I20260812 19:27:13.866878 23932 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4dc105f37baa4573b9c4d8bbbdf723c0"
dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
mode: GRACEFUL
new_leader_uuid: "ffd3f94084504c5b94551fd257267978"
 from {username='slave'} at 127.0.0.1:50784
I20260812 19:27:13.867429 23932 raft_consensus.cc:595] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Received request to transfer leadership to TS ffd3f94084504c5b94551fd257267978
I20260812 19:27:13.886405 24274 consensus_queue.cc:1035] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:13.893761 24299 raft_consensus.cc:979] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3: : Instructing follower ffd3f94084504c5b94551fd257267978 to start an election
I20260812 19:27:13.894251 24282 raft_consensus.cc:1067] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Signalling peer ffd3f94084504c5b94551fd257267978 to start an election
I20260812 19:27:13.896865 24184 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4dc105f37baa4573b9c4d8bbbdf723c0"
dest_uuid: "ffd3f94084504c5b94551fd257267978"
 from {username='slave'} at 127.0.0.1:55710
I20260812 19:27:13.897971 24184 raft_consensus.cc:482] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:13.898407 24184 raft_consensus.cc:3037] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:13.899561 24274 consensus_queue.cc:1035] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:13.907156 24184 raft_consensus.cc:504] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.911419 24184 leader_election.cc:288] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 2 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:13.913237 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dc105f37baa4573b9c4d8bbbdf723c0" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:13.914083 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dc105f37baa4573b9c4d8bbbdf723c0" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:13.916888 23932 raft_consensus.cc:3032] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:27:13.917054 24057 raft_consensus.cc:3037] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:13.917285 23932 raft_consensus.cc:729] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:13.918143 23932 consensus_queue.cc:260] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.919214 23932 raft_consensus.cc:3037] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:13.922821 24057 raft_consensus.cc:2454] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 2.
I20260812 19:27:13.924108 24119 leader_election.cc:302] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:13.924285 23932 raft_consensus.cc:2454] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 2.
I20260812 19:27:13.924979 24386 raft_consensus.cc:2781] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:13.925494 24386 raft_consensus.cc:686] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 2 LEADER]: Becoming Leader. State: Replica: ffd3f94084504c5b94551fd257267978, State: Running, Role: LEADER
I20260812 19:27:13.926230 24386 consensus_queue.cc:237] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.933935 23760 catalog_manager.cc:5495] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 reported cstate change: term changed from 1 to 2, leader changed from d5903dc2c6e247ac908381187487e4b3 (127.3.253.1) to ffd3f94084504c5b94551fd257267978 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "ffd3f94084504c5b94551fd257267978" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:13.938374 24282 raft_consensus.cc:979] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3: : Instructing follower a945c890138c411aa6413b46099be1d6 to start an election
I20260812 19:27:13.938974 24282 raft_consensus.cc:1067] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Signalling peer a945c890138c411aa6413b46099be1d6 to start an election
I20260812 19:27:13.940611 24057 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5842b318cf814fe59cb68d5a3fb2239e"
dest_uuid: "a945c890138c411aa6413b46099be1d6"
 from {username='slave'} at 127.0.0.1:51516
I20260812 19:27:13.941123 24057 raft_consensus.cc:482] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:13.941468 24057 raft_consensus.cc:3037] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:13.947854 24057 raft_consensus.cc:504] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.949685 24057 leader_election.cc:288] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 2 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:13.950951 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5842b318cf814fe59cb68d5a3fb2239e" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:13.950981 24183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5842b318cf814fe59cb68d5a3fb2239e" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:13.951865 23932 raft_consensus.cc:3032] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:27:13.951835 24274 consensus_queue.cc:1035] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:13.951906 24183 raft_consensus.cc:3037] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:13.952555 23932 raft_consensus.cc:729] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:13.953469 23932 consensus_queue.cc:260] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.954828 23932 raft_consensus.cc:3037] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:13.960197 24183 raft_consensus.cc:2454] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 2.
I20260812 19:27:13.962170 24001 leader_election.cc:302] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:13.963570 24363 raft_consensus.cc:2781] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:13.964419 23932 raft_consensus.cc:2454] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 2.
I20260812 19:27:13.964056 24363 raft_consensus.cc:686] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [term 2 LEADER]: Becoming Leader. State: Replica: a945c890138c411aa6413b46099be1d6, State: Running, Role: LEADER
I20260812 19:27:13.966012 24363 consensus_queue.cc:237] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:13.968693 24303 consensus_queue.cc:1035] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:13.974524 23761 catalog_manager.cc:5495] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 reported cstate change: term changed from 1 to 2, leader changed from d5903dc2c6e247ac908381187487e4b3 (127.3.253.1) to a945c890138c411aa6413b46099be1d6 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "a945c890138c411aa6413b46099be1d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:14.028765 24262 raft_consensus.cc:979] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6: : Instructing follower d5903dc2c6e247ac908381187487e4b3 to start an election
I20260812 19:27:14.029275 24363 raft_consensus.cc:1067] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Signalling peer d5903dc2c6e247ac908381187487e4b3 to start an election
I20260812 19:27:14.030756 23932 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c2e53b579ac947bbb23b5dede3c9391f"
dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
 from {username='slave'} at 127.0.0.1:50778
I20260812 19:27:14.031278 23932 raft_consensus.cc:482] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:14.031595 23932 raft_consensus.cc:3037] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:14.037236 23932 raft_consensus.cc:504] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:14.038825 23932 leader_election.cc:288] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 2 election: Requested vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:14.039731 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2e53b579ac947bbb23b5dede3c9391f" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:14.039947 24184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2e53b579ac947bbb23b5dede3c9391f" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:14.040481 24057 raft_consensus.cc:3032] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:27:14.040572 24184 raft_consensus.cc:3037] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:14.040887 24057 raft_consensus.cc:729] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Running, Role: LEADER
I20260812 19:27:14.041771 24057 consensus_queue.cc:260] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:14.043174 24057 raft_consensus.cc:3037] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:14.048375 24184 raft_consensus.cc:2454] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 2.
I20260812 19:27:14.049751 23872 leader_election.cc:302] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5903dc2c6e247ac908381187487e4b3, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:14.050482 24303 raft_consensus.cc:2781] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:14.050506 24057 raft_consensus.cc:2454] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 2.
I20260812 19:27:14.051026 24303 raft_consensus.cc:686] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [term 2 LEADER]: Becoming Leader. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:14.051937 24303 consensus_queue.cc:237] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:14.060492 23761 catalog_manager.cc:5495] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 reported cstate change: term changed from 1 to 2, leader changed from a945c890138c411aa6413b46099be1d6 (127.3.253.2) to d5903dc2c6e247ac908381187487e4b3 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "d5903dc2c6e247ac908381187487e4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:14.149917 24323 raft_consensus.cc:979] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978: : Instructing follower a945c890138c411aa6413b46099be1d6 to start an election
I20260812 19:27:14.150463 24410 raft_consensus.cc:1067] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 1 LEADER]: Signalling peer a945c890138c411aa6413b46099be1d6 to start an election
I20260812 19:27:14.151995 24057 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "82e36e0cbbbe4f4bb70897d2660981c2"
dest_uuid: "a945c890138c411aa6413b46099be1d6"
 from {username='slave'} at 127.0.0.1:51530
I20260812 19:27:14.152516 24057 raft_consensus.cc:482] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:14.152837 24057 raft_consensus.cc:3037] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:14.158273 24057 raft_consensus.cc:504] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:14.159833 24057 leader_election.cc:288] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 2 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:14.160915 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82e36e0cbbbe4f4bb70897d2660981c2" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:14.161130 24184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82e36e0cbbbe4f4bb70897d2660981c2" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:14.161648 23932 raft_consensus.cc:3037] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:14.161795 24184 raft_consensus.cc:3032] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:27:14.162179 24184 raft_consensus.cc:729] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Running, Role: LEADER
I20260812 19:27:14.162904 24184 consensus_queue.cc:260] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:14.164031 24184 raft_consensus.cc:3037] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:14.167765 23932 raft_consensus.cc:2454] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 2.
I20260812 19:27:14.169008 24001 leader_election.cc:302] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:14.169854 24363 raft_consensus.cc:2781] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:14.169883 24184 raft_consensus.cc:2454] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 2.
I20260812 19:27:14.170429 24363 raft_consensus.cc:686] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 2 LEADER]: Becoming Leader. State: Replica: a945c890138c411aa6413b46099be1d6, State: Running, Role: LEADER
I20260812 19:27:14.171298 24363 consensus_queue.cc:237] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:14.178220 23761 catalog_manager.cc:5495] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 reported cstate change: term changed from 1 to 2, leader changed from ffd3f94084504c5b94551fd257267978 (127.3.253.3) to a945c890138c411aa6413b46099be1d6 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "a945c890138c411aa6413b46099be1d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:14.190090 24299 raft_consensus.cc:979] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3: : Instructing follower a945c890138c411aa6413b46099be1d6 to start an election
I20260812 19:27:14.190501 24303 raft_consensus.cc:1067] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Signalling peer a945c890138c411aa6413b46099be1d6 to start an election
I20260812 19:27:14.192111 24057 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8c7d1173b851418584001c638601f887"
dest_uuid: "a945c890138c411aa6413b46099be1d6"
 from {username='slave'} at 127.0.0.1:51516
I20260812 19:27:14.192615 24057 raft_consensus.cc:482] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:14.192912 24057 raft_consensus.cc:3037] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:14.198717 24057 raft_consensus.cc:504] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:14.200385 24057 leader_election.cc:288] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 2 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:14.201395 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c7d1173b851418584001c638601f887" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:14.201555 24184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c7d1173b851418584001c638601f887" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:14.202229 23932 raft_consensus.cc:3032] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:27:14.202327 24184 raft_consensus.cc:3037] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:14.202569 23932 raft_consensus.cc:729] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:14.203394 23932 consensus_queue.cc:260] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:14.204411 23932 raft_consensus.cc:3037] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:14.208019 24184 raft_consensus.cc:2454] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 2.
I20260812 19:27:14.209177 24001 leader_election.cc:302] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:14.209754 23932 raft_consensus.cc:2454] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 2.
I20260812 19:27:14.209919 24363 raft_consensus.cc:2781] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:14.210516 24363 raft_consensus.cc:686] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [term 2 LEADER]: Becoming Leader. State: Replica: a945c890138c411aa6413b46099be1d6, State: Running, Role: LEADER
I20260812 19:27:14.211319 24363 consensus_queue.cc:237] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:14.218021 23761 catalog_manager.cc:5495] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 reported cstate change: term changed from 1 to 2, leader changed from d5903dc2c6e247ac908381187487e4b3 (127.3.253.1) to a945c890138c411aa6413b46099be1d6 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "a945c890138c411aa6413b46099be1d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:14.358502 24057 raft_consensus.cc:1261] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Refusing update from remote peer ffd3f94084504c5b94551fd257267978: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:14.360127 24410 consensus_queue.cc:1035] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:14.367861 23932 raft_consensus.cc:1261] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Refusing update from remote peer ffd3f94084504c5b94551fd257267978: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:14.369496 24386 consensus_queue.cc:1035] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:14.394281 24184 raft_consensus.cc:1261] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Refusing update from remote peer a945c890138c411aa6413b46099be1d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:14.395802 24411 consensus_queue.cc:1035] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:14.404254 23932 raft_consensus.cc:1261] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Refusing update from remote peer a945c890138c411aa6413b46099be1d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:14.408543 24262 consensus_queue.cc:1035] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:14.432703 24057 raft_consensus.cc:1261] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Refusing update from remote peer d5903dc2c6e247ac908381187487e4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:14.433982 24311 consensus_queue.cc:1035] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:14.442297 24184 raft_consensus.cc:1261] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Refusing update from remote peer d5903dc2c6e247ac908381187487e4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:14.443827 24311 consensus_queue.cc:1035] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:14.658216 24184 raft_consensus.cc:1261] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Refusing update from remote peer a945c890138c411aa6413b46099be1d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:14.659529 24262 consensus_queue.cc:1035] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:14.669394 23932 raft_consensus.cc:1261] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Refusing update from remote peer a945c890138c411aa6413b46099be1d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:14.670991 24416 consensus_queue.cc:1035] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:27:14.770715 23932 raft_consensus.cc:1261] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Refusing update from remote peer a945c890138c411aa6413b46099be1d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:14.772066 24416 consensus_queue.cc:1035] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:14.781143 24184 raft_consensus.cc:1261] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Refusing update from remote peer a945c890138c411aa6413b46099be1d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:14.783480 24416 consensus_queue.cc:1035] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:16.868845  4084 test_util.cc:268] Using random seed: -1824346421
I20260812 19:27:16.908421 23763 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51530:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 19:27:16.910720 23763 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:27:16.944393 23849 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:27:16.962849 23918 tablet_service.cc:1467] Processing CreateTablet for tablet 50fe9ebada4e421b8876573876ae885a (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260812 19:27:16.963645 24030 tablet_service.cc:1467] Processing CreateTablet for tablet 50fe9ebada4e421b8876573876ae885a (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260812 19:27:16.964381 23918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50fe9ebada4e421b8876573876ae885a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:16.964999 24030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50fe9ebada4e421b8876573876ae885a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:16.967134 24159 tablet_service.cc:1467] Processing CreateTablet for tablet d874271c17d0406ab313054114dfeb7d (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260812 19:27:16.967571 23907 tablet_service.cc:1467] Processing CreateTablet for tablet d874271c17d0406ab313054114dfeb7d (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260812 19:27:16.968552 24159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d874271c17d0406ab313054114dfeb7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:16.968945 23907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d874271c17d0406ab313054114dfeb7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:16.967705 24031 tablet_service.cc:1467] Processing CreateTablet for tablet d874271c17d0406ab313054114dfeb7d (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260812 19:27:16.972695 24031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d874271c17d0406ab313054114dfeb7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:16.964390 24152 tablet_service.cc:1467] Processing CreateTablet for tablet 50fe9ebada4e421b8876573876ae885a (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260812 19:27:16.977422 24152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50fe9ebada4e421b8876573876ae885a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:16.980309 24035 tablet_service.cc:1467] Processing CreateTablet for tablet 4e72756d41ee4f57b83249a714b53b4e (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260812 19:27:16.980502 24043 tablet_service.cc:1467] Processing CreateTablet for tablet 80020ca73e2a4122935bc86250da9eec (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260812 19:27:16.981246 24037 tablet_service.cc:1467] Processing CreateTablet for tablet 9dcd8dff1c2f4b60a3cd43a1b6dee461 (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260812 19:27:16.981566 24039 tablet_service.cc:1467] Processing CreateTablet for tablet 11558a4a5fc74c1aa6cf757c7f8438ee (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260812 19:27:16.982164 24032 tablet_service.cc:1467] Processing CreateTablet for tablet 234b3b4af38e48fb8f7165868747b7b1 (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260812 19:27:16.983587 24035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e72756d41ee4f57b83249a714b53b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:16.984681 24044 tablet_service.cc:1467] Processing CreateTablet for tablet 9025f51dac7448df8170b8533b4a7490 (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260812 19:27:16.986902 24036 tablet_service.cc:1467] Processing CreateTablet for tablet 536ecf130bd64b819eab68c849b14027 (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260812 19:27:16.987636 23920 tablet_service.cc:1467] Processing CreateTablet for tablet 11558a4a5fc74c1aa6cf757c7f8438ee (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260812 19:27:16.988579 24150 tablet_service.cc:1467] Processing CreateTablet for tablet 536ecf130bd64b819eab68c849b14027 (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260812 19:27:16.988673 23911 tablet_service.cc:1467] Processing CreateTablet for tablet 4e72756d41ee4f57b83249a714b53b4e (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260812 19:27:16.988950 23917 tablet_service.cc:1467] Processing CreateTablet for tablet 80020ca73e2a4122935bc86250da9eec (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260812 19:27:16.989886 24150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 536ecf130bd64b819eab68c849b14027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:16.991046 24167 tablet_service.cc:1467] Processing CreateTablet for tablet 9dcd8dff1c2f4b60a3cd43a1b6dee461 (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260812 19:27:16.991489 24157 tablet_service.cc:1467] Processing CreateTablet for tablet 234b3b4af38e48fb8f7165868747b7b1 (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260812 19:27:16.991756 24151 tablet_service.cc:1467] Processing CreateTablet for tablet 80020ca73e2a4122935bc86250da9eec (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260812 19:27:16.992347 24167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dcd8dff1c2f4b60a3cd43a1b6dee461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:16.993384 23919 tablet_service.cc:1467] Processing CreateTablet for tablet 9dcd8dff1c2f4b60a3cd43a1b6dee461 (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260812 19:27:16.994231 23913 tablet_service.cc:1467] Processing CreateTablet for tablet 234b3b4af38e48fb8f7165868747b7b1 (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260812 19:27:16.994784 24162 tablet_service.cc:1467] Processing CreateTablet for tablet 11558a4a5fc74c1aa6cf757c7f8438ee (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260812 19:27:16.988976 23920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11558a4a5fc74c1aa6cf757c7f8438ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:16.995716 24155 tablet_service.cc:1467] Processing CreateTablet for tablet 4e72756d41ee4f57b83249a714b53b4e (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260812 19:27:16.996340 24164 tablet_service.cc:1467] Processing CreateTablet for tablet 9025f51dac7448df8170b8533b4a7490 (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260812 19:27:16.993384 23908 tablet_service.cc:1467] Processing CreateTablet for tablet 536ecf130bd64b819eab68c849b14027 (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260812 19:27:16.997465 23919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dcd8dff1c2f4b60a3cd43a1b6dee461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:16.994339 23916 tablet_service.cc:1467] Processing CreateTablet for tablet 9025f51dac7448df8170b8533b4a7490 (DEFAULT_TABLE table=soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260812 19:27:16.998886 24157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 234b3b4af38e48fb8f7165868747b7b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:16.999591 24044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9025f51dac7448df8170b8533b4a7490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:17.002393 24036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 536ecf130bd64b819eab68c849b14027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:17.004432 24162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11558a4a5fc74c1aa6cf757c7f8438ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:17.006325 23913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 234b3b4af38e48fb8f7165868747b7b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:17.007261 24155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e72756d41ee4f57b83249a714b53b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:17.008014 24164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9025f51dac7448df8170b8533b4a7490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:17.009101 23917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80020ca73e2a4122935bc86250da9eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:17.009738 23908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 536ecf130bd64b819eab68c849b14027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:17.010507 23911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e72756d41ee4f57b83249a714b53b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:17.011088 24043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80020ca73e2a4122935bc86250da9eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:17.012673 24151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80020ca73e2a4122935bc86250da9eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:17.015076 23916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9025f51dac7448df8170b8533b4a7490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:17.019106 24032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 234b3b4af38e48fb8f7165868747b7b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:17.023149 24037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dcd8dff1c2f4b60a3cd43a1b6dee461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:17.025279 24039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11558a4a5fc74c1aa6cf757c7f8438ee. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:17.133641 24001 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38531, user_credentials={real_user=slave}} blocked reactor thread for 49383.8us
I20260812 19:27:17.148445 24448 tablet_bootstrap.cc:492] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:17.149186 24446 tablet_bootstrap.cc:492] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:17.156188 24446 tablet_bootstrap.cc:654] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.157450 24450 tablet_bootstrap.cc:492] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:17.158260 24448 tablet_bootstrap.cc:654] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.161460 24446 tablet_bootstrap.cc:492] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:17.161948 24446 ts_tablet_manager.cc:1397] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.006s
I20260812 19:27:17.164613 24448 tablet_bootstrap.cc:492] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:17.164765 24450 tablet_bootstrap.cc:654] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.165380 24448 ts_tablet_manager.cc:1397] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.002s
I20260812 19:27:17.164687 24446 raft_consensus.cc:348] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.165827 24446 raft_consensus.cc:374] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.166100 24446 raft_consensus.cc:729] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.166815 24446 consensus_queue.cc:260] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.169116 24446 ts_tablet_manager.cc:1428] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260812 19:27:17.168708 24448 raft_consensus.cc:348] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.169945 24448 raft_consensus.cc:374] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.170240 24446 tablet_bootstrap.cc:492] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:17.170446 24448 raft_consensus.cc:729] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.171743 24448 consensus_queue.cc:260] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.178005 24446 tablet_bootstrap.cc:654] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.184239 24450 tablet_bootstrap.cc:492] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:17.184927 24450 ts_tablet_manager.cc:1397] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.009s
I20260812 19:27:17.184996 24448 ts_tablet_manager.cc:1428] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260812 19:27:17.186357 24448 tablet_bootstrap.cc:492] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:17.193270 24448 tablet_bootstrap.cc:654] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.194878 24450 raft_consensus.cc:348] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.196005 24450 raft_consensus.cc:374] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.196380 24450 raft_consensus.cc:729] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.197242 24450 consensus_queue.cc:260] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.199908 24446 tablet_bootstrap.cc:492] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:17.200243 24450 ts_tablet_manager.cc:1428] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.009s
I20260812 19:27:17.200656 24446 ts_tablet_manager.cc:1397] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.009s
I20260812 19:27:17.201398 24450 tablet_bootstrap.cc:492] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:17.203974 24446 raft_consensus.cc:348] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.204820 24446 raft_consensus.cc:374] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.205168 24446 raft_consensus.cc:729] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.206073 24446 consensus_queue.cc:260] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.210937 24446 ts_tablet_manager.cc:1428] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260812 19:27:17.212235 24446 tablet_bootstrap.cc:492] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:17.214078 24450 tablet_bootstrap.cc:654] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.221725 24446 tablet_bootstrap.cc:654] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.226994 24450 tablet_bootstrap.cc:492] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:17.227705 24450 ts_tablet_manager.cc:1397] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.000s
I20260812 19:27:17.231974 24450 raft_consensus.cc:348] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.233100 24450 raft_consensus.cc:374] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.233489 24450 raft_consensus.cc:729] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.234499 24450 consensus_queue.cc:260] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.238576 24450 ts_tablet_manager.cc:1428] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260812 19:27:17.240532 24450 tablet_bootstrap.cc:492] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:17.245941 24446 tablet_bootstrap.cc:492] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:17.246722 24446 ts_tablet_manager.cc:1397] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.010s
I20260812 19:27:17.249065 24450 tablet_bootstrap.cc:654] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.250002 24446 raft_consensus.cc:348] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.250999 24446 raft_consensus.cc:374] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.251386 24446 raft_consensus.cc:729] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.252462 24446 consensus_queue.cc:260] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.255970 24446 ts_tablet_manager.cc:1428] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260812 19:27:17.257639 24446 tablet_bootstrap.cc:492] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:17.261963 24450 tablet_bootstrap.cc:492] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:17.262858 24450 ts_tablet_manager.cc:1397] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260812 19:27:17.265113 24446 tablet_bootstrap.cc:654] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.265961 24450 raft_consensus.cc:348] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.266927 24450 raft_consensus.cc:374] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.267230 24450 raft_consensus.cc:729] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.268028 24450 consensus_queue.cc:260] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.271598 24450 ts_tablet_manager.cc:1428] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260812 19:27:17.276350 24426 raft_consensus.cc:482] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.276937 24426 raft_consensus.cc:504] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.278806 24450 tablet_bootstrap.cc:492] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:17.280432 24184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d874271c17d0406ab313054114dfeb7d" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:17.281402 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d874271c17d0406ab313054114dfeb7d" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
W20260812 19:27:17.282138 23872 leader_election.cc:341] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.282470 24426 leader_election.cc:288] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.282166 24057 raft_consensus.cc:2454] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 0.
I20260812 19:27:17.284310 23874 leader_election.cc:302] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: ffd3f94084504c5b94551fd257267978
I20260812 19:27:17.286087 24426 raft_consensus.cc:2781] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:17.286482 24426 raft_consensus.cc:482] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:17.286827 24426 raft_consensus.cc:3037] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.287694 24446 tablet_bootstrap.cc:492] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:17.288307 24446 ts_tablet_manager.cc:1397] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.004s
I20260812 19:27:17.291625 24446 raft_consensus.cc:348] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.292580 24446 raft_consensus.cc:374] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.292894 24446 raft_consensus.cc:729] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.293850 24446 consensus_queue.cc:260] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.292960 24448 tablet_bootstrap.cc:492] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:17.296523 24446 ts_tablet_manager.cc:1428] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260812 19:27:17.296555 24448 ts_tablet_manager.cc:1397] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.110s	user 0.051s	sys 0.047s
I20260812 19:27:17.297850 24446 tablet_bootstrap.cc:492] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:17.298739 24426 raft_consensus.cc:504] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.301954 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d874271c17d0406ab313054114dfeb7d" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:17.302613 24057 raft_consensus.cc:3037] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.303671 24450 tablet_bootstrap.cc:654] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.306083 24446 tablet_bootstrap.cc:654] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.307780 24448 raft_consensus.cc:348] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.308588 24448 raft_consensus.cc:374] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.308895 24448 raft_consensus.cc:729] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.309664 24448 consensus_queue.cc:260] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.312224 24448 ts_tablet_manager.cc:1428] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260812 19:27:17.313283 24448 tablet_bootstrap.cc:492] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:17.316237 24057 raft_consensus.cc:2454] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 1.
I20260812 19:27:17.322330 24184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d874271c17d0406ab313054114dfeb7d" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:17.322786 24426 leader_election.cc:288] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Requested vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.323717 24426 raft_consensus.cc:482] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:27:17.324244 23872 leader_election.cc:341] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.325084 23874 leader_election.cc:302] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: ffd3f94084504c5b94551fd257267978
I20260812 19:27:17.326105 24303 raft_consensus.cc:2781] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:17.329308 24448 tablet_bootstrap.cc:654] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.334762 24303 raft_consensus.cc:686] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Leader. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:17.335865 24303 consensus_queue.cc:237] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.324223 24426 raft_consensus.cc:504] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.341964 24448 tablet_bootstrap.cc:492] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:17.342590 24448 ts_tablet_manager.cc:1397] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.030s	user 0.002s	sys 0.010s
I20260812 19:27:17.343178 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50fe9ebada4e421b8876573876ae885a" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
W20260812 19:27:17.344899 23874 leader_election.cc:341] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.345773 24448 raft_consensus.cc:348] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.346594 24448 raft_consensus.cc:374] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.346915 24448 raft_consensus.cc:729] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.347280 24184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50fe9ebada4e421b8876573876ae885a" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:17.347656 24448 consensus_queue.cc:260] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
W20260812 19:27:17.348930 23872 leader_election.cc:341] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.349390 23872 leader_election.cc:302] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5903dc2c6e247ac908381187487e4b3; no voters: a945c890138c411aa6413b46099be1d6, ffd3f94084504c5b94551fd257267978
I20260812 19:27:17.350190 24473 raft_consensus.cc:2726] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:17.350318 24426 leader_election.cc:288] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.351339 24448 ts_tablet_manager.cc:1428] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260812 19:27:17.352711 24448 tablet_bootstrap.cc:492] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:17.359552 24448 tablet_bootstrap.cc:654] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.366321 24446 tablet_bootstrap.cc:492] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:17.366482 24450 tablet_bootstrap.cc:492] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:17.366888 24446 ts_tablet_manager.cc:1397] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.069s	user 0.021s	sys 0.019s
I20260812 19:27:17.367117 24450 ts_tablet_manager.cc:1397] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.094s	user 0.024s	sys 0.045s
I20260812 19:27:17.368502 23763 catalog_manager.cc:5495] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5903dc2c6e247ac908381187487e4b3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "d5903dc2c6e247ac908381187487e4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:17.370286 24450 raft_consensus.cc:348] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.371158 24450 raft_consensus.cc:374] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.371435 24450 raft_consensus.cc:729] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.372810 24446 raft_consensus.cc:348] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.373652 24446 raft_consensus.cc:374] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.373946 24446 raft_consensus.cc:729] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.374837 24448 tablet_bootstrap.cc:492] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:17.374706 24446 consensus_queue.cc:260] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.375540 24448 ts_tablet_manager.cc:1397] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.005s
I20260812 19:27:17.372932 24450 consensus_queue.cc:260] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.378110 24450 ts_tablet_manager.cc:1428] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260812 19:27:17.378732 24448 raft_consensus.cc:348] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.379242 24450 tablet_bootstrap.cc:492] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:17.379618 24448 raft_consensus.cc:374] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.379987 24448 raft_consensus.cc:729] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.380791 24448 consensus_queue.cc:260] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.383234 24448 ts_tablet_manager.cc:1428] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260812 19:27:17.384483 24448 tablet_bootstrap.cc:492] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:17.389556 24450 tablet_bootstrap.cc:654] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.390494 24446 ts_tablet_manager.cc:1428] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260812 19:27:17.391078 24448 tablet_bootstrap.cc:654] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.391844 24446 tablet_bootstrap.cc:492] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:17.401580 24446 tablet_bootstrap.cc:654] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.410593 24450 tablet_bootstrap.cc:492] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:17.411489 24450 ts_tablet_manager.cc:1397] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.020s
I20260812 19:27:17.413301 24448 tablet_bootstrap.cc:492] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:17.413925 24448 ts_tablet_manager.cc:1397] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.004s
I20260812 19:27:17.415689 24450 raft_consensus.cc:348] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.416956 24450 raft_consensus.cc:374] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.417112 24448 raft_consensus.cc:348] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.417601 24450 raft_consensus.cc:729] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.418035 24448 raft_consensus.cc:374] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.418143 24422 raft_consensus.cc:482] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.418390 24448 raft_consensus.cc:729] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.418841 24422 raft_consensus.cc:504] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.418851 24450 consensus_queue.cc:260] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.421185 24422 leader_election.cc:288] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:17.421952 24450 ts_tablet_manager.cc:1428] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260812 19:27:17.422637 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "234b3b4af38e48fb8f7165868747b7b1" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:17.423130 24450 tablet_bootstrap.cc:492] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:17.422873 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "234b3b4af38e48fb8f7165868747b7b1" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
W20260812 19:27:17.424000 24119 leader_election.cc:341] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:17.424842 24117 leader_election.cc:341] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.425289 24117 leader_election.cc:302] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffd3f94084504c5b94551fd257267978; no voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3
I20260812 19:27:17.419269 24448 consensus_queue.cc:260] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.426625 24422 raft_consensus.cc:2726] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:17.429790 24446 tablet_bootstrap.cc:492] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:17.430472 24446 ts_tablet_manager.cc:1397] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.016s
I20260812 19:27:17.434077 24448 ts_tablet_manager.cc:1428] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.004s
I20260812 19:27:17.435319 24448 tablet_bootstrap.cc:492] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:17.435652 24446 raft_consensus.cc:348] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.436901 24446 raft_consensus.cc:374] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.437211 24446 raft_consensus.cc:729] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.437979 24446 consensus_queue.cc:260] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.440657 24446 ts_tablet_manager.cc:1428] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260812 19:27:17.441300 24450 tablet_bootstrap.cc:654] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.441789 24446 tablet_bootstrap.cc:492] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:17.443042 24448 tablet_bootstrap.cc:654] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.449965 24446 tablet_bootstrap.cc:654] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.453106 24448 tablet_bootstrap.cc:492] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:17.453799 24448 ts_tablet_manager.cc:1397] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.009s
I20260812 19:27:17.457854 24448 raft_consensus.cc:348] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.459885 24448 raft_consensus.cc:374] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.460283 24448 raft_consensus.cc:729] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.461160 24448 consensus_queue.cc:260] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.463052 24450 tablet_bootstrap.cc:492] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:17.463896 24450 ts_tablet_manager.cc:1397] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.009s
I20260812 19:27:17.464650 24448 ts_tablet_manager.cc:1428] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260812 19:27:17.465924 24484 raft_consensus.cc:482] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.466773 24448 tablet_bootstrap.cc:492] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:17.466638 24484 raft_consensus.cc:504] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.470595 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d874271c17d0406ab313054114dfeb7d" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:17.472667 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d874271c17d0406ab313054114dfeb7d" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:17.471985 24484 leader_election.cc:288] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:17.473629 24057 raft_consensus.cc:2379] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ffd3f94084504c5b94551fd257267978 in current term 1: Already voted for candidate d5903dc2c6e247ac908381187487e4b3 in this term.
I20260812 19:27:17.474993 24444 raft_consensus.cc:482] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.475423 24448 tablet_bootstrap.cc:654] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.475500 24444 raft_consensus.cc:504] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.476966 24446 tablet_bootstrap.cc:492] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:17.477538 24446 ts_tablet_manager.cc:1397] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.008s
I20260812 19:27:17.475220 24450 raft_consensus.cc:348] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.478993 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80020ca73e2a4122935bc86250da9eec" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:17.479315 24450 raft_consensus.cc:374] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.475637 24119 leader_election.cc:302] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffd3f94084504c5b94551fd257267978; no voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3
I20260812 19:27:17.479746 24450 raft_consensus.cc:729] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.479763 23932 raft_consensus.cc:2454] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 0.
I20260812 19:27:17.480556 24450 consensus_queue.cc:260] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.481516 24001 leader_election.cc:302] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:17.482511 24416 raft_consensus.cc:2781] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:17.482595 24450 ts_tablet_manager.cc:1428] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260812 19:27:17.482951 24416 raft_consensus.cc:482] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:17.483361 24416 raft_consensus.cc:3037] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.484064 24450 tablet_bootstrap.cc:492] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:17.487046 24484 raft_consensus.cc:3037] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.488795 24444 leader_election.cc:288] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.496563 24450 tablet_bootstrap.cc:654] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.501660 24416 raft_consensus.cc:504] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.490343 24183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80020ca73e2a4122935bc86250da9eec" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:17.489264 24446 raft_consensus.cc:348] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.515749 24448 tablet_bootstrap.cc:492] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:17.520018 24450 tablet_bootstrap.cc:492] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:17.539265 24446 raft_consensus.cc:374] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.524479 24444 raft_consensus.cc:482] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.540266 24446 raft_consensus.cc:729] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.540643 24444 raft_consensus.cc:504] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.541249 24448 ts_tablet_manager.cc:1397] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.075s	user 0.027s	sys 0.022s
I20260812 19:27:17.541663 24446 consensus_queue.cc:260] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.543107 24444 leader_election.cc:288] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.502592 24484 raft_consensus.cc:2726] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:17.544306 24484 raft_consensus.cc:482] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.544786 24484 raft_consensus.cc:504] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.505568 24422 raft_consensus.cc:482] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.545082 24448 raft_consensus.cc:348] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.539683 24183 raft_consensus.cc:2454] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 0.
I20260812 19:27:17.547196 24416 leader_election.cc:288] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.540391 24450 ts_tablet_manager.cc:1397] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.014s
I20260812 19:27:17.546060 24422 raft_consensus.cc:504] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.551030 24450 raft_consensus.cc:348] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.551682 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "536ecf130bd64b819eab68c849b14027" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:17.545300 24446 ts_tablet_manager.cc:1428] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.067s	user 0.014s	sys 0.013s
I20260812 19:27:17.546084 24448 raft_consensus.cc:374] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.552502 23932 raft_consensus.cc:2454] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 0.
I20260812 19:27:17.552531 24448 raft_consensus.cc:729] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.553207 24446 tablet_bootstrap.cc:492] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:17.553512 24448 consensus_queue.cc:260] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.554153 24117 leader_election.cc:302] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5903dc2c6e247ac908381187487e4b3, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:17.558305 24448 ts_tablet_manager.cc:1428] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260812 19:27:17.559522 24448 tablet_bootstrap.cc:492] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:17.551867 24450 raft_consensus.cc:374] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.560600 24450 raft_consensus.cc:729] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.564002 24484 leader_election.cc:288] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:17.566205 24448 tablet_bootstrap.cc:654] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.567612 24450 consensus_queue.cc:260] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.579133 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80020ca73e2a4122935bc86250da9eec" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:17.580219 24189 raft_consensus.cc:3037] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.568523 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dcd8dff1c2f4b60a3cd43a1b6dee461" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:17.589072 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11558a4a5fc74c1aa6cf757c7f8438ee" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:17.589849 24057 raft_consensus.cc:2454] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 0.
I20260812 19:27:17.590140 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "536ecf130bd64b819eab68c849b14027" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:17.591246 24059 raft_consensus.cc:2454] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 0.
I20260812 19:27:17.593495 24450 ts_tablet_manager.cc:1428] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.002s
I20260812 19:27:17.594911 24450 tablet_bootstrap.cc:492] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
W20260812 19:27:17.596913 24001 leader_election.cc:341] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.570015 24422 leader_election.cc:288] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:17.572952 23933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80020ca73e2a4122935bc86250da9eec" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:17.601943 23933 raft_consensus.cc:3037] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.602439 24450 tablet_bootstrap.cc:654] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.603101 24303 raft_consensus.cc:482] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.603631 24303 raft_consensus.cc:504] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.606014 24303 leader_election.cc:288] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.593508 24189 raft_consensus.cc:2454] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 1.
I20260812 19:27:17.613760 24491 raft_consensus.cc:482] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.575160 24446 tablet_bootstrap.cc:654] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.575255 23931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11558a4a5fc74c1aa6cf757c7f8438ee" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:17.577335 24184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dcd8dff1c2f4b60a3cd43a1b6dee461" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:17.615149 23931 raft_consensus.cc:2454] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 0.
I20260812 19:27:17.574486 24493 raft_consensus.cc:2781] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:17.615911 24493 raft_consensus.cc:482] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:17.616422 24493 raft_consensus.cc:3037] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.614312 24491 raft_consensus.cc:504] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.619947 24491 leader_election.cc:288] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.621299 24001 leader_election.cc:302] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:17.622917 24491 raft_consensus.cc:2781] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:17.624485 24491 raft_consensus.cc:686] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Becoming Leader. State: Replica: a945c890138c411aa6413b46099be1d6, State: Running, Role: LEADER
I20260812 19:27:17.610984 23933 raft_consensus.cc:2454] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 1.
I20260812 19:27:17.579144 24484 raft_consensus.cc:482] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.632225 24484 raft_consensus.cc:504] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.635077 24484 leader_election.cc:288] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:17.611464 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11558a4a5fc74c1aa6cf757c7f8438ee" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:17.635488 24184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11558a4a5fc74c1aa6cf757c7f8438ee" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:17.636118 24059 raft_consensus.cc:2454] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 0.
I20260812 19:27:17.636593 24184 raft_consensus.cc:2454] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 0.
I20260812 19:27:17.638053 23874 leader_election.cc:302] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:17.639365 24303 raft_consensus.cc:2781] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:17.639843 24303 raft_consensus.cc:482] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:17.640286 24303 raft_consensus.cc:3037] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.641417 24493 raft_consensus.cc:504] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.629455 23931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50fe9ebada4e421b8876573876ae885a" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:17.630229 24450 tablet_bootstrap.cc:492] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:17.643679 23931 raft_consensus.cc:2454] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 0.
I20260812 19:27:17.643872 24450 ts_tablet_manager.cc:1397] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.003s
I20260812 19:27:17.644796 24493 leader_election.cc:288] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
W20260812 19:27:17.630771 24001 leader_election.cc:341] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.646173 24001 leader_election.cc:302] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a945c890138c411aa6413b46099be1d6; no voters: d5903dc2c6e247ac908381187487e4b3, ffd3f94084504c5b94551fd257267978
I20260812 19:27:17.647362 24444 raft_consensus.cc:2726] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:17.647116 24450 raft_consensus.cc:348] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.647886 24450 raft_consensus.cc:374] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.648168 24450 raft_consensus.cc:729] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.648864 24450 consensus_queue.cc:260] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.649335 24001 leader_election.cc:302] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:17.630885 24117 leader_election.cc:302] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5903dc2c6e247ac908381187487e4b3, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:17.651456 24450 ts_tablet_manager.cc:1428] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260812 19:27:17.652537 24450 tablet_bootstrap.cc:492] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6: Bootstrap starting.
I20260812 19:27:17.653381 23933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "536ecf130bd64b819eab68c849b14027" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:17.654058 23933 raft_consensus.cc:3037] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.653851 24184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50fe9ebada4e421b8876573876ae885a" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:17.655380 23931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9025f51dac7448df8170b8533b4a7490" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:17.656255 23931 raft_consensus.cc:2454] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 0.
I20260812 19:27:17.657483 24426 raft_consensus.cc:482] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.658010 24426 raft_consensus.cc:504] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.658574 24450 tablet_bootstrap.cc:654] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.660370 24426 leader_election.cc:288] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.663636 24117 leader_election.cc:302] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5903dc2c6e247ac908381187487e4b3, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:17.664038 24484 raft_consensus.cc:2781] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:17.666121 24484 raft_consensus.cc:482] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:17.668453 24422 raft_consensus.cc:2781] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:17.672833 24422 raft_consensus.cc:482] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:17.673254 24422 raft_consensus.cc:3037] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.672366 24484 raft_consensus.cc:3037] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.671594 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e72756d41ee4f57b83249a714b53b4e" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:17.678480 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9025f51dac7448df8170b8533b4a7490" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:17.679934 24059 raft_consensus.cc:2454] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 0.
I20260812 19:27:17.679947 24057 raft_consensus.cc:2454] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 0.
I20260812 19:27:17.681243 24056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "536ecf130bd64b819eab68c849b14027" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:17.682185 24056 raft_consensus.cc:3037] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.683712 23874 leader_election.cc:302] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:17.685756 24450 tablet_bootstrap.cc:492] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6: No bootstrap required, opened a new log
I20260812 19:27:17.686286 24450 ts_tablet_manager.cc:1397] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.012s
I20260812 19:27:17.688839 24444 raft_consensus.cc:2781] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:17.689234 24444 raft_consensus.cc:482] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:17.689031 24450 raft_consensus.cc:348] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.689646 24444 raft_consensus.cc:3037] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.689843 24450 raft_consensus.cc:374] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.690167 24450 raft_consensus.cc:729] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.690274 24448 tablet_bootstrap.cc:492] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:17.690868 24448 ts_tablet_manager.cc:1397] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.132s	user 0.031s	sys 0.050s
I20260812 19:27:17.692408 24426 raft_consensus.cc:2781] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:17.692847 24426 raft_consensus.cc:482] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:17.693213 24426 raft_consensus.cc:3037] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.625732 24491 consensus_queue.cc:237] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.693682 24448 raft_consensus.cc:348] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.694494 24448 raft_consensus.cc:374] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.697031 24448 raft_consensus.cc:729] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.697736 24448 consensus_queue.cc:260] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
W20260812 19:27:17.699741 24001 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.253.1:35907, user_credentials={real_user=slave}} blocked reactor thread for 50524.6us
I20260812 19:27:17.700064 24448 ts_tablet_manager.cc:1428] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260812 19:27:17.701093 24448 tablet_bootstrap.cc:492] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978: Bootstrap starting.
I20260812 19:27:17.698277 24444 raft_consensus.cc:504] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.701216 24056 raft_consensus.cc:2454] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 1.
I20260812 19:27:17.702484 24303 raft_consensus.cc:504] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.714969 23933 raft_consensus.cc:2454] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 1.
I20260812 19:27:17.715875 24303 leader_election.cc:288] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Requested vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.716291 24117 leader_election.cc:302] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5903dc2c6e247ac908381187487e4b3, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:17.708712 24446 tablet_bootstrap.cc:492] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:17.718403 24446 ts_tablet_manager.cc:1397] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.165s	user 0.046s	sys 0.019s
I20260812 19:27:17.717905 24484 raft_consensus.cc:504] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.718612 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11558a4a5fc74c1aa6cf757c7f8438ee" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:17.719506 24189 raft_consensus.cc:2379] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d5903dc2c6e247ac908381187487e4b3 in current term 1: Already voted for candidate ffd3f94084504c5b94551fd257267978 in this term.
I20260812 19:27:17.717962 24493 raft_consensus.cc:2781] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:17.720899 24493 raft_consensus.cc:686] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 1 LEADER]: Becoming Leader. State: Replica: ffd3f94084504c5b94551fd257267978, State: Running, Role: LEADER
I20260812 19:27:17.721491 24446 raft_consensus.cc:348] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.721741 24493 consensus_queue.cc:237] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.722249 24446 raft_consensus.cc:374] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.706928 24448 tablet_bootstrap.cc:654] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.722671 24446 raft_consensus.cc:729] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.723443 24056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11558a4a5fc74c1aa6cf757c7f8438ee" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:17.729423 24448 tablet_bootstrap.cc:492] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978: No bootstrap required, opened a new log
I20260812 19:27:17.729458 24484 leader_election.cc:288] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:17.723608 24446 consensus_queue.cc:260] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.710583 24444 leader_election.cc:288] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.703080 24184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e72756d41ee4f57b83249a714b53b4e" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:17.730425 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11558a4a5fc74c1aa6cf757c7f8438ee" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:17.730789 24184 raft_consensus.cc:2454] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 0.
I20260812 19:27:17.731410 23933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11558a4a5fc74c1aa6cf757c7f8438ee" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:17.729914 24056 raft_consensus.cc:3037] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.732282 23933 raft_consensus.cc:2379] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ffd3f94084504c5b94551fd257267978 in current term 1: Already voted for candidate d5903dc2c6e247ac908381187487e4b3 in this term.
I20260812 19:27:17.702772 24450 consensus_queue.cc:260] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
W20260812 19:27:17.711223 24001 leader_election.cc:341] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.726872 23763 catalog_manager.cc:5495] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a945c890138c411aa6413b46099be1d6 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "a945c890138c411aa6413b46099be1d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:17.734303 24450 ts_tablet_manager.cc:1428] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260812 19:27:17.735931 23931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50fe9ebada4e421b8876573876ae885a" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:17.736596 23931 raft_consensus.cc:3037] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.736953 24184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50fe9ebada4e421b8876573876ae885a" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:17.737603 24184 raft_consensus.cc:3037] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.739637 24117 leader_election.cc:302] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffd3f94084504c5b94551fd257267978; no voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3
I20260812 19:27:17.730162 24448 ts_tablet_manager.cc:1397] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.006s
I20260812 19:27:17.740561 24494 raft_consensus.cc:2726] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:27:17.745714 24184 raft_consensus.cc:2454] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 1.
I20260812 19:27:17.731985 24446 ts_tablet_manager.cc:1428] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260812 19:27:17.702090 24422 raft_consensus.cc:504] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.747359 24446 tablet_bootstrap.cc:492] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3: Bootstrap starting.
I20260812 19:27:17.748293 24422 leader_election.cc:288] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:17.743489 24448 raft_consensus.cc:348] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.752059 24448 raft_consensus.cc:374] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.752441 24448 raft_consensus.cc:729] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.753197 24448 consensus_queue.cc:260] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.755494 24448 ts_tablet_manager.cc:1428] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260812 19:27:17.728892 24426 raft_consensus.cc:504] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.755496 24446 tablet_bootstrap.cc:654] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.756309 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9025f51dac7448df8170b8533b4a7490" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:17.762971 24426 leader_election.cc:288] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Requested vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.763332 23761 catalog_manager.cc:5495] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffd3f94084504c5b94551fd257267978 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "ffd3f94084504c5b94551fd257267978" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:17.764326 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e72756d41ee4f57b83249a714b53b4e" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:17.764613 24056 raft_consensus.cc:2454] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 1.
I20260812 19:27:17.762988 23932 raft_consensus.cc:3037] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.765012 24189 raft_consensus.cc:3037] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.757315 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9025f51dac7448df8170b8533b4a7490" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:17.767789 24059 raft_consensus.cc:3037] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.774878 23874 leader_election.cc:302] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: ffd3f94084504c5b94551fd257267978
I20260812 19:27:17.779609 24426 raft_consensus.cc:2781] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:17.780274 24426 raft_consensus.cc:686] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Leader. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:17.782445 24426 consensus_queue.cc:237] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.790131 23932 raft_consensus.cc:2454] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 1.
I20260812 19:27:17.794945 24117 leader_election.cc:302] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5903dc2c6e247ac908381187487e4b3, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:17.796022 24484 raft_consensus.cc:2781] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:17.796089 24059 raft_consensus.cc:2454] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 1.
I20260812 19:27:17.789985 24001 leader_election.cc:302] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:17.797871 24444 raft_consensus.cc:2781] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:17.798671 24444 raft_consensus.cc:686] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Becoming Leader. State: Replica: a945c890138c411aa6413b46099be1d6, State: Running, Role: LEADER
I20260812 19:27:17.797961 24484 raft_consensus.cc:686] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [term 1 LEADER]: Becoming Leader. State: Replica: ffd3f94084504c5b94551fd257267978, State: Running, Role: LEADER
I20260812 19:27:17.798851 24056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e72756d41ee4f57b83249a714b53b4e" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:17.799543 24056 raft_consensus.cc:3037] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.800102 24484 consensus_queue.cc:237] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.799875 24444 consensus_queue.cc:237] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.803229 23931 raft_consensus.cc:2454] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 1.
I20260812 19:27:17.807040 24189 raft_consensus.cc:2454] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 1.
I20260812 19:27:17.808920 23872 leader_election.cc:302] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5903dc2c6e247ac908381187487e4b3, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:17.810056 24303 raft_consensus.cc:2781] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:17.810578 24303 raft_consensus.cc:686] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Leader. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:17.811797 24303 consensus_queue.cc:237] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.813730 24444 raft_consensus.cc:482] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.814260 24444 raft_consensus.cc:504] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.817298 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "234b3b4af38e48fb8f7165868747b7b1" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3" is_pre_election: true
I20260812 19:27:17.818114 23932 raft_consensus.cc:2454] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 0.
I20260812 19:27:17.817898 23760 catalog_manager.cc:5495] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a945c890138c411aa6413b46099be1d6 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "a945c890138c411aa6413b46099be1d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:17.820416 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "234b3b4af38e48fb8f7165868747b7b1" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:17.821457 24189 raft_consensus.cc:2454] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 0.
I20260812 19:27:17.823078 24001 leader_election.cc:302] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:17.823925 24491 raft_consensus.cc:2781] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:17.824307 24491 raft_consensus.cc:482] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:17.825771 24056 raft_consensus.cc:2454] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 1.
I20260812 19:27:17.826220 24491 raft_consensus.cc:3037] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.829483 24446 tablet_bootstrap.cc:492] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3: No bootstrap required, opened a new log
I20260812 19:27:17.830065 24446 ts_tablet_manager.cc:1397] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3: Time spent bootstrapping tablet: real 0.083s	user 0.021s	sys 0.030s
I20260812 19:27:17.830410 24444 leader_election.cc:288] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.832940 24446 raft_consensus.cc:348] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.833750 24446 raft_consensus.cc:374] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.834025 24446 raft_consensus.cc:729] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.833413 23761 catalog_manager.cc:5495] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5903dc2c6e247ac908381187487e4b3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "d5903dc2c6e247ac908381187487e4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:17.834792 24446 consensus_queue.cc:260] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.837121 24446 ts_tablet_manager.cc:1428] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260812 19:27:17.837256 23765 catalog_manager.cc:5495] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffd3f94084504c5b94551fd257267978 (127.3.253.3). New cstate: current_term: 1 leader_uuid: "ffd3f94084504c5b94551fd257267978" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:17.839201 24491 raft_consensus.cc:504] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.843173 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "234b3b4af38e48fb8f7165868747b7b1" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:17.843811 23932 raft_consensus.cc:3037] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.843824 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "234b3b4af38e48fb8f7165868747b7b1" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:17.844843 24189 raft_consensus.cc:3037] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.843991 24491 leader_election.cc:288] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.852670 24189 raft_consensus.cc:2454] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 1.
I20260812 19:27:17.853272 23932 raft_consensus.cc:2454] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 1.
I20260812 19:27:17.853981 24001 leader_election.cc:302] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:17.855014 24491 raft_consensus.cc:2781] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:17.855516 24491 raft_consensus.cc:686] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Becoming Leader. State: Replica: a945c890138c411aa6413b46099be1d6, State: Running, Role: LEADER
I20260812 19:27:17.855466 23760 catalog_manager.cc:5495] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5903dc2c6e247ac908381187487e4b3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "d5903dc2c6e247ac908381187487e4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:17.856544 24491 consensus_queue.cc:237] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.865666 23765 catalog_manager.cc:5495] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a945c890138c411aa6413b46099be1d6 (127.3.253.2). New cstate: current_term: 1 leader_uuid: "a945c890138c411aa6413b46099be1d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:17.932284 24426 consensus_queue.cc:1035] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:17.944062 24426 consensus_queue.cc:1035] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:17.959446 23849 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260812 19:27:17.968070 24426 raft_consensus.cc:482] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.968729 24426 raft_consensus.cc:504] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.971146 24426 leader_election.cc:288] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.971994 24056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dcd8dff1c2f4b60a3cd43a1b6dee461" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6" is_pre_election: true
I20260812 19:27:17.972442 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dcd8dff1c2f4b60a3cd43a1b6dee461" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978" is_pre_election: true
I20260812 19:27:17.972810 24056 raft_consensus.cc:2454] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 0.
I20260812 19:27:17.973187 24189 raft_consensus.cc:2454] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 0.
I20260812 19:27:17.974015 23874 leader_election.cc:302] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:17.974713 24426 raft_consensus.cc:2781] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:17.975095 24426 raft_consensus.cc:482] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:17.975370 24426 raft_consensus.cc:3037] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.980949 24426 raft_consensus.cc:504] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:17.982704 24426 leader_election.cc:288] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Requested vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:17.983536 24056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dcd8dff1c2f4b60a3cd43a1b6dee461" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:17.983894 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dcd8dff1c2f4b60a3cd43a1b6dee461" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:17.984280 24056 raft_consensus.cc:3037] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.984519 24189 raft_consensus.cc:3037] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.992038 24189 raft_consensus.cc:2454] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 1.
I20260812 19:27:17.992038 24056 raft_consensus.cc:2454] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 1.
I20260812 19:27:17.993441 23872 leader_election.cc:302] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5903dc2c6e247ac908381187487e4b3, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:17.994277 24426 raft_consensus.cc:2781] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:17.994773 24426 raft_consensus.cc:686] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Leader. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:17.995435 24426 consensus_queue.cc:237] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.004489 23765 catalog_manager.cc:5495] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5903dc2c6e247ac908381187487e4b3 (127.3.253.1). New cstate: current_term: 1 leader_uuid: "d5903dc2c6e247ac908381187487e4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:18.159312 24056 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "50fe9ebada4e421b8876573876ae885a"
dest_uuid: "a945c890138c411aa6413b46099be1d6"
mode: GRACEFUL
new_leader_uuid: "d5903dc2c6e247ac908381187487e4b3"
 from {username='slave'} at 127.0.0.1:51534
I20260812 19:27:18.159870 24056 raft_consensus.cc:595] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Received request to transfer leadership to TS d5903dc2c6e247ac908381187487e4b3
I20260812 19:27:18.169380 24426 consensus_queue.cc:1035] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:18.171157 24056 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "80020ca73e2a4122935bc86250da9eec"
dest_uuid: "a945c890138c411aa6413b46099be1d6"
mode: GRACEFUL
new_leader_uuid: "d5903dc2c6e247ac908381187487e4b3"
 from {username='slave'} at 127.0.0.1:51534
I20260812 19:27:18.171896 24056 raft_consensus.cc:595] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Received request to transfer leadership to TS d5903dc2c6e247ac908381187487e4b3
I20260812 19:27:18.177278 24484 consensus_queue.cc:1035] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:18.181339 23932 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "11558a4a5fc74c1aa6cf757c7f8438ee"
dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
mode: GRACEFUL
new_leader_uuid: "a945c890138c411aa6413b46099be1d6"
 from {username='slave'} at 127.0.0.1:50784
I20260812 19:27:18.181947 23932 raft_consensus.cc:595] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Received request to transfer leadership to TS a945c890138c411aa6413b46099be1d6
I20260812 19:27:18.190487 23932 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9dcd8dff1c2f4b60a3cd43a1b6dee461"
dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
mode: GRACEFUL
new_leader_uuid: "a945c890138c411aa6413b46099be1d6"
 from {username='slave'} at 127.0.0.1:50784
I20260812 19:27:18.191188 23932 raft_consensus.cc:595] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Received request to transfer leadership to TS a945c890138c411aa6413b46099be1d6
I20260812 19:27:18.199791 24494 consensus_queue.cc:1035] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:18.201316 24426 consensus_queue.cc:1035] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:18.213644 24303 raft_consensus.cc:979] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3: : Instructing follower a945c890138c411aa6413b46099be1d6 to start an election
I20260812 19:27:18.213945 24189 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "536ecf130bd64b819eab68c849b14027"
dest_uuid: "ffd3f94084504c5b94551fd257267978"
mode: GRACEFUL
new_leader_uuid: "a945c890138c411aa6413b46099be1d6"
 from {username='slave'} at 127.0.0.1:55736
I20260812 19:27:18.214800 24189 raft_consensus.cc:595] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 1 LEADER]: Received request to transfer leadership to TS a945c890138c411aa6413b46099be1d6
I20260812 19:27:18.214246 24303 raft_consensus.cc:1067] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Signalling peer a945c890138c411aa6413b46099be1d6 to start an election
I20260812 19:27:18.217145 24057 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "11558a4a5fc74c1aa6cf757c7f8438ee"
dest_uuid: "a945c890138c411aa6413b46099be1d6"
 from {username='slave'} at 127.0.0.1:51516
I20260812 19:27:18.217746 24057 raft_consensus.cc:482] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:18.218127 24057 raft_consensus.cc:3037] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.219844 24426 consensus_queue.cc:1035] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:18.226532 24444 consensus_queue.cc:1035] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:18.226593 24494 consensus_queue.cc:1035] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:18.242393 24493 raft_consensus.cc:979] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978: : Instructing follower a945c890138c411aa6413b46099be1d6 to start an election
I20260812 19:27:18.243027 24494 raft_consensus.cc:1067] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 1 LEADER]: Signalling peer a945c890138c411aa6413b46099be1d6 to start an election
I20260812 19:27:18.244915 24056 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "536ecf130bd64b819eab68c849b14027"
dest_uuid: "a945c890138c411aa6413b46099be1d6"
 from {username='slave'} at 127.0.0.1:51530
I20260812 19:27:18.245538 24056 raft_consensus.cc:482] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:18.245961 24056 raft_consensus.cc:3037] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.253299 24057 raft_consensus.cc:504] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.253804 24056 raft_consensus.cc:504] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.256033 24056 leader_election.cc:288] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 2 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:18.257593 23933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "536ecf130bd64b819eab68c849b14027" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:18.258131 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "536ecf130bd64b819eab68c849b14027" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:18.258307 23933 raft_consensus.cc:3037] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.258862 24189 raft_consensus.cc:3032] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:27:18.259217 24189 raft_consensus.cc:729] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ffd3f94084504c5b94551fd257267978, State: Running, Role: LEADER
I20260812 19:27:18.260035 24189 consensus_queue.cc:260] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.261406 24189 raft_consensus.cc:3037] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.266603 23933 raft_consensus.cc:2454] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 2.
I20260812 19:27:18.268042 24001 leader_election.cc:302] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:18.269418 24491 raft_consensus.cc:2781] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:18.270066 24057 leader_election.cc:288] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 2 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:18.271819 23931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11558a4a5fc74c1aa6cf757c7f8438ee" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:18.272598 23931 raft_consensus.cc:3032] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:27:18.272986 23931 raft_consensus.cc:729] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:18.273962 23931 consensus_queue.cc:260] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.275870 24189 raft_consensus.cc:2454] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 2.
I20260812 19:27:18.271819 24184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11558a4a5fc74c1aa6cf757c7f8438ee" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:18.279683 24184 raft_consensus.cc:3037] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.281078 24491 raft_consensus.cc:686] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [term 2 LEADER]: Becoming Leader. State: Replica: a945c890138c411aa6413b46099be1d6, State: Running, Role: LEADER
I20260812 19:27:18.281845 24303 consensus_queue.cc:1035] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:18.282130 24491 consensus_queue.cc:237] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.288987 23931 raft_consensus.cc:3037] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.292697 24484 consensus_queue.cc:1035] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:18.296664 24529 consensus_queue.cc:1035] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:18.317618 23765 catalog_manager.cc:5495] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 reported cstate change: term changed from 1 to 2, leader changed from ffd3f94084504c5b94551fd257267978 (127.3.253.3) to a945c890138c411aa6413b46099be1d6 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "a945c890138c411aa6413b46099be1d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:18.319744 24491 consensus_queue.cc:1035] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:18.322458 24528 raft_consensus.cc:979] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6: : Instructing follower d5903dc2c6e247ac908381187487e4b3 to start an election
I20260812 19:27:18.323096 24528 raft_consensus.cc:1067] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Signalling peer d5903dc2c6e247ac908381187487e4b3 to start an election
I20260812 19:27:18.331414 24184 raft_consensus.cc:2454] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 2.
I20260812 19:27:18.335216 23931 raft_consensus.cc:2454] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 2.
I20260812 19:27:18.341452 24001 leader_election.cc:302] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:18.343305 24529 raft_consensus.cc:2781] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:18.343822 24529 raft_consensus.cc:686] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [term 2 LEADER]: Becoming Leader. State: Replica: a945c890138c411aa6413b46099be1d6, State: Running, Role: LEADER
I20260812 19:27:18.343806 24528 consensus_queue.cc:1035] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:18.345227 24529 consensus_queue.cc:237] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.350587 23931 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "80020ca73e2a4122935bc86250da9eec"
dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
 from {username='slave'} at 127.0.0.1:50778
I20260812 19:27:18.353684 23931 raft_consensus.cc:482] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:18.365450 23931 raft_consensus.cc:3037] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.371469 23760 catalog_manager.cc:5495] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 reported cstate change: term changed from 1 to 2, leader changed from d5903dc2c6e247ac908381187487e4b3 (127.3.253.1) to a945c890138c411aa6413b46099be1d6 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "a945c890138c411aa6413b46099be1d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:18.373533 23931 raft_consensus.cc:504] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.378181 24444 raft_consensus.cc:979] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6: : Instructing follower d5903dc2c6e247ac908381187487e4b3 to start an election
I20260812 19:27:18.378763 24529 raft_consensus.cc:1067] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Signalling peer d5903dc2c6e247ac908381187487e4b3 to start an election
I20260812 19:27:18.381199 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80020ca73e2a4122935bc86250da9eec" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:18.381807 24189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80020ca73e2a4122935bc86250da9eec" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:18.381893 24059 raft_consensus.cc:3032] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:27:18.383270 24059 raft_consensus.cc:729] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Running, Role: LEADER
I20260812 19:27:18.383729 23931 leader_election.cc:288] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 2 election: Requested vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:18.384066 24059 consensus_queue.cc:260] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.385339 24059 raft_consensus.cc:3037] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.394260 24059 raft_consensus.cc:2454] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 2.
I20260812 19:27:18.382054 23933 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "50fe9ebada4e421b8876573876ae885a"
dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
 from {username='slave'} at 127.0.0.1:50778
I20260812 19:27:18.395220 23933 raft_consensus.cc:482] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:18.395623 23933 raft_consensus.cc:3037] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.395975 23874 leader_election.cc:302] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: ffd3f94084504c5b94551fd257267978
I20260812 19:27:18.397514 24426 raft_consensus.cc:2781] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:18.398007 24426 raft_consensus.cc:686] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [term 2 LEADER]: Becoming Leader. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:18.398896 24426 consensus_queue.cc:237] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.405694 23933 raft_consensus.cc:504] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.406085 23761 catalog_manager.cc:5495] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 reported cstate change: term changed from 1 to 2, leader changed from a945c890138c411aa6413b46099be1d6 (127.3.253.2) to d5903dc2c6e247ac908381187487e4b3 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "d5903dc2c6e247ac908381187487e4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:18.407568 23933 leader_election.cc:288] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 2 election: Requested vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:18.408454 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50fe9ebada4e421b8876573876ae885a" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:18.408705 24183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50fe9ebada4e421b8876573876ae885a" candidate_uuid: "d5903dc2c6e247ac908381187487e4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:18.409207 24059 raft_consensus.cc:3032] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:27:18.409399 24183 raft_consensus.cc:3037] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.409579 24059 raft_consensus.cc:729] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Running, Role: LEADER
I20260812 19:27:18.410571 24059 consensus_queue.cc:260] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.411878 24059 raft_consensus.cc:3037] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.418478 24059 raft_consensus.cc:2454] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 2.
I20260812 19:27:18.419505 23874 leader_election.cc:302] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, d5903dc2c6e247ac908381187487e4b3; no voters: 
I20260812 19:27:18.420233 24473 raft_consensus.cc:2781] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:18.420184 24183 raft_consensus.cc:2454] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5903dc2c6e247ac908381187487e4b3 in term 2.
I20260812 19:27:18.421056 24473 raft_consensus.cc:686] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 2 LEADER]: Becoming Leader. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:18.421904 24473 consensus_queue.cc:237] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.428898 23761 catalog_manager.cc:5495] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 reported cstate change: term changed from 1 to 2, leader changed from a945c890138c411aa6413b46099be1d6 (127.3.253.2) to d5903dc2c6e247ac908381187487e4b3 (127.3.253.1). New cstate: current_term: 2 leader_uuid: "d5903dc2c6e247ac908381187487e4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:18.430729 24444 consensus_queue.cc:1035] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:18.442485 24529 consensus_queue.cc:1035] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:18.503650 24473 consensus_queue.cc:1035] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:18.510629 24426 raft_consensus.cc:979] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3: : Instructing follower a945c890138c411aa6413b46099be1d6 to start an election
I20260812 19:27:18.511219 24303 raft_consensus.cc:1067] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Signalling peer a945c890138c411aa6413b46099be1d6 to start an election
I20260812 19:27:18.516876 24059 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9dcd8dff1c2f4b60a3cd43a1b6dee461"
dest_uuid: "a945c890138c411aa6413b46099be1d6"
 from {username='slave'} at 127.0.0.1:51516
I20260812 19:27:18.516885 24473 consensus_queue.cc:1035] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:18.519529 24059 raft_consensus.cc:482] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:18.519995 24059 raft_consensus.cc:3037] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.528254 24059 raft_consensus.cc:504] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.530339 24059 leader_election.cc:288] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 2 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), ffd3f94084504c5b94551fd257267978 (127.3.253.3:38531)
I20260812 19:27:18.531108 23933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dcd8dff1c2f4b60a3cd43a1b6dee461" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:18.531487 24183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dcd8dff1c2f4b60a3cd43a1b6dee461" candidate_uuid: "a945c890138c411aa6413b46099be1d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffd3f94084504c5b94551fd257267978"
I20260812 19:27:18.531908 23933 raft_consensus.cc:3032] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:27:18.532287 23933 raft_consensus.cc:729] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:18.532357 24183 raft_consensus.cc:3037] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.533200 23933 consensus_queue.cc:260] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.534632 23933 raft_consensus.cc:3037] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.540863 24183 raft_consensus.cc:2454] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 2.
I20260812 19:27:18.542519 24001 leader_election.cc:302] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a945c890138c411aa6413b46099be1d6, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:18.543280 23933 raft_consensus.cc:2454] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a945c890138c411aa6413b46099be1d6 in term 2.
I20260812 19:27:18.543581 24444 raft_consensus.cc:2781] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:18.544224 24444 raft_consensus.cc:686] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 2 LEADER]: Becoming Leader. State: Replica: a945c890138c411aa6413b46099be1d6, State: Running, Role: LEADER
I20260812 19:27:18.545113 24444 consensus_queue.cc:237] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:18.552525 23761 catalog_manager.cc:5495] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 reported cstate change: term changed from 1 to 2, leader changed from d5903dc2c6e247ac908381187487e4b3 (127.3.253.1) to a945c890138c411aa6413b46099be1d6 (127.3.253.2). New cstate: current_term: 2 leader_uuid: "a945c890138c411aa6413b46099be1d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:18.729815 23933 raft_consensus.cc:1261] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Refusing update from remote peer a945c890138c411aa6413b46099be1d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:18.731420 24529 consensus_queue.cc:1035] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:18.747875 24183 raft_consensus.cc:1261] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Refusing update from remote peer a945c890138c411aa6413b46099be1d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:18.748514 24189 raft_consensus.cc:1261] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Refusing update from remote peer a945c890138c411aa6413b46099be1d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:18.750788 24444 consensus_queue.cc:1035] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:27:18.750746 24529 consensus_queue.cc:1035] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:27:18.762966 23933 raft_consensus.cc:1261] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Refusing update from remote peer a945c890138c411aa6413b46099be1d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:18.764477 24444 consensus_queue.cc:1035] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:27:18.925264 24189 raft_consensus.cc:1261] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Refusing update from remote peer a945c890138c411aa6413b46099be1d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:18.926949 24059 raft_consensus.cc:1261] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Refusing update from remote peer d5903dc2c6e247ac908381187487e4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:18.926734 24444 consensus_queue.cc:1035] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:18.928517 24473 consensus_queue.cc:1035] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:18.938725 24189 raft_consensus.cc:1261] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Refusing update from remote peer d5903dc2c6e247ac908381187487e4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:18.943187 24548 consensus_queue.cc:1035] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:27:18.947716 23933 raft_consensus.cc:1261] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Refusing update from remote peer a945c890138c411aa6413b46099be1d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:18.949368 24529 consensus_queue.cc:1035] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:27:18.973064 24057 raft_consensus.cc:1261] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Refusing update from remote peer d5903dc2c6e247ac908381187487e4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:18.974879 24426 consensus_queue.cc:1035] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 19:27:18.983687 24189 raft_consensus.cc:3037] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.996032 24189 raft_consensus.cc:1261] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Refusing update from remote peer d5903dc2c6e247ac908381187487e4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:18.998114 24548 consensus_queue.cc:1035] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:21.227072 23765 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51530:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260812 19:27:21.251091 23765 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51530:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260812 19:27:21.294698  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260812 19:27:21.470762 24001 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.1:35907, user_credentials={real_user=slave}} blocked reactor thread for 47410.7us
W20260812 19:27:21.517527 24586 log.cc:924] Time spent T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260812 19:27:21.615229 23874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:37499, user_credentials={real_user=slave}} blocked reactor thread for 58765.9us
W20260812 19:27:21.648032 24620 log.cc:924] Time spent T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6: Append to log took a long time: real 0.119s	user 0.002s	sys 0.000s
W20260812 19:27:21.681631 23874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:37499, user_credentials={real_user=slave}} blocked reactor thread for 65391.9us
I20260812 19:27:21.681958 24652 tablet.cc:1722] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260812 19:27:21.743377 23874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.2:37499, user_credentials={real_user=slave}} blocked reactor thread for 49112.1us
W20260812 19:27:21.768684 24623 log.cc:924] Time spent T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6: Append to log took a long time: real 0.141s	user 0.005s	sys 0.000s
I20260812 19:27:21.768973 24665 tablet.cc:1722] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.776789 23935 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "377918f8e49b483f9c2d59cf73ce820f"
dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
mode: GRACEFUL
new_leader_uuid: "ffd3f94084504c5b94551fd257267978"
 from {username='slave'} at 127.0.0.1:50474
I20260812 19:27:21.778081 23935 raft_consensus.cc:595] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Received request to transfer leadership to TS ffd3f94084504c5b94551fd257267978
I20260812 19:27:21.787513 24661 tablet.cc:1722] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.704984 24654 tablet.cc:1722] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260812 19:27:21.814497 24650 log.cc:924] Time spent T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260812 19:27:21.817258 24651 tablet.cc:1722] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.824847 24668 tablet.cc:1722] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.826787 24656 tablet.cc:1722] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.826835 24661 tablet.cc:1722] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260812 19:27:21.775853 23872 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.253.3:38531, user_credentials={real_user=slave}} blocked reactor thread for 66834.3us
I20260812 19:27:21.865669 24654 tablet.cc:1722] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.864298 24670 tablet.cc:1722] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.880841 24676 tablet.cc:1722] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.880980 24681 tablet.cc:1722] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.883584 24680 tablet.cc:1722] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.909459 24656 tablet.cc:1722] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.912024 24654 tablet.cc:1722] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.919867 24676 tablet.cc:1722] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.923698 24656 tablet.cc:1722] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.941972 24656 tablet.cc:1722] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.943274 24654 tablet.cc:1722] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.944743 24671 tablet.cc:1722] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.946317 24676 tablet.cc:1722] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.958037 24656 tablet.cc:1722] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.964943 24652 tablet.cc:1722] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.979758 24665 tablet.cc:1722] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:21.986217 24548 raft_consensus.cc:979] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3: : Instructing follower ffd3f94084504c5b94551fd257267978 to start an election
I20260812 19:27:21.986851 24548 raft_consensus.cc:1067] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Signalling peer ffd3f94084504c5b94551fd257267978 to start an election
I20260812 19:27:21.991640 24182 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "377918f8e49b483f9c2d59cf73ce820f"
dest_uuid: "ffd3f94084504c5b94551fd257267978"
 from {username='slave'} at 127.0.0.1:55710
I20260812 19:27:21.992278 24182 raft_consensus.cc:482] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:21.992727 24182 raft_consensus.cc:3037] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:22.006110 24661 tablet.cc:1722] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:22.024672 24059 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "82e36e0cbbbe4f4bb70897d2660981c2"
dest_uuid: "a945c890138c411aa6413b46099be1d6"
mode: GRACEFUL
new_leader_uuid: "ffd3f94084504c5b94551fd257267978"
 from {username='slave'} at 127.0.0.1:53002
I20260812 19:27:22.025573 24059 raft_consensus.cc:595] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 2 LEADER]: Received request to transfer leadership to TS ffd3f94084504c5b94551fd257267978
I20260812 19:27:22.027789  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260812 19:27:22.027376 24665 tablet.cc:1722] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:22.028571  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:22.031780 24651 tablet.cc:1722] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 19:27:22.043500 24182 raft_consensus.cc:504] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:22.059016 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377918f8e49b483f9c2d59cf73ce820f" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:22.059894 24059 raft_consensus.cc:3037] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:22.062166 24182 leader_election.cc:288] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 2 election: Requested vote from peers a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499), d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907)
I20260812 19:27:22.065591 23931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377918f8e49b483f9c2d59cf73ce820f" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:22.066318 23931 raft_consensus.cc:3032] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:27:22.066640 23931 raft_consensus.cc:729] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5903dc2c6e247ac908381187487e4b3, State: Running, Role: LEADER
I20260812 19:27:22.067482 23931 consensus_queue.cc:260] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:22.068913 23931 raft_consensus.cc:3037] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:22.067751 23760 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09: soft_deleted_table [id=c0c5a5575ddc43eaa4d3b0340acd7a4b] alter complete (version 1)
I20260812 19:27:22.081852 23931 raft_consensus.cc:2454] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 2.
I20260812 19:27:22.083406 24117 leader_election.cc:302] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5903dc2c6e247ac908381187487e4b3, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:22.084280 24059 raft_consensus.cc:2454] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 2.
I20260812 19:27:22.085716 24682 raft_consensus.cc:2781] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:22.086313 24682 raft_consensus.cc:686] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [term 2 LEADER]: Becoming Leader. State: Replica: ffd3f94084504c5b94551fd257267978, State: Running, Role: LEADER
I20260812 19:27:22.087333 24682 consensus_queue.cc:237] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:22.098381 23761 catalog_manager.cc:5495] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 reported cstate change: term changed from 1 to 2, leader changed from d5903dc2c6e247ac908381187487e4b3 (127.3.253.1) to ffd3f94084504c5b94551fd257267978 (127.3.253.3). New cstate: current_term: 2 leader_uuid: "ffd3f94084504c5b94551fd257267978" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:22.118808 24607 raft_consensus.cc:979] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6: : Instructing follower ffd3f94084504c5b94551fd257267978 to start an election
I20260812 19:27:22.119477 24603 raft_consensus.cc:1067] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 2 LEADER]: Signalling peer ffd3f94084504c5b94551fd257267978 to start an election
I20260812 19:27:22.121212 24186 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "82e36e0cbbbe4f4bb70897d2660981c2"
dest_uuid: "ffd3f94084504c5b94551fd257267978"
 from {username='slave'} at 127.0.0.1:55722
I20260812 19:27:22.121743 24186 raft_consensus.cc:482] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 19:27:22.122103 24186 raft_consensus.cc:3037] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:22.129236 24186 raft_consensus.cc:504] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:22.131003 24186 leader_election.cc:288] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 3 election: Requested vote from peers d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907), a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499)
I20260812 19:27:22.131950 23931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82e36e0cbbbe4f4bb70897d2660981c2" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d5903dc2c6e247ac908381187487e4b3"
I20260812 19:27:22.132300 24059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82e36e0cbbbe4f4bb70897d2660981c2" candidate_uuid: "ffd3f94084504c5b94551fd257267978" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a945c890138c411aa6413b46099be1d6"
I20260812 19:27:22.132611 23931 raft_consensus.cc:3037] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:22.133034 24059 raft_consensus.cc:3032] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:27:22.133371 24059 raft_consensus.cc:729] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a945c890138c411aa6413b46099be1d6, State: Running, Role: LEADER
I20260812 19:27:22.134187 24059 consensus_queue.cc:260] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:22.135429 24059 raft_consensus.cc:3037] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:22.138087 23931 raft_consensus.cc:2454] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 3.
I20260812 19:27:22.139298 24117 leader_election.cc:302] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5903dc2c6e247ac908381187487e4b3, ffd3f94084504c5b94551fd257267978; no voters: 
I20260812 19:27:22.140034 24682 raft_consensus.cc:2781] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:27:22.140442 24682 raft_consensus.cc:686] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 3 LEADER]: Becoming Leader. State: Replica: ffd3f94084504c5b94551fd257267978, State: Running, Role: LEADER
I20260812 19:27:22.141251 24682 consensus_queue.cc:237] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } }
I20260812 19:27:22.141530 24059 raft_consensus.cc:2454] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffd3f94084504c5b94551fd257267978 in term 3.
I20260812 19:27:22.148881 23761 catalog_manager.cc:5495] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 reported cstate change: term changed from 2 to 3, leader changed from a945c890138c411aa6413b46099be1d6 (127.3.253.2) to ffd3f94084504c5b94551fd257267978 (127.3.253.3). New cstate: current_term: 3 leader_uuid: "ffd3f94084504c5b94551fd257267978" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffd3f94084504c5b94551fd257267978" member_type: VOTER last_known_addr { host: "127.3.253.3" port: 38531 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:22.504985 24057 raft_consensus.cc:1261] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Refusing update from remote peer ffd3f94084504c5b94551fd257267978: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:22.506424 24682 consensus_queue.cc:1035] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:22.522043 23931 raft_consensus.cc:1261] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Refusing update from remote peer ffd3f94084504c5b94551fd257267978: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:22.523849 24682 consensus_queue.cc:1035] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:22.622903 23931 raft_consensus.cc:1261] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3 [term 3 FOLLOWER]: Refusing update from remote peer ffd3f94084504c5b94551fd257267978: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:27:22.624291 24422 consensus_queue.cc:1035] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5903dc2c6e247ac908381187487e4b3" member_type: VOTER last_known_addr { host: "127.3.253.1" port: 35907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 19:27:22.638259 24057 raft_consensus.cc:1261] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 3 FOLLOWER]: Refusing update from remote peer ffd3f94084504c5b94551fd257267978: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 19:27:22.639892 24682 consensus_queue.cc:1035] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a945c890138c411aa6413b46099be1d6" member_type: VOTER last_known_addr { host: "127.3.253.2" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 19:27:23.029649  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:23.036127  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:23.036777  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:24.037660  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:24.042745  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:24.043197  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:25.044054  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:25.049038  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:25.049484  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:26.050427  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:26.055737  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:26.056195  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:27.057183  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:27.062163  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:27.062623  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:28.063740  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:28.071396  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:28.072010  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:29.073050  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:29.078795  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:29.079278  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:30.080677  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:30.090446  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:30.091025  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:31.092168  4084 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260812 19:27:31.097481  4084 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260812 19:27:31.097934  4084 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260812 19:27:32.161381  4084 tablet_server.cc:178] TabletServer@127.3.253.1:0 shutting down...
W20260812 19:27:32.194180 24001 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
W20260812 19:27:32.199618 24001 consensus_peers.cc:487] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 -> Peer d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907): Couldn't send request to peer d5903dc2c6e247ac908381187487e4b3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:32.210860  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:27:32.211808  4084 tablet_replica.cc:330] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.212845  4084 raft_consensus.cc:2229] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.213789  4084 raft_consensus.cc:2258] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.217190  4084 tablet_replica.cc:330] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.217998  4084 raft_consensus.cc:2229] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.218636  4084 raft_consensus.cc:2258] T 11558a4a5fc74c1aa6cf757c7f8438ee P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.221575  4084 tablet_replica.cc:330] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.222597  4084 raft_consensus.cc:2229] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.223290  4084 raft_consensus.cc:2258] T 536ecf130bd64b819eab68c849b14027 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.225970  4084 tablet_replica.cc:330] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.226591  4084 raft_consensus.cc:2229] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.227737  4084 raft_consensus.cc:2258] T b60c661c0d2d4a1db6e5256c7a60da76 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.230449  4084 tablet_replica.cc:330] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.231298  4084 raft_consensus.cc:2229] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.231961  4084 raft_consensus.cc:2258] T 733f257d57b3493c8d4c87e92944a7ab P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.235211  4084 tablet_replica.cc:330] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.235980  4084 raft_consensus.cc:2229] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.237321  4084 raft_consensus.cc:2258] T d874271c17d0406ab313054114dfeb7d P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.241523  4084 tablet_replica.cc:330] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.242472  4084 raft_consensus.cc:2229] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.243772  4084 raft_consensus.cc:2258] T 4e72756d41ee4f57b83249a714b53b4e P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.247159  4084 tablet_replica.cc:330] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.247987  4084 raft_consensus.cc:2229] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.248660  4084 raft_consensus.cc:2258] T 4dc105f37baa4573b9c4d8bbbdf723c0 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.251694  4084 tablet_replica.cc:330] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.252439  4084 raft_consensus.cc:2229] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.253137  4084 raft_consensus.cc:2258] T 377918f8e49b483f9c2d59cf73ce820f P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.257846  4084 tablet_replica.cc:330] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
W20260812 19:27:32.258684 24117 consensus_peers.cc:487] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 -> Peer d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907): Couldn't send request to peer d5903dc2c6e247ac908381187487e4b3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:32.258724  4084 raft_consensus.cc:2229] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.260365  4084 raft_consensus.cc:2258] T 80020ca73e2a4122935bc86250da9eec P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.263283  4084 tablet_replica.cc:330] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.263947  4084 raft_consensus.cc:2229] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.264611  4084 raft_consensus.cc:2258] T 82e36e0cbbbe4f4bb70897d2660981c2 P d5903dc2c6e247ac908381187487e4b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.267573  4084 tablet_replica.cc:330] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.268318  4084 raft_consensus.cc:2229] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.269570  4084 raft_consensus.cc:2258] T e87eb94d5c224f8d8e6aac06c3fceca3 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.273451  4084 tablet_replica.cc:330] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.274096  4084 raft_consensus.cc:2229] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 2 LEADER]: Raft consensus shutting down.
W20260812 19:27:32.275463 24001 consensus_peers.cc:487] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 -> Peer d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907): Couldn't send request to peer d5903dc2c6e247ac908381187487e4b3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:32.275710  4084 raft_consensus.cc:2258] T 50fe9ebada4e421b8876573876ae885a P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.279066  4084 tablet_replica.cc:330] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.279691  4084 raft_consensus.cc:2229] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.280308  4084 raft_consensus.cc:2258] T 234b3b4af38e48fb8f7165868747b7b1 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.283097  4084 tablet_replica.cc:330] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.283721  4084 raft_consensus.cc:2229] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.284439  4084 raft_consensus.cc:2258] T 9025f51dac7448df8170b8533b4a7490 P d5903dc2c6e247ac908381187487e4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.287840  4084 tablet_replica.cc:330] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.288722  4084 raft_consensus.cc:2229] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.289300  4084 raft_consensus.cc:2258] T 5842b318cf814fe59cb68d5a3fb2239e P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260812 19:27:32.291064 24001 consensus_peers.cc:487] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 -> Peer d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907): Couldn't send request to peer d5903dc2c6e247ac908381187487e4b3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:32.292629  4084 tablet_replica.cc:330] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
I20260812 19:27:32.293435  4084 raft_consensus.cc:2229] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.294565  4084 raft_consensus.cc:2258] T c2e53b579ac947bbb23b5dede3c9391f P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.298286  4084 tablet_replica.cc:330] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3: stopping tablet replica
W20260812 19:27:32.298197 24001 consensus_peers.cc:487] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 -> Peer d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907): Couldn't send request to peer d5903dc2c6e247ac908381187487e4b3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:32.299134  4084 raft_consensus.cc:2229] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.299616  4084 raft_consensus.cc:2258] T 8c7d1173b851418584001c638601f887 P d5903dc2c6e247ac908381187487e4b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.350299  4084 tablet_server.cc:194] TabletServer@127.3.253.1:0 shutdown complete.
W20260812 19:27:32.356139 24117 consensus_peers.cc:487] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 -> Peer d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907): Couldn't send request to peer d5903dc2c6e247ac908381187487e4b3. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:35907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:32.404155  4084 tablet_server.cc:178] TabletServer@127.3.253.2:0 shutting down...
W20260812 19:27:32.443527 24117 consensus_peers.cc:487] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 -> Peer d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907): Couldn't send request to peer d5903dc2c6e247ac908381187487e4b3. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:35907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:32.443768  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:27:32.444702  4084 tablet_replica.cc:330] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.445802  4084 raft_consensus.cc:2229] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.446543  4084 raft_consensus.cc:2258] T 50fe9ebada4e421b8876573876ae885a P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.449535  4084 tablet_replica.cc:330] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.450273  4084 raft_consensus.cc:2229] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.451457  4084 raft_consensus.cc:2258] T 11558a4a5fc74c1aa6cf757c7f8438ee P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.454320  4084 tablet_replica.cc:330] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.455103  4084 raft_consensus.cc:2229] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.456240  4084 raft_consensus.cc:2258] T 536ecf130bd64b819eab68c849b14027 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.459050  4084 tablet_replica.cc:330] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.459832  4084 raft_consensus.cc:2229] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.460969  4084 raft_consensus.cc:2258] T 733f257d57b3493c8d4c87e92944a7ab P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.463979  4084 tablet_replica.cc:330] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.464686  4084 raft_consensus.cc:2229] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.465380  4084 raft_consensus.cc:2258] T d874271c17d0406ab313054114dfeb7d P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.468029  4084 tablet_replica.cc:330] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.468713  4084 raft_consensus.cc:2229] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.469384  4084 raft_consensus.cc:2258] T 4e72756d41ee4f57b83249a714b53b4e P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.472527  4084 tablet_replica.cc:330] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.473187  4084 raft_consensus.cc:2229] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.473735  4084 raft_consensus.cc:2258] T 4dc105f37baa4573b9c4d8bbbdf723c0 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.476934  4084 tablet_replica.cc:330] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.477802  4084 raft_consensus.cc:2229] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.478408  4084 raft_consensus.cc:2258] T b60c661c0d2d4a1db6e5256c7a60da76 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.481124  4084 tablet_replica.cc:330] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.481808  4084 raft_consensus.cc:2229] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.482437  4084 raft_consensus.cc:2258] T 80020ca73e2a4122935bc86250da9eec P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.484915  4084 tablet_replica.cc:330] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.485543  4084 raft_consensus.cc:2229] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.486063  4084 raft_consensus.cc:2258] T e87eb94d5c224f8d8e6aac06c3fceca3 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.488768  4084 tablet_replica.cc:330] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.489408  4084 raft_consensus.cc:2229] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.490002  4084 raft_consensus.cc:2258] T 82e36e0cbbbe4f4bb70897d2660981c2 P a945c890138c411aa6413b46099be1d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.492743  4084 tablet_replica.cc:330] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.493369  4084 raft_consensus.cc:2229] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.494426  4084 raft_consensus.cc:2258] T 234b3b4af38e48fb8f7165868747b7b1 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.497125  4084 tablet_replica.cc:330] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.497840  4084 raft_consensus.cc:2229] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.498476  4084 raft_consensus.cc:2258] T 9025f51dac7448df8170b8533b4a7490 P a945c890138c411aa6413b46099be1d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.501094  4084 tablet_replica.cc:330] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.501612  4084 raft_consensus.cc:2229] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.502612  4084 raft_consensus.cc:2258] T 5842b318cf814fe59cb68d5a3fb2239e P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.505376  4084 tablet_replica.cc:330] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.505935  4084 raft_consensus.cc:2229] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.507018  4084 raft_consensus.cc:2258] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.509698  4084 tablet_replica.cc:330] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.510277  4084 raft_consensus.cc:2229] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.510840  4084 raft_consensus.cc:2258] T c2e53b579ac947bbb23b5dede3c9391f P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.513427  4084 tablet_replica.cc:330] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.513945  4084 raft_consensus.cc:2229] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.515074  4084 raft_consensus.cc:2258] T 8c7d1173b851418584001c638601f887 P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.517895  4084 tablet_replica.cc:330] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6: stopping tablet replica
I20260812 19:27:32.518530  4084 raft_consensus.cc:2229] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.519057  4084 raft_consensus.cc:2258] T 377918f8e49b483f9c2d59cf73ce820f P a945c890138c411aa6413b46099be1d6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260812 19:27:32.541692 24117 consensus_peers.cc:487] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 -> Peer d5903dc2c6e247ac908381187487e4b3 (127.3.253.1:35907): Couldn't send request to peer d5903dc2c6e247ac908381187487e4b3. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.1:35907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:32.571671  4084 tablet_server.cc:194] TabletServer@127.3.253.2:0 shutdown complete.
I20260812 19:27:32.616113  4084 tablet_server.cc:178] TabletServer@127.3.253.3:0 shutting down...
I20260812 19:27:32.655112  4084 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 19:27:32.655997  4084 tablet_replica.cc:330] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.656785  4084 raft_consensus.cc:2229] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.657490  4084 raft_consensus.cc:2258] T 9dcd8dff1c2f4b60a3cd43a1b6dee461 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.661921  4084 tablet_replica.cc:330] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.662786  4084 raft_consensus.cc:2229] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.663623  4084 raft_consensus.cc:2258] T 50fe9ebada4e421b8876573876ae885a P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.667604  4084 tablet_replica.cc:330] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978: stopping tablet replica
W20260812 19:27:32.668299 24119 consensus_peers.cc:487] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 -> Peer a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499): Couldn't send request to peer a945c890138c411aa6413b46099be1d6. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:37499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:32.668982  4084 raft_consensus.cc:2229] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.669823  4084 raft_consensus.cc:2258] T 11558a4a5fc74c1aa6cf757c7f8438ee P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.672744  4084 tablet_replica.cc:330] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.673406  4084 raft_consensus.cc:2229] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.673972  4084 raft_consensus.cc:2258] T 234b3b4af38e48fb8f7165868747b7b1 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.676561  4084 tablet_replica.cc:330] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.678591  4084 raft_consensus.cc:2229] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.679466  4084 raft_consensus.cc:2258] T 5842b318cf814fe59cb68d5a3fb2239e P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260812 19:27:32.681453 24119 consensus_peers.cc:487] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 -> Peer a945c890138c411aa6413b46099be1d6 (127.3.253.2:37499): Couldn't send request to peer a945c890138c411aa6413b46099be1d6. Status: Network error: Client connection negotiation failed: client connection to 127.3.253.2:37499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:32.682618  4084 tablet_replica.cc:330] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.683434  4084 raft_consensus.cc:2229] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.684442  4084 raft_consensus.cc:2258] T 9025f51dac7448df8170b8533b4a7490 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.687376  4084 tablet_replica.cc:330] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.688126  4084 raft_consensus.cc:2229] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.688695  4084 raft_consensus.cc:2258] T d874271c17d0406ab313054114dfeb7d P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.691211  4084 tablet_replica.cc:330] T 733f257d57b3493c8d4c87e92944a7ab P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.691861  4084 raft_consensus.cc:2229] T 733f257d57b3493c8d4c87e92944a7ab P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.692363  4084 raft_consensus.cc:2258] T 733f257d57b3493c8d4c87e92944a7ab P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.694792  4084 tablet_replica.cc:330] T b60c661c0d2d4a1db6e5256c7a60da76 P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.695442  4084 raft_consensus.cc:2229] T b60c661c0d2d4a1db6e5256c7a60da76 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.695890  4084 raft_consensus.cc:2258] T b60c661c0d2d4a1db6e5256c7a60da76 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.698429  4084 tablet_replica.cc:330] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.699220  4084 raft_consensus.cc:2229] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.699764  4084 raft_consensus.cc:2258] T 80020ca73e2a4122935bc86250da9eec P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.702111  4084 tablet_replica.cc:330] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.702816  4084 raft_consensus.cc:2229] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 3 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.703883  4084 raft_consensus.cc:2258] T 82e36e0cbbbe4f4bb70897d2660981c2 P ffd3f94084504c5b94551fd257267978 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.706436  4084 tablet_replica.cc:330] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.707094  4084 raft_consensus.cc:2229] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.707713  4084 raft_consensus.cc:2258] T e87eb94d5c224f8d8e6aac06c3fceca3 P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.710062  4084 tablet_replica.cc:330] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.710716  4084 raft_consensus.cc:2229] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.711704  4084 raft_consensus.cc:2258] T 377918f8e49b483f9c2d59cf73ce820f P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.714033  4084 tablet_replica.cc:330] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.714597  4084 raft_consensus.cc:2229] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.715137  4084 raft_consensus.cc:2258] T c2e53b579ac947bbb23b5dede3c9391f P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.717394  4084 tablet_replica.cc:330] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.717949  4084 raft_consensus.cc:2229] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.718452  4084 raft_consensus.cc:2258] T 8c7d1173b851418584001c638601f887 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.720633  4084 tablet_replica.cc:330] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.721189  4084 raft_consensus.cc:2229] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.721745  4084 raft_consensus.cc:2258] T 536ecf130bd64b819eab68c849b14027 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.724093  4084 tablet_replica.cc:330] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.724689  4084 raft_consensus.cc:2229] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:32.725247  4084 raft_consensus.cc:2258] T 4e72756d41ee4f57b83249a714b53b4e P ffd3f94084504c5b94551fd257267978 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.727504  4084 tablet_replica.cc:330] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978: stopping tablet replica
I20260812 19:27:32.728044  4084 raft_consensus.cc:2229] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.729043  4084 raft_consensus.cc:2258] T 4dc105f37baa4573b9c4d8bbbdf723c0 P ffd3f94084504c5b94551fd257267978 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.774174  4084 tablet_server.cc:194] TabletServer@127.3.253.3:0 shutdown complete.
I20260812 19:27:32.817153  4084 master.cc:537] Master@127.3.253.62:35739 shutting down...
I20260812 19:27:32.844291  4084 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:32.845008  4084 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:32.845392  4084 tablet_replica.cc:330] T 00000000000000000000000000000000 P 979049e461e44afb925ffa7bd5f98b09: stopping tablet replica
I20260812 19:27:32.866817  4084 master.cc:552] Master@127.3.253.62:35739 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21183 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41905 ms total)

[----------] Global test environment tear-down
[==========] 7 tests from 2 test suites ran. (420037 ms total)
[  PASSED  ] 5 tests.
[  SKIPPED ] 1 test, listed below:
[  SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260812 19:27:32.929425  4084 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet_mm_ops.cc:221: suppressed but not reported on 2226 messages since previous log ~32 seconds ago
I20260812 19:27:32.929646  4084 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet_mm_ops.cc:305: suppressed but not reported on 2225 messages since previous log ~32 seconds ago
I20260812 19:27:32.929781  4084 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet_mm_ops.cc:140: suppressed but not reported on 2222 messages since previous log ~32 seconds ago
I20260812 19:27:32.929932  4084 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/ts_tablet_manager.cc:594: suppressed but not reported on 44 messages since previous log ~59 seconds ago
I20260812 19:27:32.930063  4084 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/ts_tablet_manager.cc:542: suppressed but not reported on 44 messages since previous log ~60 seconds ago
I20260812 19:27:32.930190  4084 logging.cc:424] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~227 seconds ago
I20260812 19:27:32.930321  4084 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/service_pool.cc:137: suppressed but not reported on 1 messages since previous log ~227 seconds ago
I20260812 19:27:32.930471  4084 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/heartbeater.cc:644: suppressed but not reported on 5 messages since previous log ~134 seconds ago
I20260812 19:27:32.930879  4084 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260812 19:27:32.931206  4084 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet.cc:2369: suppressed but not reported on 107 messages since previous log ~40 seconds ago